While you are typing, touch the ".?123" key, but don't lift your finger. Then slide your finger/thumb/tentacle over to the period/question mark/colon and lift. You'll get your mark and the keyboard with auto switch back to letter mode.
Yay.
Thanks to Gizmodo.
