Speculation about the Apple Tablet mostly focuses on what the device is, not how it works. Text input, more than anything else, is the problem Apple needs to solve to make this work. So how will they do it?
CES was rotten with new tablets, some Android, some not, some with fascinating screens, and again, some not. But one thing they all had in common was that they hadn't quite figured out the text input problem: How do you create text without a keyboard?
The Problem
We've been comfortably typing without physical keyboards for years now, and this is largely Apple's doing. One of the great triumphs of the iPhone was to make onscreen keyboards bearable—something that, even if you hate the concept of virtual keys on principle, you have to admit they accomplished. This works:
Extending this to the tablet, though, would be a mistake. I had a chance to play with a few different sizes of tablets at CES, nearly all of which had traditional onscreen keyboards—in particular, the Android 2.0 keyboard, which is aesthetically different but functionally almost identical to iPhone OSes. None of them worked, at least in the way that I wanted them to, for one reason: they were too big. Seven-inch tablets were too large to comfortably thumb-type on, while 10-inch tablets made text input all but impossible. The onscreen keyboard as we know it doesn't scale gracefully, and unless Apple wants their tablet to be completely useless (our sources say they don't) they're going to have to figure this out. So what are Apple's options?
Solution 1: A Giant iPhone
Apple has made mistakes before, but to only have a simple onscreen keyboard would qualify as an outright screw-up. QWERTY-style, thumb-actuated onscreen keyboards work on screens up to about five inches, with the 4.3-inch-screened HTC Touch HD2's keyboard straining even the most unsettlingly long thumbs. But to assume that this won't work is to assume that the tablet is to be held a certain way, with hands at four and eight o-clock, more or less like a touchscreen phone in landscape mode. This may not be the case.
What if the tablet is meant to be held with one hand, and controlled with the other? What if it has some kind of kickstand or mount, so you can actually type with both hands, a la a regular keyboard. What if it's intended to only work in portrait mode, where it would be just about narrow enough to be usable?
Apple's filed extensive patents about how a large, multitouch onscreen keyboard might work, pictured above, but that doesn't necessarily mean anything: Apple's got more patents than the tablet's got rumors, and most of them never materialized into anything meaningful. The keyboard patent, for example, also includes drawings of an onscreen clickwheel, and a description of how small interface elements, like the minimize/close/zoom buttons in OS X proper, could be handled on a touchscreen—all of which are terrible awkward, and dissonant with Apple's touchscreen philosophy so far.
Either way, a single, iPhone-esque keyboard really shouldn't be the primary input method. It could be a supplementary input method, but to have two separate text input mechanisms seems messy, and distinctly un-Apple-y. Lame, half-baked input seems like the kind of thing Steve Jobs might fitfully shitcan a tablet for, actually, but that's getting awfully speculative, even for a piece about a product that doesn't officially exist at all.
Solution 2: Voice Control
Apple's been on covert voice input crusade since it introduced Spoken Interface for OS X which, if you care to look (System Preferences>Speech>Speakable Items "On) is still there. As it stands, it's rudimentary—the iPhone's Voice Control speech recognition is much more accurate—and though there are quite a few customization options, it's really just a command system, not a full text input system.
Even more developed technologies like Dragon Dictation are still niche products, and honestly, the concept of controlling a computer entirely by voice is kind of absurd. "Open Browser! Open Gizmodo! Post withering comment about Apple tablet story, with these words!" No. Not now, and really, not ever—the computer as a stenographer is an obnoxious concept, held back by practical concerns, not technological ones.
That said, Apple is very proud of Voice Control on the iPhone, and they haven't removed voice commands from OS X in over five years. It's likely that there will be some kind of voice input for the tablet, but that it'll be relegated to the same job it's held in the past, taking care of the odd command and initiating the occasional script, and not much else.
Solution 3: The Dreaded Stylus
Styli! The very thing the iPhone was so dedicated to murdering could be the savior of the Apple tablet! Just ask Microsoft.
See, the only other tablet booklet device that's garnering remotely comparable hype is the Courier, Microsoft's dual-screen concept device leaked to us back in September. The Courier concept is very different from the blurry image we've assembled of the Apple tablet—it doesn't have a keyboard. Unlike the Apple tablet, though, we know how the Courier is supposed to work:
Handwriting. Apple staked an entire device line on handwriting recognition—the Newton—over 15 years ago, so isn't it conceivable that they've, you know, figured it out by now? Before taking another detour back to the patent office, let's take a moment to recall Steve Jobs' original iPhone keynote:
Oh, a stylus, right? We're going to use a stylus. No. Who wants a stylus? You have to get ‘em and put ‘em away, and you lose ‘em. Yuck. Nobody wants a stylus. So let's not use a stylus. We're going to use the best pointing device in the world. We're going to use a pointing device that we're all born with - born with ten of them. We're going to use our fingers. We're going to touch this with our fingers.
This wasn't a dismissal of styli. This was a dickish, public obsoleting of styli. If I were a stylus, I would refuse to work with Steve Jobs, on the basis of him being a jerk.
And yet, in November of 2009, an Apple patent, this time describing stylus input and clearly showing a tablet-like device, went public. If you have the will and patience to parse a little techno-legalese, go for it:
Upon the occurrence of an ink phrase termination event, the ink manager notifies the handwriting recognition engine and organizes the preceding ink strokes into an ink phrase data structure...The present invention, in large part, relates to the observation that client applications and handwriting recognition software in pen-based computer systems can make far more accurate ink-related decisions based on entire ink phrases, rather than individual ink strokes.
If not, you'll have to take my word for it: This is basically the Newton's Rosetta, updated for 2009.
Stylus input would be a stunning break from Apple's iPod/iPhone finger-only strategy, and to a lot of people it would seem regressive. Then again, if the tablet is a perfectly predictable extension of the iPhone concept, it won't revolutionize anything at all. I'm still filing this under "unlikely," but looking at the evidence, I honestly—and surprisingly—can't rule it out.
Solution 4: A New Style of Keyboard
The safest bet for how Apple will handle the text input problem is not coincidentally the broadest. Any onscreen keyboard would have to be different than the iPhone's somehow, but to say that Apple's tablet will have a new style of keyboard is to say that it will have pretty much any kind of onscreen keyboard that is unlike the iPhone's. This is not very useful! Luckily, we have guidance, from other companies, and even from Apple.
Split onscreen keyboards are neither new nor common, which makes them kind of perfect: the map has been charted, so Apple needs only to explore it.
The most public of the alternatives is an actual, available product called DialKeys. Coopted by Microsoft a few years ago, this tech, which splits the keyboard into two crescent-shaped virtual keyboards, shipped with a handful of touchscreen UMPCs, a category of devices that died off before it had the time to truly solve the onscreen keyboard problem. It wasn't very good. But the concept had potential, maybe. Apple is definitely aware of DialKeys, even if they can't use it—not that we'd want them to, or that they need to, having acquired a company with a similar concept about five years ago.
FingerWorks, a company specializing in touch interfaces and gesture concepts, was forcefully drawn into the Apple family about five years ago. A lot of their touch gestures actually made their way to the iPhone, albeit adapted from touchpad to screen use, according to FingerWorks employees:
The one difference that's actually quite significant is the iPhone is a display with the multi-touch, and the FingerWorks was just an opaque surface. That's all I'm going to say there. There's definite similarities, but Apple's definitely taken it another step by having it on a display
Interestingly, FingerWorks had a physical product with a split keyboard, which sat over Apple laptops' regular keyboards, and which promptly disappeared after their acquisition. From the press release, which, mind you, hit the wires in 2003:
The MacNTouch Gesture Keyboard is a complete user interface that serves as mouse, standard keyboard, and powerful multi-finger gesture interpreter. Mouse operations like point, click, drag, scroll, and zoom are combined seamlessly with touch-typing and multi-finger gesture everywhere on the MacNTouch's surface. Proprietary hardware and software allows pointing right over the keys, thus eliminating the frequent movement of the hand between the keyboard and the touchpad. The MacNTouch has been designed to minimize stress and it gives users unprecedented control of their computer using hand gestures.
Obviously such a product relates to a lot of aspects of tablet input, so let's zero in on text: it's exactly what the tablet needs, basically, except it's not software. They keyboard is split for possible thumb use, it's capable of gestures, and most importantly, it's already owned by Apple.
Best of all, the FingerWorks domain, which proudly displays all of these concepts, was pulled from the internet this week. If this feels like a strange coincidence, that's because, well, it is.
Making Bets
For all the evidence about the tablet's possible input methods, there's no standout answer. Apple's got a thing for voice input, a history with onscreen keyboards, a patent trail and strong lineage of stylus input, and a pattern of suspicious behavior with and towards new keyboard types. We've got a handful of cases here, all compelling, and all conflicting. And the takeaway, if you haven't picked it up yet, is that nobody really knows.
For my money, though, an adapted, possibly split onscreen keyboard is the best bet, and assuming the learning curve isn't too steep, the most appealing option. But of the options laid out here, it's by far the most vague—its FingerWorks ancestor is nearly a decade old, conceived in a time before multitouch screens—so the only truly safe bet is that whatever Apple comes up with, it's going to surprise us.
- The G-Bound RC Car Drives On Water [Rc] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Nanoparticles Can Rip Your DNA Apart Without Ever Touching It [Nanoparticles] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- My Favorite Top 10 List Today: The Dumbest Evil Geniuses Of All Time [Evil Geniuses] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 5,000 Volts Is More Than Enough Power To Crush a Soda Can [DIY] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Computers Are Scary, But Steve Allen Is Here to Help [Retromodo] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Pangolin Backpack [Bags] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- New For iPhone: 2 Balls 1 Cup [IPhone Apps] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Office Building Or Home To A Super Heroine? [Architecture] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- This Inflating Bra Commercial Left Me Confused Yet Reaching For My Wallet [Nsfw] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 10 Terrible Tips for Longer Battery Life [Humor] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Dealzmodo: $100 Xbox 360 at Amazon, More Electronics Deals All Day Long [Dealzmodo] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Gigabyte BIOS Update Fixes iPhone Syncing Issues [IPhone] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Hello Facebook User, I'm a Nigerian Prince in Need of Assistance... [Facebook] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Zune HD Update 4.3: Speedier Browser, Predictive Text and More [Zune Hd] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 8-Bit Wedding Invitation Acknowledges the Marital Bickering to Come [8-Bit Wedding] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- The iPhone Nano Rumor Strikes Again: Coming to Verizon in 2010? [Rumor] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Building a NAS? Skip the Performance Drives [Nas] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Microsoft COFEE, Some of the Most Illegal Software You Can Pirate [Hacking] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Robot Cow Rectum: For Educational, not Recreational, Purposes [Robots] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Watch Jonathan Ive's Segment in Objectified [Apple] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- BlueBeat’s Innovative Defense That Will Never Hold Up in Court [Music] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Nokia Booklet 3G Landing November 15 at Best Buy [Nokia] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Latest Snow Leopard Developer Build Breaks Hackintosh Support... Again [Hackintosh] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- The Cité du Design Certainly Lives Up to Its Name [Architecture] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 64% of Men Don’t RTFM Before Calling Tech Support [Tech Support] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- MIT Media Lab: Electronic Wallpaper, Conductive Threads and More [Fashion] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Famous Paintings Reproduced In Coffee [Art] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How Far Can 'Medical Tourism' Go? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Actuarial Escape Velocity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Rebuttal to 'Peak Oil' Doomsday Predictions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Reverend Jeremiah White,...I mean, Wright [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Energy vs. Financials, A Divergence of Historical Extremes [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- US Ideological Distribution, 2008 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Ten Biotechnology Breakthroughs Soon to be Available [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Nanohealing Material Heads to Market [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Solar Revolution is Near [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Why the US Will Still be the Only Superpower in 2030, v2.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Culture of Happiness [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Surfaces : The Next Killer Ap in Computing [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- More on the Economics of Medical Tourism [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Ten Myths in America [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Can Buildings be 'Printed'? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Pre-Singularity Abundance Milestones [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Futurist's Stock Portfolio for 2009 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Future Timeline for Economics [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A History of Stock Market Bottoms [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Few Electoral Statistics [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- It's Official : The Recession Began in December 2007 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How We Decisively WON in Iraq in 2008 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 2008 Technology Breakthrough Roundup [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Futurist's Stock Portfolio for 2008 - RESULTS [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Why Government is Set to Extinguish Silicon Valley [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Solar Power's Next 5 Game-Changing Technologies [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The End of Rabbit Ears, a Billion more Broadband Users - Part II [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Guantanamo Meets Geneva Convention Rules [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Nanotechnology : Bubble, Bust, ....Boom? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Form of Economic Recovery [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Impact of Computing : 78% More per Year, v2.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Wolfram Alpha : The Birth of Web 3.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Energy vs. Financials, RESULTS [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- SETI and the Singularity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Eight Ways to Supercharge the US Economy [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Big Thing in Entertainment, A Half-Time Update [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Video Conferencing : A Cascade of Disruptions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Timing the Singularity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Mobile Broadband Surge : A Prediction Follow Up [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Two US Recessions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Google Promotes Droid Day With Rare Homepage Ad [Google] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Microsoft Confirms Improved Xbox 360 Warranty Seal [Blockquote] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- OpenOfficeMouse Is An 18 Button Freak, But I Want It [Mouse] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 10 Classic Analog Games Defiled By Digital [Tgif] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Wire Your House With Ethernet Cable For Better Home Networking [DIY] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Room Eavesdropping Device Is Way Better Than a Drinking Glass [Surveillance] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Steve Jobs and Sarah Jessica Parker Sittin' In A Courthouse B-E-I-N-G S-U-E-D [Lawsuits] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Folding Titanium Spork Is the Ultimate Portable Eating Utensil [Spork] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Queen of Google: "I Do Code All Night!" [Google] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- This Week's Best iPhone Apps [IPhone Apps] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- DIY Star Trek Bluetooth Communicator Almost Makes Regular Bluetooth Headsets Look Stylish [DIY] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Intel Swears That It's Gonna Stop Its Firmware From Bricking Any More SSDs [Intel] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- H20 Audio's Waterproof iPod Nano Case Is Built for Surfer-Videographers [Accessories] [Last Updated On: December 12th, 2009] [Originally Added On: December 12th, 2009]