All Things Digital

Skip to main content.

Personal Technology

Personal Technology from The Wall Street Journal

Multitouch Interface Is Starting to Spread Among New Devices

We are now witnessing the emergence of a new user interface for digital devices, including laptop computers, advanced cellphones, wireless portable data gadgets and other types of computing products.

This interface is generally called “multitouch,” and it involves using one or more fingers on a screen or touchpad to perform special gestures that manipulate lists or objects on a screen — without moving a mouse, pressing buttons, turning scroll wheels or striking keys.

The best-known example of the interface is on Apple’s iPhone and iPod Touch devices. It allows you, for example, to rapidly flip through photos, lists of emails or song titles by merely “flicking” a fingertip on its screen, or to resize a photo by “pinching” the image with two fingers. And, this month, Apple moved some of these multitouch features onto a laptop, its new MacBook Air, where fingertip actions are performed on an oversized touchpad rather than on a screen.

Apple didn’t invent the multitouch concept. Academic and commercial researchers, and small, obscure companies, have been working on it for years. Apple is adapting the concept, adding its own ideas and popularizing it — just as it did in the 1980s with the mouse and the graphical user interface, which had also been invented elsewhere.

Rival companies are scrambling to add multitouch features to laptops and other digital gadgets. Synaptics, a leading supplier of touchpads for laptop makers who compete with Apple, has announced that shortly it will incorporate several multitouch features into its touchpads. Microsoft is producing a coffee-table-size computer called the Surface, meant for hotels, casinos and retail stores, that uses multitouch finger gestures to move around digital objects such as photos, play games and browse through product options. Hewlett-Packard developed a prototype of a similar multitouch coffee-table computer for home use.

Photo
Rotating a photo on Apple’s MacBook Air

And, in the back rooms of this month’s Consumer Electronics Show in Las Vegas, various cellphone makers, seeking to emulate the iPhone, were showing off their own unannounced efforts at multitouch. One prominent cellphone maker, Taiwan-based HTC, has already built a phone, called the Touch, which slaps a rudimentary multitouch interface on Microsoft’s Windows Mobile operating system.

The basic touch screen, of course, is an old and familiar thing. People use them every day to get money from ATMs or to check into flights at airport kiosks. Microsoft’s Tablet computers and Palm’s Treo cellphones, among others, use touch screens that employ styluses or fingers to move cursors, select icons and other items, and even to write on the screen.

But multitouch interfaces are potentially much more versatile. They allow you to use your fingers to manipulate virtual objects on a screen as if they were real, sort of the way Tom Cruise’s character did in the 2002 Steven Spielberg science-fiction film, “Minority Report.” For example, Microsoft’s Surface allows users to rearrange groups of digital photos by just dragging them around on the table top as if they were actual paper prints.

Unlike the touch screens on, say, ATMs, multitouch devices are able to distinguish between the press of a single finger and the press of multiple fingers, and to interpret the motions or gestures you make. They take different actions depending on how many fingers they detect and which gestures a user performs.

On Apple’s MacBook Air, the touchpad still allows you to use one finger to move the cursor and click like a mouse can. But, optionally, it can do much more using multitouch gestures.

You can rotate photos by just touching two fingers to the touchpad and moving the images on the screen as you wish. You can quickly move back and forth through a series of Web pages or photos by “swiping,” or placing three fingers on the touchpad and moving them rapidly sideways. And you can shrink or expand a photo, or zoom in and out on a Web page, by pinching the image.

All recent Mac laptops, not just the new Air, have the optional ability to scroll through a screen without using any button or special zone on the touchpad. You just place two fingers, instead of one, anywhere on the touchpad and drag them across its surface.

In addition to pinching, the new Synaptics touchpads have a feature called “ChiralMotion,” which achieves rapid scrolling by moving two fingers in a circle anywhere on the touchpad. Another Synaptics feature, called Momentum, lets you emulate a trackball by flicking a single finger across the touchpad. This gesture can move an object on screen, like a virtual bowling ball in a game, with the illusion of inertia.

It’s too early to know if the new multitouch approach will ever be as big as the mouse-driven graphical user interface. But it’s already evident that it offers real advantages on devices where a mouse isn’t possible or convenient to use, or the decades-old interface of menus and folders is too cumbersome.

Email me at mossberg@wsj.com. Find all my columns and videos online, free, at the new All Things Digital Web site, http://walt.allthingsd.com.

Comments

  1. Excellent article, Walt. It was already clear from the moment the iPhone first appeared that Apple was introducing the world at large to something very new—a gesture-based interface both brilliant in its simplicity and far-reaching in its implications. It was already clear—although no one but Steve Jobs and his iPhone team could see how Apple would do it—that this technology was destined to find its way into Apple’s laptop computers and beyond. Now, with the debut of the MacBook Air, we begin to catch a glimpse of what is perhaps going on in the mind of Steve.

    Dazzled as I am by the brilliance of Apple’s vision, I can’t help wondering if the widespread adoption of the multitouch interface on laptop computers will lead to an epidemic of repetitive stress injuries. I have traveled all over the world with my 12-inch aluminum powerbook, relying exclusively on the trackpad for long periods of time. But simple click and drag maneuvers can usually be accomplished with the palm of the hand comfortably resting on the computer surface. Two-finger scrolling, which you mention in your article, is the only gesture that requires the hand to be lifted. This lifting motion, unfortunately, has a tendency to be accompanied by a raising of the shoulder, which in turns creates tension in the neck, arm, shoulder and upper back. In other words, even existing latops are ergonomic disasters waiting to happen unless sensible work habits are adopted. My concern is that the situation will be immeasurably worse if millions of computer users start hunching their shoulders as they perform the latest must-have gestures on their marvelous multitouch trackpads.

    Either way, I suppose the bottom line is that Apple appears to have the makings of another huge hit on its hands.

    Posted by Alan Sanders at January 31st, 2008 at 11:41 am
  2. Great article!

    I also agree with Mr. Sanders in that the ergonic stress that will be put on the end users hands will potentially have an effect on the market as these types of devices beome more popular. If you are a user with an iPhone, and Ipod Touch, the Air laptop, and type all day, you may increase your risk of carpal tunnel injuries.

    As Apple tries to stay ahead of the curve, it would be interesting to see if they have any new tricks for the standard keyboard.

    Posted by Willie Pritchett at February 5th, 2008 at 5:09 am
  3. There are times when a technology stands as a marker for the future and multi-touch is one such technology.
    Just put your fingers on your desktop and start making pinch, flip, zoom and scroll gestures and you’ll realise just how cool and useful that would be on a tablet’s pad.
    Apple will do it, others will do it but this is the future of interfacing with a GUI

    Posted by David McManus at February 5th, 2008 at 1:36 pm
  4. Multi-touhc is the future of technology, thanks for the article

    Posted by toma alaoui at September 2nd, 2008 at 11:31 am
  5. This device of “multitouch interface” is one I am all too familar with simply based on how much all of my trendy Apple loving friends show it off to me. It is interesting to think of how common this technology is in some places, and yet it is still to this day getting more and more developed and applied to new technology coming out. I guess that is the point of technology after all.

    MTI holds plenty of promise for advancements in lots of current technology. Think of the possiblities of a laptop computer without the need for a keyboard. Getting these interpersonal devices (phones, laptops, players, etc.) smaller and more hand-held friendly seems to be the ultimate goal for these things. Multitouch interface is one of many keys to unlocking the promised land.

    Posted by David Hanson at October 9th, 2008 at 5:34 pm

Add a Comment

You must be logged in to post a comment. Sign up here or log in below.

Comments posted on this site must be signed with your full, real name. Please see our Comments policy for details.

Search The Mossberg Archives

Latest Personal Technology Videos

More Videos »


BlackBerry News and Reviews on All Things Digital

Click below to browse or search past editions of Walt and Katie's columns.

Personal Technology »

Walt's main column, written since 1991, in which he reviews hardware, software and web sites, and comments on technology issues.

Mossberg’s Mailbox »

Walt's weekly column in which he answers readers' questions.

The Mossberg Solution »

Edited by Walt and written by Katie Boehret, this is a guide to gadgets, web services and other consumer technologies.

Ethics Statement

Here is a statement of my ethics and coverage policies. It is more than most of you want to know, but, in the age of suspicion of the media, I am laying it all out.

Read more »