Perhaps oddly in this day and age, the Leap Motion is a cheap, potentially revolutionary computer and video game peripheral that wasn’t funded on Kickstarter. Essentially, it’s an inexpensive, easy-to-setup Kinect for the PC. It’s a small — 0.5 inches tall, 1.2 inches wide, 3 inches deep, and weighs 0.1 pounds (1.27×3.04×7.62 centimeters) — unobtrusive device that’s similar in shape and size to one of the rectangular iPod Nanos. With a sleek black-and-silver aesthetic, it looks like a first-party Apple peripheral for the MacBook Pro — it won’t interrupt the vibe of your sweet battle station. It plugs into your computer through a standard USB 3.0 connection, and its placement is only limited to the length of the USB cable. Setup is simple: Plug in the Leap, press “Next” a few times on the installer, make an account for the Airspace Store (the Leap’s app store), then either download or load some apps. Easy peasy. What is not easy peasy, unfortunately, is using the Leap.

The goal of the Leap, of course, is to allow you to just sit back in your chair, relax, and effortlessly wave a hand or poke a finger in the air to interact with your computer. It has not yet achieved that goal, mainly because of that “effortlessly” qualifier. Using the Leap is a chore.

The Leap creates a three-dimensional motion and gesture recognition zone around itself that measures in at eight cubic feet. Eight cubic feet sounds like a pretty large area in which to wave your hands, and considering both you and the Leap are sitting comfortably in each other’s vicinity, you would think that eight cubic feet would allow you to sit back, relax, and control your computer with the ease of a technopath. Unfortunately, the Leap seems to have a sweet spot of recognition much smaller than that eight cubic feet, and even more unfortunately, the sweet spot doesn’t ever seem to be in the same spot from app to app. To make that matter even more frustrating, you aren’t ever in the same spot. When you use your computer, you likely shift around in your chair, maybe lean your head in one hand while you use the mouse with another, sit up straight, slouch, and so on. Sneezing even puts your body in a slightly different place. While using the Leap, you constantly lose that sweet spot of being recognized, even if you’re completely aware that you have to remain still.

If you have only been paying attention to the Leap in an ancillary news capacity, you might think that it just plugs into your computer, and after installation, you can control your everyday computer tasks with the wave of a hand. This isn’t the case — the device requires Leap-specific apps, downloaded from the Airspace Store. You’ll find apps with which you’re familiar, such as a Cut the Rope, while other apps such as Google Earth have Leap Motion support. However, the Leap isn’t designed to take over your computer’s input methods. There’s an app for the Leap, Touchless, that attempts to achieve this goal — it essentially turns your monitor into a virtual touchscreen — but it’s disappointingly frustrating to use. This seems to be more due to the Leap’s finicky recognition than it is due to a poor implementation of the app.

There are quite a bit of mobile-style games, meaning nothing too in-depth, but some fun experiences to kill a few minutes with. Again, though, the Leap’s finicky recognition makes the majority of experiences to be had less than ideal. However, the recognition seems to vary from app to app. One game, Boom Ball — a 3D iteration of Breakout — works well for the most part. In a 3D space, the paddle is closest to you on the screen, while the blocks are in the distance. You simply wave your hand around to control the paddle and bounce the ball back toward the blocks. For some reason, Boom Ball also has acceptable recognition within menus — you can easily hover over an option and choose it without any hassle — whereas navigating menus in just about every other app I tried is a frustrating experience.

While Boom Ball worked well enough to show what the Leap is going for, Double Fine’s music visualizer game, Dropchord, on the other hand, is a good example of what the Leap currently seems to be. The game itself is simple, but fun. Little circles appear on screen within a larger circle, which is the field of play. Using a finger on each of your hands, you point at the screen on either side of the field of play, and it creates a line between your two finger points. You touch the little circles with the line by moving your fingers around the field to maneuver the line, the little circles clear, and you get points. Sadly, the Leap just can’t seem to notice your fingers on a consistent basis, mainly because you’re moving them around and the Leap loses them. Furthermore, at the two different desk-and-computer setups I tried the game at, neither of which allowed me to rest my elbows on the chairs’ armrests. Regardless of how in shape your shoulders and forearms are, holding them up without rest and moving them around quickly becomes tiring, giving you gorilla arm.

Sadly, the finicky recognition isn’t just inconsistent the one way, as it also tends to notice appendages that it shouldn’t be noticing. A majority of the apps require you to point with one finger, but the Leap often times notices your knuckles on the hand you’re pointing with, and classifies them as other fingers. You can’t exactly remove your knuckles, so you end up moving your finger around a bunch in order to find a sweet spot of the Leap noticing your pointing finger, but not its companion knuckles. In the same vein, if you rest your head in the hand that isn’t in use, the Leap might recognize that hand’s fingers, as well as what appears to be your nose. Again, though, these issues seem to be more or less apparent from app to app.

You can calibrate the Leap in an attempt to rectify these issues, but even the calibration tool is finicky. A window appears on screen, at which you have to point the top part of the Leap. A score meter sits at the bottom of the window. You have to wave the top part of the Leap around the window, which moves a circular cursor and paints the window green. The more of the screen you paint, the more the score meter is moved. You have to reach a score of 80 for the Leap to be calibrated. At one computer, I was able to reach 80, but the Leap’s recognition didn’t improve when I loaded up some apps for a second time. At my more powerful gaming rig, after about five minutes of trying as patiently as possible, I could not crack the 65 mark and gave up.

Another odd issue is that you’re sitting right in front of your monitor, but have to wave your hands around in front of it. This partially obstructs your view. Your hands have to be situated above the Leap, and you can move the Leap anywhere the USB cable can reach. However, if you move it off to the side so you have a clear view of your monitor, you now have to awkwardly stretch your hands off to the side, and the gestures don’t exactly give you a precise feeling. When the Leap is off to the side, and you have to poke the screen to select an icon, for example, you’re now poking the Febreze bottle you keep next to your desk rather than that icon on the screen.

The majority of my time with the Leap was spent being frustrated. Either the Leap wouldn’t recognize my motions or appendages on a consistent basis, or it consistently recognized everything it shouldn’t, causing interference. I am honestly not entirely sure where the problems lie. Some apps, like Boom Ball, worked great — seemingly with the same exact motions and gestures with which other apps had trouble. The majority of the apps, though, were frustrating to use, and due to Boom Ball‘s success, it’s difficult to tell whether or not the problem is with the Leap, or with the apps’ understanding of the Leap. Either way, though the Leap is only $80, it would seem like that money is better off buying you a week or two of groceries until the Leap can get itself sorted out. Until then, keep your fancy gaming mouse plugged in.

Written by: James Plafke, ExtremeTech
Posted by: Situated Research

The post Leap Motion Review: Is It Time to Replace the Mouse? appeared first on Situated Research.

SANTA CLARA, Calif. — Reality isn’t what is used to be. With increasingly powerful technologies, the human universe is being reimagined way beyond Google Glass’ photo-tapping and info cards floating in space above your eye. The future is fashionable eyewear, contact lenses or even bionic eyes with immersive 3D displays, conjuring up a digital layer to “augment” reality, enabling entire new classes of applications and user experiences. 

Like most technologies that eventually reach a mass market, augmented reality, or AR, has been gestating in university labs, as well as small companies focused on gaming and vertical applications, for nearly half a century. Emerging products likeGoogle Glass and Oculus Rift’s 3D virtual reality headset for immersive gaming are drawing attention to what could now be termed the “wearable revolution,” but they barely scratch the surface of what’s to come.

The wearable revolution can be traced back to Ivan Sutherland, a ground-breaking computer scientist at the University of Utah who in 1965 first described a head-mounted display with half-silvered mirrors that let the wearer see a virtual world superimposed on the real world. In 1968 he was able to demonstrate the concept, which was dubbed “The Sword of Damocles.”

His work was followed up and advanced decades later by researchers including the University of Toronto’s Steve Mann and Columbia University’s Steven Feiner. In the second decade of the 21st century, the technology is finally catching up with their concepts.

The necessary apparatus of cameras, computers, sensors and connectivity is coming down in cost and size and increasing in speed, accuracy and resolution to point that wearable computers will be viewed as a cool accessory, mediating our interactions with the analog and digital worlds.

Augmented Reality past and future

“You need to have technology that is sufficiently comfortable and usable, and a set of potential adopters who would be comfortable wearing the technology,” said Feiner at the gathering of the fledgling AR industry at the Augmented Reality Expo here Wednesday. “It would be like moving from big headphones to earbuds. When they are very small and comfortable, you don’t feel weird, but cool.” He added that glasses with a “sexy lump of bump” with electronics and display could also be cool to the early adopters, especially the younger generation that has grown up digital. However, he didn’t have any prediction for when wearable computer would reach a mass market.

In the last decade, AR has been primarily focused on immersive gaming that teleports users to another world and on vertical applications, such as tethered, interactive 3D training simulations.

But now augmented reality is about to break out into free space. “AR will be the interface for the Internet of things,” said Greg Kipper, author of “Augmented Reality: An Emerging Technologies Guide to AR.”

“It is a transition time, like from the command line to graphical user interface,” he said. “Imagine trying to do PhotoShop in a command-line interface. Augmented reality will bring to the world things beyond the graphical user interface. With sensors, computational power, storage and bandwidth, we’ll see the world in a new way and make it very personal.”

Will Wright, creator of the popular The Sims family games, likened AR to having super-sensory abilities, like flipping a switch to see what is underground, beneath your feet. “It’s not about bookmarks or restaurant reviews…it’s something that maps to my intuition.” He hoped that instead of augmenting reality, the technology could “decimate” reality, filtering out even more information than the brain already does to engage reality with less cacophony.

Steve Mann, who is rarely seen without one of his wearable computing rigs and is considered the father of AR, views the wearable revolution as a benefit to society. Quality of life can be improved with overlays of information, adding and subtracting it to facilitate improved “eyesight,” he said. “The first purpose is to help people see better,” he said during his keynote at the expo.

Just as the smartphone is compressing a lot of the function from antecedent computing devices into a single product, wearable computing will eventually make the handheld smartphone irrelevant.

“The value proposition of digital eyewear is having all devices in one, with a camera for each eye representing full body 3D, and the ability to interact with an infinite screen. We are architecting the future of interaction,” said Meron Gribetz of Meta, a Ycombinator startup working on a new operating system and hardware interface for augmented reality computing.

“There is no other future of computing other than this technology, which can display information from the real world and control objects with your fingers at low latency and high dexterity. It’s the keyboard and mouse of the future,” he claimed.

Atheer, a Mountain View, Calif.-based AR startup, is developing a platform that will work with existing mobile operating systems, such as Google’s Android. “We are the first mobile 3D platform delivering the human interface. We are taking the touch experience on smart devices, getting the Internet out of these monitors and putting it everywhere in physical world around you,” said CEO Sulieman Itani. “In 3D, you can paint in the physical world. For example, you could leave a note to a friend in the air at restaurant, and when the friend walks into the restaurant, only they can see it.”

The company plans to seed its technology to developers this year and have its technology embedded in stylish, lightweight glasses with cameras next year.

The transition to touch and gesture interfaces doesn’t mean that the old modes of human-computer interaction go away. Just as TV didn’t replace radio, augmented reality won’t obliterate previous interfaces. The keyboard might still be the best interface for writing a book. Nor is waving your hands in front of your face all day a good interface.

“Holding hands out in front of self as primary interface is the ‘gorilla arm’ effect,” said Noah Zerkin, who is developing a full-body inertial motion-capture system for head-mounted displays. “You get tired. We need to have alternative interfaces. If not thought-based, it needs to be subtle gestures that don’t require that you to wave hands around in front of your face.”

3Gear Systems is working on technology that allows 3D cameras mounted above a keyboard, like a lamp, to detect smaller gestures just above the keyboard, such as pinching to rotate an object on a screen, and can use input from all 10 fingers with millimeter-level accuracy.

Some companies are taking less radical approaches, focusing on inserting a layer of digital information into scenes via smartphones. Par Works, for example, image recognition technology makes it possible overlays digital imagery on real world data, such as photos and videos, with precision. A person looking for an apartment takes a picture of a building with a smartphone and the app overlays information on the image, or a shopper will see coupons or other information for various products on a shelf in a drug store.

Brands are adopting AR technology to increase performance of ads and sales. Several companies provide ways to turn a print ad into an interactive experience just by pointing the camera at the paper or an object with a marker. Blippar, for instance, recognizes images by pointing a phone camera at ads or object with its mark and inserts virtual layers of content.

The future of augmented reality

And where is all this heading over the next few years? It’s beginning to look like a real business, just as mobile did nearly a decade ago. Mobile analyst Tomi Ahonen expects AR to be adopted by a billion users by 2020. Intel is betting that AR will be big. The chip maker is investing $100 million over the next 2 to 3 years to fund companies developing “perceptual computing” software and apps, focusing on next-generation, natural user interfaces such as touch, gesture, voice, emotion sensing, biometrics, and image recognition.

Apple isn’t in the AR game yet, but the company has been awarded a U.S. patent, “Synchronized, interactive augmented reality displays for multifunction devices,” for overlaying video on live video feeds.

Eyewear will evolve over the next year with comfortable stylish glasses with powerful embedded technology. They will range from Google Glass-style glance-at displays that also replace the phone to stereoscopic 3D-viewing wearables for everyday use.

“You’ll get 20/20, perfectly augmented vision by 2020, with movie-quality special effects blended seamlessly into the world around you,” said Dave Lorenzini, founder of AugmentedRealityCompany.com and former director at Keyhole.com, now known as Google Earth. “The effects will look so real, you’ll have to lift your display to see what’s really there. There’s more of the world than meets the eye, and that’s what’s coming.”

He cautioned that the growth of the AR industry could be slowed by a lack of standards to connect disparate players and their formats for bringing a 3D digital layer to life. “The AR industry has to get together to power the hallucination of what’s do come,” Lorenzini said. He added that a key turning point will be the availability of the WYSIWYG (What You See Is What You Get) real-world markup tools needed to bring this digital layer to life.

When the AR industry does take off, Lorenzini envisions a trillion dollar market for animated content, services and special effects layered into the real world. “Imagine people tagging friends with visual effects like a 3D halo and wings, or paying for a face recognition service to scan and add a floating name tag over the head of everyone in a room,” he said. “AR will grow from specific vertical uses to mass market appeal, driven by young, early adopters.

“Anyone reviewing devices like Google Glass needs to take it to their kids’ school before they pass judgement,” Lorenzini added. “This is not a device from our time, it’s from theirs. They love it, use it effortlessly, and are totally unfazed by ad targeting or privacy concerns. It will be be a natural part of who they are, how they learn, connect and play.”

Eventually, wearable technology will become more integrated with the human body. With advances in miniaturization and nanotechnology glasswear will be replaced with contact lens or even bionic eyes that record everything, make phone calls and allow you to use parts of your body, or even your thoughts, to navigate the world.

“Contact lenses are difficult now but the bionic eye will become commonplace and AR will just be a feature,” Kipper said. “Some may choose to have eyes in back of their heads, and some won’t. Some will want to be cyborgs. We will always use tools as advanced as they can be to help ourselves.”

Brian Mullins, CEO of Daqri, an augmented reality developer of custom solutions, went even further in melding humans and technology. “Thinking is the future of AR,” he said. Mullins talked about measuring “thought intensity” with EEG machines and focusing the mind to manipulate objects during a panel discussion at the Augmented Reality Expo.

Of course, the technical challenges are accompanied by issues of social etiquette and privacy. Smartphones are now a well-accepted part of daily life in most countries, but issues around data ownership and access to the data abound. The subtlety and potentially always-on capacity of wearable technologies will create more privacy concerns and challenges to acceptance.

Feiner acknowledged that it’s “scary” in terms of the information available, especially when billions of people with cameras and microphones can capture anything in public. “There are no laws against it,” he noted.

He gave Google some compliments for not overloading Glass with features. “It not suffering from doing too much too soon,” he said. Whether Google Glass is the tip of the spear for the mass adoption of far more powerful AR is uncertain, but it is doing a good job of surfacing the issues around the introduction of a disruptive, new way of computing.

Nicola Liberati, a Ph.D. student in philosophy at the University of Pisa studying the intersection of humans and technology, suggested another line of thinking about AR in his presentation at the expo. “We should not focus our attention only on what we can do with the such technology, but even on what we become by using it.”

So, when you are strolling down the street wearing the latest digital eyewear from Google, Apple or some as yet unformed or now early-stage company, with your continuous partial attention on the 3D holographic screen feeding you all kinds of personalized information about the environment around you, zeroing in on the people and places in your field of view or piped in remotely from around the real and virtual worlds, and spaces in between, think about what we have become.

It all depends on your perspective.

Written by: by Dan Farber, CNET (via Presence)
Posted by: Situated Research

The post Beyond Google Glass: The Evolution of Augmented Reality appeared first on Situated Research.

After testing iPhone, iPad and an eye-tracking device as possible user interfaces to maneuver our research car, named “MadeInGermany,” we now also use Brain Power. The “BrainDriver” application is of course a demonstration and not roadworthy yet, but in the long run human-machine interfaces like this could bear huge potential in combination with autonomous driving.

To record brain activity, the researchers use an Emotiv “neuroheadset” an electroencephalography, or EEG, sensor by San Francisco-based company Emotiv, which design it for gaming. After a few rounds of “mental training,” the driver learns to move virtual objects only by thinking. Each action corresponds to a different brain activity pattern, and the BrainDriver software associates the patterns to specific commands – turn left, turn right, accelerate etc. The researchers then feed these commands to the drive-by-wire system of the vehicle, a modified Volkswagen Passat Variant 3c. Now the driver’s thoughts can control the engine, brakes, and steering.

To road test their brain-controlled car, the Germans headed out to the former airport in Berlin Tempelhof. The video below shows a driver thought-controlling the car, Yoda-style. “Don’t try this at home,” the narration says, only half-jokingly.

The researchers caution that the BrainDriver application is still a demonstration and is not ready for the road. But they say that future human-machine interfaces like this have huge potential to improve driving, especially in combination with autonomous vehicles. As an example, they mention an autonomous cab ride, where the passenger could decide, only by thinking, which route to take when more than one possibility exist.

This type of non-invasive brain interface could also allow disabled and paralyzed people to gain more mobility in the future, similarly to what is already happening in applications such as robotic exoskeletons and advanced prosthetics.

Rojas group’s research is part of the MadeInGermany project and follows previous work on autonomous cars, including his AutoNOMOS Project. A 2:26 minute video is available here.

Written by: Markus Waibel, IEEE Spectrum blog Automaton (via Presence)
Posted by: Situated Research

The post BrainDriver: A Mind Controlled Car appeared first on Situated Research.