Published in collaboration with NCMS
Digital Manufacturing Report

News & information about the fast-moving world
of digital manufacturing, modeling & simulation

Language Flags

Interactive System Detects Touch, Gestures on Any Surface


WEST LAFAYETTE, Ind., Nov. 29 – People can let their fingers - and hands - do the talking with a new touch-activated system that projects onto walls and other surfaces and allows users to interact with their environment and each other.

The system identifies the fingers of a person's hand while touching any plain surface. It also recognizes hand posture and gestures, revealing individual users by their unique traits.

"Imagine having giant iPads everywhere, on any wall in your house or office, every kitchen counter, without using expensive technology," said Niklas Elmqvist, an assistant professor of electrical and computer engineering at Purdue University. "You can use any surface, even a dumb physical surface like wood. You don't need to install expensive LED displays and touch-sensitive screens."

The new "extended multitouch" system allows more than one person to use a surface at the same time and also enables people to use both hands, distinguishing between the right and left hand.

Research indicates the system is 98 percent accurate in determining hand posture, which is critical to recognizing gestures and carrying out commands. The technology has many possible applications, said Karthik Ramani, Purdue's Donald W. Feddersen Professor of Mechanical Engineering.

"Basically, it might be used for any interior surface to interact virtually with a computer," he said. "You could use it for living environments, to turn appliances on, in a design studio to work on a concept or in a laboratory, where a student and instructor interact."

Findings are detailed in a research paper being presented this week during the Association for Computing Machinery Symposium on User Interface Software and Technology (ACM UIST 2012) in Cambridge, Mass. The paper was written by doctoral students Sundar Murugappan and Vinayak, who uses only one name, Elmqvist and Ramani.

The system uses the Microsoft Kinect camera, which senses three-dimensional space.

"We project a computer screen on any surface, just a normal table covered with white paper," Ramani said. "The camera sees where your hands are, which fingers you are pressing on the surface, tracks hand gestures and recognizes whether there is more than one person working at the same time."

The Kinect camera senses depth, making it possible to see how far each 3-D pixel is from the camera. The researchers married the camera with a new computer model for the hand.

"So we can isolate different parts of a hand or finger to show how far they are from the surface," Elmqvist said. "We can see which fingers are touching the surface. With this technology, you could potentially call up a menu by positioning your hand just above the surface."

That camera coupled with the hand model allows the system to locate the center of each hand, which is necessary for determining gestures and distinguishing between left and right hands.

Researchers explored possible applications, including one that allows the user to draw a sketch with a pen and then modify it with their hands.

"We can detect gestural interactions between more than one hand and more than one user," Ramani said. "You could do precision things, like writing with a pen, with your dominant hand and more general things, such as selecting colors, using the non-dominant hand."

Researchers tested the concept in two user studies, one with 14 volunteers and the other with nine. Findings from one study indicated display features should be no smaller than 18 millimeters, or about an inch, to be efficient.

"While new and more precise cameras will improve accuracy, we have established the necessary hand models and principles for the system," Ramani said.

The other user study showed the system can effectively determine hand posture and whether the right or left hand is being used.

"We wanted to see how accurate we could be while figuring out different configurations, such as touching with all 10 fingers, which hand is being used and so on," Elmqvist said.

Patents are pending on the concept.

The research has been supported by the National Science Foundation and the Donald W. Feddersen Chaired Professorship at Purdue School of Mechanical Engineering.

(A video about the system can be viewed at https://Engineering.Purdue.edu/cdesign/wp/?p=1423).

-----

Source: Purdue University

RSS Feeds

Subscribe to All Content


Feature Articles

Titan Puts a New Spin on GE’s Wind Turbine Research

Unlike traditional energy sources, wind is a trouble to tame, which has led GE to turn to advanced simulations at Oak Ridge National Laboratory to put the technology on track to cover 12 percent of the world's energy production.
Read more...

Lighting a Fire Under Combustion Simulation

Combustion simulation might seem like the ultimate in esoteric technologies, but auto companies, aircraft firms and fuel designers need increasingly sophisticated software to serve the needs of 21st century engine designs. HPCwire recently got the opportunity to take a look at Reaction Design, one of the premier makers of combustion simulation software, and talk with its CEO, Bernie Rosenthal.
Read more...

D-Wave Sells First Quantum Computer

On Wednesday, D-Wave Systems made history by announcing the sale of the world's first commercial quantum computer. The buyer was Lockheed Martin Corporation, who will use the machine to help solve some of their "most challenging computation problems." D-Wave co-founder and CTO Geordie Rose talks about the new system and the underlying technology.
Read more...

Short Takes

Local Motors and ORNL Partner for Automotive Manufacturing

Jan 24, 2014 | Local Motors, a vehicle innovator, and the U.S. Department of Energy’s Oak Ridge National Laboratory (ORNL) have announced a new partnership that they hope will bring change to the automotive industry.
Read more...

Robots Showcase Skills at DRC

Jan 22, 2014 | A month ago, the DARPA Robotics Challenge Trials (DRC) commenced. The main goal of the event was to aid in the development of robots that will someday respond to natural or even man-made disasters. At this year’s DRC, prototype robots from 16 teams were put through a series of trials in which they were to showcase their skills.
Read more...

Advanced Modeling Benefits Wind Farms

May 25, 2011 | Advanced computing resources optimize the site selection of wind farms.
Read more...

Not Your Parents' CFD

Oct 13, 2010 | Outdated beliefs stand in the way of greater CFD adoption.
Read more...

Manufacturers Turn to HPC to Cut Testing Costs

Oct 06, 2010 | Supercomputing saves money by reducing the need for physical testing.
Read more...

Sponsored Whitepapers

Technical Computing for a New Era

07/30/2013 | IBM | This white paper examines various means of adapting technical computing tools to accelerate product and services innovation across a range of commercial industries such as manufacturing, financial services, energy, healthcare, entertainment and retail. No longer is technically advanced computing limited to the confines of big government labs and academic centers. Today it is available to a wide range of organizations seeking a competitive edge.

The UberCloud HPC Experiment: Compendium of Case Studies

06/25/2013 | Intel | The UberCloud HPC Experiment has achieved the volunteer participation of 500 organizations and individuals from 48 countries with the aim of exploring the end-to-end process employed by digital manufacturing engineers to access and use remote computing resources in HPC centers and in the cloud. This Compendium of 25 case studies is an invaluable resource for engineers, managers and executives who believe in the strategic importance of applying advanced technologies to help drive their organization’s productivity to perceptible new levels.

Conferences and Events

Featured Events



Copyright © 2011-2014 Tabor Communications, Inc. All Rights Reserved.
Digital Manufacturing Report is a registered trademark of Tabor Communications, Inc. Use of this site is governed by our Terms of Use and Privacy Policy.
Reproduction in whole or in part in any form or medium without express written permission of Tabor Communications Inc. is prohibited.
Powered by Xtenit.