Three sensing techniques behind the gesture control

The touch control method is gradually replacing the physical buttons on the car's central control panel. However, we all know that touch is not the only way to interact. Voices, gestures, and even eyeballs and mind control have all appeared in a variety of concept cars. The protagonist of today is gesture control technology.

This article refers to the address: http://

For example, at the CES Asia Electronics Show held last month, Volkswagen exhibited a Golf R Touch with gesture control. Of course, the public is not the only participant. Also at this CES, Intel exhibited 3D real-world technology that not only captures hand movements, but also enables facial recognition and 3D scanning modeling. At the subsequent Google I/O Developers Conference 2015, a wearable smart device chip called Project Soli was able to detect small movements on hands and fingers in real time and perform actions according to the settings. How do these technologies that look cool and tickle?

Gesture control, three points in the world

Although the three companies are all gesture recognition technologies, the specific technologies used by the three companies are different. According to reports, Volkswagen's Golf R Touch uses ToF technology, Intel's structured light technology, and Google uses millimeter wave radar technology. Let's talk about it separately.

ToF's full name is Time of Flight, a technique for measuring distance by calculating the propagation time of light. According to the difference of the distance, the specific position of the different fingers is determined, thereby determining a specific gesture and corresponding to the corresponding control command.

To measure distance by light propagation, you need a device that emits light and a sensing device that receives light. Volkswagen used a 3D camera module to emit pulsed light, and then used the built-in sensor to receive the light reflected back from the user's hand. Then, based on the time difference between the two, the processing chip can construct the current position and posture of the hand.

ToF camera hidden behind the shift lever in the popular gesture recognition technology (red dot position)

By collecting this information in real time, the central control system can call the corresponding database to get the action the user is doing. Different operations can be implemented according to the predefined functions. Since the light travels very fast, the ToF-based sensor requires a femtosecond shutter to measure the light flight time. This is one of the reasons why ToF technology is difficult to popularize. Such a sensor chip is too expensive.

The basic principle of structured light technology is similar to that of ToF technology, except that it uses light with a pattern of points, lines or faces. Take Intel's integrated front-facing camera as an example, which includes infrared laser emitters, infrared sensors, color sensors, and real-world image processing chips.

Camera used by Intel RealSense Technology

The basic principle is as follows: First, the laser emitter projects the structured light to the front surface of the human body, and then uses the infrared sensor to receive the structured light pattern reflected by the human body. Then, the processing chip calculates spatial information of the human body of the object according to the position and the degree of deformation of the receiving pattern on the camera. Combined with the principle of triangulation, and then performing depth calculation, the identification of three-dimensional objects can be performed. After the camera sends the collected information to the Software Development Kit (SDK) responsible for real-world computing, the SDK can be combined with an acceleration calculator to provide gesture recognition and other functions.

As a fast, portable and high-precision 3D measurement technology, structured light measurement technology has been widely used in aviation, mold, medical and other fields. Gesture recognition is just one of the application cases.

The principle of millimeter wave radar is also basically the same as that of ToF technology, except that the medium used for measurement changes from light to radio waves. Project Soli uses a built-in millimeter-wave generator to transmit radio waves (radar waves) and then receives the echoes using the receiver. At this time, the built-in processing chip calculates the target position data in real time based on the time difference between transmission and reception.

By comparing the differences in finger positions over different time periods, Project Soli can compare the built-in data to get the finger's ongoing action. The disadvantage of millimeter-wave radar is that the signal is easily blocked by air, and the scanning range is limited, so the detection of long-distance targets is unclear, but the survey of close-range targets is very clear. Among the active safety technologies, the millimeter wave radar is indispensable. In addition, it has applications in short-range high-resolution air defense systems, missile guidance systems, and target measurement systems.

Long road

The public's gesture recognition technology is slightly slower in the experience process, but the accuracy is not bad; Intel's real-world technology is said to have been developed for three years, and has already begun to be practical in the game; Google's Project Soli is just a Display, not yet officially applied. But no matter which one, the road on the car is still very long. Volkswagen engineers said that it will take at least two years to officially bring gesture recognition to the production model. Intel's real-world technology is still in contact with the car companies. As for Google, it is even further.

ToF technology has obvious drawbacks when applied - "external overlay error". The so-called external superposition error is relative to the internal superposition error due to light scattering. The reason for the error is that the light emitted by the camera does not return directly to the camera's photographic original when it reaches the hand, but returns to the camera module after several irregular diffuse reflections. The distance thus measured does not match the actual distance. However, if the background in the camera is fixed, the sensor can ignore measurement errors caused by external overlay errors. The Volkswagen Golf uses the fixed background of the car to reduce the impact of the error.

Google Project Soli chip

Project Soil uses a very high-frequency millimeter-wave radio wave of 60 GHz and a wavelength of 5 mm to capture information such as motion, distance, and speed. The sensing error is fine to millimeters. However, how to miniaturize devices with such precision is a very difficult thing. The most difficult part is that miniaturization affects the transmission power and efficiency of the device, and the sensitivity of sensing. It took Google about ten months to reduce it from the size of the PC to the size of the coin, and in order to improve accuracy and eliminate interference, two transmitters and four receivers were used. Currently, Project Soli has not been officially applied to specific devices.

As for Intel's real-world technology, from the technology itself, the most important problem to be solved is firstly to verify whether it is suitable for use in the car. In addition, from the field experience, the accuracy of recognition needs to be improved.

In addition to the technical development challenges, the user experience is also a challenge for developers.

China leading manufacturers and suppliers of Pendant Lamp ,E27 Pendant Lamp, and we are specialize in Hanging Pendant Lamp,Pendant Light Fixtures, etc.

the types of lamps include pendant lamps, table & floor lamps, chandelier, Wall Lamp ,desk lamp and etc., the materials include steel, metal, fabric, crystal, glass, aryclic and so on.


We offer samples with new designs every month to update our showroom and well display in lighting exihibtions.
We can make samples for his own designs as per shop drawings even potential idea from customers.


Glass Pendant Lamp

Glass Pendant Lamp,Mini Pendant Lights,Glass Ceiling Lights,Hanging Ceiling Lights

Monike Lighting , https://www.monikelight.com