Kinect, the door to virtual reality
The system offered by Microsoft is a higher performance and simpler interface for virtual worlds than all current systems. He was originally named Natal.
It can recognize six people, including two active players at a time, without having to wear any devices, surpassing all other existing systems.
It now runs on XBox 360 with an expansion case and should be integrated into Windows in the future.
Use
The sensor has a viewing angle of 57 ° horizontally and 43 ° vertically, which complements the rotational ability of the support pivot both horizontally and vertically. Therefore, you need to be close enough to the group.
It is necessary to put at least 1.8 meters and further if there are several players.
How Kinect works
The console is accompanied by a sensor with a camera, which is placed next to the microphone, a depth sensor. This is enough to distinguish all movements. The character's hand mimics the player's hand and his body with all his movements, thus interacting with virtual objects and scenery.
The Kinect chassis, as described in the documentation, has the following devices:
- Multichannel microphone.
- Depth sensors in 3d.
- RGB webcam (red-green-blue).
- Motorized support to support user movement.
Software for 200 megabytes of disk space is added to the case.
The software includes facial recognition, allowing multiple players to be recognized and associated with the same characters in a virtual world. It is necessary to record his face so that it can be automatically recognized when the case appears in front of the camera.
The microphone receives a signal that is processed by software to locate its source and remove ambient sounds.
The depth sensor under the red color can work in the dark.
Kinect actually uses a library of preset motions that is provided to software publishers to adapt their products to the console. Unexpected moves from the player would not be recognized.
The user is seen as a skeleton with about twenty dots at the ends and joints, which allows him to recognize his movements, which he then recognizes in the library .
Hackers and Kinect
Microsoft initially protested the hackers' initiatives to create open source drivers for the case, and then decided to allow it.
Thus, the project Free60 develop Linux software currently running on the Xbox 360.
Hacking consists precisely in using the USB port to restore the 3D sensor signal and redirect it to the computer. Microsoft said it did not see any inconvenience in this.
Applications
Next to the game console, you can find new applications for the device, combining it with specialized software.
- OsiriH
This medical application of the Virtopsy project in Switzerland uses it by linking to the voice to order an imaging system to facilitate X-ray examination.
It will be used by surgeons in the operating room or forensic experts to conduct virtual autopsies, easier. - Learn sign language
Researchers at the Georgia College of Technology are working to develop a sign language course based on Kinect. It provides interactivity that makes learning much easier.
Watch the video. - Surgery
Using Kinect as a surgical robot interface, as part of an experiment conducted by the University of Washington, students show that you can save 50 thousand dollars . - Robotic learning
The Predator software, combined with Kinect, allows the robot to learn how to track moving objects by isolating them from the environment and correcting its errors.
It could also be used in video monitoring, in augmented reality.
Source: University of Surrey .
Kinect for PC
In addition to hacking a device for use on a PC, can you hope to see an equivalent tool specifically designed for a PC?
Kinect is not an invention of Microsoft, but of PrimeSense, which fired its technology at the firm. And PrimeSense is now working in collaboration with Asus on WAVI Xtion, which will allow you to control your computer with gestures.
It is expected to appear in February.
For its part, Microsoft released a Windows development kit to the network on June 16, 2011. This opens up opportunities for gesture-driven apps and games on desktops.
It can be downloaded for free .
Kinect vs. Wiimote and competitors
As noted in the article on new interfaces to computers, there are many different systems for interacting with a computer and integrating into the virtual world.
The most successful was Nintendo's Wiimote, a pen augmented by Wii made, scales that recognize body movements.
The handle sends a signal to the receiver that recognizes hand movements. It's perfect for a game like tennis, but it's not suitable for all situations. The scales add a plus, recognizing the movements of the legs and body, all this is a rather heavy device, from which Kinect does not use any of them: the movements are recognized directly by the system.
In addition, Kinect responds to voice commands.
Asus Kstion
The Asus-made PC device recognizes gestures up to 3.5 m away, and the Kinect at a short distance.
Games are shipped with the device.
Further information
- Milo. Another video. Based on Kinect - a smart virtual character that reacts to user emotions.
- Minority report with Kinect.
- Below-red vision. How Kinect sees the room where you are.
- How kinect works. English video and PDF document.
See also