How Microsoft Kinect Works

Project Natal Challenges the Wii

On June 1, 2009, Microsoft’s annual E3 press conference announced the development of a motion-sensitive gaming technology code-named Project Natal. The promotional video on YouTube, posted the same day as the press release, portrayed Project Natal as a controller-less way to play games, watch movies and keep in touch with friends. The video featured game control by just moving your body, plus facial and voice recognition for each player. At the end of the video, Microsoft gave viewers a peek at the hardware: a sleek, black, low-profile box sitting on a small platform, looking at you with two camera-like eyes in the middle and a green light offset to the left.

How Microsoft Kinect Works

At the heart of the project was a 3-D detection digital camera. Reports suggested that the technology likely originated with Israeli start-up 3DV, a company Microsoft had acquired just two months before. Press images of the 3DV camera from months before were significantly different from the Project Natal form factor: a small upright box with a series of purple lights and a protruding camera lens in the center.
The natural response from video game console enthusiasts was to compare the technology to the Nintendo Wii. Nintendo had revolutionized console gaming when it released the Wii in 2006. The Wii meant that, for the first time, the game controller was more than just a series of buttons: It also detected the movement of the controller and allowed the player to interact with the game based on that movement. For three years, the Wii was unmatched for bringing motion detection to home video game consoles.
The central part of the Wii experience was the controller. The movement of the controller was the means of transmitting the player’s movement to the console. In fact, Nintendo and other vendors created enhancements so the player could hold an object similar to that in the game (like a guitar or a tennis racket), or so the player could get motion feedback (a “rumble” effect). The Wii Balance Board controller added even more interactive options for players, detecting pressure from standing on it and shifting your weight.
Project Natal promised a dramatic leap forward from the Wii as it seemed to have overcome the need for any physical controller. Even better: Those with existing Xbox 360 consoles could use it without buying a completely new console. For the year following its original announcement, Microsoft gave celebrities and talk show hosts a chance to try it out. The result was a series of TV segments and YouTube videos buzzing about the good, the bad, and the creepy of the Project Natal experience. By the next E3 event, Project Natal, officially branded Microsoft Kinect, was one of the most anticipated Microsoft products in years, with a line of Kinect-based games to appeal to the same diverse audience as the Wii.

The Kinect Sensor

The innovative technology behind Kinect is a combination of hardware and software contained within the Kinect sensor accessory that can be added to any existing Xbox 360. The Kinect sensor is a flat black box that sits on a small platform, placed on a table or shelf near the television you’re using with your Xbox 360. Newer Xbox 360s have a Kinect port from which the device can draw power, but the Kinect sensor comes with a power supply at no additional charge for users of older Xbox 360 models. For a video game to use the features of the hardware, it must also use the proprietary layer of Kinect software that enables body and voice recognition from the Kinect sensor [source: Rule].
There’s a trio of hardware innovations working together within the Kinect sensor:

  • Color VGA video camera – This video camera aids in facial recognition and other detection features by detecting three color components: red, green and blue. Microsoft calls this an “RGB camera” referring to the color components it detects.
  • Depth sensor – An infrared projector and a monochrome CMOS (complimentary metal-oxide semiconductor) sensor work together to “see” the room in 3-D regardless of the lighting conditions.
  • Multi-array microphone – This is an array of four microphones that can isolate the voices of the players from the noise in the room. This allows the player to be a few feet away from the microphone and still use voice controls.

A further look at the technical specifications for Kinect reveal that both the video and depth sensor cameras have a 640 x 480-pixel resolution and run at 30 FPS (frames per second). The specifications also suggest that you should allow about 6 feet (1.8 meters) of play space between you and the Kinect sensor, though this could vary depending on where you put the sensor [source: Microsoft Store].
The Kinect hardware, though, would be nothing without the breakthrough software that makes use of the data it gathers. Leap forward to the next page to read about the “brain” behind the camera lens.

For more detail: How Microsoft Kinect Works


About The Author

Ibrar Ayyub

I am an experienced technical writer holding a Master's degree in computer science from BZU Multan, Pakistan University. With a background spanning various industries, particularly in home automation and engineering, I have honed my skills in crafting clear and concise content. Proficient in leveraging infographics and diagrams, I strive to simplify complex concepts for readers. My strength lies in thorough research and presenting information in a structured and logical format.

Follow Us:
LinkedinTwitter

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top