Develop Kinect A community based site focusing on development and programming for the Microsoft Kinect 3D depth sensor.

• Laser Scanning
• Systems Modeling

Contents. Process.

Discovered a simple method for implementing the Kinect into Unity. Downloaded all side programs (OpenNI, NITE, Kinect drivers, OpenNI hack) and found all versions that work with our machines.

Tested sample code and then handed it off to be revamped for simple model swapping and raw output of Kinect data. How to Install Drivers and OpenNI for Microsoft Kinect. Download KinectInstallFiles.zip. Unzip the folder and begin Installing OpenNI-Bin-Win32-v1.0.0.25.exe. After OpenNI finishes, Open the NITE SDK Installer (NITE-Win32-1.3.0.17.exe).

Before the installation begins, make sure to enter the following Free License key from Openni.org. It should be the last step before it begins License Key: 0KOIk2JeIBYClPWVnMoRKn5cdY4=. Unzip the SensorKinect file (avin2-SensorKinect-0124bd2.zip). Connect the Kinect device to your PC. Open the Device Manager (Start Run. devmgmt.msc) and verify that 'Xbox NUI Motor' is on the list (but with an exclamation mark).

Right-click on the device and choose 'Update Driver.' Make windows search for a driver in the avin2-SensorKinect-0124bd2 Platform Win32 Driver folder. There should now be three devices. 'Kinect Motor' and 'Kinect Camera' should be successfully installed. The third device will fail, which is okay. This is 'Kinect NUI Audio.'

This is the driver for the array mics, but currently we don't have access to it. Install the executable (SensorKienct-Win32-5.0.0.exe) located in avin2-SensorKinect-0124bd2 Bin. Run C: Program Files(x86) OpenNI Samples Bin Release NiUserTracker.exe to test if everything works. If this fails, try to run C: Program Files OpenNI Tools vcredistx86.exe Adding the DLLs and Scripts.

Make sure all the drivers are installed before attempting to use. If you haven't already made your project, do so. Inside the KinectInstallFiles folder, open Project Files. Copy both the UnityInterface.dll and OpenNI.xml files into the root of your project folder. Copy the scripts contained inside the Scripts folder into your project.

The source for the DLL originally came from the now defunct PrimeSense. It is available here:. Setting Up the Scripts - Quick Overview There are three total scripts that are required to use the Kinect inside of Unity: KinectWrapper, AvatarController, and KinectManager. Make sure each of these scripts are in the same folder, otherwise you may have pathing issues.

KinectWrapper wraps the functions form UnityInterface.dll and allows them to be called in C# / Unity. This script just needs to be present within your project. You do not need to attach it to an object within the scene.

AvatarController contains all of the methods required to map your avatar to the Kinect. First, attach the script to the model you want to control. Next, Drag and drop the appropriate bones to be controlled by the Kinect skeleton. Afterwards, check the flags for whether the model should move, how fast, and whether the movement should be mirrored. You can define which player controls which model in the KinectManager.

KinectManager has all of the update logic required to use the Kinect. Attach this to the Main Camera. Add all of the models you want to control to the appropriate list for the appropriate players. Using AvatarController Attaching the Bones To set up the AvatarController with your model, attach the script to the model you want to control. Next, select the model.

Expand it, and select the skeleton. Device seizure 5 keygen idm 5. Within the skeleton, you will find all the appropriate bones you need to control your model. Drag and drop the appropriate bone to the bone you wish to control.

(See Figure 1). 1, Avatar Controller Note that you can attach as many or as few bones as you want to the model - it will leave those bones unmodified if you don't pair them to the AvatarController. Also, please note that the Avatar needs to have its rotation set to 0 across X, Y, and Z.

If you want to have model rotate, make sure to set an Offset Node and rotate that instead (see 'Rotating the Character'). This is due to the fact we are using Quaternion coordinates.

The 'Mirrored Movement' flag causes the model to move the opposite limbs (Left Arm - Right Arm and vice versa). WARNING: Be careful when rescaling the model - this can cause the rotations and movement rate to behave oddly.

Moving the Character To have the character move in space, check the 'Moves in Space' box within the editor. To apply vertical movement, check 'Vertical Movement.' To change the speed of the character, raise the movement rate.

The characters speed is multiplied by.001f (Unity's framerate), and the Movement Rate field multiplies that. Rotating the Character To have the character rotate, you must first set an Offset Node. This is done by creating an empty Game Object and parenting the model to it. (See Figure 2).

You must definitely know the (formerly Natal Project)? This is the latest toy for the Xbox from Microsoft which allows players to control games with the help of their body. This week I had the opportunity to test it and to realize all the possibilities it offered (precision of the movements, recognition of the skeleton, etc.).

Pending an official SDK from Microsoft (announced in spring 2011), I did some tests on PC by helping me with the drivers supplied by the open source community. But if you don’t know this environment, it’s fairly complex to know what projects to use, what they do and how to install them. The objective of this tutorial is to explain to you what are the differences between OpenKinect and OpenNI in a first time.

And then we’ll see how to install the OpenNI framework in order to run the first examples on your PC (OpenNI runs on Mac OSX and Linux, but their installations/usages are a little different and therefore they’ll be not explained here). In a second part we will see how to use some tools such as and to test some possibilities offered by the Kinect. Before to start, if you bought the Xbox + Kinect pack, you must purchase an USB adapter with the power supply to connect the Kinect to the computer. It is only available on Microsoft website.

For those who bought the Kinect without the pack, the adapter is supplied with. To begin you must know that at this writing (February 2011) there are two major open source Framework to run the Kinect on a computer which are and:. OpenKinect is an open source project built around the libfreenect driver which offering an APIs to control the motor, the LEDs, the cameras and the audio. It also provides a library to analyze the outputs of the Kinect in order to provide a layer abstraction such as the tracking of the hands or of the skeleton.

Moreover several are available to allow you to develop in your preferred language (Java, C#, C, Actionscript, Python, etc.). OpenNI (Open Natural Interaction) is an open source Framework (under LGPL), partially developed by PrimeSence which is one of the creators of the Kinect. It provides standard abstract programming interfaces (API) (in C and C #) which allow developers to write applications based on natural interactions.

It’s not specific to the Kinect and that’s its main advantage because it can be plug to another audio or visual device sensors. This scheme shows us the architecture of OpenNI.

To make simple OpenNI allows you to connect the sensors that send data raw to middleware which will analyze them, will forward them to other middleware and/or will deal with them to finally sent high-level data to the application (like Push Detector, Wave Detector). This modular architecture allows you to interface different middleware or devices complying with the API defined by OpenNI. In our case NITE as middleware and the Kinect as device. Now, I’m going to explain you how to install the various components of the OpenNI in order to run the Kinect on your PC.

Laser Scanning

To begin we are going to install OpenNI:. Go here first and download the last OpenNI version (v1.0.0.25 at the time of writing). Once the download is finished, run the installer and follow the instructions. Now we are going to install the Kinects drivers that can interface with the OpenNI’s API:. To start, download the SensorKinect drivers (v5.0.0) (If you don’t use a git client click on Downloads Download.zip).

Once the download is finished, extract the file and go to the Bin folder. Then run the executable and follow the instructions. To finish you need to install an additional driver which is located into the folder where you extracted the driver and go in the path Platform Win32 Driver. If you are on a 32 bit system install the driver dpinst-x86.exe and if you are on a 64 bit system install the driver dpinst-amd64.exe. Finally we are going to install the last component which allows OpenNI to run, namely NITE which is a middleware that contains all image processing algorithms and treatments of data raw from sensors:. In the first place download the latest version of NITE here (v1.3.0.18 when I write these lines). Once the download is complete, run the installation and follow the instructions.

During the installation it’ll ask you a key. Enter the following key: 0KOIk2JeIBYClPWVnMoRKn5cdY4= (NITE is not free but PrimeSense provided a free key to allow users to test its middleware).

All must be properly installed on your PC. To verify this you just have to connect the adapter on your Kinect then the on electric plug before connecting it to your PC. If all goes well, the green Led will begin flashing and Windows will begin installing the device. Finally go to the OpenNI installation directory and browse to the SamplesBinRelease folder and run one of example as NiViewer.exe.

Systems Modeling

If everything works, you should see this: (IR and RGB video) If you need to go deeply you can read this really great book:. ( 7 votes, average: 3.86 out of 5).