Kinect for Windows: SDK and Runtime version 1.5 Released


Kinect for Windows sensorI am pleased to announce that today we have released version 1.5 of the Kinect for Windows runtime and SDK.  Additionally, Kinect for Windows hardware is now available in Hong Kong, South Korea, Singapore, and Taiwan. Starting next month, Kinect for Windows hardware will be available in 15 additional countries: Austria, Belgium, Brazil, Denmark, Finland, India, the Netherlands, Norway, Portugal, Russia, Saudi Arabia, South Africa, Sweden, Switzerland and the United Arab Emirates. When this wave of expansion is complete, Kinect for Windows will be available in 31 countries around the world.  Go to our Kinect for Windows website to find a reseller in your region.

 We have added more capabilities to help developers build amazing applications, including:

  • Kinect Studio, our new tool which allows developers to record and play back Kinect data, dramatically shortening and simplifying the development lifecycle of a Kinect application. Now a developer writing a Kinect for Windows application can record clips of users in the application’s target environment and then replay those clips at a later time for testing and further development.
  • A set of Human Interface Guidelines (HIG) to guide developers on best practices for the creation of Natural User Interfaces using Kinect.
  • The Face Tracking SDK, which provides a real-time 3D mesh of facial features—tracking the head position, location of eyebrows, shape of the mouth, etc.
  • Significant sample code additions and improvements.  There are many new samples in both C++ and C#, plus a “Basics” series of samples with language coverage in C++, C#, and Visual Basic.
  • SDK documentation improvements, including new resources as well as migration of documentation to MSDN for easier discoverability and real-time updates.

 We have continued to expand and improve our skeletal tracking capabilities in this release:

  • Kinect for Windows SDK v1.5 offers 10-joint head/shoulders/arms skeletal trackingSeated Skeletal Tracking is now available. This tracks a 10-joint head/shoulders/arms skeleton, ignoring the leg and hip joints. It is not restricted to seated positions; it also tracks head/shoulders/arms when a person is standing. This makes it possible to create applications that are optimized for seated scenarios (such as office work with productivity software or interacting with 3D data) or standing scenarios in which the lower body isn’t visible to the sensor (such as interacting with a kiosk or when navigating through MRI data in an operating room).
  • Skeletal Tracking is supported in Near Mode, including both Default and Seated tracking modes. This allows businesses and developers to create applications that track skeletal movement at closer proximity, like when the end user is sitting at a desk or needs to stand close to an interactive display.

We have made performance and data quality enhancements, which improve the experience of all Kinect for Windows applications using the RGB camera or needing RGB and depth data to be mapped together (“green screen” applications are a common example):

  • Performance for the mapping of a depth frame to a color frame has been significantly improved, with an average speed increase of 5x.
  • Depth and color frames will now be kept in sync with each other. The Kinect for Windows runtime continuously monitors the depth and color streams and corrects any drift.
  • RGB Image quality has been improved in the RGB 640×480 @30fps and YUV 640×480 @15fps video modes. The image quality is now sharper and more color-accurate in high and low lighting conditions.

New capabilities to enable avatar animation scenarios, which makes it easier for developers to build applications that control a 3D avatar, such as Kinect Sports.

  • Kinect for Windows skeletal tracking is supported in near mode, including both default and seated tracking modesKinect for Windows runtime provides Joint Orientation information for the skeletons tracked by the Skeletal Tracking pipeline.  
  • The Joint Orientation is provided in two forms:  A Hierarchical Rotation based on a bone relationship defined on the Skeletal Tracking joint structure, and an Absolute Orientation in Kinect camera coordinates.

Finally, as I mentioned in my Sneak Peek Blog post, we released four new languages for speech recognition – French, Spanish, Italian, and Japanese. In addition, we released new language packs which enable speech recognition for the way a language is spoken in different regions: English/Great Britain, English/Ireland, English/Australia, English/New Zealand, English/Canada, French/France, French/Canada, Italian/Italy, Japanese/Japan, Spanish/Spain, and Spanish/Mexico.

As we have worked with customers large and small over the past months, we’ve seen the value in having a fully integrated approach: the Kinect software and hardware are designed together; audio, video, and depth are all fully supported and integrated; our sensor, drivers, and software work together to provide world class echo cancellation; our approach to human tracking, which is designed in conjunction with the Kinect sensor, works across a broad range of people of all shapes, sizes, clothes, and hairstyles, etc. And because we design the hardware and software together, we are able to make changes that open up exciting new areas for innovation, like Near Mode.

Furthermore, because Kinect for Windows is from Microsoft, our support, distribution, and partner network are all at a global scale. For example, the Kinect for Windows hardware and software are tested together and supported as a unit in every country we are in (31 countries by June!), and we will continue to add countries over time. Microsoft’s developer tools are world class, and our SDK is built to fully integrate with Visual Studio. Especially important for our global business customers is Microsoft’s ability to connect them to partners and experts who can help them use Kinect for Windows to re-imagine their brands, their products, and their processes.

It is exciting for us to have built and shipped such a significantly enhanced version of the Kinect for Windows SDK less than 16 weeks after launch. But we are even more excited about our plans for the future – both in country expansion for the sensor, and in enhanced capabilities of our runtime and SDK.  We believe the best is yet to come, and we can’t wait to see what developers will build with this!

Craig Eisler
General Manager, Kinect for Windows

 

Comments (21)

  1. pradeeplive says:

    Awesome..

  2. majd kasawat says:

    I've been waiting :)

  3. Chris Gardner says:

    That is a great list of feature. Many of which will certainly help my current project. However, is there any timeline that can be discussed about the integration of facial recognition?

  4. Tinux says:

    Great!

  5. Lentin Joseph says:

    I was waiting for a new release .Can  it be use for commercial applications ?

  6. Sandeep says:

    Awesome!!! The next target should be finger tracking…

  7. El Bruno says:

    Really cool ! great job :D

  8. The Kinect for Windows SDK v1.5 (and previous version) can be used to for creating commercial applications in the countries in which the Kinect for Windows sensor is available. Learn more by reviewing this FAQ http://bit.ly/K4WFAQ

  9. Tom Kerkhove says:

    This is really a nice upgrade that will make developing much easier!

    The face tracking is super as well!

  10. ykbharat says:

    These are the most awaited features/enhancements. Kinect development is too cool now.

  11. lorenzo cambiaghi says:

    Joint Orientation,real-time 3D mesh of facial features,record and play back Kinect data….wow!!!! amazing new features!

  12. That is an awesome release! :)

  13. Joseph Cooney says:

    Where can the new languages you alluded to in the 'sneak peek' blog post, and mentioned again here be downloaded from?

  14. Joseph Cooney says:

    OK – I think I found the language packs here http://www.microsoft.com/…/details.aspx

  15. Nik says:

    If you are interested, here is a little helper doc that explains how to use Kinect's Face Tracking SDK in your application (coming from its developers) –

    nsmoly.wordpress.com/…/face-tracking-sdk-in-kinect-for-windows-1-5

  16. Tj says:

    Can Kinect Studio be used for generating gesture definitions for recognition similar to the "Be The Controller" project?  This seems like a natural fit and important piece for utilizing the hardware.

    Is there any documentation about how to accomplish this with the SDK (posture/gesture recognition)?

  17. Andrea LEganza says:

    The only feature missing after this release seems the support to be used into Windows running inside a virtual machines.

  18. Rob Relyea says:

    @Tj-

    You could definitely imagine using Kinect Studio recordings to generate/test gesture detection (code based or machine learning generated). We don't currently have docs/samples/tools for the machine learning side of this.

    Thanks, Rob Relyea (http://twitter.com/rrelyea)

    Kinect for Windows team (twitter.com/kinectwindows)

  19. Jowen Mei says:

    From the release notes: "Seated mode skeletal tracking has higher performance requirements than Default mode"

    How is this possible when it has less joints to track?

  20. great job! I'm using two KFW under Touchdesigner, but right now the skeleton data is only available for one of them, if I use the same thread for both. Will it be possible to use both kinects skeleton data in the same thread?

  21. Cluster Storms says:

    Can we use this SDK 1.5 with Xbox kinect ? All features of SDK 1.5 will work on Xbox kinect ?