HoloLens – How to Create Mixed Reality?

Developer Support

January 24th, 20170 0

Rick McGuire, Senior ADM, provides an introduction to mixed reality development with a test drive using HoloLens, Unity, and Visual Studio 2015.

With the invention of HoloLens, it is now possible to superimpose a virtual 3D world onto our exiting reality. HoloLens lets you create holograms, virtual objects that appear in the in the same space as our real world, and they seem like real objects!

I am admittedly a geek and love Sci-fi, I always thought the idea of superimposing graphics/objects in our real-world space was intriguing. I believe that HoloLens is the first step towards making this a common occurrence. Imagine the possibilities, all the applications that could be developed with mixed reality (MR). The amazing thing is, the tools for creating MR are readily available today!

To start with, what exactly is mixed reality?

“Mixed reality (MR), sometimes referred to as hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects co-exist and interact in real time.” – Wikipedia

I recently spent some time learning Unity and experimenting with the HoloLens emulator. For my first project, I decided to download Unity and followed the video tutorial to develop the Roll-a-ball game. This tutorial integrates a handful of C# scripts, so you get an idea how to leverage Unity capabilities with Visual Studio and .NET. I highly recommend that you walk through this tutorial and develop and run the Roll-a-ball application. This is a great way to jump in and start learning key features of the environment including, Scenes, Scripting, Camera, lighting, etc.

The Roll-a-ball tutorial is located here. If you want to learn Unity this is a good place to start. If you prefer to just jump in and run an application on the HoloLens emulator, then read on to create the “Holo” World application.

Unity Screen Shot – Roll-a-ball tutorial:

HoloLens provides a rich API and set of tools which allows you to build applications on Windows 10 using Visual Studio 2015 or later, Unity 5.5 or later, along with the HoloLens emulator that runs on Hyper-V. You can also purchase the HoloLens developer kit that includes a HoloLens device here. To start with, I recommend reading the HoloLens Developer Documentation to get an overview. You will need to ramp up on Gaze, Gestures, Spatial Mapping, Raycasting, just to name a few. To get started, you can download and install all the tools here.

At a minimum you need to Install Visual Studio 2015, the HoloLens Emulator, and Unity 5.5.

Important: Make sure you have the Windows 10 SDK installed, it is not installed with Visual Studio by default. You can run the Visual Studio installer to add the Windows 10 SDK. Go to Control Panel->Programs->Programs and Features then double click on Visual Studio 2015 to launch the setup. Select the Universal Windows App Development tools and install them.

Visual Studio Setup:

Installing and running Unity is fairly straight forward. If you have experience working with Unity I would recommend going right to the Holograms 101E tutorial which will walk through the basics of getting an app up and running on the HoloLens emulator. You should be able to get your first app up and running within an hour or so (depending on your internet connection for downloading).

You will need Windows 10 Pro, Enterprise, or Education with a 64-bit CPU and 8 GB of RAM. The documentation indicates the emulator requires a CPU with 4 cores, I was able to run the emulator with no problems on my Surface Book i5 (2 cores/4 Logical) with 8 GB of RAM. The full system requirements are listed on the tools link above.

Important: Building the Demo in Unity – you will need to download a separate file from Unity (not mentioned in the tutorial). In order to select the appropriate build setting you will need to download the Windows 10 (Metro) support here. This allows you to target your build for Universal Windows 10 store app.

Unity Build Setting Screen shot:

Important: You must enable developer mode for “sideloading” apps. You can go to Setting->Updates and security->For developers, and select “Developer mode“ (if you are allowed and are aware of the risks associated). I was required to choose this option to deploy my Origami app on the HoloLens emulator. If you don’t do this, you will get a deployment error in Visual Studio.

Windows 10 Settings screen shot:

Once you have everything configured, you should be able to follow the Holograms 101E tutorial and have your first app running in the emulator rather quickly. I suggest using two screens, one for Unity/Visual Studio and the other for the video tutorial.

HoloLens emulator – launched Origami App with Visual Studio 2015:

I hope this information helps get you started on your path to creating the next MR application for HoloLens. Perhaps “Ferengi Blast” or “Attack from Species 8472”?

Premier Support for Developers provides strategic technology guidance, critical support coverage, and a range of essential services to help teams optimize development lifecycles and improve software quality. Contact your Application Development Manager (ADM) or email us to learn more about what we can do for you.