Mixed Reality Development Fundamentals

Course details

Learn how to develop immersive mixed reality (MR) applications using popular tools, including Unity. This course starts by covering headset selection and basic development techniques. Downloading, installation, and setup steps are covered, followed by a tour of the interface. Then, learn how to set up scenes and begin using the camera and gaze features to integrate movement. Next, find out how to configure the speech and audio features. Finish the course by learning about optimizing and debugging an app using Visual Studio 2017, then deploying to the Windows Online Store.

Learning objectives
Mixed reality
Setting up the camera and scenes
Gaze in Unity
Building movement and teleporting
Setting up audio in Unity
Conditional compilation in Unity
Creating simple models using Paint 3D
Topology and polygon count
Normal maps, bump maps, and CrazyBump
Fixing issues using Maya and Visual Studio
Exploring the frame debugger
Building an application in Visual Studio
Submitting an app to the Windows Store

Concepts

0. Introduction

01 - Introduction
02 - Getting started
03 - What is mixed reality
04 - Setting up
05 - Health and safety

1. Introduction to Unity

06 - What is Unity
07 - Unity APIs
08 - User interface in mixed reality
09 - Setting up the camera parent
10 - Setting up a scene
11 - Setting up the controllers
12 - Understanding the controllers
13 - Controllers in action

2. Developing in Unity - Gaze

14 - Introduction to gaze
15 - Building gaze
16 - The gaze target class
17 - The gaze class
18 - Gaze in Unity

3. Developing in Unity - Movement

19 - Movement in mixed reality
20 - Building movement using the controllers
21 - Teleporting
22 - Ad hoc teleportation

4. Developing in Unity - Speech and Audio

23 - Introduction to speech and audio
24 - Setting up audio in Unity
25 - Voice command tips
26 - Spatial sound in Unity
27 - Getting your MR application working with audio
28 - Conclusion to speech and audio

5. Conditional Compilation

29 - Introduction to conditional compilation
30 - Conditional compilation in Unity
31 - Building for UWP
32 - Conclusion to conditional compilation

6. Designing for MR

33 - Introduction to designing for mixed reality
34 - Creating simple models using Paint 3D
35 - Exporting Paint 3D models
36 - Topology and polygon count
37 - Engons and triangles
38 - Normal maps and bump maps
39 - Creating maps using CrazyBump
40 - High poly to low poly using Maya

7. Optimization and Debugging

41 - Introduction to optimization and debugging
42 - Exploring the Profiler
43 - Fixing issues in Visual Studio
44 - Reviewing fixes in Unity
45 - Exploring the Frame Debugger
46 - Fixing your scene in Unity
47 - Optimizing your scene
48 - Top tips for optimization

8. Deploying with Visual Studio 2017

49 - Building a Visual Studio solution in Unity
50 - Building the application in Visual Studio
51 - Deploying and sideloading
52 - Submitting to the store