Skip to content

Latest commit

 

History

History
47 lines (31 loc) · 4.68 KB

File metadata and controls

47 lines (31 loc) · 4.68 KB
title description author ms.author ms.date ms.topic keywords
App views
Learn how to use the two kinds of views in Windows Mixed Reality apps - immersive views and 2D views.
thetuvix
alexturn
03/21/2018
article
immersive view, 2D view, slate, app, mixed reality headset, windows mixed reality headset, virtual reality headset, HoloLens, MRTK, Mixed Reality Toolkit

App views

Windows apps can contain two kinds of views: immersive views and 2D views. Apps can switch between their various immersive and 2D views, showing their 2D views either on a monitor as a window or in a headset as a slate. Apps that have at least one immersive view are categorized as mixed reality apps. Apps that never have an immersive view are 2D apps.

Immersive views

An immersive view gives your app the ability to create holograms in the world around you or immerse the user in a virtual environment. When an app is drawing in the immersive view, no other app is drawing at the same time—holograms from multiple apps aren't composited together. By continually adjusting the perspective from which your app renders its scene to match the user's head movements, your app can render world-locked holograms. World-locked holograms stay at a fixed point in the real world or can render a virtual world that holds its position as a user moves.

When in an immersive view, holograms can be placed in the world around you.
When in an immersive view, holograms can be placed in the world around you

On HoloLens, your app renders its holograms on top of the user's real-world surroundings. On a Windows Mixed Reality immersive headset, the user can't see the real world, and so your app must render everything the user will see.

The Windows Mixed Reality home (including the Start menu and holograms you've placed around the environment) doesn't render while in an immersive view either. On HoloLens, Cortana relays any system notifications that occur while an immersive view is showing, to which the user can respond with voice input.

While in an immersive view, your app is also responsible for handling all input. Input in Windows Mixed Reality is made up of gaze, gesture (HoloLens only), [voice, and motion controllers (immersive headsets only).

2D views

Multiple 2D views laid out around the Windows Mixed Reality home
Multiple apps with a 2D view placed around the Windows Mixed Reality home

An app with a 2D view appears in the Windows Mixed Reality home (sometimes called the "shell") as a virtual slate, rendered alongside the app launchers and other holograms the user has placed in their world. The user can adjust this slate to move and scale it, though it remains at a fixed resolution whatever its size. If your app's first view is a 2D view, your 2D content will fill the same slate used to launch the app.

In a desktop headset, you can run any Universal Windows Platform (UWP) apps that run on your desktop monitor today. These apps are already rendering 2D views today, and their content will automatically appear on a slate in the user's world when launched. 2D UWP apps can target the Windows.Universal device family to run on both desktop headsets and on HoloLens as slates.

One key use of 2D views is showing a text entry form that uses the system keyboard. Because the shell can't render on top of an immersive view, the app has to switch to a 2D view to show the system keyboard. Apps that want to accept text input need to switch to a 2D view with a text box. While that text box has focus, the system will show the system keyboard, allowing the user to enter text.

An app can have 2D views on both the desktop monitor and in an attached headset on a desktop PC. For example, you can browse Edge on your desktop monitor using its main 2D view to find a 360-degree video. When you play that video, Edge will launch a secondary immersive view inside the headset to display the immersive video content.

See also