> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.stereolabs.com/docs/integrations/unreal-engine-5/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.stereolabs.com/_mcp/server.

# Getting Started with Unreal Engine and ZED

## Introduction

The [ZED Plugin for Unreal](https://github.com/stereolabs/zed-UE5) allows developers to build AR/MR applications within Unreal Engine 5. It provides access to stereo video passthrough, depth sensing, positional tracking, spatial mapping and object detection features from the ZED SDK.

![image](/_fern-img/20e3fc9a886cd4ef74df5c53a96c575aac18c1199ab462629fcf8a724f68d532.webp)

## How to Get Started

### Prerequisites

* Windows 10/11
* [ZED SDK](https://www.stereolabs.com/developers/release/latest/) 5.5
* [CUDA](https://developer.nvidia.com/cuda-downloads) dependency
* [Unreal Engine](https://www.unrealengine.com/en-US/download) 5.4 to 5.8
* [Visual Studio](https://visualstudio.microsoft.com/) 2019 or later

Do not hesitate to consult the [Unreal Engine documentation](https://dev.epicgames.com/documentation/en-us/unreal-engine/setting-up-visual-studio-development-environment-for-cplusplus-projects-in-unreal-engine) page to learn how to set up your Visual Studio installation.

> **Note**
>
> The **Object Detection and Body Tracking** features are compatible with the ZED 2 and more recent cameras.

### Installation

* Download or clone the [ZED plugin for UE5](https://github.com/stereolabs/zed-UE5).
* In your project root directory right click on the **ZEDSamples.uproject** file and select **Generate Visual Studio project files** in the context menu.
* Open Visual Studio and compile. Launch the project from the **uproject** file or Visual Studio.

If these options are not available, make sure your Visual Studio installation is correctly set up.

## How it works

The plugin uses our C wrapper to interface with the SDK. This allows the usage of all the SDK features mentioned above, with either a video feed from a ZED Camera (via USB or streaming) or by reading an SVO file.

## Available sample levels

Explore the different sample levels provided in the project, like [Spatial Mapping](/docs/development/zed-sdk/modules/spatial-mapping/), [Object Detection](/docs/development/zed-sdk/modules/object-detection/) or [Body Tracking](/docs/development/zed-sdk/modules/body-tracking/).

* *L\_BackgroundSubstraction*: Background subtraction with plane occlusion or depth clamping.
* *L\_BodyTrackingSingle*: Body tracking of a single person in a virtual scene, with the Unreal Mannequin as an avatar.
* *L\_BodyTrackingMulti*: Body tracking of multiple persons in a virtual scene, with the Unreal Mannequin as an avatar.
* *L\_CameraTracking*: Camera tracking demo in a virtual scene.
* *L\_DynamicCrosshairOnMouse*: Depth dynamic crosshair hovering on the environment, without spatial mapping.
* *L\_NewHitTest*: Depth-based hit test with ball stopping on the environment without spatial mapping.
* *L\_ObjectDetection\_2D*: Object detection (human body model) with 2D frames.
* *L\_ObjectDetection\_3D*: Object detection (human body model) with 3D boxes.
* *L\_OpenNewLevel*: Procedure to change active level, ZED-wise.
* *L\_Passthrough*: Simple AR passthrough vision showing a virtual object in a real scene, with depth occlusion.
* *L\_PlaneDetection*: Showcase of the SDK plane detection feature.
* *L\_PointCloud*: Point cloud mapping of the environment.
* *L\_SpatialMapping*: Visualization of the spatial mapping of the environment, and potentially creation of a static mesh out of the mapping.

## Docs

- [Configuring your Unreal Project for AR/MR](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/configuring-your-project.md)
- [Body Tracking with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/body-tracking.md)
- [Camera Tracking with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/camera-tracking.md)
- [AR/MR with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/ar-mr.md)
- [Environmental Mapping with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/spatial-mapping.md)
- [Object Detection with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/object-detection.md)
- [Background Subtraction with UE5](https://docs.stereolabs.com/docs/integrations/unreal-engine-5/background-subtraction.md)