ZED SDK 2.8

What’s New

ZED SDK 2.8 introduces streaming ZED video feed across a network, turning ZED cameras into IP cameras. It also adds support for point-based spatial mapping, simpler Jetson installation process and major wrapper/plugin updates. Read more.

2.8.5

General

• Updated automatic port assignment for the streaming receiver. Previously, the port was randomly chosen in a list of available ports.
  Now the port assigned is either the same port number defined in InitParameters.input.setFromStream(ip,port) or the closest available port number if the port defined is not available.
  This allows to know explicitly the internal port that will be used by the streaming receiver, which is useful in applications where the receiving port number must be defined explicitly (Docker containers for example). See InitParameters.input.setFromStream() API documentation for more information.

Platforms

• Added support for CUDA 10.2 (Windows, Ubuntu 16, Ubuntu 18)
• Added support for JetPack 4.3 (Nvidia Jetson)

2.8.4

General

• Fixed a memory leak in Streaming module on Jetson that continuously increased memory until the camera was closed.
• Improved IMU timestamp accuracy. Timestamp is based on epoch time and IMU clock drift is now compensated. Note that getIMUData(TIME_REFERENCE_IMAGE).timestamp and getTimestamp(TIME_REFERENCE_IMAGE) can now be slightly different since they are not based on the same computation, however the difference will be less than the time of a frame.
• Fixed a wrong translation scale that was applied in getCameraInformation().camera_imu_transform. Translation was given in meters when the selected unit was in millimeters.

Platforms

• Fixed Jetson clock script so that it correctly enables maximum performance (nvpmodel -m 0) with the new JetPack 4.2.

2.8.3

General

• Fixed multiple camera detection on Ubuntu 18.
• Fixed getCameraSettingsValue() when using network streaming input. It was not fully supported on previous versions.
• Fixed random freeze on Windows when using network streaming input.
• Fixed retrieveImage() for Side by Side View mode that would lead to an empty image.
• Fixed error code that returned SUCCESS when retrieveImage() or retrieveMeasure() was used with a resolution higher than the camera resolution. Functions will now return ERROR_CODE_INVALID_RESOLUTION.

SVO

• Fixed a bug in LOSSLESS compression on Linux when using ZED Mini cameras. IMU metadata was not reported in the SVO file, leading to wrong tracking states.
• Fixed metadata synchronization issue where IMU and image data could be out of sync in H264 (AVCHD) and H265 (HEVC) SVO files recorded on Desktop platforms.

2.8.2

General

• Added static sl_svo library on Linux. All ZED SDK libraries are now available as static libraries.

Video

• Fixed unrectified image orientation in Flip mode.
• Fixed a potential issue leading to file corruption when multiple programs accessed the camera calibration file at the same time.

Positional Tracking

• Updated IMU output to remove gyroscope bias correction from raw data. This will improve SLAM algorithms that include online bias estimation and use the IMU raw data.
• Fixed enable_imu_fusion function. When set to false, it now effectively disables IMU use for visual odometry estimation.

Spatial Mapping

• Fixed a memory detection issue preventing the mapping to start when <2GB of RAM was available.

SVO

• Fixed a potential issue when reading the last frame of an SVO file.
• Added support for ~ character in SVO paths on Linux.

2.8.1

Positional Tracking

• Fixed IMU bias correction that could lead to slow movement not being correctly tracked.

SVO

• Fixed automatic low recording bitrate when target FPS is not reached.

2.8.0

New Features

Streaming over IP network

• ZED SDK 2.8 introduces a brand new streaming feature. Users can now connect as many ZED cameras as needed directly to a network and conveniently access the video feeds simultaneously, on multiple devices and applications. Get Started.
• Also, Ethernet cabling greatly extends the distance allowed between the ZED camera and the host device making installation and placement of ZED cameras more flexible and scalable.

SDK

General

• Added Streaming capabilities. The ZED SDK can now stream data from local cameras over the network, for multiple remote computers running the SDK to use as input.
• Added support for scanning into point clouds using Spatial Mapping.
• In collaboration with NVIDIA, solved an issue on Jetson preventing the ZED Mini from being detected after reboot. Fix is available in JetPack 4.2 and will be applied to older versions.
• Fixed an issue on Jetson TX2 leading to incorrect floor plane detection with the ZED Mini.
• Fixed image timestamping issue that could lead to offsets when using getTimestamp(TIME_REFERENCE_IMAGE).

Streaming

• Added input.setFromStream() function in InitParameters to open a streaming camera.
• Added enableStreaming() and disableStreaming() functions to start and stop a stream from a camera.
• Added StreamingParameters structure to setup custom bitrate, port and codec of a camera stream.
• Added isStreamingEnabled() function to get the streaming status of a camera.
• Added getStreamingDeviceList() function to list the camera streams available on the network.

Spatial Mapping

• Added map_type parameter in SpatialMappingParameters to select between mesh or point cloud-based mapping.
• Added SPATIAL_MAP_TYPE enumerate to list available mapping types (mesh vs. point cloud).
• Added extractWholeSpatialMap() function, deprecating extractWholeMesh().
• Added retrieveSpatialMapAsync() function, deprecating retrieveMeshAsync().
• Added requestSpatialMapAsync() function, deprecating requestMeshAsync().
• Added getSpatialMapRequestStatusAsync() function, deprecating getMeshRequestStatusAsync().

API

• Added CAMERA_SETTINGS_LED_STATUS in CAMERA_SETTINGS to allow users to enable or disable the camera LED.
• Updated Jetson installers. There is now one installer per JetPack version that covers all supported Jetson boards, instead of one installer per board and per JetPack.

SVO

• Fixed memory leak in disableRecording() function.
• Introduced optional_settings_path to select a custom calibration file path.

Positional Tracking

• Added enable_imu_fusion parameter in TrackingParameters to disable camera-IMU odometry fusion when using a ZED Mini in specific environments such as high vibration platforms.
• Updated TrackingParameters.enable_pose_smoothing behavior to better track high-speed movements of the camera when disabled.
• Updated Pose.pose_covariance behavior when using spatial memory. The covariance is now accessible when TrackingParameters.enable_spatial_memory is activated.
• Deprecated Pose.pose_confidence attribute. Use Pose.pose_covariance instead.
• Introduced camera_disable_imu to disable the IMU opening in live mode. This allows opening a ZED Mini on USB 3.0 only extensions cord such as optical fiber.