Sony OCELLUS Unveiled: New Camera Tracking System for AR and VR Production

Sony has introduced its first camera tracking system, OCELLUS (ASR-CT1), designed to facilitate markerless camera tracking using multiple sensors. This innovative system enhances augmented reality (AR) and virtual production capabilities in the film, television, and broadcasting industries.

OCELLUS is compatible with various camera types, including both film and broadcast models. Its compact dimensions of 86mm x 60mm x 43mm and lightweight design of just 250g make it an accessible option for many production settings.

OCELLUS, perfectly suited for virtual productions such as In-Camera VFX and AR, sends data on the position and orientation of the camera during shooting. The system consists of a sensor unit, a processing box, and three lens encoders and can be used with Sony Cinema Line cameras, system cameras, and non-Sony cameras. 

Thanks to five image sensors and Sony's Visual SLAM (Simultaneous Localization and Mapping ) technology, the system creates a reference map, enabling stable, marker-free tracking in both indoor and outdoor environments.

When using Sony cameras, metadata related to the camera and lens focus, iris, and zoom values can be obtained via the camera's SDI output and transmitted in real time to external devices via an Ethernet cable. If the lens does not support metadata acquisition through the camera, encoders can be applied to the camera to obtain this metadata. The acquired metadata can be used for virtual production and AR. The system also supports the recording of tracking data, camera/lens metadata, timecode, and file name, which can be used for post-production workflow. 

Sony continues to support creators in the field of virtual production and AR, with tools ranging from capture to display screens like the Crystal LED VERONA and software-based solutions like the Virtual Production Toolset. 

Main features

Compact and lightweight sensor unit with five image sensors:

• Four out of five image sensors in the sensor unit are selected for use.
  
• If at least one image sensor in use captures valid feature points, tracking data can be extracted.
  
• IR LEDs on both sides of each image sensor help track images in low-light environments.
  
• The visible light-cutting unit is included for stable tracking in environments with frequent lighting changes.
  
• Sensor unit dimensions: Approx. 86 mm × 60 mm × 43 mm (W × H × D) (3.39" × 2.36" × 1.69"), weight: Approx. 250 grams.
  
• Easy installation and position adjustment thanks to NATO rail mounting parts (included).
  
• Connects to the computing box via a single locking USB Type-C® cable, powered by the computing box via the same USB Type-C® cable. 

Processing box:

• Real-time transmission of camera2/lens3 tracking data and metadata to CG rendering software such as Unreal Engine via Ethernet cable in free-d format.
  
• Equipped with Genlock input, Timecode input, SDI input/output terminals and lens encoder connection terminals.
  
• Supports recording of tracking data and camera/lens metadata as FBX files to SDXC (UHS-II/UHS-I) memory cards synchronized with the main camera's video files.
  
• OLED display to check IP address, tracking information, target data, and more.
   
  Encoder lens:
  
  
• Detect precise rotation angles and positions of the lens focus, zoom, and iris values. 
• It transmits the detected data to the processing box via a 7-pin LEMO cable.
• Enables metadata acquisition for lenses and cameras that do not support embedding lens data on the SDI output.
  
• Includes five different types of gears for various lenses.
   
  The OCELLUS “ASR-CT1” camera tracking system will be exhibited at the NAB (National Associations of Broadcasters ) Show 2025 in Las Vegas, USA, starting April 6, 2025, at the Sony booth.