NU3000

A multi-core signal processor that supports 3D Image Processing (3D depth) and Computer Vision (CV) processing

A multi-core signal processor that supports 3D Image Processing (3D depth) and Computer Vision (CV) processing

NU3000 is a multi core processor, optimized for depth sensing, 3D Image Processing and Computer Vision in consumer-electronics applications. It can interface directly and manage 3 cameras: 2 as a stereo depth source, and 1 a visible sensor (e.g. an RGB or a monochromatic Fish Eye). More cameras can be connected via a bridge. The NU3000 architecture combines dedicated hardware accelerators with vector DSPs to allow a power efficient execution of depth sensing, as well as higher-level algorithms and applications. NU3000 can manage, synchronize, and time stamp various sensors. It can also execute real-time Simultaneous Localization and Mapping algorithms (SLAM). NU3000 can serve as the core depth generating engine with a smart sensor hub and functions as the primary processor of the mapping and localization algorithms.

Key Features and parameters

  • A multi core CV and depth processor
  • Dedicated depth engine
  • 40nm geometry
  • Connects to 3 cameras
  • Size: 12X10mm
  • Command, control and interface all external elements on the module, including:

– Two RGB/IR CMOS sensors, aligned in a stereoscopic setup

– An RGB CMOS sensor, configured to function as a standard web-cam

– Multiple illumination interfaces

– An external LPDDR memory unit

  • Depth map generation, based on the information generated by the two RGB or IR sensors
  • 6DoF pose estimation and feature tracking for SLAM (Simultaneous Localization and Mapping)
  • Real time processing capable of synchronizing, timestamping and process inputs from multiple sensors to serve as a smart sensor hub.
  • Main interfaces

– Host – MIPI CSI-2 Master TX, 2 lanes or USB2/3

– Memory – High performance LPDDR2

– External – 3xConfigurable Bidirectional MIPI CSI-2:

  • Master TX or Slave RX, 2 lanes for sensor-connections,
  • 3xUART, 4xI2C, SPI for flash/other, I2S, GPIO and timers

 

NU3000 High Level Architecture
Block Diagram

close