M4.3VN

A refrence design module for the NU4000AI 3D image and computer vision processor

A refrence design module for the NU4000AI 3D image and computer vision processor

General

The M4.3VN is a reference design module that integrates deep learning, 3D computer vision and image processing functions. The M4.3VN is based on Inuitive’s NU4000AI multi-core processor SoC which is optimized for 3D image processing, computer vision and AI.

The power efficient M4.3VN is the leading solution for implementing 3D sensing and computer vision into consumer electronic devices. The M4.3VN is designed to function as a self-contained, selfsufficient depth sensor (at narrow Fov), vision and AI processor
module. It functions as an independent sub-system, generating fully processed depth information to its host.

The M4.3VN primary processing unit is Inuitive’s multi-core NU4000AI processor. In addition, the M4.3VN includes tracking and RGB sensors. These sensors are controlled and time stamped by the NU4000AI. Data generated by the sensors (and processed
in real-time by the NU4000AI) is used to generate a hybrid tracking based on 2D, 3D and IMU.

For design flexibility and enhanced performance, M4.3VN reference
design is comprised of two sub-modules:

  • M4.3VN EOM (Electro Optical Module) – the EOM hosts the cameras, the projector and the IMU.
  • M4.3V Base – the base includes the NU4000AI IC, various interfaces, power-management circuit and other peripherals.

Key Features

  • Active stereo depth sensor based on IR pattern illumination and IR monochrome sensors
    • 0.3-3 or 0.5-4 meters range (configurable settings)
  • Narrow Field of View (65⁰x40⁰ FoV)
  • RGB camera sensor, registered to the depth sensor
  • 2 monochromatic Fish Eye cameras for tracking
  • Utilizes Inuitive’s NU4000AI multi-core computer vision and 3D image processor
  • On-board Interial Measurements Unit (IMU)
  • Low power, small size
  • Target Markets:
    • VR Head Mounted Displays (HMD)
    • AR/MR Glasses
    • Robots
    • Drones
  • Enables AI processing on NU4000AI
  • Supports Inuitive AI framework
  • Supports Windows, Linux, and Android OSs
  • Operates in all lighting conditions (from darkness to daylight)
  • API for easy Application-Layer Design
  • On-chip Feature Tracking algorithms
  • Smart speakers
  • Home security cameras
  • Accessories

Block Diagram

Key Parameters

General Parameters

Parameter Value Units Comments
Parameter
Power consumption
Value
1.1
Units
W
Comments
Depth only, 30FPS, 4ms exposure, total power for EOM + Base
Parameter
Module size - X
Value
114.8
Units
mm
Comments
M4.3V EOM
Parameter
Module size – Y
Value
16.6
Units
mm
Comments
M4.3V EOM
Parameter
Module size - Z
Value
8.8
Units
mm
Comments
M4.3V EOM
Parameter
Minimum operating temperature
Value
0
Units
ᴼC
Comments
Parameter
Maximum operating temperature
Value
50
Units
ᴼC
Comments
Ambient conditions, preliminary results
Parameter
Host Interface
Value
USB-type C
Units
Comments
USB 3.0 and USB 2.0 compliant

Depth Image Generation

Parameter Value Units Comments
Parameter
Sensor
Value
OV9282
Units
N/A
Comments
2 monochrome sensors on board
Parameter
Sensor Resolution
Value
1280x800
Units
Pixels
Comments
Actual depth map size slightly smaller
Parameter
Frame rate
Value
60
Units
fps
Comments
Sensor supports 130 fps (@720p), 180 fps (@ VGA) and more.
Parameter
Baseline
Value
100
Units
Mm
Comments
Parameter
Minimum depth sensing range
Value
0.3/0.5
Units
m
Comments
Configurable settings
Parameter
Maximum depth sensing range
Value
3.0/4.0
Units
m
Comments
Configurable settings
Parameter
Depth accuracy at maximum range
Value
1
Units
%
Comments
Parameter
Field of view
Value
65x40
Units
Degrees
Comments

Tracking

Parameter Value Units Comments
Parameter
Sensor
Value
OV7251
Units
Comments
2 monochrome sensors on board
Parameter
Resolution
Value
640x480
Units
Pixels
Comments
VGA sensor supports QVGA as well
Parameter
Frame rate
Value
Up to 100
Units
fps
Comments
@VGA Resolution
Parameter
DFOV
Value
166.5
Units
ᴼC
Comments
Fisheye
Parameter
IMU
Value
BMI-160
Units
Comments
6 Axis. Utilizes a Gyro and an Accelerometer

RGB

Parameter Value Units Comments
Parameter
Sensor
Value
OV2685
Units
N/A
Comments
Parameter
Resolution
Value
1600x1200
Units
Pixels
Comments
Parameter
Frame rate
Value
60
Units
fps
Comments
Parameter
FOV
Value
60x45
Units
Degrees
Comments
close