M4.3TE

A REFERENCE DESIGN MODULE FOR AR, ROBOT & MOBILE APPLICATIONS

A REFERENCE DESIGN MODULE FOR AR, ROBOT & MOBILE APPLICATIONS

General

The M4.3TE is a compact sized reference design hosting Inuitive’s NU4000 vision processor, a dedicated multi-core processor optimized for 3D image processing, computer vision, and AI. The highly power efficient M4.3TE is the leading solution for implementing 3D sensing and computer vision in consumer electronic devices. The M4.3TE is designed to function as a self-contained, self-sufficient depth sensor module, functioning as an independent sub-system and generating fully processed depth information to its host.

In addition, the M4.3TE includes several sensors that are controlled and timed by the NU4000. Data generated by the sensors and
processed in real-time by the NU4000 is used to generate 3D information. M4.3TE addresses key functionalities required from
mobile XR (AR/VR/MR) platforms as well as smartphones.

Use cases

  • Accurate augmentation: generate 3D positioning that is dense, stable and accurate
  • Gesture recognition: allow hands-based gestures as user interface
  • AP offload: control, acquire data, synchronize and time stamp data from multiple sensors to offload the main application processor

Key Features

The M4.3TE provides Inuitive’s best of breed combination of depth sensing with vision technologies:

  • Real-time depth map generation at 0.5%- 1% accuracy
  • 6DoF pose estimation and feature tracking for SLAM (Simultaneous Localization and Mapping)

Key Benefits

  • Optimized for dimension-sensitive platforms
  • Operates at all lighting conditions, from darkness to daylight
  • System offload, enabled by Vision Processor cores and a strong general-purpose processor, backed up with ultra-fast hardware accelerators
  • Active Stereoscopic IR cameras for Depth Sensing
  • Fisheye camera for SLAM (external add-on module)
  • Supports Android OS, Linux and Windows
  • Seamless integration with customer-designed applications
    • Easy-to-use API
    • Wide ecosystem of third-party technologies/applications to be used
  • Configurable depth sensing range: (0.2 – 1.0) and/or (0.5 –  4) meters (using the ‘Alternating Mode’)

Smart Sensor Hub

The M4.3TE platform performs real-time processing, capable of synchronizing, time-stamping and processing inputs from multiple sensors, hence serving as a smart sensor hub.

BLOCK DIAGRAM

Key Parameters

General Parameters

Parameter Value Units Comments
Parameter
Power consumption
Value
0.55
Units
W
Comments
Depth only, 5FPS, 4m, VGA
Parameter
Module size – X
Value
43.6
Units
mm
Comments
Parameter
Module size – Z
Value
11.5
Units
mm
Comments
Parameter
Module size – Z
Value
5
Units
mm
Comments
Parameter
Minimum operating temperature
Value
0
Units
ᴼC
Comments
Parameter
Maximum operating temp
Value
50
Units
ᴼC
Comments
Ambient conditions

Depth Image Generation

Parameter Value Units Comments
Parameter
Sensor
Value
OV9282
Units
N/A
Comments
2 sensors on board
Parameter
Max Sensor Resolution
Value
1280x800
Units
Pixels
Comments
Parameter
Frame rate
Value
30
Units
fps
Comments
Preliminary
Parameter
IR Projector
Value
Heptagon Lima2
Units
Comments
Parameter
Baseline
Value
35
Units
mm
Comments
Parameter
Minimum depth sensing range
Value
0.25 / 0.12
Units
M
Comments
0.25 – long range mode, 0.2 – short range mode
Parameter
Maximum depth sensing range
Value
4.0 / 1.0
Units
M
Comments
4.0 – long range mode, 1.0 – short range mode
Parameter
Depth accuracy at maximum range
Value
1.8
Units
%
Comments
Will be <1% once NU3000 is replaced with NU4000
Parameter
Max Field of view
Value
65x40
Units
Comments

Tracking

Parameter Value Units Comments
Parameter
Sensor
Value
OV7251
Units
N/A
Comments
2 monochrome sensors on board
Parameter
Resolution
Value
640x480
Units
Pixels
Comments
VGA. Sensor supports QVGA as well
Parameter
Frame rate
Value
Over 100
Units
Fps
Comments
@VGA Resolution
Parameter
DFOV
Value
166.5
Units
Comments
Fisheye
Parameter
IMU
Value
BMI-160
Units
N/A
Comments
6 DOF. Utilizes a Gyro and an Accelerometer, can incorporate an external Magnetometer
close