Twiggy

A SmaLL-FOOTPRINT REFERENCE DESIGN MODULE FOR DEPTH SENSING, TRACKING AND PROJECT TANGO APPLICATIONS, UTILIZING NU4000

A SmaLL-FOOTPRINT REFERENCE DESIGN MODULE FOR DEPTH SENSING, TRACKING AND PROJECT TANGO APPLICATIONS, UTILIZING NU4000

General

The Twiggy-HD is a compact sized reference design hosting Inuitive’s NU4000 3D Imaging and Vision Processor. Twiggy-HD addresses key functionalities required from mobile XR (AR/VR/MR) platforms as well as smartphones.

Use cases

  • Accurate augmentation: generate 3D positioning that is dense, stable and accurate
  • Gesture recognition: allow hands based gestures as user interface
  • AP offload: control, acquire data, synchronize and time stamp data from multiple sensors to offload the main application processor

Key Features

The Twiggy-HD provides Inuitive’s best of breed combination of Depth Sensing with vision technologies:

  • Real-time depth map generation at 0.5%- 1% accuracy
  • 6DoF pose estimation and feature tracking for SLAM (Simultaneous Localization and Mapping)

Key Benefits

  • Optimized for dimension-sensitive platforms
  • Operates at all lighting conditions, from darkness to daylight
  • System offload, enabled by Vision Processor cores and a strong general-purpose processor, backed up with ultra-fast hardware accelerators
  • Active Stereoscopic IR cameras for Depth Sensing
  • Fisheye camera for SLAM (external add-on module)
  • Supports Android OS, Linux and Windows
  • Seamless integration with customer-designed applications
    • Easy-to-use API
    • Wide ecosystem of third-party technologies/applications to be used
  • Configurable depth sensing range: (0.2 – 1.0) and/or (0.5 –  4) meters (using the ‘Alternating Mode’)

Smart Sensor Hub

The Twiggy-HD platform performs real-time processing, capable of synchronizing, time-stamping and processing inputs from multiple sensors, hence serving as a smart sensor hub.

BLOCK DIAGRAM

Key Parameters

General Parameters

Parameter Value Units Comments
Parameter
Power consumption
Value
0.55
Units
W
Comments
Depth only, 5FPS, 4m, VGA
Parameter
Module size – X
Value
43.6
Units
mm
Comments
Parameter
Module size – Z
Value
11.5
Units
mm
Comments
Parameter
Module size – Z
Value
5
Units
mm
Comments
Parameter
Minimum operating temperature
Value
0
Units
ᴼC
Comments
Parameter
Maximum operating temp
Value
50
Units
ᴼC
Comments
Ambient conditions

Depth Image Generation

Parameter Value Units Comments
Parameter
Sensor
Value
OV9282
Units
N/A
Comments
2 sensors on board
Parameter
Max Sensor Resolution
Value
1280x800
Units
Pixels
Comments
Parameter
Frame rate
Value
30
Units
Fps
Comments
Preliminary
Parameter
IR Projector
Value
Heptagon Lima2
Units
Comments
Parameter
Baseline
Value
35
Units
mm
Comments
Parameter
Minimum depth sensing range
Value
0.25 / 0.12
Units
M
Comments
0.25 – long range mode, 0.2 – short range mode
Parameter
Maximum depth sensing range
Value
4.0 / 1.0
Units
M
Comments
4.0 – long range mode, 1.0 – short range mode
Parameter
Depth accuracy at maximum range
Value
1.8
Units
%
Comments
Will be <1% once NU3000 is replaced with NU4000
Parameter
Max Field of view
Value
65x40
Units
Comments

Tracking

Parameter Value Units Comments
Parameter
Sensor
Value
OV7251
Units
N/A
Comments
2 monochrome sensors on board
Parameter
Resolution
Value
640x480
Units
Pixels
Comments
VGA. Sensor supports QVGA as well
Parameter
Frame rate
Value
Over 100
Units
Fps
Comments
@VGA Resolution
Parameter
DFOV
Value
166.5
Units
Comments
Fisheye
Parameter
IMU
Value
BMI-160
Units
N/A
Comments
6 DOF. Utilizes a Gyro and an Accelerometer, can incorporate an external Magnetometer
close