Semantic SLAM for Spatial AI

LG Electronics 2023

Confidential project. Internal figures and numbers are not shown.

Hydra on real data: the metric-semantic mesh of a building floor and its 3D scene graph.
Hydra on real data: the metric-semantic mesh of a building floor and its 3D scene graph.

Overview

Platform
Handheld rig
Sensors
Depth camera, RGB camera, IMU
Environment
Two floors of a KAIST building
Sensor inputsdepth, semantics, odometry
Mesh and places
Objects and rooms
Loop closing

Highlighted: my part.

My Part

Real-sensor inputs

Depth, semantics (HRNet trained on ADE20K, mapped to 20 classes), and odometry wired into Hydra.

Loop closing with Quatro

Replaced TEASER++ with our gravity-aligned Quatro; revisited floors stopped drifting apart in height.