← Back to Research

Room Geometry Inference

Research Visualizations

Room Geometry Inference visualization 0
Room Geometry Inference visualization 1

Proposed Model Architecture

Room Geometry Inference visualization 2

Pentagonal Room (Left: ground truth, Right: estimated)

Room Geometry Inference visualization 3

L-shape Room (Left: ground truth, Right: estimated)

Overview

Estimating indoor geometries is a crucial step in creating realistic digital twins of indoor spaces. Traditionally, methods to determine indoor geometries relied on vision-based techniques. However, creating an accurate digital twin becomes challenging when the camera-captured indoor image has hidden areas in the scene.

To overcome this challenge, we use acoustic echoes to discover room geometry. Acoustic echoes contain crucial information about indoor geometric characteristics. When an audio device emits sound, it interacts with room boundaries, and this interaction is captured as a room impulse response (RIR). Identifying invisible (non-line-of-sight) walls from measuring device position becomes possible by utilizing high-order echoes reflected from multiple walls.

Focus Areas

  • Room geometry inference using deep learning.

Related Publications