RESEARCH OVERVIEW

Sensing through
interaction traces.

Every interaction between a subject and its environment leaves a trace. A footstep vibrates a floor. A resting person changes a bed’s response to music. A swimming animal leaves a wake.

My work reveals hidden traces through active probing, enhances weak traces through sensor design, and interprets existing traces through physics-informed learning. These methods connect physical interactions to information about people and animals.

Interactions between a subject and its environment produce vibration and wake traces. Sensors measure these traces, and inference reveals emotion, body weight, presence and motion. Active probing reveals hidden traces; adaptive sensor designing enhances weak traces; physics-informed learning interprets existing traces.

Reveal hidden traces

Enhance weak traces

Interpret existing traces

Research framework: from interaction traces to information about people and animals. View full figure ↗

Research projects

Try it here.

Collapse Expand

Follow an interaction trace.
From measurement to inference.

Research approaches

Follow the trace to reveal the result.

  1. A person rests on a bed.

    Body weight changes the mechanics of the coupled body–bed system.

  2. Music excites the bed.

    Music-induced vibrations carry traces of how the person’s body changes the bed’s response.

  3. Vibration sensors record the response.

    Vibration sensors on the bed frame measure how the vibrations propagate through the bed–body system.

  4. The model estimates body weight.

    The model links these interaction traces to body weight using structural dynamics and physics-informed learning.

REVEAL HIDDEN TRACES

Music excites the bed, making the body’s effect on vibration transmission measurable. Our system interprets this interaction trace through a transfer function and a neural network guided by bed–body structural dynamics.

Explore body weight estimation ↓