The idea
Two people build inside one simulation, with books, ramps, and cereal boxes mapped to connected coordinate frames in separate rooms.
How it works
- Map local tabletops to a shared world coordinate system.
- Exchange object and simulation state so each person sees the same build from their own room.
- Invite a friend to build the other side of a bridge, ramp, or puzzle.
AI’s role: Help place recognizable objects and translate collaborative intent; deterministic networked simulation owns object positions and game rules.
First demonstration
A virtual car crosses a real cardboard bridge in one home and emerges through a portal into the second player’s room.
What to solve next
How can local coordinate frames stay aligned as objects and phones move between homes?