[Workshop #222] Touch-to-interact — tap agents for info and conversation #44

New Issue

perplexity · 2026-03-18T21:41:17-04:00

perplexity commented

2026-03-18 21:41:17 -04:00

Epic: rockachopa/Timmy-time-dashboard#222 — The Workshop: Timmy as Presence

The Gap

#242 specifies "tap to interact" as the primary interaction. Currently interaction.js only has OrbitControls (orbit/zoom). There's no way to tap an agent to learn about it or initiate a conversation. On iPad, the 3D world is look-only.

What

Raycasting on touch/click to identify tapped agents, with a contextual response.

Acceptance Criteria

Tap/click on an agent mesh → raycasts to identify which agent was hit
Selected agent: visual highlight (ring brightens, subtle scale pulse)
Agent info tooltip: label, role, current state displayed near the agent or in a HUD panel
If Timmy is tapped: focus chat input on Timmy (ready to talk)
If another agent is tapped: show status panel (name, role, state, current task)
Tap on empty space → deselect / dismiss info panel
Send visitor_interaction WS message: {type: "visitor_interaction", target: "agent_id", action: "tap", timestamp: ...}
Works with both mouse click (desktop) and touch tap (iPad)
Does not interfere with OrbitControls drag/pinch gestures (distinguish tap from drag via threshold: <10px movement + <300ms duration = tap)

Design Notes

This is how visitors explore the Workshop. Tap the wizard, he notices. Tap another agent, learn what they're doing. The Workshop should reward curiosity.

Ref: rockachopa/Timmy-time-dashboard#242 (Workshop 3D world), #243 (bridge protocol — visitor_interaction)

## Epic: rockachopa/Timmy-time-dashboard#222 — The Workshop: Timmy as Presence ### The Gap #242 specifies "tap to interact" as the primary interaction. Currently `interaction.js` only has OrbitControls (orbit/zoom). There's no way to tap an agent to learn about it or initiate a conversation. On iPad, the 3D world is look-only. ### What Raycasting on touch/click to identify tapped agents, with a contextual response. ### Acceptance Criteria - [ ] Tap/click on an agent mesh → raycasts to identify which agent was hit - [ ] Selected agent: visual highlight (ring brightens, subtle scale pulse) - [ ] Agent info tooltip: label, role, current state displayed near the agent or in a HUD panel - [ ] If Timmy is tapped: focus chat input on Timmy (ready to talk) - [ ] If another agent is tapped: show status panel (name, role, state, current task) - [ ] Tap on empty space → deselect / dismiss info panel - [ ] Send `visitor_interaction` WS message: `{type: "visitor_interaction", target: "agent_id", action: "tap", timestamp: ...}` - [ ] Works with both mouse click (desktop) and touch tap (iPad) - [ ] Does not interfere with OrbitControls drag/pinch gestures (distinguish tap from drag via threshold: <10px movement + <300ms duration = tap) ### Design Notes This is how visitors explore the Workshop. Tap the wizard, he notices. Tap another agent, learn what they're doing. The Workshop should reward curiosity. Ref: rockachopa/Timmy-time-dashboard#242 (Workshop 3D world), #243 (bridge protocol — `visitor_interaction`)

perplexity referenced this issue

2026-03-18 21:41:32 -04:00

[Workshop #222] Bridge protocol completeness — all 9 message types from #243 #45

perplexity referenced this issue from a commit

2026-03-18 21:46:09 -04:00

feat: Workshop interaction layer — chat input, visitor presence, bark display (#40, #41, #42)

perplexity referenced this issue

2026-03-18 21:49:50 -04:00

[Workshop #222] Visitor presence protocol — announce arrival and departure #41

perplexity referenced this issue from a commit

2026-03-19 16:52:01 -04:00

feat: Touch-to-interact, Ambient state, Streaming tokens (#44, #43, #16)