SwarmDeck — three surfaces, one recorder

A flight recorder for an agent swarm. The PC does the work and the capturing; the phone is the brain you carry; the glasses are a glance. Same recorder feeds all three.

The three versions, as they actually look

PC · desktop review + daemon

localhost:8140

SwarmDeck — runs

20260719-092040 · agent · done · 5 steps

1.5snavigate — example.com
1.7snote — landed on page
1.7sclick — 'More information' link
2.4s⚑ flag — needs a look

screen.mp4 · drill-down evidence

20260719-093140 · teach · done · demo

0.0snote — TEACH demo

Timeline first, video second — scan ten agents in seconds, tap into footage only where it looks wrong.

Also the daemon: capture + control + serves this page. Runs from run.bat.

Mobile · the hub (full control)

http://192.168.1.20:8140 ⟳

Pair

Live

Teach

Demo

Auth refactor demo

running12 steps

Checkout playbook

doneplaybook ✓ · 20 steps

Nav bug repro

needs you7 steps · 1 ⚑

Same capabilities as the desk: Teach starts/stops a PC recording, Demo launches an agent, tap a run to review + pull the video onto the phone.

Secrets + recording archive live on the phone (the APK rule).

Glasses · live glance (viewer)

track 3 · ⚑ flagged
14 steps · running

live · newest frame

SWARMDECK · LIVE

No install, no typing. A web URL opened once via the Meta AI app dev mode. Shows the newest frame + a step feed.

Glance only — you never scrub video on the lens. Additive display: bright mint on black.

Do you need an installer? — per surface

Surface	Install	How	Prereq
PC (daemon)	Yes — a run script	Run `setup.bat` once, then `run.bat` to start. It prints the LAN address to pair.	Python 3.10+ & Edge (both already on this machine)
Mobile (APK)	Yes — sideload once	Install `SwarmDeck-0.1-hub-debug.apk` via `adb install` or copy to phone & tap. Built & ready.	Android 10+, "install unknown apps" on
Glasses	No install	Open the daemon/relay URL as a Web Verknüpfung in Meta AI app developer mode. It's just a web page.	Meta Ray-Ban Display, dev mode unlocked

The logic & UX — two ways in, one pipeline out

1 · Describe → drive

You (or Claude) write a task in words. A swarm agent runs it with its own hands, recorded.

task text
  ▼
agent · own browser + Windows input
  ▼  every action wrapped
actions.jsonl  +  screen.mp4
  ▼
review: timeline ▸ video

2 · Demonstrate → learn

Hit record, do it once yourself. The recorder captures it; Claude distills a playbook you can edit before any agent runs it.

you do the task once
  ▼  screen + clicks + windows
demo recording
  ▼  claude -p distills
playbook.md  (you edit)
  ▼
agent replays it → recorded again

The one rule that ties it together

The action timeline is always captured and is the primary review surface — video is drill-down evidence keyed to it. An audit trail with an off-switch isn't an audit trail. That timeline is also the only view that fits the glasses, so it's what the swarm's status feed is built from.

SwarmDeck v0.1 · PC daemon (verified) · mobile hub APK (built, 15 MB) · glasses viewer · thin cloud relay (spec, not deployed). Cloud never holds recordings — the phone is the archive of record.