carlos / platform Public

harness: Run 8 G10 FAIL (claimtrial2 create accepted, install stalls), evidence g10-run8

claude 4 days ago 73394d0e83dcc6a42336b963b668daffdd56bfb1 parent ebb88cb

18 files changed, +245 −0

harness/RUNLOG.md +36 −0
harness/evidence/g10-run8/a-claim-etag-1.txt +16 −0
harness/evidence/g10-run8/a-claim-etag-2.txt +16 −0
harness/evidence/g10-run8/a-claim-exec-kathleen-juggling.json +0 −0
harness/evidence/g10-run8/a-claim.json +1 −0
harness/evidence/g10-run8/b-record-versions.txt +1 −0
harness/evidence/g10-run8/b-record.json +1 −0
harness/evidence/g10-run8/c-leo-journals-db.txt +8 −0
harness/evidence/g10-run8/c-leo-root-state.txt +28 −0
harness/evidence/g10-run8/collected-at.txt +1 −0
harness/evidence/g10-run8/control_host-actors.json.versions +16 −0
harness/evidence/g10-run8/d-leo-journal-1247-1249.txt +3 −0
harness/evidence/g10-run8/e-sophie-all-journal-1246-1250.txt +15 −0
harness/evidence/g10-run8/e-sophie-console-journal-1246-1250.txt +8 −0
harness/evidence/g10-run8/f-versions-1240-1252.txt +16 −0
harness/evidence/g10-run8/status_boxes_ada-letterpress.json.versions +29 −0
harness/evidence/g10-run8/status_boxes_kathleen-juggling.json.versions +29 −0
harness/evidence/g10-run8/status_consoles_dev-console.json.versions +21 −0

CI cancelled — superseded by a newer push — run details

CI log

=== gate ===
cd launchctx && go vet ./... && go test ./... -count=1
ok  	amadan.net/carlos/platform.git/launchctx	0.012s
?   	amadan.net/carlos/platform.git/launchctx/controlname	[no test files]
?   	amadan.net/carlos/platform.git/launchctx/wireid	[no test files]
go vet ./...
gofmt -l .: clean
go test ./... -count=1 -timeout 30m

amadan: job cancelled — a newer push superseded it

diff --git a/harness/RUNLOG.md b/harness/RUNLOG.md

index dcc62cd37..3d5767562 100644

--- a/harness/RUNLOG.md

+++ b/harness/RUNLOG.md

@@ -1316,3 +1316,39 @@ cohort1-20261020T121705Z (backfill_publish.go hashes the Store.Get body).` The e

CLI prints `instances create: unexpected response (status 202)` and exits 1 (`instances_cli.go` has no 202 path;

a CLI defect for the owner). Until the CLI is fixed, read 202 as "accepted", not as a failed attempt; check the

claim (`control/hosts/<host>.json`, `.op.kind`) and do not retry.

+### Run 8: G10 FAIL

+- B4 steps 1-3 (12:31-12:34Z): wc4 stand-in `4a79c656...`; nothing under `apps/bab/claimtrial2/`; `box_inspect` rev 15;

+ the "Paused state" resume block (bucket substituted): `console-config` dry run and apply

+ (`CARLOS_HOST_CLAIM=1`), restart, `claim-console.env 5df17bac 73 600 root`, console pid 513 as carlos with

+ `CARLOS_HOST_CLAIM=1`, run sweep and seeds pass lines back, healthz 200. `apps create claimtrial2`, `ship ...

+ wc4` (`shipped claimtrial2 wc4`), `promote ... wc4 edge`, store-mode `instances enable ... --pool cohort1`:

+ `{"schema":1,"app":"claimtrial2","domain":"dev.harness.test","pool":"cohort1","channel":"edge"}`.

+- `status/consoles/dev-console.json` did not move until **12:46:36Z**, 15 minutes after the resume restart: the

+ console's collision guard refuses to overwrite a report younger than 15 minutes from another PID namespace or boot

+ (`hostReportCollision`/`hostReportProcessGone`, `internal/console/hostreports.go:133-147`,

+ `hostreports_process_linux.go:80-107`); the previous report (12:26:53Z) came from sophie's previous container

+ start (pidns 4026532761 vs 4026532824). A box reboot on dev does the same (C9 note).

+- Timed pair, attempt 1 (`blocks/b4-pair.sh`): `console-report` dry run and apply at 12:46:52Z (sophie's report

+ 25 s old): PASS. `instances create` at 12:46:54Z: **`instances create: unexpected response (status 202)`**: the

+ console accepted the create asynchronously (202 with `operation_id`; the CLI has no 202 path, C11).

+- The claim (`control/hosts/claimtrial2.dev.harness.test.json`, op `creating` `f96f2afa`, executor

+ `kathleen-juggling`) and the record (`acq f96f2afa`) were written; leo acked at 12:47:09Z (ack `lease_etag

+ "dd9c0579..."`, `expires 12:48:39.746Z`). It never completed: leo logs `provision: claim install

+ claimtrial2.dev.harness.test: hostbox: selected authority changed` (12:48:18Z) and `agent: regional claims:

+ hostbox: selected authority changed` each minute; op still `creating` at 12:50:44Z, no route. **G10: FAIL.**

+ Failure action: no further attempt (the door did not refuse; the create was accepted and stalled), evidence

+ captured. Snapshot **`g10-stuck-run8`**.

+- Evidence (`harness/evidence/g10-run8/`): the claim object unchanged across two reads a minute apart (etag

+ `a0c96407`, written 12:47:09.819Z); the exec lease object rewritten every 20 s (etag changes); leo's report at

+ 12:42:15Z and **12:48:15Z** (inside the ack window, v0.28.12, `host_claim_enabled true`); the console's report

+ 12:46:37Z; roster rev 16 (12:46:54Z) with leo `active`, enrollment `2e0246b2` = the executor's; no fence. The

+ console's only lines in the window are its 2-minute claim recovery pass (12:47:37Z, 12:49:37Z) ending

+ `console: claim recovery: hostops: required contract unavailable` (three joined ErrContract lines), the same as

+ every pass since its claim-mode start at 12:31:37Z. Candidate (for the owner): `hostops.Backfill.read`

+ accepts only phase `adopting` (`internal/hostops/backfill.go:171`), and the plan is `done`.

+- A site-tagging debug release (v0.28.14, every `return` of `hostbox.ErrChanged`/`ErrUnsupported` tagged) was

+ built to go on leo through a normal `system update`; it did not get there: session 6's `publish-identity`

+ refused (`claim activation: phase, revision, or actor inputs refused`, 13:03:01Z) and the promote answered

+ `carlos system update: system pointer does not verify` (13:03:04Z). Held at the coordinator's word.

diff --git a/harness/evidence/g10-run8/a-claim-etag-1.txt b/harness/evidence/g10-run8/a-claim-etag-1.txt

new file mode 100644

index 000000000..95bacc02f

--- /dev/null

+++ b/harness/evidence/g10-run8/a-claim-etag-1.txt

@@ -0,0 +1,16 @@

+"a0c96407fec8a4c8432a4dfedefb36ec" 2026-10-20T12:47:09+00:00 1a5f2495-7725-44fa-8922-8daee2bd6f3d

+control/hosts/claimtrial2.dev.harness.test.json 2026-10-20T12:47:09.819000+00:00 "a0c96407fec8a4c8432a4dfedefb36ec" 1844

+control/hosts/claimtrial2.dev.harness.test.json 2026-10-20T12:46:54.835000+00:00 "92a040bdc77ba25adcd0d1d488e39fcf" 1456

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:51:11.336000+00:00 "1543c29ee25bae6bd1e98cbf7e436d43" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:50:51.200000+00:00 "25313624dc2317a625a5a21f043bb17a" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:50:31.058000+00:00 "196d75a30af6eb21091f09a71d57d1fd" 83

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:50:10.925000+00:00 "06c1eb3102d91db051c99babdb92f665" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:49:50.780000+00:00 "cd11a0886e76cd0064fa43697928b39a" 83

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:49:30.655000+00:00 "8f92b4030243cf0f29e87b15166474f4" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:49:10.524000+00:00 "2f14731c4fa474ee8aae8578b0384004" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:48:50.411000+00:00 "ff9c5afa627fe98e263f5e858118ad4e" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:48:30.281000+00:00 "cc43b19c6c078781e35eb90831a8a9c7" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:48:10.145000+00:00 "5aeafc6eb7c54db2c4905c840a81d2d2" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:47:50.027000+00:00 "b46b293669d014f0306e10cc8bedc90e" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:47:29.888000+00:00 "1e43a0b6c534fb34b4a2ff33eb526487" 84

+control/hosts/claimtrial2.dev.harness.test/exec/kathleen-juggling.json 2026-10-20T12:47:09.767000+00:00 "dd9c05797970fd1cdc108bf02b7f705e" 84

diff --git a/harness/evidence/g10-run8/a-claim-etag-2.txt b/harness/evidence/g10-run8/a-claim-etag-2.txt

new file mode 100644

index 000000000..95bacc02f

--- /dev/null

+++ b/harness/evidence/g10-run8/a-claim-etag-2.txt