gate PROBE 3 (revert me): run only root@0 beside rest
Probe 2 (d0227a68) finished the gate with the root package skipped, so the runner's TERM follows the root CLI tests. This run keeps rest and runs only root@0 of the root package.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
1 file changed,
+6
−3
.amadan/test-gate.sh+6 −3
CI failed — run details
CI log
amadan: log truncated — showing the last 409444 bytes of 639016
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabb: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabb: ok true
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabb: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:27 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:27 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabc: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabc: ok true
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabc: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:27 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:27 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabd: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabd: ok true
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabd: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:27 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:27 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:27 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:27 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:27 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:27 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabe: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabe: ok true
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabe: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:28 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:28 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabf: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabf: ok true
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabf: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:28 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:28 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabg: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabg: ok true
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabg: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:28 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabh: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabh: ok true
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabh: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:28 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabh: estimate write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:28 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:28 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:28 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:28 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:28 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabi: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabi: ok true
2026/10/24 00:28:28 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabi: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:29 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabi: estimate write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:29 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:29 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:29 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabj: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabj: ok true
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabj: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:29 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabj: estimate write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:29 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:29 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabk: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabk: ok true
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabk: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabk: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:29 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabk (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:29 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:29 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabl: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabl: ok true
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabl: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabl: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:29 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabl (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:29 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:29 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:29 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:29 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:29 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:29 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:29 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabm: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabm: ok true
2026/10/24 00:28:29 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabm: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabm: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:30 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabm (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:30 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:30 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:30 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabn: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabn: ok true
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabn: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabn: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:30 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabn (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:30 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:30 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabo: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabo: ok true
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabo: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabo: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:30 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabo (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:30 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:30 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabp: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabp: ok true
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabp: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabp: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:30 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabp (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:30 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:30 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:30 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:30 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:30 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:30 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:30 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:30 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabq: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabq: ok true
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabq: staged round: 4 object(s) changed, 3232 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabq: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:31 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabq (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:31 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:31 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabr: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabr: ok true
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabr: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabr: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:31 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabr (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:31 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:31 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabs: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabs: ok true
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabs: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabs: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:31 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabs (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:31 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 ERROR compaction failed system=store db=shop.example.com.db level=9 error="invalid argument"
2026/10/24 00:28:31 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:31 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabt: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabt: ok true
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabt: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:31 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabt: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:31 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabt (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:31 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:31 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:31 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:31 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:31 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:31 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabu: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabu: ok true
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabu: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabu: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabu (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:32 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabv: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabv: ok true
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabv: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabv: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabv (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:32 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:32 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabw: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabw: ok true
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabw: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabw: abort write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabw: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabw (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:32 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabx: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabx: ok true
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabx: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabx: abort write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:32 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabx: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:32 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaabx (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:32 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:32 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:32 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:32 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:32 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:33 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaby: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaby: ok true
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaby: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:33 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaby: abort write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaby: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:33 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaby (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:33 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:33 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:33 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:33 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabz: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaabz: ok true
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaabz: staged round: 5 object(s) changed, 4073 bytes copied; 5 of 5 objects staged
2026/10/24 00:28:33 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaabz (was ready)
shop.example.com: config updated
2026/10/24 00:28:33 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaca: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaca: ok true
2026/10/24 00:28:33 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaca: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:33 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaaca (was ready)
shop.example.com: config updated
2026/10/24 00:28:33 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:33 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:33 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:33 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:33 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:34 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacb: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacb: ok true
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacb: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:34 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacb (was ready)
shop.example.com: config updated
2026/10/24 00:28:34 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:34 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:34 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:34 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:34 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:34 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacc: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacc: ok true
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacc: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:34 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacc (was ready)
shop.example.com: config updated
2026/10/24 00:28:34 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:34 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:34 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:34 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:34 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:34 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:34 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacd: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacd: ok true
2026/10/24 00:28:34 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacd: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:34 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacd (was ready)
shop.example.com: config updated
2026/10/24 00:28:35 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:35 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:35 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:35 ERROR retention enforcement failed system=store db=shop.example.com.db error="enforce snapshot retention: remove ltx files: s3: delete batch of 1 objects: operation error S3: DeleteObjects, https response error StatusCode: 405, RequestID: , HostID: , api error MethodNotAllowed: MethodNotAllowed"
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 ERROR enforce L0 time retention system=store db=shop.example.com.db error="remove expired l0 files: s3: delete batch of 1 objects: operation error S3: DeleteObjects, https response error StatusCode: 405, RequestID: , HostID: , api error MethodNotAllowed: MethodNotAllowed"
2026/10/24 00:28:35 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:35 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaace: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaace: ok true
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaace: staged round: 5 object(s) changed, 4073 bytes copied; 5 of 5 objects staged
2026/10/24 00:28:35 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaace (was ready)
shop.example.com: config updated
2026/10/24 00:28:35 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:35 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacf: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacf: ok true
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacf: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:35 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacf (was ready)
shop.example.com: config updated
2026/10/24 00:28:35 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:35 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:35 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:35 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:35 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:35 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:35 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacg: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacg: ok true
2026/10/24 00:28:35 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacg: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:36 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacg (was ready)
shop.example.com: config updated
2026/10/24 00:28:36 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:36 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:36 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:36 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaach: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaach: ok true
2026/10/24 00:28:36 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaach: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:36 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaach (was ready)
shop.example.com: config updated
2026/10/24 00:28:36 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:36 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaci: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaci: ok true
2026/10/24 00:28:36 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaci: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:36 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaaci (was ready)
shop.example.com: config updated
2026/10/24 00:28:36 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:36 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:36 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:36 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:36 ERROR retention enforcement failed system=store db=shop.example.com.db error="enforce snapshot retention: remove ltx files: s3: delete batch of 1 objects: operation error S3: DeleteObjects, https response error StatusCode: 405, RequestID: , HostID: , api error MethodNotAllowed: MethodNotAllowed"
2026/10/24 00:28:36 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:36 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:36 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacj: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacj: ok true
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacj: staged round: 5 object(s) changed, 4073 bytes copied; 5 of 5 objects staged
2026/10/24 00:28:37 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacj (was ready)
shop.example.com: config updated
2026/10/24 00:28:37 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaack: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaack: ok true
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaack: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:37 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaack (was ready)
shop.example.com: config updated
2026/10/24 00:28:37 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacl: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacl: ok true
2026/10/24 00:28:37 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacl: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:37 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaacl: start write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:37 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacl (was ready)
shop.example.com: config updated
2026/10/24 00:28:37 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:37 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:37 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:37 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:37 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:37 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacm: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacm: ok true
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacm: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:38 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaacm: start write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:38 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacm (was ready)
shop.example.com: config updated
2026/10/24 00:28:38 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:38 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:38 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:38 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:38 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacn: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacn: ok true
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacn: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:38 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaacn: start write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:38 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacn (was ready)
shop.example.com: config updated
2026/10/24 00:28:38 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:38 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:38 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:38 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:38 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:38 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaco: ok true
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:38 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaaco (was ready)
shop.example.com: config updated
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:38 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:38 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:38 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:38 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:38 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 4: invalid argument"
2026/10/24 00:28:38 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000002 size=841
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: sealed at TXID 3 (4 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:38 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: sealed
2026/10/24 00:28:38 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:38 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaaco (app "app" acct "bac")
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaco: landed; every item is OK
2026/10/24 00:28:39 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:39 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacp: ok true
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:39 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacp (was ready)
shop.example.com: config updated
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: sealed at TXID 3 (4 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: sealed
2026/10/24 00:28:39 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:39 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacp (app "app" acct "bac")
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacp: landed; every item is OK
2026/10/24 00:28:39 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacq: ok true
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:39 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacq (was ready)
shop.example.com: config updated
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:39 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000003 size=880
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: sealed at TXID 3 (4 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: sealed
2026/10/24 00:28:39 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:39 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacq (app "app" acct "bac")
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacq: landed; every item is OK
2026/10/24 00:28:39 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:39 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:39 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:39 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:39 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:39 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:39 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacr: ok true
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:40 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacr (was ready)
shop.example.com: config updated
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: sealed
2026/10/24 00:28:40 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:40 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacr (app "app" acct "bac")
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacr: landed; every item is OK
2026/10/24 00:28:40 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:40 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacs: ok true
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:40 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacs (was ready)
shop.example.com: config updated
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: sealed at TXID 3 (4 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: sealed
2026/10/24 00:28:40 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:40 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacs (app "app" acct "bac")
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacs: landed; every item is OK
2026/10/24 00:28:40 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:40 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:40 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:40 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:40 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:40 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaact: ok true
2026/10/24 00:28:40 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:40 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaact (was ready)
shop.example.com: config updated
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: sealed at TXID 3 (4 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: sealed
2026/10/24 00:28:41 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:41 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaact (app "app" acct "bac")
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaact: landed; every item is OK
2026/10/24 00:28:41 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:41 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:41 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacu: ok true
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:41 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacu (was ready)
shop.example.com: config updated
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: sealed at TXID 3 (3 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: sealed
2026/10/24 00:28:41 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:41 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacu (app "app" acct "bac")
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacu: landed; every item is OK
2026/10/24 00:28:41 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacv: ok true
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:41 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacv (was ready)
shop.example.com: config updated
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:41 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: sealed at TXID 3 (3 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: sealed
2026/10/24 00:28:41 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:41 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacv (app "app" acct "bac")
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:41 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacv: landed; every item is OK
2026/10/24 00:28:41 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:41 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:41 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:41 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:41 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:41 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:41 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacw: ok true
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:42 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacw (was ready)
shop.example.com: config updated
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 INFO compaction complete system=store db=shop.example.com.db level=2 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: sealed
2026/10/24 00:28:42 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:42 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacw (app "app" acct "bac")
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacw: landed; every item is OK
2026/10/24 00:28:42 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:42 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:42 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacx: ok true
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:42 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacx (was ready)
shop.example.com: config updated
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:42 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:42 INFO compaction complete system=store db=shop.example.com.db level=2 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: sealed at TXID 3 (6 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: sealed
2026/10/24 00:28:42 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:42 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacx (app "app" acct "bac")
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacx: landed; every item is OK
2026/10/24 00:28:42 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:42 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:42 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:42 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:42 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:42 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacy: ok true
2026/10/24 00:28:42 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:43 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacy (was ready)
shop.example.com: config updated
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: sealed
2026/10/24 00:28:43 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:43 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacy (app "app" acct "bac")
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacy: landed; every item is OK
2026/10/24 00:28:43 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaacz: ok true
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:43 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaacz (was ready)
shop.example.com: config updated
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: sealed at TXID 3 (3 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: sealed
2026/10/24 00:28:43 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:43 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaacz (app "app" acct "bac")
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaacz: landed; every item is OK
2026/10/24 00:28:43 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:43 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:43 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaada: ok true
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:43 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaada (was ready)
shop.example.com: config updated
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: sealed
2026/10/24 00:28:43 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaada: flip write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:43 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:43 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaada (app "app" acct "bac")
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:43 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaada: landed; every item is OK
2026/10/24 00:28:43 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:43 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:43 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:43 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:43 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:43 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadb: ok true
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:44 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaadb (was ready)
shop.example.com: config updated
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 INFO compaction complete system=store db=shop.example.com.db level=2 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: sealed
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadb: flip write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:44 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:44 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaadb (app "app" acct "bac")
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadb: landed; every item is OK
2026/10/24 00:28:44 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadc: ok true
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:44 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaadc (was ready)
shop.example.com: config updated
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:44 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: sealed at TXID 3 (3 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: sealed
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadc: flip write: context deadline exceeded (confirming from the record)
2026/10/24 00:28:44 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:44 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaadc (app "app" acct "bac")
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadc: landed; every item is OK
2026/10/24 00:28:44 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:44 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000002 size=841
2026/10/24 00:28:44 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadd: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadd: ok true
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadd (shop.example.com): aborting: could not determine the replica's size on ie-box
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadd (shop.example.com): aborted could not determine the replica's size on ie-box
2026/10/24 00:28:44 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:44 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:44 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:44 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:44 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaade: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaade: ok true
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaade (shop.example.com): aborting: could not determine the replica's size on ie-box
2026/10/24 00:28:44 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaade (shop.example.com): aborted could not determine the replica's size on ie-box
2026/10/24 00:28:44 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:44 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:44 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadf: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadf: ok true
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadf (shop.example.com): aborting: this account's files are too large to move this way
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadf (shop.example.com): aborted this account's files are too large to move this way
2026/10/24 00:28:45 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:45 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO compaction complete system=store db=shop.example.com.db level=2 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadg: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadg: ok true
2026/10/24 00:28:45 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadh: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadh: ok true
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadh: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadh: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadh: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadh: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:45 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadi: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadi: ok true
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadi: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:45 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:45 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadj: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadj: ok true
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadj: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadj (shop.example.com): sealed, the seal not read: the copy's bytes are unknown (no copy timing)
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadj: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:45 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadj: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:45 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:45 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:45 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:45 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:45 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:45 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadk: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadk: ok true
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadk: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:46 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000002 size=841
2026/10/24 00:28:46 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadl: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadl: ok true
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadl: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:46 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadl: waiting: this move is offline-landed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:46 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadl: waiting: this move is offline-landed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:46 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadl: waiting: this move is offline-landed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:46 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadm: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadm: ok true
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadm: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:46 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadn: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadn: ok true
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadn: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:46 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:46 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:46 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaado: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaado: ok true
2026/10/24 00:28:46 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaado: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:46 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:46 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:46 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:46 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:46 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadp: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadp: ok true
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadp: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:47 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadp (shop.example.com): an operator started the move; the job yields it
2026/10/24 00:28:47 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:47 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadq: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadq: ok true
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadq: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:47 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadq (shop.example.com): an operator started the move; the job yields it
2026/10/24 00:28:47 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:47 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadr: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadr: ok true
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadr: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:47 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadr (shop.example.com): an operator started the move; the job yields it
2026/10/24 00:28:47 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:47 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:47 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaads: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaads: ok true
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaads: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:47 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaads (shop.example.com): an operator started the move; the job yields it
2026/10/24 00:28:47 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:47 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:47 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:47 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:47 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:47 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadt: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadt: ok true
2026/10/24 00:28:47 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadt: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadt (shop.example.com): an operator started the move; the job yields it
2026/10/24 00:28:48 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:48 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadu: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadu: ok true
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadu: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadu: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadu: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadu: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:48 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:48 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadv: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadv: ok true
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadv: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadv: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadv: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadv: waiting: Waiting for ie-box in ie to confirm it has stopped shop.example.com. shop.example.com is offline.
2026/10/24 00:28:48 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:48 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadw: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadw: ok true
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadw: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadw: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadw: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadw: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:48 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaadw: waiting: this move is offline-sealed. run carlos move offline status --host shop.example.com to see what it waits for
2026/10/24 00:28:48 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:48 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadx: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadx: ok true
2026/10/24 00:28:48 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadx: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:48 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:48 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:48 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:48 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:48 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:48 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaady: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaady: ok true
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaady: staged round: 4 object(s) changed, 3232 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadz: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaadz: ok true
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaadz: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaea: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaea: ok true
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaea: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 4: invalid argument"
2026/10/24 00:28:49 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000002 size=841
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaec (shop.example.com): aborted the move could not be started
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:49 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaee: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:49 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaed (shop.example.com): aborted another move is in flight
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeg: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:49 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaef (shop.example.com): aborted another move is in flight
2026/10/24 00:28:49 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:49 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:49 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:49 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:49 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:49 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:49 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeh: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaei (shop.example.com): the record is offline-queued, behind the row's barrier; the row is left where it is
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaei (shop.example.com): the record is offline-queued, behind the row's barrier; the row is left where it is
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaei (shop.example.com): the record is offline-queued, behind the row's barrier; the row is left where it is
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaej: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaej: ok true
2026/10/24 00:28:50 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaej: staged round: 3 object(s) changed, 2479 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:50 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaek (shop.example.com): aborted the instance was recreated
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000002 size=841
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaael (shop.example.com): aborting: a run is open on this instance: run_1. wait for it to finish or cancel it, then move the instance
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaael (shop.example.com): aborted a run is open on this instance: run_1. wait for it to finish or cancel it, then move the instance
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaem (shop.example.com): aborting: shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
2026/10/24 00:28:50 provision: skipping record apps/bac/app/instances/shop.example.com.json: invalid shape: steering "canary": want "" or "latency"
2026/10/24 00:28:50 provision: skipping record apps/bac/app/instances/shop.example.com.json: invalid shape: steering "canary": want "" or "latency"
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaem (shop.example.com): aborted shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaen: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaen: ok true
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaen: stage write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaen: stage write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaen: stage write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaen: stage write: faultStore: the reply was lost (confirming from the record)
2026/10/24 00:28:50 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaen (shop.example.com): faultStore: the reply was lost
2026/10/24 00:28:50 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:50 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000001.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:50 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:50 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:50 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:50 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:50 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeo: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaeo: ok true
2026/10/24 00:28:50 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeo: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:51 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:51 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaep: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaep: ok true
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaep: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:51 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaep: abort write: provision: record apps/bac/app/instances/shop.example.com.json: incarnation 1 record_seq 4, expected 1 and 3: store: compare-and-swap conflict (confirming from the record)
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaep: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:51 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaep (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:51 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeq: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaeq: ok true
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaeq: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:51 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:51 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaer: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaer: ok true
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaer: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:51 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaes: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaes: ok true
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaes: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:51 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaes: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:51 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaes (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:51 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:51 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:51 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:51 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:51 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:51 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaet: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaet: ok true
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaet: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaet: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:52 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaet (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:52 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:52 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaeu (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:52 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaev (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:52 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaew: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaew: ok true
2026/10/24 00:28:52 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaew (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:52 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaex: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaex: ok true
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaex: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaex: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:52 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaex (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:52 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:52 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:52 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:52 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:52 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:52 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaey: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaey: ok true
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaey: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:52 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaey: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:53 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaey (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:53 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:53 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:53 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaaez: ok true
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:53 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaaez (was ready)
shop.example.com: config updated
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: sealed
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaaez (app "app" acct "bac")
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: landed; every item is OK
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: wake fence lifted
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: opened; the row is ready and adoption stages its build
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: waiting for reconcile to remove the row
2026/10/24 00:28:53 provision: removed retired instance route shop.example.com (record gone)
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaaez: tombstone lifted
2026/10/24 00:28:53 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaaez (shop.example.com): done
2026/10/24 00:28:53 moves: shop.example.com: reported the leftovers of move mv_mvjobaaaaaaaaaaaaaaaaaaaez for return request 1792801733520828343-console-e2e-job-144792ad
2026/10/24 00:28:53 moves: shop.example.com: reported the leftovers of move mv_mvjobaaaaaaaaaaaaaaaaaaaez for return request 1792801733540602454-console-e2e-job-1e676f71
2026/10/24 00:28:53 moves: shop.example.com: reported the leftovers of move mv_mvjobaaaaaaaaaaaaaaaaaaaez for return request 1792801733555286068-console-e2e-job-b7f366f4
2026/10/24 00:28:53 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:53 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaafa: ok true
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:53 provision: held shop.example.com moving by mv_mvjobaaaaaaaaaaaaaaaaaaafa (was ready)
shop.example.com: config updated
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:53 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:53 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:53 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: sealed at TXID 3 (3 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: sealed
2026/10/24 00:28:53 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafa (shop.example.com): sealed, the seal not read: the copy's bytes are unknown (no copy timing)
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: minted instance route shop.example.com held landing by mv_mvjobaaaaaaaaaaaaaaaaaaafa (app "app" acct "bac")
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: landed; every item is OK
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: wake fence lifted
2026/10/24 00:28:53 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: opened; the row is ready and adoption stages its build
2026/10/24 00:28:53 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:54 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:54 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:54 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: waiting for reconcile to remove the row
2026/10/24 00:28:54 provision: removed retired instance route shop.example.com (record gone)
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafa: tombstone lifted
2026/10/24 00:28:54 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafa (shop.example.com): done
2026/10/24 00:28:54 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:54 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_pgz3i5vzk7dpxiv5fpivnnb6ta: lane probe of data-uk/moves/_lane/mv_pgz3i5vzk7dpxiv5fpivnnb6ta: ok true
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_pgz3i5vzk7dpxiv5fpivnnb6ta: staged round: 3 object(s) changed, 2435 bytes copied; 3 of 3 objects staged
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_pgz3i5vzk7dpxiv5fpivnnb6ta: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:54 console: self-serve move mv_pgz3i5vzk7dpxiv5fpivnnb6ta (shop.example.com): aborted the move was cancelled
2026/10/24 00:28:54 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:54 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:54 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_nwxhohryqylz6c5ab3ui72ztm4: lane probe of data-uk/moves/_lane/mv_nwxhohryqylz6c5ab3ui72ztm4: ok true
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_nwxhohryqylz6c5ab3ui72ztm4: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:54 console: self-serve move mv_nwxhohryqylz6c5ab3ui72ztm4 (shop.example.com): aborting: the target box already holds data for shop.example.com: /tmp/TestSelfServeAbortByFailedPrecheck1215094323/007/shop.example.com.env
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_nwxhohryqylz6c5ab3ui72ztm4: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:54 moves: parked /tmp/TestSelfServeAbortByFailedPrecheck1215094323/007/shop.example.com.env at /tmp/TestSelfServeAbortByFailedPrecheck1215094323/007/.offline-moves/shop.example.com/mv_nwxhohryqylz6c5ab3ui72ztm4/target/shop.example.com.env
2026/10/24 00:28:54 console: self-serve move mv_nwxhohryqylz6c5ab3ui72ztm4 (shop.example.com): aborted the target box already holds data for shop.example.com: /tmp/TestSelfServeAbortByFailedPrecheck1215094323/007/shop.example.com.env
2026/10/24 00:28:54 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:54 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:54 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:54 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: lane probe of data-uk/moves/_lane/mv_3p67jg4lmdoc5o37txsimnlmoe: ok true
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:54 provision: held shop.example.com moving by mv_3p67jg4lmdoc5o37txsimnlmoe (was ready)
shop.example.com: config updated
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:54 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:54 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:54 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:54 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:54 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: sealed at TXID 3 (5 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: sealed
2026/10/24 00:28:54 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:54 provision: minted instance route shop.example.com held landing by mv_3p67jg4lmdoc5o37txsimnlmoe (app "app" acct "bac")
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:54 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: landed; every item is OK
2026/10/24 00:28:54 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:55 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:55 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: wake fence lifted
2026/10/24 00:28:55 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: opened; the row is ready and adoption stages its build
2026/10/24 00:28:55 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:55 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:55 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:55 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: waiting for reconcile to remove the row
2026/10/24 00:28:55 provision: removed retired instance route shop.example.com (record gone)
2026/10/24 00:28:55 moves: shop.example.com: offline move mv_3p67jg4lmdoc5o37txsimnlmoe: tombstone lifted
2026/10/24 00:28:55 console: self-serve move mv_3p67jg4lmdoc5o37txsimnlmoe (shop.example.com): done
2026/10/24 00:28:55 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:55 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:55 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000001 size=797
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:55 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:55 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 1: invalid argument"
2026/10/24 00:28:55 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
2026/10/24 00:28:55 console: self-serve move mv_qeja2y66xdhjtuvdhqknp7n6ey: waiting: the box ie-box has not reported recently
--- FAIL: TestClaimsOffInstanceIDIsPublished (0.82s)
selfserve_operator_test.go:337: after 60 rounds, still not in staging
2026/10/24 00:28:55 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:55 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:55 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:55 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:55 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:55 INFO snapshot complete system=store db=shop.example.com.db txid=0000000000000002 size=841
2026/10/24 00:28:55 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:55 ERROR enforce L0 time retention system=store db=shop.example.com.db error="remove expired l0 files: s3: delete batch of 1 objects: operation error S3: DeleteObjects, https response error StatusCode: 405, RequestID: , HostID: , api error MethodNotAllowed: MethodNotAllowed"
2026/10/24 00:28:55 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=797
2026/10/24 00:28:56 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: lane probe of data-uk/moves/_lane/mv_5dyhewevapvxljueg7yrnd7s64: ok true
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: staged round: 4 object(s) changed, 3276 bytes copied; 4 of 4 objects staged
2026/10/24 00:28:56 provision: held shop.example.com moving by mv_5dyhewevapvxljueg7yrnd7s64 (was ready)
shop.example.com: config updated
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafc (c.shop.example.com): aborting: box x-box was replaced
2026/10/24 00:28:56 provision: minted instance route b.shop.example.com (app "app" acct "bac")
2026/10/24 00:28:56 provision: minted instance route c.shop.example.com (app "app" acct "bac")
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:56 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000003
2026/10/24 00:28:56 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000003 maxTXID=0000000000000003 size=880
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000003 txid.db=0000000000000003
2026/10/24 00:28:56 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000003.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:56 INFO compaction complete system=store db=shop.example.com.db level=1 txid.min=0000000000000002 txid.max=0000000000000003 size=880
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: checkpointed the local database (position 2, replica 2)
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: sealed at TXID 3 (6 staged objects, files sha256:d5d1e68c7c5625619df1b080c376d8a6f08442e5e03c6d5969c2d51af245789b)
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: sealed
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafc (c.shop.example.com): aborted box x-box was replaced
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 provision: minted instance route shop.example.com held landing by mv_5dyhewevapvxljueg7yrnd7s64 (app "app" acct "bac")
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: extracted the files and env
shop.example.com: config updated
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: landed; every item is OK
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: wake fence lifted
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: opened; the row is ready and adoption stages its build
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 provision: not removing shop.example.com (record gone): participant of a running operation
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: waiting for reconcile to remove the row
2026/10/24 00:28:56 provision: removed retired instance route shop.example.com (record gone)
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_5dyhewevapvxljueg7yrnd7s64: tombstone lifted
2026/10/24 00:28:56 console: self-serve move mv_5dyhewevapvxljueg7yrnd7s64 (shop.example.com): done
2026/10/24 00:28:56 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:56 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:56 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:56 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:56 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafd: queue write: provision: record apps/bac/app/instances/shop.example.com.json: incarnation 1 record_seq 1, expected 1 and 0: store: compare-and-swap conflict (confirming from the record)
2026/10/24 00:28:56 provision: converged shop.example.com steering "" -> "latency"
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafd (shop.example.com): aborting: shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafd (shop.example.com): aborted shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
2026/10/24 00:28:56 provision: minted instance route shop.example.com (app "app" acct "bac")
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:56 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000000 txid.db=0000000000000001
2026/10/24 00:28:56 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000001 maxTXID=0000000000000001 size=797
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000001
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=3 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=9 interval=24h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=1 interval=1h0m0s
2026/10/24 00:28:56 INFO starting compaction monitor system=store level=2 interval=6h0m0s
2026/10/24 00:28:56 INFO starting L0 retention monitor system=store interval=1h0m0s retention=5m0s
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000001 txid.db=0000000000000002
2026/10/24 00:28:56 INFO ltx file uploaded system=store db=shop.example.com.db replica=s3 level=0 minTXID=0000000000000002 maxTXID=0000000000000002 size=841
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 INFO replica sync system=store db=shop.example.com.db replica=s3 txid.replica=0000000000000002 txid.db=0000000000000002
2026/10/24 00:28:56 ERROR compaction failed system=store db=shop.example.com.db level=9 error="s3: upload to instances/shop.example.com/0009/0000000000000001-0000000000000002.ltx: read upload data failed: write snapshot ltx: read database page 2: invalid argument"
2026/10/24 00:28:56 console: materialized account bac (fixture) from the bucket
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafe: lane probe of data-uk/moves/_lane/mv_mvjobaaaaaaaaaaaaaaaaaaafe: ok true
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafe: staged round: 2 object(s) changed, 1638 bytes copied; 2 of 2 objects staged
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafe: start write: provision: record apps/bac/app/instances/shop.example.com.json: incarnation 1 record_seq 8, expected 1 and 7: store: compare-and-swap conflict (confirming from the record)
2026/10/24 00:28:56 provision: converged shop.example.com steering "" -> "latency"
2026/10/24 00:28:56 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafe (shop.example.com): aborting: shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
2026/10/24 00:28:56 moves: shop.example.com: offline move mv_mvjobaaaaaaaaaaaaaaaaaaafe: the staged copy in data-uk/moves/shop.example.com/ is deleted
2026/10/24 00:28:57 console: self-serve move mv_mvjobaaaaaaaaaaaaaaaaaaafe (shop.example.com): aborted shop.example.com is steered or runs under a unit. offline moves cannot carry either yet
FAIL
FAIL github.com/carlosframework/platform/internal/e2e/selfserve 36.291s
FAIL
=== e2e@3 (28 s)
ok github.com/carlosframework/platform/internal/e2e/selfserve 26.642s
=== e2e-vet (1 s)
FAILED: rest e2e@2
make: *** [Makefile:19: test] Error 1
amadan: step gate failed: exit status 2
amadan: job failed at step gate — its output is above, not at the tail of this log
diff --git a/.amadan/test-gate.sh b/.amadan/test-gate.sh| index 5ef89d5af..c33e3162b 100755 |
| --- a/.amadan/test-gate.sh |
| +++ b/.amadan/test-gate.sh |
| @@ -33,11 +33,12 @@ |
| # next) can surface here. That is a bug in the test, not in the split. |
| set -eu |
| -: "${TEST_SPLIT=}" |
| +: "${TEST_SPLIT=.=3}" |
| +: "${PROBE_ONLY=root@0}" |
| # PROBE (revert me): internal/console is not tested at all in this run, to |
| # learn whether the runner's TERM (ten runs, ~35 s after the shards start) |
| # follows the console tests. Nothing else changes. |
| -PROBE_SKIP="github.com/carlosframework/platform/internal/console github.com/carlosframework/platform" |
| +PROBE_SKIP="github.com/carlosframework/platform/internal/console" |
| weights=$(pwd)/.amadan/test-weights.tsv |
| # A shard count that is not a whole number of at least 1 would take a |
| @@ -242,7 +243,9 @@ for spec in $TEST_SPLIT; do |
| while [ "$i" -lt "$shards" ]; do |
| pattern=$(awk -v i="$i" -F '\t' '$1 == i { printf "%s%s", sep, $2; sep = "|" }' "$out/deal-$tag") |
| if [ -n "$pattern" ]; then |
| - start "$tag@$i" go test -count=1 -timeout 30m -run "^($pattern)\$" "$dir" |
| + if [ -z "$PROBE_ONLY" ] || [ "$tag@$i" = "$PROBE_ONLY" ]; then |
| + start "$tag@$i" go test -count=1 -timeout 30m -run "^($pattern)\$" "$dir" |
| + fi |
| launched=$((launched + $(awk -v i="$i" -F '\t' '$1 == i' "$out/deal-$tag" | wc -l))) |
| fi |
| i=$((i + 1)) |