Commit Graph
145 Commits
Author SHA1 Message Date
pj cbf2c313ec test(runner): cover the logs reaching the page and failing to
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:42:16 +05:30
pj 78d57bf94f fix(runner): install the step's logs before the page extracts
On web every extractor reading is replaced by the one the page computed,
and the page answered logs: [], so noLogcatErrors counted an empty array
however full of errors the console was.

Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:41:10 +05:30
pj 3dfd5df511 test(runner): teach the web fakes to take the step's logs
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:41:06 +05:30
pj 6d72410f55 feat(chrome): install the step's logs in the page
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:39:17 +05:30
pj e18dafeba9 feat(verifier): encode state.logs for the web host
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:38:42 +05:30
pj 36caf6916f Merge branch 'web-logs-reach-the-spec' into correctness-and-spec-skills 2026-08-16 01:32:38 +05:30
pj 59da61fecb fix(chrome): keep the message of an object console argument
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:29:58 +05:30
pj 546c80885e docs(ioscompanion): name the vacuity behind the empty log slice
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:27:02 +05:30
pj c420b84768 Merge branch 'held-step-soundness' into correctness-and-spec-skills 2026-08-16 01:26:55 +05:30
pj beb036d2c1 fix(chrome): record console levels on the logcat scale
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:23:45 +05:30
pj 9b1fbdf60f fix(chrome): keep a log entry the level scale cannot rank
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:23:17 +05:30
pj a4c2a6b91c docs(driver): state the log level scale on LogEntry
Claude-Session: https://claude.ai/code/session_01ShuAy8q8ZfPi8KHxwc8JpQ
2026-08-16 01:23:04 +05:30
pj 0d588ff22f refactor(runner): name the settle predicate for what it means 2026-08-16 01:21:30 +05:30
pj 127234b58c docs(runner): say what makes the two reads comparable
the reread's comment claimed the round trip was the only interval between
them; what it left out is that the two rpcs have to read the same way, which
the repo's own android backend did not do.
2026-08-16 01:20:33 +05:30
pj 565aea77e9 docs: a bound still needs the relaunch guard, and eventually does convict 2026-08-16 01:18:35 +05:30
pj 4406d3b5ab test(ios): name the picker test for what it covers 2026-08-16 01:08:51 +05:30
pj cb45508e72 test(ios): a device driver can bring a runner up 2026-08-16 01:05:59 +05:30
pj 01f9ea942c fix(ios): one address picker for every bring-up
bringUpRunner reads the picker from a field, and NewDevice only ever set
the device one, so a device driver that reached bringUpRunner would call
nil. The two fields held the same function; keeping one leaves no path
that can be wired without it.
2026-08-16 01:05:59 +05:30
pj d124354379 test(ios): a clear-state launch for an uncleared bundle is refused 2026-08-16 01:04:58 +05:30
pj 6beea91046 fix(ios): the clear-state guard checks the bundle that was cleared
A bool only said that something was cleared, so Launch(ctx, otherBundle,
clearState=true) passed the guard and reported a reset that had reached a
different app. Record what was cleared and compare against the bundle
being launched.
2026-08-16 01:04:58 +05:30
pj 99b9fe23f5 test(ios): a device clear-state without an app path ends the run 2026-08-16 01:03:48 +05:30
pj 220c7fe1d7 fix(ios): a device clear-state that cannot happen must fail
--clear-data on a physical device with no --ios-app-path warned and then
ran anyway, so the run started on the previous run's data while the flag
said it started clean. There is no data-container wipe on a device, so
there is nothing to fall back to.
2026-08-16 01:03:48 +05:30
pj 9ede9dc3e2 test(ios): pin the stop that has to precede a clear
The ordering probe now records the stop, and a scripted xcrun holds what
reaches the tool: terminate before get_app_container, with the previous
run's files gone after. A simctl terminate that finds nothing to stop
still leaves the clear a success.
2026-08-16 01:03:02 +05:30
pj 119877c78a fix(ios): stop the app before clearing its state
Launch terminated and then cleared; the clear moved to construction and
left nothing stopping the app first. The container wipe deletes files a
live app still holds open, and the CI ios leg passes no app path so the
wipe is the path it takes. simctl stops it, since the clear now runs
before any automation session exists. On a device the uninstall that is
its only clear takes the running app with it.
2026-08-16 01:02:57 +05:30
pj 33c585de7b fix(testrun): a run that judged nothing is not a green run
every step skipped means no property ever evaluated, so no violations is the
absence of a verdict rather than a clean one. the hold makes that reachable
now, so the run says it instead of exiting 0.
2026-08-16 01:02:29 +05:30
pj 8e37be2afd test(runner): pin both guard writes to what the spec reads
deleting lastAction.Relaunched or lastAction.Applied left the whole suite
green, so the only producer of the two fields every spec-side guard reads
had nothing holding it. both now assert the value out of the trace.
2026-08-16 01:01:03 +05:30
pj f911079e32 test(ios): drive the launch recovery with what the transports return
The wedged-session fake answered with ctx.Err() raw, which is the one
shape the guard already matched. The recovery now runs against the error
each transport really produces for the same expiry, taken from a runner
and a legacy companion that never answer.
2026-08-16 01:00:49 +05:30
pj f1a5db886e fix(ios): recognise every shape a blown launch bound arrives in
The runner transport reports a blown budget two ways, its own comment says
so: the context's error once cancellation has landed, and the connection's
i/o timeout when the deadline armed from that context fires first. The
legacy transport reports it as a gRPC status. errors.Is against
context.DeadlineExceeded only matches the first, so the session restart
never fired for the other two and a wedged session stayed wedged.
2026-08-16 01:00:45 +05:30
pj 0a7afbabec test(runner): pin what the two reads are compared on
structuralShape excluding text and bounds is the decision separating this
feature from a run that verifies nothing, and only prose held it. adding
either field back now turns a case red.
2026-08-16 00:59:13 +05:30
pj 86da6ed8ee fix(runner): a bounded hold puts the swallow back one step later
the hold carries one action; letting the runner act again while the verifier
is still skipped overwrites it, so the carried action reaches no spec. hold
for as long as the verifier is skipped, and settle on a held step so the
reread pair is not tighter than the window the detector was measured over.
2026-08-16 00:57:36 +05:30
pj ea952378fe test(android): name the uninstall failure for what it says, not why 2026-08-16 00:07:58 +05:30
pj 87aa7d9284 docs(android): say why the uninstall text cannot be read 2026-08-16 00:07:12 +05:30
pj 6234bf5ba0 fix(ios): a failed devicectl uninstall must fail the reinstall
same hole as the simulator path: devicectl install over an app keeps its data, and the discarded uninstall error hid it. Uninstalling a bundle id that is not installed exits 0 with 'App uninstalled.' on a paired iPhone, so a failure here is always real.
2026-08-16 00:02:36 +05:30
pj abc5e7db3e fix(ios): a failed simctl uninstall must fail the reinstall
simctl install over an installed app carries its data container across, so discarding the uninstall error reported a clear-state that never happened. Uninstalling an app that is not installed exits 0 on a booted simulator, so every failure here is a real one.
2026-08-16 00:01:40 +05:30
pj 1ec6eb3847 fix(android): a refused uninstall must not pass for clear-state
adb uninstall answers Failure [DELETE_FAILED_INTERNAL_ERROR] both when the package was never installed and when it refuses to remove one, so the failure text cannot say which happened and the old code installed over the top either way, keeping the data clear-state was asked to drop. Ask pm path instead, and fall back to pm clear when the app is still there.
2026-08-16 00:00:36 +05:30
pj 48e901bd9b Merge branch 'android-home-diagnostic' into trial-merge 2026-08-15 22:51:48 +05:30
pj e61b39f2e3 test(testrun): cover the sidecar shutdown path after an early exit 2026-08-15 22:46:47 +05:30
pj 708a8a2929 fix(testrun): report a sidecar that dies at startup as the exit it was 2026-08-15 22:42:26 +05:30
pj f819dad7b6 fix(testrun): preflight resolves adb through the sdk, not just PATH 2026-08-15 22:39:38 +05:30
pj a5f86334af fix(android): say what the sdk lookup checked, not just to set ANDROID_HOME 2026-08-15 22:36:50 +05:30
pj b415323b08 Merge branch 'relaunch-signal-and-badge-reach' into trial-merge 2026-08-15 21:52:19 +05:30
pj cc2e0ecc35 docs(runner): describe both modes of the composing test driver 2026-08-15 21:46:30 +05:30
pj 7d4e85f407 refactor(runner): drop the empty branch from the hold path 2026-08-15 21:44:21 +05:30
pj dba9da8575 Merge branch 'ios-clear-before-session' into trial-merge 2026-08-15 21:43:31 +05:30
pj 5aee168098 fix(runner): hold the action back on a step nothing verified 2026-08-15 21:42:48 +05:30
pj 9f8afab9c0 test(runner): a skipped step must not swallow the action before it 2026-08-15 21:42:48 +05:30
pj fef80e00ff fix(testrun): thread clear-data into the ios drivers 2026-08-15 21:31:53 +05:30
pj 67da9313dd fix(ios): the device path clears before its runner session too 2026-08-15 21:31:53 +05:30
pj aed65976e3 fix(ios): clear app state before the automation session attaches
New performs the clear-state reset, so the uninstall and reinstall no
longer land underneath a live XCTest session that is already bound to
the app. Launch refuses a clear-state request the driver was not built
for rather than reinstalling under its own session.
2026-08-15 21:31:48 +05:30
pj 985c6befdd test(runner): cover the reread's cost to the existing snapshot rules 2026-08-15 21:30:21 +05:30