Commit Graph
100 Commits
Author SHA1 Message Date
pj 64b9087be2 Merge branch 'sanderling-property-patterns-skill' into spec-authoring-skills 2026-08-15 22:57:18 +05:30
pj d79fb3f2d6 docs(skills): name the selector keys that still substring match 2026-08-15 22:56:28 +05:30
pj 7068b03ffc docs(skills): ground the property patterns catalogue in the merged specs 2026-08-15 22:55:56 +05:30
pj 404ce4bcbb Merge branch 'spec-authoring-skills' into sanderling-property-patterns-skill 2026-08-15 22:50:56 +05:30
pj ac4846bf55 Merge branch 'trial-merge' into spec-authoring-skills 2026-08-15 22:50:21 +05:30
pj 1ca812beed docs(skills): add a property patterns catalogue skill 2026-08-15 22:48:27 +05:30
pj 049b8d513e docs(skills): add a spec review skill and the skills index 2026-08-15 22:39:47 +05:30
pj f9b13b1781 Merge branch 'sidecar-adb-and-ime' into trial-merge 2026-08-15 22:31:31 +05:30
pj 19707df04d docs(ci): the android step number describes a local emulator, not ci
the leg disables animations and the number was measured with them on. the
first real dispatch carries 4 transitional steps over 200, so the cross-fade
wait does still fire in ci, just far less often.
2026-08-15 22:25:54 +05:30
pj e67fffcab7 test(sidecar): use the tree the device really returns 2026-08-15 22:19:49 +05:30
pj 3df8a3b3ba fix(sidecar): find the erased field by class, past the keyboard's own focus
The check that decides whether the select-all worked looked for an
"editable" attribute maestro's tree does not carry, so it answered
"cannot tell" every time and every erase paid the per-character
fallback. Worse, an open keyboard puts a second focused node in the
tree, one of the IME's own keys, carrying no text: taking the first
focused node would read a field still holding 4096 characters as empty,
which is the one answer that stops the erase early.

Match the text field by class instead. Measured against the real
backend, 4096 characters now clear in 385ms on API 34, 409ms on API 35
and 870ms on API 36, verified empty, where the fallback took ~4s.
2026-08-15 22:19:49 +05:30
pj b3a565e9e9 test(sidecar): pin the constant-cost erase and its residue check 2026-08-15 22:02:52 +05:30
pj 7fa2d71e99 fix(sidecar): erase a field by selecting it, not one delete per character
maestro's eraseText sends one delete per character through its
instrumentation, measured 29.6 ms/char on the API 34 emulator. The
4096-character string the corpus types cost ~121s to clear, a fifth of a
20 minute run spent on one step, and it recurred every time that field
was typed into again.

Select the content and delete the selection instead: two key events at
any length, measured 0.15s to 1.16s for 4096 characters across API 34,
35 and 36. The result is read back off the tree, and a field that is not
empty, or that the tree cannot report on, is finished off per character
in batches rather than assumed clear.

Fixes #80
2026-08-15 22:02:43 +05:30
pj b415323b08 Merge branch 'relaunch-signal-and-badge-reach' into trial-merge 2026-08-15 21:52:19 +05:30
pj cc2e0ecc35 docs(runner): describe both modes of the composing test driver 2026-08-15 21:46:30 +05:30
pj 7d4e85f407 refactor(runner): drop the empty branch from the hold path 2026-08-15 21:44:21 +05:30
pj dba9da8575 Merge branch 'ios-clear-before-session' into trial-merge 2026-08-15 21:43:31 +05:30
pj 5aee168098 fix(runner): hold the action back on a step nothing verified 2026-08-15 21:42:48 +05:30
pj 9f8afab9c0 test(runner): a skipped step must not swallow the action before it 2026-08-15 21:42:48 +05:30
pj 6cf67e709c Merge branch 'sidecar-adb-and-ime' into trial-merge 2026-08-15 21:37:00 +05:30
pj fef80e00ff fix(testrun): thread clear-data into the ios drivers 2026-08-15 21:31:53 +05:30
pj 67da9313dd fix(ios): the device path clears before its runner session too 2026-08-15 21:31:53 +05:30
pj aed65976e3 fix(ios): clear app state before the automation session attaches
New performs the clear-state reset, so the uninstall and reinstall no
longer land underneath a live XCTest session that is already bound to
the app. Launch refuses a clear-state request the driver was not built
for rather than reinstalling under its own session.
2026-08-15 21:31:48 +05:30
pj 985c6befdd test(runner): cover the reread's cost to the existing snapshot rules 2026-08-15 21:30:21 +05:30
pj 81b737188f feat(runner): skip a step whose tree changed between two reads 2026-08-15 21:30:21 +05:30
pj 2762dc3011 test(runner): answer Snapshot and Hierarchy off one tree in the fakes 2026-08-15 21:30:15 +05:30
pj bd72b0c2f7 Merge branch 'folio-spec-attribution' into trial-merge 2026-08-15 21:27:48 +05:30
pj 5b218edb92 Merge branch 'companion-honest-launch' into trial-merge 2026-08-15 21:27:48 +05:30
pj 79dbc471b8 Merge branch 'spec-parity-holes' into trial-merge 2026-08-15 21:27:47 +05:30
pj 40bd5322b7 Merge branch 'folio-amount-bounds' into trial-merge 2026-08-15 21:27:47 +05:30
pj ec1fdc85ad test(sidecar): pin the degraded typing guard both ways 2026-08-15 21:26:51 +05:30
pj 8d7ef4d681 fix(sidecar): a foreground read that fails degrades the typing guard
An unreadable dumpsys passed a null owner to typeChunks, which switches
the mid-type focus guard off outright and lets the rest of the string
spray into whatever holds the foreground. Fall back to the launched
bundle instead: the guard stays armed, typing still happens, and the
degradation is said out loud rather than assumed away.
2026-08-15 21:26:51 +05:30
pj ae3c9fe091 feat(folio): read the amount field into every submit window
Each of the three windows asks whether the tap could have committed, off the
field as the landing frame shows it.
2026-08-15 21:24:57 +05:30
pj 6b276253e8 fix(folio): stop spending the submit budget on taps the app refused
The window is an upper bound on the transactions an interval could hold, and
a bound inflated by taps that commit nothing is a bound the app can never
exceed: #78 read a rise of 15 transactions against 37 submits. TxnSubmit is
clickable(enabled = amount.isNotBlank()) and parseCents refuses anything its
regex misses, so a tap whose landing frame shows a refused amount cannot have
committed. Over four recorded android runs that is 19, 11, 25 and 25 of 35,
26, 42 and 42 submit taps.

A relaunch is excepted: a fresh process draws an empty field whatever was
submitted.
2026-08-15 21:24:53 +05:30
pj 07e8abb9ef test(sidecar): unknown animation state must not read as idle 2026-08-15 21:23:45 +05:30
pj 9ff82b1565 fix(sidecar): an unreadable animation count is not idle
Defaulting the count to zero made a dumpsys that said nothing mean
nothing is animating, so a degraded link broke out of the settle early
and handed the runner a frame caught mid-animation. Unknown now waits,
inside the deadline waitForIdle already holds.
2026-08-15 21:23:45 +05:30
pj 34b8be2d8c test(sidecar): pin the bound on a wedged adb read 2026-08-15 21:17:09 +05:30
pj 23a2454459 fix(sidecar): bound the diagnostic adb reads
adbOutput and readLogcat read to EOF and then waited with no timeout, so
a wedged adb held the step for as long as it liked; one stall over a
remote adb server measured ~100s. The bound has to sit on the read, not
on waitFor: a wedged adb never reaches EOF, so a bounded waitFor after
the read is a line that never runs.
2026-08-15 21:17:06 +05:30
pj ff7dde4be8 test(folio): pin that two accounts can render the same card text
The proof behind the comment: "Travel1" holding 25 transactions and
"Travel12" holding 5 merge to the same string, so no identity key read off
a web card can tell them apart.
2026-08-15 21:12:36 +05:30
pj 95e0ab8afa docs(folio): say why the merged card key cannot be made injective
Folio rejects a duplicate account name, so the twin the drop rule guards
against is two names the web key cannot tell apart, not two accounts
sharing a name. State what closing the rest would cost and what the tree
would have to carry to close it properly.
2026-08-15 21:11:47 +05:30
pj 9770537aa6 fix(folio): decline the two demanding properties across a relaunch
The runner now keeps lastAction and marks it relaunched: true where it used
to report nothing at all, so the two properties that demand an effect judge
a step whose process may have died before the write landed.
submitChangesBalanceByTypedAmount and createdAccountHasNonZeroBalance both
decline there. The counting bound does not: a relaunch cannot manufacture a
transaction, and the submit is counted, so declining would throw away the
detection the runner fix restored.
2026-08-15 21:11:30 +05:30
pj 64f99babd5 docs(sidecar): put the measured read cost in the dismissal bound 2026-08-15 21:08:03 +05:30
pj f65bc1631c ci: switch to jdk 21 only for the folio step 2026-08-15 21:08:03 +05:30
pj cc32640d03 ci: run folio's unit tests on every pr 2026-08-15 21:08:03 +05:30
pj ca409ca6b8 chore(folio): a just recipe for the unit tests 2026-08-15 21:08:03 +05:30
pj fbc5102b25 chore(make): a target that runs folio's unit tests 2026-08-15 21:08:03 +05:30
pj 1e350f7fd3 test(sidecar): pin the tree-guarded keyboard dismissal 2026-08-15 21:08:03 +05:30
pj b4cd9d5cd1 fix(sidecar): close a keyboard standing in the snapshot
A tap on a text field raises the keyboard and nothing closed it, so the
tree the picker chooses from was missing every app node underneath it,
the submit control included. Close it before the read rather than after
the tap: the picker only ever sees snapshots, and the keyboard is still
on its way up when the tap returns.

Fixes #78
2026-08-15 21:08:03 +05:30
pj a71cbfc685 test(sidecar): pin the adb server endpoint parsing 2026-08-15 21:08:03 +05:30
pj 83e9d5fd95 fix(sidecar): reach the adb server the environment names
buildDadb hardcoded localhost:5037, so a serial-addressed device always
resolved through this machine's adb server and ADB_SERVER_SOCKET was
ignored. Read the endpoint the way the adb CLI does instead.

Fixes #79
2026-08-15 21:08:03 +05:30
pj 0e096c00b3 feat(folio): close the submit window on the account's own screens
submitCommitsOneTransactionPerAction now states its rule over two windows:
the Home counts it already compared, and the account balance the ledger and
the add-transaction screen redraw on nearly every frame of the transaction
flow. Same rule, and the second window is usually one action wide.
2026-08-15 21:04:39 +05:30
pj bc73975604 docs(replay-ui): name the viewport the tab overflow was measured at 2026-08-15 21:03:55 +05:30
pj e686362fb6 docs(runner): point the guard comment at the renamed test 2026-08-15 21:03:43 +05:30
pj 94a1d59d60 test(runner): an overlay dismissal must not convict the counting property 2026-08-15 21:03:23 +05:30
pj 2d789d7d17 feat(folio): judge a submit against the account's own balance
The counting invariant can only close its window on Home, and the iOS run
in #78 went 117 steps between two Home readings: 37 submits against a rise
of 15 transactions is no evidence about the double tap sitting inside it.
The ledger and the add-transaction screen both show the account's own
balance, and an accepted submit pops back to the ledger, so a window
bounded by those readings holds one action.

The bound is an upper one: a balance that has not moved is a commit still
in flight, a rejected submit or a tap that never landed, and none of those
is a violation. Moving by more than the one submit in the window typed is.
2026-08-15 21:03:07 +05:30
pj 578ead6554 test(replay-ui): drive the fuzzer onto a violating step with a panel 2026-08-15 21:01:10 +05:30
pj 5be530bf17 fix(replay-ui): wrap the tab strip so its last tabs stay clickable 2026-08-15 20:57:55 +05:30
pj 047c53a2e7 test(browser): the cross-host fixture uses the object selector form 2026-08-15 20:52:43 +05:30
pj 4324573d97 test(verifier): both ax.find selector forms resolve the same element 2026-08-15 20:51:43 +05:30
pj ad63c5eb74 fix(hierarchy): object selectors resolve by the same rule as string ones 2026-08-15 20:50:55 +05:30
pj 4ac969bb3f fix(folio): attribute a created account by its whole key, not a suffix
createdAccountHasNonZeroBalance matched the created card with endsWith, so
an older account whose name ends with the typed one ("Emergency Fund" for a
typed "Fund") was judged instead whenever the new card was clipped out of
the reading. Build both keys the card can carry, the plain name and web's
initials + name, and compare them whole.
2026-08-15 20:49:38 +05:30
pj a7e94c85df test(ios): a refusal the runner names costs no session restart
The session restart is for a launch that never answers. A launch that
reports the app's state has already said what a fresh session would.
2026-08-15 20:49:35 +05:30
pj 73736ab26f fix(ios): the runner must not answer ok for a launch that failed
XCTest records a refused launch as a test issue that never throws, so the
companion returned ok for an app that never started. Check the state the
app actually reached and report the refusal instead.
2026-08-15 20:49:31 +05:30
pj 4caafafb1d Merge branch 'ci-hygiene-and-fmt' into trial-merge 2026-08-15 20:49:20 +05:30
pj b425cd0267 Merge branch 'android-ime-verify' into trial-merge 2026-08-15 20:49:20 +05:30
pj c50bf56cf3 style(sidecar): bring the last three lines under the line limit 2026-08-15 20:48:39 +05:30
pj 7623ca7a21 fix(folio): uninstall before installing in just ios
folio's signed-in session lives in the data container, which an install
over the top keeps, so a local run started right after just ios opened on
the previous run's Home screen and diverged at step 1. On CI's fresh
simulator the uninstall is a no-op, so the ios leg is unchanged.
2026-08-15 20:43:28 +05:30
pj 56d6aa53f1 test: pin that a nested undefined does not survive the wire 2026-08-15 20:42:36 +05:30
pj ca969f495a fix(runner): keep the action the app was relaunched after 2026-08-15 20:42:20 +05:30
pj 99160b4c12 test(verifier): pin the relaunch field on both hosts 2026-08-15 20:42:20 +05:30
pj 365418f73e feat(verifier): report a relaunch on state.lastAction 2026-08-15 20:42:20 +05:30
pj 3865c6515d ci: move every action off the node20 runtime
checkout v4->v7, setup-go v5->v7, setup-node v4->v7, setup-java v4->v5,
upload-artifact v4->v7, cache v4->v6, upload-pages-artifact v3->v5,
deploy-pages v4->v5, setup-chrome v1->v2, setup-android v3->v4,
goreleaser-action v6->v7. setup-bun and android-emulator-runner are
already node24; buf-setup-action stays on its deliberate SHA pin.

setup-chrome v2 resolves stable from Chrome for Testing rather than the
official installer, so the ci.yml comment about the action's default no
longer held.
2026-08-15 20:41:39 +05:30
pj 0cef5bd1d3 test(spec): name the shadow match in the grammar both hosts parse 2026-08-15 20:39:21 +05:30
pj e62b08dffd test(browser): compare ax.find across both hosts on one page 2026-08-15 20:39:18 +05:30
pj 46f2969350 test(runner): a relaunch must not convict the submit counting property 2026-08-15 20:38:17 +05:30
pj 26a1eda68d ci(folio): say what the android gate found, not why
The gate proves only that AddTransactionScreen is absent from the trace.
Claiming the run never got past login was an inference it cannot make: the
run that produced it had logged in and was stuck on the new account screen.
Name the routes the trace does record instead.
2026-08-15 20:37:07 +05:30
pj 3fe972946d fix(spec): deepQueryAll returns matches in document order 2026-08-15 20:35:05 +05:30
pj 4d8e790bf1 style(sidecar): make ktlint clean, formatting only
ktlint -F over every kotlin file except DriverBackend.kt, then hand
fixes where the reflow read worse and for the long lines ktlint cannot
break. No behaviour changes.

DriverBackend.kt is left untouched to avoid a conflict with concurrent
work; its three over-long lines still fail fmt-kotlin.
2026-08-15 20:34:21 +05:30
pj 3cc7f6a4b6 test(spec): give the fake dom a real tree and a walking querySelectorAll 2026-08-15 20:32:05 +05:30
pj e584cb316f fix(folio): cap a transaction at one million dollars 2026-08-15 20:31:07 +05:30
pj a6fdcb5825 fix(folio): reject amounts parseCents cannot represent 2026-08-15 20:31:03 +05:30
pj f11bcd795e test(folio): add commonTest source sets to core and shared 2026-08-15 20:30:59 +05:30
pj cf517097b8 Merge branch 'android-ime-verify' into trial-merge 2026-08-15 20:14:32 +05:30
pj 7ea9e2e6de docs(sidecar): record why the stale ime flag stays out of reach 2026-08-15 20:11:09 +05:30
pj 0352a2882e Merge branch 'ios-frontboard-retry' into trial-merge 2026-08-15 19:51:22 +05:30
pj 9583aa365f Merge branch 'android-ime-targets' into trial-merge 2026-08-15 19:51:22 +05:30
pj 9dc1d2d41b Merge branch 'recalibrate-ios-seed' into trial-merge 2026-08-15 19:51:22 +05:30
pj 24adf74245 Merge branch 'add-apache-license' into trial-merge 2026-08-15 19:51:22 +05:30
pj e45fcfd04b docs(ci): the ios leg does not convict on the runner, and a seed cannot fix it
seed 28 reproduced its walk on macos-15 and reached the bug at the step it
convicts at locally. it still could not be judged: the run did not return
home between step 19 and step 136, so the counting invariant saw a rise of
15 against a window of 37 submits.
2026-08-15 19:39:38 +05:30
pj 0929ae54bf test(ios): the restart a blown launch triggers has to be bounded 2026-08-15 19:31:24 +05:30
pj f073f2cc74 fix(ios): share one deadline across the restart and the second launch
the recovery a blown bound triggers now costs at most launchRecoveryTimeout
whatever it spends it on, so the launch path tops out at 150s and testrun's
three minute backstop stays a backstop.
2026-08-15 19:31:24 +05:30
pj 8baea14245 test(ios): cover the session replacement a wedged launch needs 2026-08-15 19:24:27 +05:30
pj d64781ce39 fix(ios): replace the session when a launch blows its bound
a launch the simulator refuses is never reported: xctest records it as a test
failure the runner cannot see, then holds the session's main thread for about
four minutes on a diagnostic chain. so the only signal is the expired bound,
and every later call queues behind the same wedge. restart the session once and
launch again, bounded so the launch path stays inside testrun's backstop.
2026-08-15 19:24:23 +05:30
pj 788c68c777 docs(ci): record what the ios calibration assumes and where it was measured 2026-08-15 18:52:59 +05:30
pj 3713b8cfb8 ci(folio): drop the stale frontboard note from the ios job 2026-08-15 18:52:59 +05:30
pj ca454483e1 ci(folio): let the ios leg clear state for itself 2026-08-15 18:52:58 +05:30
pj 4bbab3ff4c fix(sidecar): treat a failed ime probe as no keyboard open 2026-08-15 16:23:16 +05:30
pj 7d36c2a513 test(sidecar): pin the guarded ime dismissal 2026-08-15 16:16:29 +05:30
pj 276c05ac84 fix(sidecar): close the soft keyboard after typing on android 2026-08-15 16:16:29 +05:30
pj 7a28e8c4e6 docs: add the apache 2.0 license text
package.json has declared Apache-2.0 since the first release and .goreleaser.yaml
globs LICENSE* into the archives, so that glob has been matching nothing. npm
only picks up a license from the package directory, hence the copy under
pkg/spec.
2026-08-15 15:55:19 +05:30