Commit Graph
288 Commits
Author SHA1 Message Date
pj bc73975604 docs(replay-ui): name the viewport the tab overflow was measured at 2026-08-15 21:03:55 +05:30
pj e686362fb6 docs(runner): point the guard comment at the renamed test 2026-08-15 21:03:43 +05:30
pj 94a1d59d60 test(runner): an overlay dismissal must not convict the counting property 2026-08-15 21:03:23 +05:30
pj 2d789d7d17 feat(folio): judge a submit against the account's own balance
The counting invariant can only close its window on Home, and the iOS run
in #78 went 117 steps between two Home readings: 37 submits against a rise
of 15 transactions is no evidence about the double tap sitting inside it.
The ledger and the add-transaction screen both show the account's own
balance, and an accepted submit pops back to the ledger, so a window
bounded by those readings holds one action.

The bound is an upper one: a balance that has not moved is a commit still
in flight, a rejected submit or a tap that never landed, and none of those
is a violation. Moving by more than the one submit in the window typed is.
2026-08-15 21:03:07 +05:30
pj 578ead6554 test(replay-ui): drive the fuzzer onto a violating step with a panel 2026-08-15 21:01:10 +05:30
pj 5be530bf17 fix(replay-ui): wrap the tab strip so its last tabs stay clickable 2026-08-15 20:57:55 +05:30
pj 047c53a2e7 test(browser): the cross-host fixture uses the object selector form 2026-08-15 20:52:43 +05:30
pj 4324573d97 test(verifier): both ax.find selector forms resolve the same element 2026-08-15 20:51:43 +05:30
pj ad63c5eb74 fix(hierarchy): object selectors resolve by the same rule as string ones 2026-08-15 20:50:55 +05:30
pj 4ac969bb3f fix(folio): attribute a created account by its whole key, not a suffix
createdAccountHasNonZeroBalance matched the created card with endsWith, so
an older account whose name ends with the typed one ("Emergency Fund" for a
typed "Fund") was judged instead whenever the new card was clipped out of
the reading. Build both keys the card can carry, the plain name and web's
initials + name, and compare them whole.
2026-08-15 20:49:38 +05:30
pj a7e94c85df test(ios): a refusal the runner names costs no session restart
The session restart is for a launch that never answers. A launch that
reports the app's state has already said what a fresh session would.
2026-08-15 20:49:35 +05:30
pj 73736ab26f fix(ios): the runner must not answer ok for a launch that failed
XCTest records a refused launch as a test issue that never throws, so the
companion returned ok for an app that never started. Check the state the
app actually reached and report the refusal instead.
2026-08-15 20:49:31 +05:30
pj 4caafafb1d Merge branch 'ci-hygiene-and-fmt' into trial-merge 2026-08-15 20:49:20 +05:30
pj b425cd0267 Merge branch 'android-ime-verify' into trial-merge 2026-08-15 20:49:20 +05:30
pj c50bf56cf3 style(sidecar): bring the last three lines under the line limit 2026-08-15 20:48:39 +05:30
pj 7623ca7a21 fix(folio): uninstall before installing in just ios
folio's signed-in session lives in the data container, which an install
over the top keeps, so a local run started right after just ios opened on
the previous run's Home screen and diverged at step 1. On CI's fresh
simulator the uninstall is a no-op, so the ios leg is unchanged.
2026-08-15 20:43:28 +05:30
pj 56d6aa53f1 test: pin that a nested undefined does not survive the wire 2026-08-15 20:42:36 +05:30
pj ca969f495a fix(runner): keep the action the app was relaunched after 2026-08-15 20:42:20 +05:30
pj 99160b4c12 test(verifier): pin the relaunch field on both hosts 2026-08-15 20:42:20 +05:30
pj 365418f73e feat(verifier): report a relaunch on state.lastAction 2026-08-15 20:42:20 +05:30
pj 3865c6515d ci: move every action off the node20 runtime
checkout v4->v7, setup-go v5->v7, setup-node v4->v7, setup-java v4->v5,
upload-artifact v4->v7, cache v4->v6, upload-pages-artifact v3->v5,
deploy-pages v4->v5, setup-chrome v1->v2, setup-android v3->v4,
goreleaser-action v6->v7. setup-bun and android-emulator-runner are
already node24; buf-setup-action stays on its deliberate SHA pin.

setup-chrome v2 resolves stable from Chrome for Testing rather than the
official installer, so the ci.yml comment about the action's default no
longer held.
2026-08-15 20:41:39 +05:30
pj 0cef5bd1d3 test(spec): name the shadow match in the grammar both hosts parse 2026-08-15 20:39:21 +05:30
pj e62b08dffd test(browser): compare ax.find across both hosts on one page 2026-08-15 20:39:18 +05:30
pj 46f2969350 test(runner): a relaunch must not convict the submit counting property 2026-08-15 20:38:17 +05:30
pj 26a1eda68d ci(folio): say what the android gate found, not why
The gate proves only that AddTransactionScreen is absent from the trace.
Claiming the run never got past login was an inference it cannot make: the
run that produced it had logged in and was stuck on the new account screen.
Name the routes the trace does record instead.
2026-08-15 20:37:07 +05:30
pj 3fe972946d fix(spec): deepQueryAll returns matches in document order 2026-08-15 20:35:05 +05:30
pj 4d8e790bf1 style(sidecar): make ktlint clean, formatting only
ktlint -F over every kotlin file except DriverBackend.kt, then hand
fixes where the reflow read worse and for the long lines ktlint cannot
break. No behaviour changes.

DriverBackend.kt is left untouched to avoid a conflict with concurrent
work; its three over-long lines still fail fmt-kotlin.
2026-08-15 20:34:21 +05:30
pj 3cc7f6a4b6 test(spec): give the fake dom a real tree and a walking querySelectorAll 2026-08-15 20:32:05 +05:30
pj e584cb316f fix(folio): cap a transaction at one million dollars 2026-08-15 20:31:07 +05:30
pj a6fdcb5825 fix(folio): reject amounts parseCents cannot represent 2026-08-15 20:31:03 +05:30
pj f11bcd795e test(folio): add commonTest source sets to core and shared 2026-08-15 20:30:59 +05:30
pj cf517097b8 Merge branch 'android-ime-verify' into trial-merge 2026-08-15 20:14:32 +05:30
pj 7ea9e2e6de docs(sidecar): record why the stale ime flag stays out of reach 2026-08-15 20:11:09 +05:30
pj 0352a2882e Merge branch 'ios-frontboard-retry' into trial-merge 2026-08-15 19:51:22 +05:30
pj 9583aa365f Merge branch 'android-ime-targets' into trial-merge 2026-08-15 19:51:22 +05:30
pj 9dc1d2d41b Merge branch 'recalibrate-ios-seed' into trial-merge 2026-08-15 19:51:22 +05:30
pj 24adf74245 Merge branch 'add-apache-license' into trial-merge 2026-08-15 19:51:22 +05:30
pj e45fcfd04b docs(ci): the ios leg does not convict on the runner, and a seed cannot fix it
seed 28 reproduced its walk on macos-15 and reached the bug at the step it
convicts at locally. it still could not be judged: the run did not return
home between step 19 and step 136, so the counting invariant saw a rise of
15 against a window of 37 submits.
2026-08-15 19:39:38 +05:30
pj 0929ae54bf test(ios): the restart a blown launch triggers has to be bounded 2026-08-15 19:31:24 +05:30
pj f073f2cc74 fix(ios): share one deadline across the restart and the second launch
the recovery a blown bound triggers now costs at most launchRecoveryTimeout
whatever it spends it on, so the launch path tops out at 150s and testrun's
three minute backstop stays a backstop.
2026-08-15 19:31:24 +05:30
pj 8baea14245 test(ios): cover the session replacement a wedged launch needs 2026-08-15 19:24:27 +05:30
pj d64781ce39 fix(ios): replace the session when a launch blows its bound
a launch the simulator refuses is never reported: xctest records it as a test
failure the runner cannot see, then holds the session's main thread for about
four minutes on a diagnostic chain. so the only signal is the expired bound,
and every later call queues behind the same wedge. restart the session once and
launch again, bounded so the launch path stays inside testrun's backstop.
2026-08-15 19:24:23 +05:30
pj 788c68c777 docs(ci): record what the ios calibration assumes and where it was measured 2026-08-15 18:52:59 +05:30
pj 3713b8cfb8 ci(folio): drop the stale frontboard note from the ios job 2026-08-15 18:52:59 +05:30
pj ca454483e1 ci(folio): let the ios leg clear state for itself 2026-08-15 18:52:58 +05:30
pj 4bbab3ff4c fix(sidecar): treat a failed ime probe as no keyboard open 2026-08-15 16:23:16 +05:30
pj 7d36c2a513 test(sidecar): pin the guarded ime dismissal 2026-08-15 16:16:29 +05:30
pj 276c05ac84 fix(sidecar): close the soft keyboard after typing on android 2026-08-15 16:16:29 +05:30
pj 7a28e8c4e6 docs: add the apache 2.0 license text
package.json has declared Apache-2.0 since the first release and .goreleaser.yaml
globs LICENSE* into the archives, so that glob has been matching nothing. npm
only picks up a license from the package directory, hence the copy under
pkg/spec.
2026-08-15 15:55:19 +05:30
pj 11f72a722a follow-ups from the pr #73 review (#77)
* ci(folio): run gradle on jdk 21 for the metro plugin

the metro gradle plugin folio builds with publishes org.gradle.jvm.version 21
and java 21 class files, so every leg failed at the folio build on a 17
runtime. local builds pass on jdk 25, which is why only ci saw it.

* fix(build): clean pkg/spec/dist, not the dead spec-api path

* chore: point stale spec-api comments at pkg/spec

* fix(spec): publish src so an installed package carries the runtime entries

* fix(testrun): alias the installed spec package so one module graph loads

* fix(spec): export Direction, ScrollAction and LongPressAction from the entry

* docs(spec): cut the package readme to a description and doc links

* docs: say how the cli and spec package versions relate

* fix(verifier): report whether the last action was confirmed applied

Both hosts get applied: true when the runner saw the dispatch succeed and
applied: null when it could not, so an unconfirmed action stops arriving at
the spec as no action at all.

* fix(runner): an apply error leaves the action's fate unknown, not undone

A deadline that fires after the tap was dispatched leaves the effect
committed. Reporting nil made the spec see an effect with no action to cause
it, which is how the counting property convicts a healthy app.

* fix(release): stage the sidecar jar at the renamed embed path

* test(replay-ui): trace fixtures for the vacuity counts

one real green run, one run that rendered nothing, one that judges every property at least once.

* ci(replay-ui): count the steps each property judged

the exit code says no property returned false; it does not say any property was ever evaluated. this reads the trace and reports judged vs declined per property, and fails when the step page never rendered.

* test(replay-ui): cover the summary script from make test

* ci(replay-ui): summarise through the vacuity script

* docs(ci): explain the replay-ui judged/declined counts

* fix(verifier): encode element-valued extractors into the trace

An ax element exports with its find/findAll host functions attached, and
json.Marshal refuses the whole value over them: json: unsupported type:
func(goja.FunctionCall) goja.Value. The encoding failed, curr stayed nil,
and the goja hosts (ios, android) recorded null for every element-valued
extractor in both the per-step diff and the violation witness.

Apply the web host's sanitize rule before marshaling, so one rule encodes
an element on both hosts.

* test(verifier): pin element encoding to one rule on both hosts

* test(runner): assert an element reaches trace.jsonl and its witness

* feat(spec): give state.lastAction an applied field

Three states, not two: no action is a null lastAction, applied: true is an
action the runner confirmed, applied: null is one it dispatched and never
learned the fate of.

* fix(folio): do not attribute an effect to an unconfirmed action

submitChangesBalanceByTypedAmount and createdAccountHasNonZeroBalance both
convict by pinning an effect on the last action, so both decline unless the
runner saw it applied. The fixtures now say which fate they mean.

* test(folio): an unconfirmed submit belongs in the window

The count is an upper bound on the submits a window holds, so the tap that may
have landed counts and committedTransactionsExceedSubmits has nothing to
convict on.

* test(runner): a tap that lands under a failed apply is not a double submit

Drives the real folio counting predicates through the runner against a device
that commits the tap and then times out. The double-submit case is the control:
without it a green proves only that the property never fired.

* test(verifier): pin the three lastAction states on both hosts

The web page is handed the same applied field the goja object exposes, so a
property cannot read one thing on native and another on web.

* docs(spec-language): document the three lastAction states
2026-08-15 15:51:33 +05:30