Commit Graph
203 Commits
Author SHA1 Message Date
pj f09c6b5d4d fix(web): read aria-disabled as disabled
the enabled fact came off the disabled property, which only real form
controls have. it reads undefined on the role-based controls the
tappable set now covers, so every one of them looked enabled however
plainly it was marked otherwise, and the fuzzer would spend actions on
inert ones.

both producers answer the same two ways, and the parity fixture carries
a disabled row so the comparison covers it: reverting one side alone
names the element and the fact.
2026-08-15 12:46:24 +05:30
pj f3096d195b test(browser): tap a role-based control end to end
every control on the page is an <li role="option">, the shape the
replay ui gives its step rows, and the spec carries no action of its
own: the property firing is the evidence the default enumeration offered
a tap on one.
2026-08-15 12:46:13 +05:30
pj a460eba3db fix(web): offer the aria roles a user activates
only role=button was in the tappable set, so link, checkbox, radio,
switch, tab, option, the menuitems and treeitem were invisible to the
enumeration however plain the control looked. the replay ui builds its
step rows as <li role="option">, and the spec dogfooding it had to
hand-write an action to reach them because no default verb could see a
single row.

both producers build the set from the same role list, since the parity
test compares them element by element.
2026-08-15 12:46:05 +05:30
pj ce4f660098 test(browser): drive an undefined reading through the whole web path
four layers carry it: the page's envelope, the driver's unwrap, the
runner's count check and the verifier's decode. each has a unit test and
only a run proves they compose. goes red both ways, decoding an absent
value as null and dropping the envelope.
2026-08-15 12:45:37 +05:30
pj 85338aeaf1 fix(runner): fail when the page reports fewer readings than extractors
the comment here already claimed a partial override was fatal. it was
not: the skipped check only catches indices outside the extractor list,
so a page reporting values for some extractors and not others left the
rest holding goja's reading of the dump with nothing said.
2026-08-15 12:45:31 +05:30
pj 4b7a9e2fe2 feat(verifier): report the registered extractor count
the web path needs it to check the page sent one reading per extractor.
2026-08-15 12:45:31 +05:30
pj 45b7624280 fix(web): keep an undefined reading's index through JSON
json has no undefined, so an extractor whose getter returned one had its
whole index dropped by JSON.stringify. that index then kept goja's
dump-derived value while its neighbours held the page's, and a property
comparing previous to current across the split fires on a healthy app.
folio has nine on(route, tag) extractors, so this was most extractors on
most steps.

each reading is wrapped in a {value} envelope: the drop now happens
inside the entry, and an absent value means the getter returned
undefined, which is what the goja host records for the same getter. a
json null would instead claim it returned null and x.current ===
undefined would answer differently on the two hosts.
2026-08-15 12:45:25 +05:30
pj 63d80f293e perf(folio): read each frame once
every extractor asked routeOf, and routeOf does five ax.find calls. on
web each find walks the document and every shadow root beneath it, so
the spec cost 110 tree walks a step; homeCards was parsed four times
over. now 5 and once.

keyed on the identity of the state object because both hosts build a new
one per step and hand that one object to every getter, so it cannot
outlive its frame. holding the reference is what keeps that true rather
than likely.
2026-08-15 12:45:16 +05:30
pj ade3e77ff5 fix(folio): drop a name two cards answer to
homeTxnCountsOf keyed on the account name and let the last card win, so
two accounts the fuzzer named the same collapsed into one entry. a
reading that saw one Travel card and a later one that saw both then
subtracted two different accounts' counts, and
submitCommitsOneTransactionPerAction convicted a healthy app of
double-submitting. it is a gated property in folio-run.sh, so that reads
as "found the submit bug" over a card scrolling into view.

same rule createdAccountHasNonZeroBalance already applies: a name
nothing can attribute is no evidence. counted over every card, since an
unreadable twin spoils the identity too.
2026-08-15 12:45:09 +05:30
pj ea4d40e507 docs: six of seven, the seventh is the stock property 2026-08-14 22:49:09 +05:30
pj 61e493002e fix(web): fail on a partial extractor override
same mixed-producer hazard as the install error: some extractors hold
the page's value and the rest hold goja's, and a property comparing
across that split fires on a healthy app.
2026-08-14 22:49:09 +05:30
pj 973ca16a41 fix(chrome): anchor the transition deadline when the dom goes quiet
it was anchored at script start, so a page that churned past the window
reached the check already expired and returned mid cross-fade. the
driver now publishes the idle timeout it needs, since the caller's 1s
could never spend the 800ms window.
2026-08-14 22:48:38 +05:30
pj f738a590f0 fix(web): read the page's extractors only on steps that count
the page advances the spec's carriers when it evaluates, but the runner
applied the result only on non-transitional steps. a discarded step
moved the window forward anyway, so the next accepted pair bracketed two
transactions while counting one submit, and convicted a healthy app.
extractor errors now fail the run instead of leaving goja's values in
current against v8's in previous.
2026-08-14 22:48:38 +05:30
pj b1bf39bac5 test(sidecar): pin that a slow read counts toward the stability streak 2026-08-14 22:41:58 +05:30
pj 9f1dfe27ba docs: correct the snippets and numbers that drifted from the code 2026-08-14 22:41:53 +05:30
pj 5ad545a6ba ci: install idb-companion from its tap and stop interpolating inputs
idb-companion is not in homebrew-core, so the ios leg died before it
built anything. replay-ui expanded dispatch inputs into the shell.
2026-08-14 22:41:53 +05:30
pj f1989324a2 ci(folio): a thrown predicate is not a conviction
exit 2 means the run recorded a violation, and a predicate that throws
is recorded as one too. so was newAccountBalanceIsZero, an unrelated
property in the same spec. the gate read the exit code and went green
with detection dead.
2026-08-14 22:41:53 +05:30
pj 87b1eb0910 docs: only the repo owner merges 2026-08-14 22:23:53 +05:30
pj 85358f007e ci(folio): let the android leg run far enough to see its conviction 2026-08-14 20:40:22 +05:30
pj 129bbc7a62 fix(android): wait out a route cross-fade before snapshotting
the dump could hold two screens at once, and the runner refuses to act
on such a tree, so a quarter of android steps applied no action and the
count varied per run: the same seed never walked the same trajectory.
the ios companion and the chrome driver already do this.
2026-08-14 20:39:58 +05:30
pj 05d65841b7 docs(ci): describe the two properties and why android cannot convict 2026-08-14 19:04:15 +05:30
pj a9334b2927 ci(folio): pin the recalibrated seeds and drop android to a health gate
web 3 and ios 7 convict 3 runs out of 3 with an exactly 2x witness.
android convicts 2 in 5 because the same seed does not walk the same
trajectory there, so it proves the app runs instead.
2026-08-14 19:03:51 +05:30
pj 21ae7fde83 fix(folio): only disambiguate counts that came from merged text
the equal-length digit rule exists because web merges the card and an
account named -1 makes '12' ambiguous. a dedicated count node has
nothing to disambiguate, so applying it there threw away real evidence.
2026-08-14 19:03:21 +05:30
pj 9efed1f669 test(folio): cover transition frames, card readings and creation 2026-08-14 16:33:11 +05:30
pj d31de3b247 fix(folio): never read a frame that shows two screens
android dumps a cross-fade with both screens in the tree. the route said
add-transaction while an unscoped find said home, so the oracle took a
half-rendered total as fresh and convicted on a tap that committed
nothing. one function now decides the route and returns null when the
frame is ambiguous.
2026-08-14 16:33:11 +05:30
pj 6f7e690750 test(folio): pin the window rules and the count invariant 2026-08-14 13:52:28 +05:30
pj e5900712b8 fix(folio): read the app's own total and refuse contaminated windows
summing cards went null when one was clipped, and the null poisoned the
carrier for the rest of the run. the balance window also spanned every
transaction since the last home visit, so the property convicted on
deltas it could not attribute: the old web witness was 3.16x the typed
amount, not 2x.
2026-08-14 13:52:28 +05:30
pj 6f0ee85eec feat(folio): tag the home total and the card transaction count
the total was the only untagged node on the screen, so the spec had to
sum cards and a clipped card broke the sum.
2026-08-14 13:52:28 +05:30
pj a6474dc911 docs: write down the silent-vacuity failure modes 2026-08-14 11:58:48 +05:30
pj 32b6869526 docs: stop teaching the zero-default that caused a false alarm 2026-08-14 11:23:00 +05:30
pj 646c3663e0 test(folio): pin the safe-integer guard and its boundary 2026-08-14 11:22:07 +05:30
pj 0ad8a015ca fix(folio): stop convicting on arithmetic float64 cannot hold
past 2^53 cents the gap between representable values is 128, so a real
1600-cent move reads back as something else and the equality is false
for a healthy submit as readily as a double one. also match parseCents:
a sign or an oversized amount is rejected, not read as an amount.
2026-08-14 11:22:07 +05:30
pj e591cdf6bf docs(ci): correct the calibrated step ranges 2026-08-14 11:05:07 +05:30
pj 3ce9455928 fix(ios): read a StaticText's label as its text
AXValue was the only source for text, but a StaticText carries its
string in AXLabel, so nothing on screen had .text on ios: a spec reading
it saw everything on android and nothing here.
2026-08-14 11:04:05 +05:30
pj 2f782608c5 docs(ci): explain why a submit tap landing on home is the bug 2026-08-13 22:41:24 +05:30
pj 7cd3bc7749 ci(folio): make web an expect-the-bug leg
the web runtime can observe the double submit now, so the health gate
understates it. seed 1 finds it at step 109, 3 runs out of 3.
2026-08-13 22:41:24 +05:30
pj 94084d9992 test(folio): cover merged-card parsing and unknown balances 2026-08-13 22:34:35 +05:30
pj 5b80c0701b fix(folio): read balances from merged cards and treat unreadable as unknown
compose for web merges the whole accountcard subtree, so the balance
child never exists there and every card parsed as 0. the property then
compared 0 to 0 and fired on any submit, which is a false positive
generator. unknown is now null and null is vacuously true.
2026-08-13 22:34:35 +05:30
pj 68d5633d1d fix: bound the pre-run app launch
launch happens before the runner starts, so --duration never covered it
and a wedged driver hung with no trace and no error.
2026-08-13 21:45:30 +05:30
pj 5017036b62 fix(chrome): wait out a route transition before sampling facts
the tree stays byte-identical and quiet across a cross-fade, so both the
quiet timer and the unchanged-tree escape called it settled mid-flight
and extractors read two screens at once.
2026-08-13 21:45:24 +05:30
pj 5c420ef72a fix(web): carry element identity on actions and fix findAll on paths
an action's target was coordinates only, so a property matching on which
element was acted upon could never fire. ax.findAll([a,b]) also returned
nothing on web.
2026-08-13 21:45:24 +05:30
pj 1d46107ee8 fix(web): install lastAction in the page before extractors read it
state.lastAction was hardcoded null on web, so every property reading it
was silently vacuous: a correct property passed without ever firing.
2026-08-13 21:45:18 +05:30
pj df74bf4d6f refactor(verifier): derive the lastAction shape from one field list
both hosts must show a spec the same lastAction. one ordered list now
feeds the goja object and the json the web host installs, so they
cannot drift.
2026-08-13 21:45:18 +05:30
pj 9f75ee433d docs(ci): correct the ios hang wording and note the device lock 2026-08-13 21:05:38 +05:30
pj 0c249ec261 fix(ios): bound lifecycle rpcs and claim the target device
a launch the simulator rejects sent the xctest session into a recovery
chain that answered minutes late or never, and the rpc had no deadline,
so the run hung with no trace and no error. also take a per-udid flock:
a second run's reinstall lands under the first's live automation session
and wedges it.
2026-08-13 21:05:16 +05:30
pj 0a8b441d35 docs: record that canvas apps need a dom proxy to be text-fuzzable 2026-08-13 20:48:14 +05:30
pj 71657b2d0b ci: authenticate and pin the buf setup step
the anonymous release download hit the shared runner ip rate limit and
failed the job with 'socket hang up' after three retries.
2026-08-13 20:48:14 +05:30
pj a632dbc406 ci: pin calibrated seeds, skip the flaky ios reinstall, bound every job 2026-08-13 02:04:49 +05:30
pj 83285f0c30 refactor(web): use max for the settle budget 2026-08-13 01:36:39 +05:30
pj b7d3b1b7cb ci(folio): give the ios leg its jdk, android sdk, just, and a clean app start 2026-08-13 01:23:49 +05:30