mirror of
https://github.com/priyanshujain/sanderling.git
synced 2026-10-02 19:17:10 +00:00
* feat(companion): add appState, eraseText, pressKey runner handlers
The Go runner transport already calls these methods; the in-device runner
implemented them only latently. They become load-bearing on the device
path, where the hybrid's legacy-companion fallback is absent. Backward
compatible: the simulator hybrid never calls them.
* feat(ios): resolve physical devices from devicectl
ResolveDevice parses xcrun devicectl list devices into Device{Name,
HardwareUDID, CoreDeviceID}: the hardware UDID feeds xcodebuild/iproxy
and the CoreDevice id feeds devicectl install. Matches by name or either
id; errors list candidates on none/ambiguous. Fixes the stale sidecar
comment on ResolveTarget.
* feat(ioscompanion): runner-only device driver mode
NewDevice reuses Driver with d.companion set to the runner dialed over an
iproxy usbmux tunnel, hybrid=false, runnerClient=nil. The existing accessor
seams then route launch/snapshot/text/gesture to the runner with no new
DeviceDriver methods. Device seams swap clear-state to a devicectl
reinstall, container reset to a warn-once no-op, and paste grant to a no-op.
realSpawnDeviceRunner builds and signs the runner at run time via the App
Store Connect API key (no Xcode UI), caching on a source hash.
* test(ioscompanion): cover device wiring, routing, and shell-out argv
Seam-driven NewDevice wiring + gesture/text routing (asserting no keyboard
HID), devicectl/build/test/iproxy argv builders, xctestrun test-target dict
name parsing, signing-credential env checks, and source-hash cache keying.
* feat(testrun): route physical-device iOS runs to the device driver
Execute resolves a non-simulator iOS target through ios.ResolveDevice into
its hardware UDID and CoreDevice id; buildDriver constructs NewDevice via a
seam instead of rejecting the device. Generalizes the --ios-device and
--ios-app-path help to cover the device path; signing stays env-read, never
a flag.
* feat(doctor): device prereqs replace java/sidecar for ios-device
iosDeviceChecks now verifies devicectl, iproxy on PATH, a connected+paired
device (via ios.ConnectedDevices), and App Store Connect signing creds (via
ioscompanion.VerifyDeviceSigning). The retired JVM sidecar checks stay only
under android.
* feat(conformance): device backend uses iphoneos app and tunnel orphan checks
The device backend now builds via just ios-device, points --ios-app-path at
the Debug-iphoneos bundle, and reinstalls each run for clear-state. The G5
orphan scan replaces the retired sidecar.jar check with lingering iproxy and
device test-without-building sessions (destination platform=iOS,id=).
* feat(folio): device build linking the iosArm64 framework
project.yml selects the Kotlin framework slice by SDK (iosArm64 for
iphoneos, iosSimulatorArm64 for simulator) and links via -framework Shared
on the SDK-conditional search path. New ios-device/test-ios-device recipes
mirror ios/test-ios, signing the Debug-iphoneos build with the .env API key.
* docs(cli): document ios-device doctor checks and the device flags
The --ios-device flag now also selects a connected device; --ios-app-path
covers the device install; the doctor gains an ios-device platform whose
checks are devicectl, iproxy, a paired device, and signing credentials.
Corrects the --clear-data default to true.
* fix(ioscompanion): resolve signing key path to absolute
xcodebuild's -authenticationKeyPath requires an absolute path, but .env
files commonly carry a repo-relative one. Resolve it against the working
directory before the stat so a relative ASC_API_KEY_PATH still signs.
* fix(ioscompanion): re-enable signing for the device runner build
companion/project.yml disables code signing for the simulator build, so
the device build inherited it and produced an unsigned runner that the
device rejected at install (0xe8008018). build-for-testing now forces
CODE_SIGNING_ALLOWED/REQUIRED=YES so automatic provisioning signs it.
* fix(ioscompanion): key the device build cache on signing identity
The cache marker hashed only sources, so switching signing team or key
reused a runner signed with the stale identity, which the device rejects at
install (0xe8008018). Fold team + key id into the cache key so a signing
change forces a rebuild.
* docs(getting-started): document physical iOS device setup
Lists the iproxy requirement and the App Store Connect signing env vars
(SANDERLING_IOS_TEAM, ASC_API_*) a device run needs, plus the
test-ios-device recipe and the doctor check.
* feat(ios): native usbmux client and in-process tunnel forwarder
Talk to macOS usbmuxd directly instead of shelling out to iproxy, so the
device path depends on nothing beyond macOS + Xcode.
* refactor(ios): drive device tunnel via io.Closer seam
Replace the tunnelChild *exec.Cmd and spawnTunnel seam with a tunnel
io.Closer and startTunnel seam backed by the in-process usbmux forwarder.
* refactor(ios): remove iproxy spawn from device runner
* test(ios): cover tunnel close via io.Closer not child process
* feat(doctor): check usbmuxd socket instead of iproxy on PATH
* chore(conformance): drop iproxy orphan check; tunnel is in-process
* docs(ios): device tunnel uses native usbmux, nothing to install
* chore: gitignore the signing keys directory
* feat(folio): add Android launcher icon (black bg, white dot)
* feat(folio): add iOS app icon (black bg, white dot)
* feat(folio): add web favicon (black bg, white dot)
* docs(ioscompanion): fix stale const comments
* refactor(ioscompanion): inline single-use devicectl argv builders
* refactor(ioscompanion): inline xcodegenArgs, drop tautological argv tests
* refactor(ioscompanion): inline firstNonEmpty
* refactor(doctor): dedup usbmuxd socket path via ioscompanion seam
* test(doctor): trim redundant signing-check test
* refactor(ioscompanion): deliver COMPANION_PORT via TEST_RUNNER_ env
* fix(testrun): seam preflight so iOS routing tests pass on CI without xcrun
136 lines
4.3 KiB
Go
136 lines
4.3 KiB
Go
// Command sanderling is the CLI entry point for the property-based UI fuzzer.
|
|
package main
|
|
|
|
import (
|
|
"context"
|
|
"errors"
|
|
"flag"
|
|
"fmt"
|
|
"io"
|
|
"os"
|
|
"os/signal"
|
|
"syscall"
|
|
"time"
|
|
)
|
|
|
|
// Version is stamped at build time via goreleaser ldflags.
|
|
// Default "dev" marks untagged local builds.
|
|
var Version = "dev"
|
|
|
|
type testOptions struct {
|
|
spec string
|
|
bundleID string
|
|
platform string
|
|
avd string
|
|
iosDevice string
|
|
iosAppPath string
|
|
duration time.Duration
|
|
seed int64
|
|
output string
|
|
clearData bool
|
|
}
|
|
|
|
const topUsage = `sanderling is a property-based UI fuzzer for mobile apps.
|
|
|
|
Usage:
|
|
sanderling <command> [flags]
|
|
|
|
Commands:
|
|
test Run a spec against an app for a fixed duration.
|
|
replay Serve a local web UI for browsing runs/.
|
|
doctor Check that the host environment is ready to run sanderling.
|
|
version Print the sanderling version.
|
|
|
|
Run "sanderling <command> -h" for command-specific flags.
|
|
`
|
|
|
|
func parseTestArgs(args []string, stderr io.Writer) (testOptions, error) {
|
|
flagSet := flag.NewFlagSet("test", flag.ContinueOnError)
|
|
flagSet.SetOutput(stderr)
|
|
var options testOptions
|
|
flagSet.StringVar(&options.spec, "spec", "", "path to the TypeScript spec (required)")
|
|
flagSet.StringVar(&options.bundleID, "bundle-id", "", "target app bundle ID (required)")
|
|
flagSet.StringVar(&options.platform, "platform", "android", "target platform: android, ios, web")
|
|
flagSet.StringVar(&options.avd, "avd", "", "Android AVD name to boot if no device is connected")
|
|
flagSet.StringVar(&options.iosDevice, "ios-device", "", "iOS target: a simulator name/UDID to boot, or a connected device's name, UDID, or CoreDevice id")
|
|
flagSet.StringVar(&options.iosAppPath, "ios-app-path", "", "path to the .app bundle for iOS clear-state reinstall (simulator: simctl; device: devicectl)")
|
|
flagSet.DurationVar(&options.duration, "duration", 5*time.Minute, "total test duration")
|
|
flagSet.Int64Var(&options.seed, "seed", 0, "RNG seed (0 = random)")
|
|
flagSet.StringVar(&options.output, "output", "./runs", "output directory for traces")
|
|
flagSet.BoolVar(&options.clearData, "clear-data", true, "clear app data before launching so each run starts from a fresh install; pass --clear-data=false to resume prior state")
|
|
if err := flagSet.Parse(args); err != nil {
|
|
return testOptions{}, err
|
|
}
|
|
if options.spec == "" {
|
|
return testOptions{}, errors.New("--spec is required")
|
|
}
|
|
if options.bundleID == "" {
|
|
return testOptions{}, errors.New("--bundle-id is required")
|
|
}
|
|
switch options.platform {
|
|
case "android", "ios", "web":
|
|
default:
|
|
return testOptions{}, fmt.Errorf("unsupported platform: %q (android, ios, web)", options.platform)
|
|
}
|
|
return options, nil
|
|
}
|
|
|
|
func runTest(options testOptions, stdout io.Writer) error {
|
|
// A signal-aware root context: on Ctrl-C the cancellation propagates into
|
|
// the drivers' process contexts, so spawned children (the iOS companion,
|
|
// the xcodebuild runner session) get their SIGTERM instead of outliving
|
|
// the run as orphans.
|
|
ctx, cancel := signal.NotifyContext(context.Background(), os.Interrupt, syscall.SIGTERM)
|
|
defer cancel()
|
|
return runTestPipeline(ctx, options, stdout)
|
|
}
|
|
|
|
func runDoctor(args []string, stdout, stderr io.Writer) error {
|
|
options, err := parseDoctorArgs(args, stderr)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
checks := doctorChecksFor(options.platform)
|
|
return runDoctorChecks(context.Background(), checks, stdout)
|
|
}
|
|
|
|
func run(args []string, stdout, stderr io.Writer) error {
|
|
if len(args) < 2 || args[1] == "-h" || args[1] == "--help" || args[1] == "help" {
|
|
fmt.Fprint(stdout, topUsage)
|
|
return nil
|
|
}
|
|
switch args[1] {
|
|
case "test":
|
|
options, err := parseTestArgs(args[2:], stderr)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
return runTest(options, stdout)
|
|
case "replay":
|
|
options, err := parseReplayArgs(args[2:], stderr)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
return runReplay(options, stdout)
|
|
case "doctor":
|
|
return runDoctor(args[2:], stdout, stderr)
|
|
case "version", "-v", "--version":
|
|
fmt.Fprintln(stdout, Version)
|
|
return nil
|
|
default:
|
|
return fmt.Errorf("unknown command: %q (try 'sanderling help')", args[1])
|
|
}
|
|
}
|
|
|
|
func main() {
|
|
if err := run(os.Args, os.Stdout, os.Stderr); err != nil {
|
|
// flag.ErrHelp means -h/--help was requested; flag already printed
|
|
// usage to stderr, so exit 0 rather than treating it as a failure.
|
|
if errors.Is(err, flag.ErrHelp) {
|
|
return
|
|
}
|
|
fmt.Fprintf(os.Stderr, "error: %v\n", err)
|
|
os.Exit(1)
|
|
}
|
|
}
|