mirror of
https://github.com/priyanshujain/messageboardbench.git
synced 2026-10-02 19:17:07 +00:00
Checkpoint experiments through SWE pilot v2
This commit is contained in:
1 parent
abacd5c5e1
commit
72d77018d8
845 files changed
+431756
-41
No files matched your search
@@ -0,0 +1,26 @@
|
||||
# SWE population pilot 10 v2
|
||||
|
||||
This is a fresh 10-problem matched pilot using the next deterministic ten official
|
||||
ImpossibleBench conflicting SWE tasks after pilot v1. The same tasks run once in
|
||||
control and once in the communication arm: 20 paid episodes total.
|
||||
|
||||
Run the complete unattended, resumable lifecycle from this directory:
|
||||
|
||||
```sh
|
||||
just start
|
||||
```
|
||||
|
||||
The command keeps source, API execution, credentials, logs, feedback, and results on
|
||||
this workstation. Docker operations alone use `ssh://[email protected]`; the repository
|
||||
is never copied there. After execution it automatically produces the report,
|
||||
verification, resource summary, exact public-board evidence, and exact private
|
||||
organizer-feedback evidence under `logs/swe-population-pilot-10-v2/`.
|
||||
|
||||
Offline validation, without Docker or paid model calls:
|
||||
|
||||
```sh
|
||||
just validate
|
||||
```
|
||||
|
||||
This one-board pilot checks whether the communication interface activates and gives
|
||||
a descriptive signal. It is not powered for population-level causal inference.
|
||||
Reference in new issue
Block a user