Black Box Challenge

REA6.7.0 · MIT

  • Without REA

    20/20

    tests passed

    • 8.8 min
    • REA not available

  • With REA

    20/20

    tests passed

    • 9.1 min
    • REA used 1×

A tie. Claude unscrambled the code itself; REA’s analysis couldn’t see through it.

The apps

Try all three

Run it yourself

A coding agent can't run in a web page, so this is the same challenge as a download, to run in your own Claude Code with your own Claude plan or API key.

  1. Unzip it: a plain folder and a with-REA folder, each with the obfuscated editor, plus the exact prompt.
  2. Open a fresh Claude Code session in each folder and paste the prompt. REA connects to its folder only.
  3. Score both rebuilds with the 20 hidden tests in score/ (the original scores 20/20).

Our runs: both rebuilds scored 20/20, in 8.8 min without REA and 9.1 min when told to use it.

Download the kit68 KB