@regehr Thanks for writing this! It feels close to how I started thinking of LLMs as "Kahneman system 1" thinkers (stochastic, intuitive, ...) . So you need "Kahneman system 2" tools (deterministic, analytical, controlled, ...) to control, verify or shape their output. It sounds like "executable oracles" are exactly one such kind of "Kahneman system 2" tool...