Benchmark typed decision models with JevBench
Built JevBench, a reproducible benchmark for typed decision models used around agent memory and tooling.
Source
florianstandhar on Hacker News · 2026-09-22 · Project link
Written in our own words. Credit to the original author. Link checked 2026-10-15.
What they did
Built JevBench, a reproducible benchmark for typed decision models used around agent memory and tooling.
Result (as claimed)
Open benchmark on Show HN.
Tools they used
Cost: Claude Code: free plan, paid from $17/mo; OpenAI Codex: free plan, paid from $8/mo. Checked 2026-10-14.
Set it up
Gather your sources
Collect the papers, notes, links or files you want to work from in one place.
Load them into the tool
Open Claude Code, OpenAI Codex and add your sources. Keep the original files so you can check claims later.
Ask focused questions
Ask for summaries, comparisons or connections with citations to the source passages.
Verify and save
Spot check claims against the sources, then save the output as notes you can reuse.
Copy the full setup prompt
Paste into your agent and it will walk you through the setup, asking before anything that sends, posts or spends.
You are helping me set up this AI use case end to end in Claude Code. Goal: Benchmark typed decision models with JevBench What the original author did: Built JevBench, a reproducible benchmark for typed decision models used around agent memory and tooling. Reported result (as claimed by the author): Open benchmark on Show HN. Source: https://news.ycombinator.com/item?id=49800574 Tools they used: Claude Code, OpenAI Codex Category: Research & learning Please: 1. Ask me 3 short questions about my situation (accounts I have, budget, what I want the output to look like). 2. Propose a step-by-step plan using these tools or cheaper alternatives, with the time and cost of each step. Use official pricing pages; say "check pricing" if unsure. 3. Then do the setup with me one step at a time, waiting for my OK before anything that sends messages, posts publicly, spends money or deletes data. 4. Finish with a checklist to run it again next time.
You are helping me set up this AI use case end to end in Codex. Goal: Benchmark typed decision models with JevBench What the original author did: Built JevBench, a reproducible benchmark for typed decision models used around agent memory and tooling. Reported result (as claimed by the author): Open benchmark on Show HN. Source: https://news.ycombinator.com/item?id=49800574 Tools they used: Claude Code, OpenAI Codex Category: Research & learning Please: 1. Ask me 3 short questions about my situation (accounts I have, budget, what I want the output to look like). 2. Propose a step-by-step plan using these tools or cheaper alternatives, with the time and cost of each step. Use official pricing pages; say "check pricing" if unsure. 3. Then do the setup with me one step at a time, waiting for my OK before anything that sends messages, posts publicly, spends money or deletes data. 4. Finish with a checklist to run it again next time.
You are helping me set up this AI use case end to end in Grok Bot. Goal: Benchmark typed decision models with JevBench What the original author did: Built JevBench, a reproducible benchmark for typed decision models used around agent memory and tooling. Reported result (as claimed by the author): Open benchmark on Show HN. Source: https://news.ycombinator.com/item?id=49800574 Tools they used: Claude Code, OpenAI Codex Category: Research & learning Please: 1. Ask me 3 short questions about my situation (accounts I have, budget, what I want the output to look like). 2. Propose a step-by-step plan using these tools or cheaper alternatives, with the time and cost of each step. Use official pricing pages; say "check pricing" if unsure. 3. Then do the setup with me one step at a time, waiting for my OK before anything that sends messages, posts publicly, spends money or deletes data. 4. Finish with a checklist to run it again next time.
The Daily 5
Get five new use cases tomorrow morning
Free. Real sources. Unsubscribe any time.
Related use cases
Benchmark how much extra code AI models add
Built Parsimony, an open benchmark that scores how much unnecessary code models insert beyond solving the task.
Run a murder-board Q&A on your pitch before the real meeting
Open-sourced a murder-board style panel that asks brutal prep questions before you present, for Claude Code, Codex, Cursor and ChatGPT.
Run a deep research agent in your terminal
Built Mole, a deep research agent you run from the terminal.
Keep a Karpathy-style LLM wiki your agents maintain in Git
Built a Markdown-and-Git wiki in the Karpathy style that coding agents maintain for you.