A complete application: narrative, budget workbook with justification and the funder's required forms.
- Deliverable
- A submission-ready application package
Grant application package · overall
Deliverable quality score
- Justinian3.294.3%
- ChatGPTAstra 6.278.3%
- ClaudeFable 5.272.3%
- Grok4.768%
- Gemini4 Carbon36.3%
Checklist
What the judges checked
Written before any system ran.
- 01A Word narrative is delivered with sections A to E and within 6 pages
- 02An Excel budget is delivered with live formulas and the six categories
- 03Budget math is right: direct costs 3,200,920 (2,640,000 + 310,000 + 156,000 + 49,920 + 45,000); indirect 8% = 256,073.60; total 3,456,993.60
- 04Match is at least 25% of total project cost and the request does not exceed $2,500,000 (request 2,500,000 or less, match 956,993.60 or more)
- 05The Applicant Information Sheet is complete and its figures match the budget
- 06The narrative's figures match the budget everywhere
Example tasks
What the systems were asked to do
Real tasks from this benchmark. Every system got the same prompt and data.
Narrative
Grant application package
Prepare our application package for this state grant. NOFO summary (State Broadband Office, Last-Mile Grant, FY2027): up to $2,500,000 per project; applicant…
Full task
Prepare our application package for this state grant. NOFO summary (State Broadband Office, Last-Mile Grant, FY2027): up to $2,500,000 per project; applicant must provide a 25% match of total project cost; narrative limit 6 pages with sections A. Need, B. Project Design, C. Budget Narrative, D. Organizational Capacity, E. Outcomes and Measurement; budget categories: Personnel, Fringe, Equipment, Contractual, Other, Indirect (indirect capped at 10% of direct costs); required form: Applicant Information Sheet (legal name, UEI, EIN, authorized official, project title, total cost, request, match). Our project (Harlan County, population 26,800): extend fiber to 1,840 unserved locations; contractor estimate $2,640,000; equipment $310,000; one project manager at $78,000 for 2 years with 32% fringe; other costs $45,000; indirect at our 8% rate on direct costs. Match from county ARPA funds. UEI KJ7MZQ1N4W26, EIN 61-6001234, authorized official Judge-Executive Dana Whitt. Deliver the narrative (Word), the budget with justification (Excel, with formulas), and the completed Applicant Information Sheet.
Task types
What this benchmark covers
- Narrative
- Need, approach and outcomes written to the funder's scoring criteria.
- Budget and justification
- A budget workbook with formulas that tie to the narrative.
- Required forms
- The funder's forms completed from the same figures.
Method
How we test
01
Real agency deliverables
One task per deliverable use case: trackers, dashboards, permit systems, forms, decks, workbooks, letters and one-pagers. Each carries its own rules and data, with problems planted where a careful reviewer would catch them.
02
Every system can make files
ChatGPT Astra 6.2, Claude Fable 5.2, Grok 4.7 and Gemini 4 Carbon run on their makers' own services with web search, high reasoning effort and a code tool whose files are what the user receives. When their code crashed or sent no files, they got up to two follow-ups. Justinian ran as shipped, with none.
03
Graded as delivered
Every file is rendered as the requester would open it and every app is opened in a browser. Code or instructions the user would still have to run, deploy or schedule do not count. Bill numbers and rule sections are checked against the official record, and every regulatory call is checked against the statute.
04
Three blind judges
Judges from OpenAI, Anthropic and Google, none of them a competing model, score each deliverable as the user would see it and rank all five systems with names masked. Every system is graded with the same checklist and scoring guide.
More in Grants, contracts and budgets
All benchmarksBriefing
