https://arcprize.org/2024-results

ARC Prize Logo
[ ]

  * Home
  * ARC-AGI
  * 2024 Results
  * Technical Guide
  * Play
  * Blog

ARC Prize remains undefeated.
New ideas still needed.

  * Home
  * ARC-AGI
  * 2024 Results
  * Technical Guide
  * Play
  * Blog

2025 Sign up
2025 Sign up

ARC Prize 2024

The Grand Prize remains unclaimed.

[arc-prize-]

The official 2024 Technical Report.

  * 2024 competition results
  * Top solution approaches
  * In-depth technical analysis
  * Trends & key insights

Read the Report

All scores & papers below are open source & reproducible.

2024 High Score Winners

1st the ARChitects 53.5% $25k
    Code Paper
2nd G. Barbadillo  40%   $10k
    Code Paper
3rd alijs          40%   $5k
    Code
4th William Wu     37%   $5k
    Code
5th PoohAI         37%   $5k
    Code Paper

Score (private eval)

2024 Paper Award Winners

1st Place - $50k

"Combining Induction and Transduction for Abstract Reasoning".Open in
new window
Li et al.

2nd Place - $20k

"The Surprising Effectiveness of Test-Time Training for Abstract
Reasoning".Open in new window
Akyurek et al.

3rd Place - $5k

"Searching Latent Program Spaces".Open in new window
Bonnet & Macfarlane

---------------------------------------------------------------------

Runners Up - $2.5k

"The LLM ARChitect: Solving ARC-AGI Is a Matter of Perspective".Open
in new window
Franzen et al.

"Omni-ARC".Open in new window
Barbadillo

"Mini-ARC: Solving Abstraction and Reasoning Puzzles with Small
Transformer Models".Open in new window
Fletcher-Hill

"Towards Efficient Neurally-Guided Program Induction for ARC-AGI".
Open in new window
Ouellette

"A 2D nGPT Model For ARC Prize".Open in new window
Puget

2024 ARC-AGI-Pub High Scores

Jeremy Berman     53.6% 58.5% Code Paper
MARA(BARC) + MIT  47.5% 62.8% Code Paper
Ryan Greenblatt   43%   42%   Code Paper
o1-preview        18%   21%   Code
Claude 3.5 Sonnet 14%   21%   Code
GPT-4o            5%    9%    Code
Gemini 1.5        4.5%  8%    Code

Score (semi-private eval) / Score (public eval)

ARC Prize 2025

We aspire to grow ARC Prize from its experimental origins into a
durable north star for AGI.

The 2025 edition of the competition will account for a diversity of
incentives to serve academics, independent researchers, startups, and
big labs.

Alongside the competition launch, expect to see ARC-AGI-2 - same
format, better benchmark.

We'll announce more competition details early next year. Stay tuned!

Sign up for updates

[arc-prize-]

  * [icon-email] Newsletter
  * [icon-disco] Discord
  * [icon-x] Twitter
  * [icon-youtu] YouTube
  * [icon-githu]GitHub

(c) 2024 ARC Prize, Inc. Privacy Terms
A non-profit for the public advancement of open artificial general
intelligence. All rights reserved.

ARC Prize : 2025

We expect to re-launch ARC Prize in Q1 2025. Sign up now to receive
official competition updates and news.

[                    ]
Sign Up
No spam. You can unsubscribe at anytime.
ARC Prize : Newsletter

Subscribe to receive official competition updates and news.

[                    ]
Subscribe
No spam. You can unsubscribe at anytime.
Toggle Animation