RankedAGI aggregates benchmark data and cost comparisons for various AI models in a single free tool, so you can choose the right model for their needs without sifting through research papers — it’s all in one place and company blogs.
AGI Benchmarking with Tier-Based Model Classification
RankedAGI is a free online tool designed for benchmarking and comparing various Artificial Intelligence (AI) models. It aggregates benchmark data, so you can compare performance across different tasks and evaluate associated costs. The platform features a leaderboard and detailed model pages that display various benchmark scores and pricing information.
AI Safety Researchers, Policy Makers, and Strategists
It primarily serves developers, researchers, and anyone interested in understanding the capabilities and cost-effectiveness of different AI models. Specific use cases include:
- Identifying top performers: Quickly find the best-performing models for tasks like coding, reasoning, mathematics, and multimodal understanding.
- Cost optimization: Evaluate models based on their token costs to make informed decisions for projects and applications.
- Streamlined research: Access consolidated benchmark data without needing to manually gather information from numerous individual sources.
Composite Scoring Across Reasoning, Coding, and Math
RankedAGI features a wide array of benchmarks, covering categories such as coding, reasoning, math, general AI, multimodal capabilities, and agentic tasks. Notable supported benchmarks include:
- SWE Bench Verified
- Codeforces
- LMSYS
- LiveBench
- GPQA Diamond
- AIME
- MMMU
The tool also calculates experimental composite scores, such as the "RankedAGI Coding score," which blend related benchmarks to provide a more holistic view of performance. The benchmark results are compiled manually by the creator from publicly available primary sources, including official blogs and papers from model providers (e.g., OpenAI, Anthropic, Google, xAI), and benchmark platforms (e.g., LiveBench, Arena, Aider, SWE-Bench). RankedAGI is built as a static site, which keeps it fast and eliminates the need for server or database management.
Free Web Dashboard
RankedAGI is completely free to use. There aren’t any login requirements, paywalls, or tracking beyond basic analytics. Users can access all features and data directly from the website: https://rankedagi.com/
Subjective Tier Boundaries, Rapidly Changing Model market
As a hobby project, RankedAGI’s data is updated manually. That means there’s sometimes a delay in reflecting the absolute latest announcements or benchmark results from rapidly evolving AI models. You’ll want to verify the ‘last updated’ timestamp on model listings for the freshest information.