By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
Felly ViralFelly ViralFelly Viral
Notification Show More
Font ResizerAa
  • Home
  • Nigeria
    NigeriaShow More
    My family mocked my poor boyfriend — His 30th birthday gift left dad in tears
    October 23, 2026
    Immigration scam: Canada arrest and foreigners, details emerge
    October 22, 2026
    Malta sets deadline for foreigners to secure residence permits before new tax rule
    October 22, 2026
    Malta sets deadline for foreigners to secure residence permits before new tax rule
    October 22, 2026
    Malta announces increase in tax payable by foreign residents from January 2027
    October 22, 2026
  • Technology
    TechnologyShow More
    Etsy is cracking down on AI slop listings
    October 23, 2026
    AI Benchmark Scores Don’t Tell the Whole Story. Here’s What You Need to Look For.
    October 22, 2026
    Spotify says yes, it is busting people for using Family Plan sharing too widely
    October 22, 2026
    My son begged me to move in — Then my daughter-in-law handed me a chore list
    October 22, 2026
    My son begged me to move in — Then my daughter-in-law handed me a chore list
    October 22, 2026
  • Sports
  • World News
    World NewsShow More
    Amber warning in place as Storm Austen hits parts of UK
    October 23, 2026
    Heavy rain warning as Storm Austen sweeps across Scotland
    October 22, 2026
    Leaked Mass Effect: Universe trailer gives a taste of what we're all missing
    October 22, 2026
    Leaked Mass Effect: Universe trailer gives a taste of what we're all missing
    October 22, 2026
    Royal Navy lacks resources to counter Russian threat in high north, MPs warn
    October 21, 2026
  • Politics
    PoliticsShow More
    Britain’s gas security needs reinforcement. Last-minute deals with Belgium are not a proper fix
    October 23, 2026
    Imagine if, for once, Labour decided to tell the truth about immigration | Gaby Hinsliff
    October 23, 2026
    MoD seeks out-of-court resolution over compensation battle with gay veterans
    October 23, 2026
    How Zimbabwe's government turned international condemnation into political ammunition
    October 23, 2026
    Tinubu's campaign council knocks Atiku over claim on Ebola
    October 22, 2026
  • Science
  • Entertainment
    EntertainmentShow More
    Actor Francis Duru dies at 57 months after addressing health rumours
    October 23, 2026
    A police officer knocked on my door and asked why my car was at a cemetery all night
    October 22, 2026
    My husband brought his mistress to our 35th anniversary—A stranger shut him down
    October 22, 2026
    'I'm 96 and have 15 million followers': The grannies taking over TikTok
    October 22, 2026
    YouTube says it isn’t testing hiding the dislike button
    October 21, 2026
  • Crypto
    CryptoShow More
    Meta’s AI could still scrape news sites, legal experts say
    October 22, 2026
    Meta’s AI could still scrape news sites, legal experts say
    October 22, 2026
    Cryptocurrency exchange founded by Reform donor Ben Delo sued for £20m
    October 13, 2026
    5 Books That Redefine Success Beyond the Hustle
    October 7, 2026
    It looks like the Atlantic storm season may finally produce a hurricane
    October 6, 2026
  • About Us
  • Contact
Reading: AI Benchmark Scores Don’t Tell the Whole Story. Here’s What You Need to Look For.
Share
Font ResizerAa
Felly ViralFelly Viral
  • Home
  • Entertainment
  • Science
  • Technology
  • Business
  • Crypto
  • Health
  • Nigeria
  • Politics
  • Sports
  • World News
Search
  • Home
  • About Us
  • Contact Us
  • Categories
    • Nigeria
    • Technology
    • Entertainment
    • Science
    • Health
    • Sports
    • Politics
    • World News
    • Business
    • Crypto
Have an existing account? Sign In
Follow US
Felly Viral > Blog > Technology > AI Benchmark Scores Don’t Tell the Whole Story. Here’s What You Need to Look For.
Technology

AI Benchmark Scores Don’t Tell the Whole Story. Here’s What You Need to Look For.

admin
Last updated: October 22, 2026 11:30 pm
admin Published October 22, 2026
Share
SHARE
October 22, 2026 at 11:30 pmIn: Technology

Opinions expressed by Entrepreneur contributors are their own. AGI, artificial general intelligence, means a system that can match or beat human performance across essentially any cognitive task, not just the narrow ones it was trained for. That distinction matters because it’s exactly what’s being argued about right now. Jensen Huang has a habit of declaring victory at the exact moment his company needs the market to believe it.

So when OpenAI shipped GPT-6 Astra on Sept. 3, Huang posted on X that “AGI has arrived,” adding that “400K GPUs” are “coming online next.” I’m an AI engineer, and I’m currently building ChatMakr, an AI-powered platform that creates multi-agent chatbots in seconds. I spent the last year watching every model release get relabeled as the one that finally changes everything. Here is the truth. Astra isn’t a chatbot upgrade.

OpenAI positions it as an operator — a system that browses, codes, runs multi-step workflows, models in Blender and handles cybersecurity tasks with minimal supervision. The benchmark numbers are genuinely striking: 97.6% on FrontierMath Tier 4, 99.9% on ARC-AGI-3, and a perfect 100% on ExploitBench, up from 78.5% for its predecessor, GPT-5.6 Sol. Those are not incremental gains. But OpenAI itself, notably, stopped short of calling Astra AGI, choosing instead to emphasize “speed and versatility.” That restraint from the company that built the model is the tell.

The pushback isn’t really about whether Astra is impressive. It clearly is. It’s about the word AGI itself. Wharton professor Ethan Mollick has argued for months that what we’re seeing is “jagged AGI:” systems that are superhuman in some narrow domains and unreliable in others, which is a very different thing from general intelligence.

There’s still no agreed upon test for AGI, so declaring it “arrived” is closer to a subjective judgment call than a measurement. Augmented Mind and Manolo Remiddi put it plainly: “AGI is the point where you can trust the output without checking. We are not there.” This is where it gets interesting for anyone actually building with these models. On paper, Astra and Anthropic’s Claude Fable 5.1 look neck and neck on several coding and reasoning benchmarks.

In practice, engineers report meaningfully different output quality. Fable tends to produce more production-ready code with fewer output tokens, while Astra’s strength shows up more in computer use and multi-step automation. Snorkel AI’s testing revealed that Fable fails through a fundamentally different pattern than how it succeeds, losing valid work mid-trajectory rather than running out of budget, which matters far more to a shipping team than a leaderboard percentage. The reason similar scores can hide such different outputs comes down to something most people outside AI engineering have never heard of: the harness.

A harness is the infrastructure wrapped around a model: the prompt assembly, tool access, memory management and error recovery that determine how the raw model is actually put to work. As MindStudio describes it: “A model is the engine. The harness is the car. Most benchmarks test the car.” Swap the harness and the same model produces wildly different results.

Cursor’s own research found one model scoring 46% accuracy with one harness and 80% with another, with no model change at all. Astra’s own benchmark history makes the point better than any explainer could. On ARC-AGI-3, Astra scored 62.7% using a standard harness, essentially tied with its predecessor, and 99.9% using a “Provider Adapter” harness that let it retain and reuse prior reasoning instead of restarting cold on every step, according to Augmented Mind and Manolo Remiddi. Same weights.

Same model. A 37 point swing from infrastructure alone. That’s not a small footnote. It means a huge share of what gets reported as “model improvement” is actually harness improvement, and leaderboards that don’t control for it are telling a story, not reporting a fact.

This is exactly why SpaceX’s $60 billion acquisition of Cursor matters more than it looks. Cursor isn’t a model company. It’s one of the best harness companies in the world, the layer that decides how coding models actually get used. Folding it into SpaceX’s GPU fleet is a bet that owning the layer is as valuable as owning the model, maybe more.

OpenAI has already cut Cursor’s access to its models over trust concerns tied to Musk’s companies, which tells you the model providers see the same thing: Whoever controls the harness controls the product experience, regardless of which model sits underneath it. Nobody serious disputes that GPT-6 Astra is a major model. What’s contested is the leap from “major model” to “AGI has arrived.” If you’re evaluating these systems for your own business, ignore the AGI framing entirely. Look at the harness a vendor wraps around the model, ask how it fails, and test it on your actual workflow.

The benchmark gap between Astra and Fable 5.1 already proved the leaderboard alone won’t tell you. AGI, artificial general intelligence, means a system that can match or beat human performance across essentially any cognitive task, not just the narrow ones it was trained for. That distinction matters because it’s exactly what’s being argued about right now. Jensen Huang has a habit of declaring victory at the exact moment his company needs the market to believe it.

So when OpenAI shipped GPT-6 Astra on Sept. 3, Huang posted on X that “AGI has arrived,” adding that “400K GPUs” are “coming online next.” I’m an AI engineer, and I’m currently building ChatMakr, an AI-powered platform that creates multi-agent chatbots in seconds. I spent the last year watching every model release get relabeled as the one that finally changes everything. Here is the truth.

You Might Also Like

Fuel prices added to Google Maps as petrol and diesel costs soar

Samsung all but confirms iPhone Duo is goosing Galaxy Z8 sales

Biolevate raises €30M Series A and opens Boston office for its life sciences AI

Top mathematicians will advise OpenAI on releasing its AI maths results

Now that Character.AI is going bankrupt, what happens to all of its users’ data?

Share This Article
Facebook Twitter Email Print
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

What's Hot

Badenoch accuses Burnham of kicking defence spending into the long grass

Zack Polanski says he'll run for former PM Starmer's seat in by-election

Tragedy averted as fan slips and falls in front of Burna Boy's ₦9bn Bugatti

Rewetting peatlands may curb warming-driven CO₂ emissions

Davido reacts to video of Burna Boy taking delivery of his ₦9billion customised Bugatti Chiron

Bridging interfacial water structure and reactivity in photocatalytic hydrogen evolution at TiO₂ interfaces

Categories

Business

307 Articles

Politics

1173 Articles
- Advertisement -
Ad image

Categories

  • Sports
  • Politics
  • Technology
  • Science
  • World News
  • Entertainment
  • Business
  • Nigeria
  • Health
  • Crypto

About US

Welcome to Felly Viral, your destination for the latest trends, breaking stories, engaging updates, and conversations shaping the world around us
Quick Link
  • Home
  • About Us
  • Contact
  • Member Login
  • Profile
  • My Bookmarks
  • Privacy Policy
  • Terms and Conditions
Top Categories
  • Entertainment
  • Sports
  • World News
  • Politics
  • Technology
  • Science
  • Business
  • Health
  • Crypto

Subscribe US

Subscribe to our newsletter to get our newest articles instantly!

© Foxiz News Network. Ruby Design Company. All Rights Reserved.

Powered by CookieAdmin
Necessary cookies enable essential site features like secure log-ins and consent preference adjustments. They do not store personal data.
None
Functional cookies support features like content sharing on social media, collecting feedback, and enabling third-party tools.
None
Analytical cookies track visitor interactions, providing insights on metrics like visitor count, bounce rate, and traffic sources.
None
Advertisement cookies deliver personalized ads based on your previous visits and analyze the effectiveness of ad campaigns.
None
Unclassified cookies are cookies that we are in the process of classifying, together with the providers of individual cookies.
None
Powered by CookieAdmin
Welcome Back!

Sign in to your account