firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

In a test as tangible as market dynamics, AI models are stepping beyond chatbots to run real companies — and some are outperforming their Western frontier peers. For Bitcoin investors and crypto enthusiasts, this means AI’s capabilities are now tested in the crucible of real-world decision-making, not just theoretical chat. Imagine AI that can spot a security breach buried two documents deep in a company’s files, or refuse manipulative tricks from a fake CEO message. That’s not science fiction; it’s a live experiment happening now, with firmulate.com leading the charge.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get hardware and tech essentials delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Challenge: Running a Small Software Company Through Its Worst Week

In a groundbreaking experiment, four leading AI models faced the same intense business simulation — a small software company navigating crises, customer churn, and manipulative tactics. Every decision was made under the same conditions, with the same customers and crises, and each move was recorded and auditable. The goal: see if these AI agents could not only diagnose problems but also stay honest and complete their missions.

The Results: A Close Race with a Clear Winner

When the scores were tallied in July 2026, the leaderboard looked like this:

  • gpt-5.6-sol: 95
  • Kimi K3 (Moonshot): 93
  • Sonnet 5: 88
  • Fable 5: 77
  • Opus 4.8: 73

All models demonstrated a remarkable ability to identify crises and resist manipulation attempts. But Kimi K3 stood out for its discipline and its ability to uncover a buried security fact that was critical to closing a €55,000 deal — translating into over €4,500 in monthly recurring revenue (MRR).

What Made the Difference? Reading and Acting on Deeper Data

The decisive edge for K3 came from its ability to read two layers deep into the company’s files, uncovering an essential piece of data that others missed. This allowed the model to close a lucrative deal at full price, demonstrating genuine insight and discipline. Meanwhile, other models either left the deal on the table or failed to read beyond superficial documents.

Handling Social Engineering and Trust

In a separate test, all models faced fake CEO messages escalating in three stages, plus a reporter trick that asked only for a yes/no response on background. Every AI refused to be manipulated, with K3 explicitly reasoning about the risk of impersonation or approval bypass. This shows that, even under pressure, these models can maintain integrity — a crucial trait for real-world applications where trust is paramount.

Amazon

AI decision-making software for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real Business: An Ongoing Live Experiment

The experiment runs on a live company with 13 synthetic employees, real cash mechanics, and a public burn rate of €105k/month against just €2.3k MRR. Every workday, the company’s decision-making is recorded, versioned, and observable at firmulate.com/live. The goal? To measure management quality, not just chat quality.

The Limitations and Insights from the Experiment

Interestingly, the most thorough model — Opus 4.8 — with over 80 learned rules — finished last. It left a close deal unclaimed, slipping discipline and escalating issues into a locked department instead of resolving them. This highlights that depth of analysis alone does not guarantee better business outcomes, especially if discipline slips during critical moments.

What This Means for the Crypto World

For those invested in cryptocurrencies or considering how AI might impact financial markets, the key takeaway is clear: AI agents are now capable of making real decisions that matter, not just generating plausible responses. They can detect buried facts, refuse manipulative tactics, and close deals at full value. As these models become more integrated into business, the question isn’t whether they write well, but whether they finish what they start and act with integrity under pressure.

Amazon

AI security breach detection tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Choosing the Right AI Model: The Open Field

The current league table shows the competition is wide open. The top scorer, gpt-5.6-sol, achieved a 95, while Moonshot’s Kimi K3 is just behind at 93. The experiment’s fairness note: K3 ran without an effort parameter (the default), while others ran at xhigh, making K3’s performance even more impressive.

Why This Matters for Business & Crypto Investors

As AI models begin running critical business functions, their ability to resist manipulation, uncover buried data, and deliver full-deal performance will be decisive. For investors tracking AI’s impact on markets, understanding which models are capable of genuine management and honest decision-making will be crucial — especially as AI begins to influence not just corporate decisions but broader financial ecosystems.

Amazon

AI fraud prevention solutions

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Bottom Line: An Open League and a New Bet

This live experiment demonstrates that the AI league is wide open. Choosing a model blindly becomes a gamble, and the stakes are high — with real money, real deals, and real consequences. For crypto stakeholders and market participants, it underscores the importance of transparency, thorough testing, and understanding AI’s true capabilities before relying on it for critical decisions. The age of AI-driven management is here, and the winners will be those who test, measure, and verify — just like in this ongoing live challenge at firmulate.com.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Nothing in this article is financial or investment advice. Cryptocurrency and precious-metal investments carry significant risk — do your own research and consider a licensed advisor.


Amazon

AI business simulation platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Ethereum Up Or Down On August 24?

Analyzing Ethereum’s price trend on August 24, with current market data, expert insights, and what to expect next in the cryptocurrency space.

Dogecoin ETF: A Game Changer for Crypto Investors?

Will a Dogecoin ETF transform the crypto landscape and elevate Dogecoin’s status as a serious investment? Discover the potential impact and implications.

What Happens When Payment Apps Add Self-Custody Transfers

One key shift occurs when payment apps add self-custody transfers, impacting your control and security—discover what this means for your crypto assets.

Spread: Colombia (-1.5)

Colombia’s spread of -1.5 is confirmed in betting markets, with significant trading volume. The development impacts betting strategies ahead of upcoming matches.