firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine if your woodworking project could be managed entirely by an AI — making decisions, reading your plans, resisting shortcuts, and even sealing deals without a single misstep. While that might sound futuristic, recent live experiments with AI models suggest that some are already capable of navigating complex business challenges with impressive discipline. The question is no longer whether AI can write a good report but whether it can truly run a company — and the answers might surprise you.

Buying for a business?Offer from Amazon

Get business pricing on tools and workshop supplies

  • Business-only prices and quantity discounts
  • Tax-exempt purchasing
  • Multiple users, one account, clear invoices
As an affiliate, we earn on qualifying purchases.

The Live Test: AI Facing the Business Worst Week

At the forefront of this inquiry is a real-world experiment conducted by Firmulate. They set up a small software company, complete with synthetic employees and real money mechanics, and tasked AI models to manage it through its toughest week. This wasn’t a simple chat test; it was a comprehensive simulation involving crises, customer interactions, and temptations to cut corners.

Same Crisis, Different Results

Four advanced AI models, representing the leading frontier of artificial intelligence, were each run through identical scenarios. These included customer crises, security challenges, and social engineering tricks like fake CEO messages and journalists requesting background info. Remarkably, all four models correctly identified every crisis and refused every manipulation attempt. This shows a baseline capability: AI can recognize threats and maintain integrity under pressure.

Who Sealed the Deal?

Despite their shared vigilance, only two models managed to close a crucial €55,000 deal, generating over €4,500 in monthly recurring revenue. The other two, despite diagnosing problems accurately and pitching solutions convincingly, left the opportunity unclaimed. The key difference? A buried reference in the company’s files that the winning models read — a detail only those models that dug into the company’s internal documents secured the deal at full price.

The Discipline of the Leading Model

The standout performer, a model called Kimi K3, demonstrated the cleanest discipline of all. It resisted all manipulation attempts, read the company files thoroughly, and made the decisive move that led to the deal. Its performance was even more notable because it ran without an effort parameter (the default API setting), while other models operated at a higher effort level — a technical detail that underscores its efficiency.

Amazon

AI business management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Significance for Business and Woodworking

This experiment’s implications reach far beyond software companies. For DIY enthusiasts, custom woodworkers, and small business owners, the core lesson is clear: AI is beginning to handle the nuanced, disciplined decision-making that traditionally required human oversight. Whether managing inventory, reading complex plans, or resisting shortcuts that compromise quality, some AI models are already showing they can do the job with integrity.

Real Work, Real Money, Real Risks

The live setup runs every business day, with 13 synthetic employees and real money mechanics, burning €105k monthly against a tiny €2.3k MRR. It’s a transparent, watchable experiment that demonstrates AI’s current limits and strengths in managing real-world operations. The models are continually learning and evolving, and their decision-making is fully auditable, meaning you can see exactly how they arrive at each choice.

Why It Matters to You

If AI agents will someday help you with your CRM, support queue, or supply chain forecast, the critical question isn’t whether they can generate pretty reports or chat smoothly — it’s whether they can finish what they start, read your essential documents, stay honest under pressure, and deliver value reliably. The league table from the experiment shows that the top models don’t just excel at understanding but also at discipline and execution, key qualities for any business owner or DIY builder.

The League Table: Who’s Leading?

  • gpt-5.6-sol — scored 95, found the buried fact, closed the deal — the full performance
  • Kimi K3 — scored 93, the newcomer from Moonshot, closed the deal with the cleanest discipline
  • Sonnet 88 — scored 88, closed the deal but with some process slips
  • Fable 5 — scored 77, also closed but with more slips
  • Opus 4.8 — scored 73, the weakest in closing the deal

It’s important to note that K3 ran without an effort parameter, using the default API setting, which means its discipline wasn’t artificially boosted.

Final Thoughts: A New Benchmark for Business AI

This experiment is a wake-up call for anyone considering AI integration. The league is open, and the best models are already capable of running complex operations with honesty and focus. For woodworking and DIY entrepreneurs, it suggests that AI can be more than a chat assistant — it can be a disciplined, reliable partner in managing your craft or business.

To see the live data, read detailed results, or try the same wargame against your own business, visit firmulate.com. The future of AI in business is unfolding now — and the best contenders are just getting started.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Recent live experiments show some AI models can manage complex business challenges with discipline and accuracy, outperforming many expectations — a game-changer for enterprise and DIY alike. The league is open, and the best models are proving they can finish what they start, read deeply into your files, and resist manipulation under pressure.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Interfacing 101: Different Types and How to Choose the Right One

Understanding the different types of interfacing is essential for perfect sewing projects, and choosing the right one can be easier than you think—continue reading to learn how.

Fabric Softener Mistakes That Can Ruin Sewing Results

Wasting too much fabric softener mist can ruin your sewing results—learn how to avoid these mistakes and achieve perfect finishes.

Discover the Secret to Perfectly Aligned Sewing Machine Notches!

With expert tips on sewing machine notches, unlock the key to flawless garment construction and elevate your sewing skills to the next level.

How to Repurpose Broken Handbags Into Useful Craft Materials

Unlock creative ways to repurpose broken handbags into useful craft materials that will inspire your next eco-friendly project.