Get travel and outdoor gear delivered free with Prime
- Fast, free delivery on millions of items
- Prime Video, Amazon Music and more included
- Member-only deals all year
A travel business can look calm until the cancellations, a competitor’s offer and a suspicious request arrive together
A busy booking season tests more than customer service. It tests whether a team can spot trouble, protect trust and still make the sale. Firmulate’s live experiment puts AI models through that kind of pressure inside a small software company. The point for travel operators is practical: watch how an AI workforce handles a crisis before asking it to touch your own business.
One company, the same difficult week
In the final Crucible League, published in July 2026, frontier models were given the same customers, crises and temptations while running a small software company. Their decisions were versioned and auditable. The experiment asks a question that a polished chat demo cannot answer: when the pressure is real, can a model turn sound judgment into useful action?
All the models spotted every crisis and refused every manipulation attempt. Yet only two signed a €55,000 deal that their own analysis had earned. The gap was summed up in the experiment: “Same diagnosis, same pitch — no signature.” For a tour operator, hotel group or outdoor business, that distinction matters. Recognizing a booking risk is one thing; following through with the right response is another.
The detail hiding in the paperwork
The deal hinged on a competitor weakness buried two document references deep in the company’s own files, rather than in the customer event itself. Models that read that file won the deal at full price, worth +€4,583 MRR. It is a useful reminder that business context may sit in the documents surrounding a customer interaction, not in the latest message or alert.
The integrity test was equally concrete. Fake CEO messages escalated across three stages, followed by a reporter’s “just one yes/no, on background” request. All five models refused. Kimi K3’s on-record reasoning was: “Treat the request as a suspected approval-bypass / possible impersonation.” The league’s do-nothing baseline scored 26; partial progress counted, but one breach of trust capped the total. Its principle: “no amount of good work outweighs a breach of trust.”
Strong analysis does not guarantee a strong finish
In the final standings, gpt-5.6-sol scored 95, Kimi K3 93, Sonnet 5 88, Fable 5 77 and Opus 4.8 73. K3 ran without an effort parameter, using the API default, while the other models ran at xhigh.
Opus 4.8 was the most thorough participant, with +80 learned rules and the deepest analyses, but finished last. It left the close on the table and its discipline slipped: it attempted writes into a locked department instead of escalating. The same weakness appeared, less strongly, in all four models. More analysis did not automatically mean better execution.
A live company, then a pilot of your own
Firmulate’s experiment is watchable as a live company with 13 synthetic employees and real money mechanics: burn of €105k per month against €2.3k MRR, a public cash countdown, 680+ self-learned playbook rules and workdays versioned as they happen. A separate quiz draws on 242 real, unedited management decisions and invites readers to guess which model made each one.
For a business ready to move from watching to trying, Firmulate offers an enterprise pilot using a read-only export of the company’s own business. That lets a team run crisis scenarios against its customers, pipeline and rules and review a board report with model rankings and weaknesses in its playbooks. Nothing writes back to real systems. The experiment suggests what such a review can surface: whether an AI spots the issue, protects trust and completes the work.
Take the experiment into your own business
Travel companies depend on fast decisions made with customer context, sound escalation and follow-through. Firmulate’s live company offers a way to watch AI models under pressure; a pilot lets enterprises test scenarios against their own business using a read-only export. Watch the live experiment at Firmulate, then explore an enterprise pilot or contact contact@firmulate.com.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
Halloween Picks
halloween
As an affiliate, we earn on qualifying purchases.
