OutfitterBench: Evaluating LLM Agents on Long-Horizon Resource Allocation and Commitment Coordination
Only one of seven frontier LLM agents consistently beat a simple rule-based baseline at running an equipment-rental business.
OutfitterBench gives agents 200 simulated days, a 46-product catalog and roughly 1,100 reservation requests under a fixed capital ceiling. Reservations and uncertain walk-in demand compete for reusable equipment, so each commitment constrains future availability. Some agents made decisions that conflicted with existing bookings; others fulfilled commitments reliably but earned low returns or delayed reallocating resources. Even the leading agent missed opportunities to use assets more profitably.
HF Daily Papers' note
OutfitterBench gives agents 200 simulated days, a 46-product catalog and roughly 1,100 reservation requests under a fixed capital ceiling. Reservations and uncertain walk-in demand compete for reusable equipment, so each commitment constrains future availability. Some agents made decisions that conflicted with existing bookings; others fulfilled commitments reliably but earned low returns or delayed reallocating resources. Even the leading agent missed opportunities to use assets more profitably.
HF Daily Papers' note
score 4