--- title: "Practitioner's Corner" canonical: "https://current.tinyfish.ai/issue/6/practitioners-corner" publication: "TinyFish" publisher: "TinyFish" language: "en-US" guide: "https://current.tinyfish.ai/llms.txt" permalink: "https://current.tinyfish.ai/issue/6/practitioners-corner" issue: 6 section: "practitioners-corner" description: "Lessons from the field—what we see building at scale" authors: ["Rina Takahashi"] published: 2025-12-08 updated: 2025-12-04 articles: 15 --- # TinyFish > CURRENT is a journal about AI agents in production, for the engineering and product leaders who have to make them work. Drawing on experience building enterprise web agents, it explains why the demo succeeded and the deployment didn't, and what that means for choosing vendors, briefing the board, and avoiding mistakes others have already made. [Read on the website]() ## Issue 6 — Practitioner's Corner Lessons from the field—what we see building at scale ### Dispatches from Production Scale - [The Page That Lies]() — By [Rina Takahashi]() · Published 2025-12-03 · Format: Field Dispatch You click a button. Nothing happens. You click again. Still nothing. Then, three seconds later, both clicks register at once and you've accidentally submitted a form twice. The button was visible, styled, perfectly clickable. It just wasn't connected to anything yet. ### The Builders - [When Your Agent Fails at Step 47]() — By [Rina Takahashi]() · Published 2025-12-03 · Format: Builder Profiles When an agent fails at step 47 of a 50-step workflow—maybe verifying a hotel booking across a regional site that just changed its confirmation page—you don't get a stack trace. You get silence, or worse: a "success" message with subtly corrupted data that won't surface until a customer complains three days later. ### The Number That Matters - [Browser Agents Hit 89% Success Rate, Humans 95.7%]() — Published 2025-12-03 The best browser agents now achieve 89% success on standardized benchmarks. Humans hit 95.7% on identical tasks. Six point seven percentage points. ### Field Notes from the Ecosystem November delivered a series of production failures that reveal how systems actually break. Not the theoretical failure modes we plan for. The ones that emerge from scale, configuration, and timing colliding in unexpected ways. Configuration files double in size. Authentication stops nothing. Crawler traffic quadruples in eight months. Task queues choke on connection surges. Each incident exposes the distance between our mental models of infrastructure and its actual behavior under load. These observations come from public incident reports, security research, and infrastructure analysis. They represent the operational reality of building at scale in 2025. - **Config File Doubles, Internet Goes Dark** — [Source]() — Published 2025-12-03 Tag: Configuration Management November 18: Cloudflare's Bot Management config doubled in size, hit hard limits. X, ChatGPT, Shopify offline simultaneously. Engineers spent hours chasing Workers KV before finding the real problem. A configuration change took down a chunk of the internet. - **Protection Collapsed 67% This Year** — [Source]() — Published 2025-12-03 Tag: Bot Detection Testing 17,000 domains: full bot protection dropped from 8.4% to 2.8% in twelve months. Detection effectiveness ranged 6% to 42% depending on tool. Even large enterprises (10,001+ employees) left 61% of domains completely unprotected. The numbers are brutal. - **95% of Attacks Come From Authenticated Sessions** — [Source]() — Published 2025-12-03 Tag: API Security Authentication stops nothing. 95% of API attacks in 2025 came from authenticated sessions. Injection and broken authorization made up over one-third of incidents. Organizations test only 38% of APIs, leaving legacy endpoints exposed. Stripe's /v1/sources breach proves the pattern. - **$44.5 Billion Wasted on Unused Resources** — [Source]() — Published 2025-12-03 Tag: Cloud Economics Q2 2025 cloud spend hit $99 billion, up 25% year-over-year. But 21% goes to unused or under-utilized resources. That's $44.5 billion annually. One in three IT leaders report wasting over a quarter of their cloud budget. Scale amplifies waste. - **LLM Crawlers Quadrupled in Eight Months** — [Source]() — Published 2025-12-03 Tag: Crawler Traffic January to August 2025: LLM crawler traffic more than quadrupled. Some publishers saw web scraping reach eight times the volume of compliant AI bots when using advanced detection. The fundamental composition of automated traffic has shifted. Old assumptions about bot behavior no longer hold. - **Task Queue Chokes on Connection Surge** — [Source]() — Published 2025-12-03 Tag: Deployment Infrastructure Railway's November 25 incident: Temporal-backed task queue couldn't handle hundreds of thousands of new connections in minutes. All Free, Trial, and Hobby deployments stopped. Pro deployments continued with delays. The proxy layer plus metadata management hit scalability limits nobody anticipated. ### Practitioner Resources - **What Actually Breaks at Scale** — [Source]() — Published 2025-12-04 Real incident reports from Cloudflare, Google, CrowdStrike. Null pointers, validation bugs, cascading failures. The unglamorous reality of production. - **Google's Postmortem Culture** — [Source]() — Published 2025-12-04 At scale, incidents are inevitable. What separates mature operations from chaos is formalizing how you learn from failure. - **Running Postmortems That Actually Work** — [Source]() — Published 2025-12-04 Blameless is the easy part. Atlassian's guide covers the operational details: timing, facilitation, documentation that uncovers root causes. - **Browser-Use Framework Benchmarks** — [Source]() — Published 2025-12-04 Open source automation framework showing 3-5x speed improvements. Real code, concrete numbers. Worth examining if you're building at scale. - **Multi-Agent Coordination Beats Single-Agent Approaches** — [Source]() — Published 2025-12-04 93% on Mind2Web benchmark through specialized agent teams. The architectural insight: cardinality as a scaling dimension in web automation. - **Deploying Web Agents With LangChain** — [Source]() — Published 2025-12-04 Technical walkthrough addressing authentication, CAPTCHA, reliability. Shows the operational decisions you face when agents hit production constraints. ## Other sections in Issue 6 - [Daily Brief]() - [Market Pulse]() - [Foundations]() - [Echoes]() - [Vision]() ## More - [Publication guide]() - [Issue archive]()