Anthropic Rebuilt Git (yes really)
This video argues that Git is no longer the right primitive for modern software development, particularly with the rise of AI agents generating significant code changes. GitHub's frequent downtime and the inherent friction of human-centric Git workflows, such as code reviews and merge queues, are becoming bottlenecks. The presenter highlights Anthropic's new in-house version control system, Scion, which is designed for agent-scale development with extreme concurrency, immutability, and sparse checkouts, achieving massive speedups and scalability improvements over traditional Git.
read more
The core argument of this video is that the traditional Git workflow, especially when layered with platforms like GitHub, is becoming a significant bottleneck in modern software development, particularly with the increasing involvement of AI agents in code generation. The presenter emphasizes that Git's foundational design, centered around human review, approval, and control, was built in an era where code changes were expensive and humans were the primary contributors. This model is now showing rough edges as AI-driven development accelerates.
The presenter first highlights GitHub's unreliability, showing a "Missing GitHub Status Page" revealing as much as 7% downtime across various services, which can block releases and important changes. This unreliability is compounded by the inherent inefficiencies of Git's design when dealing with large-scale, concurrent changes.
The video then pivots to Anthropic's recent announcement about their in-house version control system, Scion, which they fully migrated to from Git in just five months. This move was driven by a staggering increase in code changes: from 2,500 changes per day in May 2026 to over 30,000 changes per day by September 2026. Anthropic found their existing developer infrastructure, built for human scale, was bottlenecking their progress, especially in areas like source control, builds, and CI.
Scion is built on several core principles tailored for agent-scale source control: Clients are always online: Unlike Git, which assumes clients work offline, Scion is designed with the understanding that nearly all clients (agents and jobs) are always online, allowing for direct data fetching rather than complete local repository copies. Client-server asymmetry: Git treats every client as a full-fledged server. Scion, however, centralizes file history and blame on the server. Clients maintain a bounded local object cache and only fetch data when needed, drastically reducing local data requirements and enabling lightweight operations. Comprehensive source control service: Scion provides rich APIs for various operations (e.g., getting changesets, computing diffs, finding merge bases) without requiring a full local repository. This enables automated tools and CI jobs to query the repository efficiently via API, rather than cloning the entire repository, which was deemed impractical at Anthropic's scale. Horizontally scalable: Scion's design emphasizes horizontal scalability for servers, requiring minimal coordination. It uses large caches to compute derived data on the fly and write results back to Spanner. There are no multi-gigabyte packfiles (Git's compressed bundles of objects), eliminating repository maintenance needs. Commits are cheap, incremental, and lock-free: In Git, commits are local and require a push to share. In Scion, every commit, rebase, or merge happens on the server, removing the need for pushes and enabling faster operations. The cost of creating/updating data structures scales with the size of the change, not the entire repository. This design discourages direct references (pointers) to commits, branches, or tags, favoring a global state model that every server agrees on, mitigating scaling problems. Working copy is optional and sparse: Due to the massive monorepo size and millions of daily CI checkouts, Scion avoids full checkouts whenever possible. It supports sparse checkouts, where only requested directories are contained, and virtualized checkouts, which materialize files on demand. Clients only pay for what they actually read from disk.
Scion's Architecture and Performance: The system uses a tiered architecture, with a scion-server managing the authoritative state in Spanner (for changesets, branches, trees) and Cloud Storage (for immutable file contents). Regional scion-cache layers serve developer machines and CI/cluster jobs. These caches stream objects directly from memory in disk format, avoiding time-consuming data transformations. Scion-daemon instances per node periodically refresh snapshots, providing fast access to the latest state for CI jobs.
This architecture results in significant performance gains: pulling latest code is 25x faster, checkouts are 14x faster, rebases are 4.8x faster, status checks are 207x faster, and diffs are 6.1x faster for developer environments. For agent environments, creating new worktrees is 84x faster, and pull latest operations are 26x faster. The infrastructure footprint is 200x smaller than their previous Git mirroring setup.
Key takeaways from building Scion include: Rapid development with small teams: A team of seven built both Scion and Antique (their code review tool) and fully migrated their monorepo in five months, even while code volume increased tenfold. This hints at a future of nimble migrations. Changing role of engineers: Engineers are no less valuable, but their work shifts from low-level code review to high-level inter-system design and troubleshooting. AI agents can handle routine code-writing, but skilled engineers are needed to guide AI and solve complex, emergent issues. Anthropic uses AI extensively for adversarial review and optimizations. * Rethinking established paradigms: The traditional friction-adding approaches in engineering (e.g., global repository locks) are being re-evaluated. Scion invests in post-merge and pre-deploy automated testing to handle concurrent changes and conflicts, leveraging AI to resolve conflicts faster than humans.
The presenter also shares a personal anecdote about rewriting a TypeScript compiler in Rust, highlighting the effort involved in custom tooling to achieve desired performance, despite having access to powerful AI models. He emphasizes that while not every company needs to build their own Git alternative, the underlying principles of optimizing for agent-scale development are becoming increasingly relevant across the industry. This is a call to rethink fundamental tools and workflows to embrace the new possibilities of AI-driven software engineering.