How to Generate Mergeable Code with a Context Engine — Peter Werry, Unblocked
This video introduces Unblocked, a context engine designed to solve the 'access versus understanding' problem for AI agents and human workers in engineering organizations. It proposes that while current AI tools offer features like tab completion and agent IDEs, they often lack the organizational context needed to truly understand and contribute to a codebase, leading to a 'new employee' problem where agents constantly rediscover information. Unblocked aims to bridge this gap by curating and providing relevant context from diverse data sources, ultimately leading to faster, more accurate, and cost-effective development.
read more
The core problem Unblocked addresses is the context layer for both human and AI workers in engineering organizations. Historically, humans served as the primary context layer, manually sifting through disparate data sources like GitHub (code changes, PRs), Notion (system architecture), Jira (tickets), Slack (discussions), and Confluence (documentation) to build tribal knowledge. This process is time-consuming and prone to outdated information or conflicting data, leading to battle scars from incidents and ongoing maintenance.
With the rise of AI agents, this problem is exacerbated. Agents, much like new employees, reset their knowledge with every new task. They have to rediscover the codebase, build processes, testing methodologies, and deployment strategies repeatedly. This is a significant bottleneck that compounds costs and reduces efficiency. The speaker highlights that while tools like tab completion and agent IDEs are steps towards AI maturity, they only address superficial aspects. The ultimate goal is software factories where AI agents can operate autonomously and intelligently, which requires a robust context layer.
The speaker emphasizes the distinction between access and understanding. Simply providing agents with access to vast amounts of data (like an entire codebase or documentation in a large context window) does not equate to understanding. This is akin to the satisfaction of search phenomenon in radiology, where finding one indicator might lead to overlooking other crucial details. Agents tend to find plausible outputs and then stop, failing to distill true understanding of how all pieces fit together, including dependencies, architectural decisions, and future planning. This leads to distraction and wasted tokens (cost).
Unblocked's solution is a context engine that delivers organizational context to both human workers and AI agents. It aims to provide task-specific flow rather than a broad, undifferentiated stream of information. The demonstration shows how Unblocked can answer complex questions about an internal system, like the `SourceMark Engine`, by synthesizing information from multiple sources. It not only articulates the architecture and operation but also generates architectural diagrams and identifies optimization opportunities, showing its work by linking back to the relevant source documents (code, Notion pages, etc.). This trust-building feature allows users to verify the AI's answers and make corrections, which further enriches the knowledge base.
Unblocked also integrates with communication platforms like Slack, proactively chiming in on discussions when it has high-confidence answers. It can even surface past comments from specific individuals (like a senior engineer's insights), leveraging seniority and expertise as a signal to boost relevant information. Furthermore, it can interact with development workflows, as shown by its ability to generate a pull request (PR) to fix an issue identified through its analysis of code review metrics. The generated PR includes context, an overview of the fix, and links back to the original Slack conversation that spurred the change. This demonstrates Unblocked's capability to understand the why behind code changes, not just the what.
The speaker presents a Context Engine Simulator to illustrate the impact of Unblocked. In a simulated environment, using Unblocked's context engine resulted in a +7 quality improvement, -22% task speed, and -33% task cost. This highlights the efficiency gains from providing curated context. The underlying open-source projects, `document-query-engine` and `engineering-social-graph`, are also mentioned, allowing users to explore how Unblocked processes historical pull requests to generate schemas and identify team relationships and expertise within a codebase. The ultimate takeaway is that by providing targeted, intelligent context, Unblocked enables fewer tokens, faster triage, and better answers for engineering tasks.