The summer Math fell to the machines...

Fireship · 2026-08-19

This video, titled "AI is killing Math," presents a satirical yet concerning look at the increasing capabilities of AI in solving complex mathematical problems, historically thought to be exclusive to human ingenuity. It highlights recent instances where AI models, particularly from OpenAI and Anthropic, have disproven long-standing mathematical conjectures and advanced the understanding of highly challenging problems like the Riemann Hypothesis. The core takeaway is that AI is rapidly encroaching upon domains of pure mathematics, which may lead to a foundational shift in how mathematical research is conducted and what it means to be a mathematician in the age of AI.

read more

The video opens by humorously contrasting the common developer fear of AI making them "obsolete" with the unexpected reality that mathematicians might be the ones truly facing an existential crisis. It cites an article titled "AI was meant to replace software developers. It's creating more instead," to set up the ironic turn. The author then introduces the recent advancements in AI's mathematical prowess, emphasizing that in the last three weeks, AI has solved more open math problems than the entire human race in the previous decade.

Several specific examples are provided:

Erdos Problems: AI has killed multiple open Erdos problems, including an 87-year-old conjecture and a 30-year-old graph theory conjecture (the Dinitz-Garg-Goemans conjecture). These were solved by models like GPT-5.2 Pro, often with minimal prompting from human users. The video points out that even non-mathematicians, like a Columbia PhD student and a 23-year-old amateur, have successfully used AI to solve these problems. International Math Olympiad (IMO): About a year prior, AI models solved five out of six problems at the IMO, which the video likens to the "LeetCode of math problems"—a common benchmark in competitive programming. While initially considered harmless due to the nature of competition math, this achievement foreshadowed deeper advancements. Erdos-Turan Conjecture (Unit Distance Problem): In May, an OpenAI model disproved an 80-year-old Erdos conjecture in discrete geometry related to unit distances. This marked a significant step beyond competitive math, moving into fundamental problems. Jacobian Conjecture: More recently, mathematician Levent Alpöge, with the help of a tool called Fable, posted a counterexample to the Jacobian Conjecture—one of the most famous problems in algebraic geometry, open since 1939. This problem concerns whether a polynomial function with a non-singular Jacobian matrix always has a polynomial inverse. The AI-generated counterexample demonstrated that local invertibility does not guarantee global invertibility for these functions. Non-Sofic Groups and Connes's Rigidity Conjecture: OpenAI's next major model, Astra, has internally solved ten open problems across mathematics and theoretical computer science. These include improving upper bounds on high-dimensional sphere packing (a problem related to packing identical spheres in n-dimensional space), constructing non-sofic groups (which had been an open question in group theory), and disproving Connes's rigidity conjecture (a complex problem in von Neumann algebras). Notably, OpenAI released all these proofs on GitHub with Lean certificates, which are formal, machine-checkable proofs. Riemann Hypothesis: Most strikingly, Anthropic's Claude model made progress on the Riemann Hypothesis, one of the seven Millennium Prize Problems with a million-dollar bounty. While Claude didn't fully prove the hypothesis, it significantly improved the long-standing lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis, increasing it from 41.6% to 67.2%. This achievement was prompted by Jarred Sumner, the creator of Bun.js, who, with simple encouragement, guided Claude to coordinate 60 subagents, run 2400 shell commands, and write hundreds of Python scripts to achieve this breakthrough. The result was validated by both internal Anthropic mathematicians and two external number theory experts, and formalized in Lean.

The video concludes by emphasizing the profound implications of these advancements for the field of mathematics, suggesting a future where AI is not just a tool but a formidable force in mathematical discovery, challenging traditional human-centric approaches to research and problem-solving.

Why Your Enterprise Tech Stack Isn’t Ready for AI Agents — Christopher Lovejoy & Saul Howard

AI Engineer · 2026-08-19

This talk addresses the challenges of building AI agents for regulated enterprise environments like healthcare. The speakers highlight four key issues: auditability, sensitive data handling, human-in-the-loop escalation, and continuous evaluation. They propose leveraging existing distributed systems design patterns, such as immutable ledgers and orchestration-adjacent object storage, to build a platform that intrinsically supports these requirements for AI agents, rather than bolting them on as afterthoughts.

read more

Dr. Christopher Lovejoy (Anthropic) and Saul Howard (Anterior) discuss the challenges of deploying AI agents in regulated enterprise settings, particularly healthcare, and propose architectural primitives to address these issues. They emphasize that while building a successful Proof of Concept (POC) for an AI agent can be relatively quick and achieve good performance metrics (e.g., fast, cheap, accurate), the real challenges emerge during productionization.

They outline a common scenario: a successful four-week POC involving two engineers, an application layer (Care Management System, custom application, SalesForce), a control plane (EventBridge, Lambdas), and a data plane (S3, Dynamo, Databricks), all interacting with an LLM API. The POC achieves great results and generates excitement, but then stakeholders raise critical questions about production deployment:

1. Auditability: Regulated industries like healthcare (HIPAA, SOC 2, HiTrust) require a complete, legally justifiable audit trail for every action an agent takes, including data accessed and authorizations. Traditional developer logs are insufficient. The proposed solution is an immutable ledger of actions as the data store. This append-only, timestamped log comprehensively captures all inputs, tool calls, parameters, and outputs. This makes auditability trivial, as all actions are recorded with provenance, allowing for complete system state reconstruction at any point in time.

2. Sensitive Data Handling: How is sensitive data (e.g., Protected Health Information - PHI) passed to and used by the agent? Healthcare data is complex, often unstructured, large, and subject to strict access controls. Developers often need to debug and observe agent behavior without direct access to sensitive data. The solution is orchestration-adjacent object storage. Sensitive data is stored in a segregated object store, with the orchestrator's event log only containing metadata and pointers to the data. This allows developers to see the data's shape without exposing the raw PHI, and zero-trust principles can be applied to the agent's data access using tokens, ensuring data is only accessed at the point of use and not unnecessarily circulated.

3. Dynamic Escalation to Humans: Who approves the agent's decisions, especially when it's unsure or for critical actions? This requires dynamic, unpredictable human intervention. LLMs and humans process context differently, making seamless handoffs challenging. The solution involves defining “agent” to encompass both LLMs and humans within the platform. This human-agent equivalency ensures that any action an LLM can take, a human can also take. Furthermore, any set of context can be given both to an agent as a prompt and to a human as a UI. This structural definition allows for flexible, dynamic human-in-the-loop escalation, as the downstream system doesn't differentiate between an action taken by an LLM or a human.

4. Effective Evals as a By-Product: How do we ensure the agent continues to perform well over time? Evals are crucial but challenging due to LLM non-determinism, potential data drift (offline vs. production data), and the difficulty of tracking precise changes. The primitives previously discussed naturally support continuous evaluation: The immutable ledger allows replaying actions and comparing variations in prompts, models, and code, providing a granular understanding of changes. Human-agent equivalency allows direct ground-truthing of any action within the platform, enabling direct comparison of agent-taken actions against human-approved ones. * Orchestration-adjacent object storage enables running evaluations directly on production data without exposing sensitive information, addressing data drift and representativeness issues.

The key takeaway is that architectural decisions should treat production-ready, scaled enterprise system constraints seriously from the outset. By building foundational primitives like immutable ledgers, segregated object storage, and human-agent equivalency, auditability, secure data handling, dynamic escalation, and continuous evaluation become intrinsic properties of the system rather than bolt-on additions.

Citizens Build, Agents Execute, Experts Govern

Martin Fowler · 2026-08-19 · 7 min read

TLDR: AI has made it trivially easy to build working software, but that's never been the hard part of software engineering — keeping it secure, resilient, auditable, and maintainable in production is. This shifts experienced engineers from writing features to governing the systems and guardrails that let everyone else (humans and agents) build safely at scale. The real scarcity was never people who could write code; it was always engineering judgment, and that judgment is now more leveraged than ever.

Don’t be data poor — Anuj Iravane, Anterior

AI Engineer · 2026-08-19

This talk highlights Anterior's approach to generating synthetic medical records to overcome the challenge of data scarcity and privacy in healthcare AI. By reversing the traditional inference workflow, they leverage clinical policies modeled as decision trees to sample diverse reasoning traces and then iteratively generate realistic patient journeys and associated medical documents. This human-in-the-loop, skills-based pipeline allows domain experts to steer data generation, enabling rapid creation of high-fidelity synthetic datasets for robust model evaluation and deployment.

read more

Anuj (from Anterior) begins by introducing Anterior as a clinician-led AI company building agents for high-stakes healthcare administrative workflows like prior authorization and payment integrity. The core challenge in these domains is dealing with highly unstructured, sensitive, and ephemeral data, primarily in the form of scanned fax bundles containing medical records. Approximately 70% of medical communication still occurs via fax, leading to a "rich data" problem: data is information-dense, covers diverse clinical trajectories (long-tail, rare, edge cases), and exists in varied formats (handwriting, tables, checkboxes, images).

The critical constraint is that this data is Protected Health Information (PHI), meaning it cannot be retained, reused, or even derived into anonymized copies due to strict HIPAA regulations and contractual obligations. This creates a dilemma: how do you build and evaluate high-accuracy AI models (where 95% is not sufficient) when the data you need most is the data you're least allowed to keep?

Anterior's solution is to synthetically generate the data themselves. While Large Language Models (LLMs) are powerful for generation, they present challenges for this specific task: Diversity collapses to the average case: LLMs tend to generate generic content, lacking the nuanced and diverse scenarios found in real clinical data. Realism is generic, never convincingly specific: Generating highly realistic, specific medical details consistently is difficult for generic LLMs. Length constraints: Medical records can be hundreds of pages long, pushing the limits of current LLM context windows and generation capabilities. Lack of exposure: LLMs often have limited exposure to highly specialized medical data in their pre-training corpora.

Anterior proposes a novel approach by reversing the inference workflow. In a typical forward task: Data (medical record) -> Reasoning Trace (review steps based on Policy) -> Label (generated outcome/decision). Their synthetic data generation pipeline works backward:

Idea #1: Start from the answer, work backward. Instead of generating data and then inferring a label, they start with a desired outcome (label). They then sample a reasoning trace (the logical steps a clinician would take to arrive at that outcome) and, finally, generate the data (medical record) conditioned on that trace. This ensures that the generated data is directly relevant to specific outcomes and reasoning paths.

Idea #2: Sample from the policy. Clinical policies are explicitly modeled as symbolic reasoning graphs (SRG), similar to decision trees. This explicit, structured representation of clinical logic allows Anterior to deterministically sample diverse reasoning traces for a given outcome. This overcomes the diversity collapse problem faced by generic LLMs, as they can specifically target rare or edge cases defined within the policy's decision points. This also acts as a more uniform and effective prior distribution for data generation, helping explore more scenarios than would typically appear in production data.

The Full Pipeline: 1. Sampled Seed: The process begins with a chosen label (outcome) and a reasoning trace (review steps) sampled from the clinical policy (SRG). 2. Patient Invariants: Using this seed, the pipeline first generates patient invariants (e.g., biological sex, birth date, blood group). These are fundamental patient characteristics that remain constant throughout their journey. 3. Patient Journey (Events & Encounters): Next, an LLM generates an ordered list of events and provider encounters that the patient might have experienced. This represents a high-level narrative of the patient's clinical trajectory, captured in natural language. 4. Documents per Encounter: For each encounter in the patient journey, the pipeline fans out to generate specific medical documents (e.g., H&P, labs, nurse notes, path reports, discharge summaries). This is done incrementally, layer by layer, with separate LLM calls to avoid overloading context windows and enable scaling for longer patient journeys. The generation happens in plain text and Markdown format, which can then be converted to rendered PDFs if needed. 5. Human-in-the-Loop: Clinicians are integrated into the loop at various points, allowing them to interject and steer the generation process. This ensures that the generated data aligns with clinical reality and specific needs. They can refine reasoning traces or document content, helping to model complex failure cases proactively. 6. Evals (Refinement Loop): A suite of evaluations provides feedback to refine the generated data. Key checks include: Consistency: An LLM-based check ensures no contradictions or conflicting information across generated documents. Round-trip Check: The pipeline verifies if the generated medical records, when fed back through the original inference workflow, yield the initially sampled label and reasoning trace. This property is crucial, as it means ground truth labels are implicitly correct by construction, eliminating the need for expensive manual labeling of synthetic data. * Realism: Qualitative and quantitative assessments ensure the generated data's resemblance to real-world medical records.

Results & Takeaways: Anterior's generated synthetic data has shown high fidelity; in blind reviews, clinicians could distinguish synthetic from real data less than 60% of the time. 90% of Anterior's datasets are synthetic, helping them maintain a >95% accuracy (F1) SLA in production across many customer deployments. * Over 50% of datasets are created just-in-time for customer-specific deployments, significantly accelerating development and testing cycles.

Key Takeaways: Try reversing your inference workflow: Think backward from desired outcomes to data generation. Diversity should be sampled: Leverage structured knowledge (like clinical policies) to sample diverse scenarios, not just generic ones. Try to emulate the process in which data was generated: Mimic real-world data generation processes to create more realistic synthetic data. Give your domain experts the keys: Empower domain experts (e.g., clinicians) to own and steer the data pipeline, ensuring realism and driving recursive self-improvement, rather than relying solely on AI engineers.

Claude reveals research flaws and urges source tracing #claudeai #researchaccuracy #aitechnology

AI Honeycove · 2026-08-19

This video highlights a critical flaw in Claude's research capabilities: it treats repeated claims across multiple low-quality websites as independent confirmations, leading to the propagation of unverified rumors. The proposed solution, dubbed "RumorKiller," involves appending a specific one-line prompt to instruct Claude to trace every factual claim back to its earliest identifiable source. This technique enables Claude to distinguish between genuinely confirmed information, unconfirmed data, and rumors, significantly enhancing the reliability and utility of its research output for decision-making and content creation.

read more

The video addresses a significant issue with Claude's web research functionality, particularly how it handles factual claims found across the internet. The core problem is that Claude, by default, pulls the highest-ranking passages from its web searches. If a specific claim appears across multiple websites (e.g., ten different sites), Claude interprets this as ten independent confirmations, even if all ten sites have merely copied from a single, potentially anonymous, unverified source. This leads to a false sense of reliability, where a rumor can be presented as solid research due to its widespread (but interconnected) repetition.

To counteract this, the video introduces a simple yet effective technique called "RumorKiller." This is a one-line addition to your prompt that fundamentally changes how Claude approaches factual verification. The specific line to append after your main prompt is:

"Trace every factual claim back to its earliest identifiable source, distinguish independent confirmation from repeated or derivative reporting, and clearly flag any claim that cannot be independently verified."

This instruction forces Claude to perform a deeper, more rigorous analysis. Instead of merely aggregating prevalent information, it directs Claude to:

1. Trace claims to their origin: Identify the earliest identifiable source for each factual claim, rather than just the highest-ranking or most frequently cited contemporary sources.

2. Distinguish independent confirmation: Actively differentiate between truly independent verification of a claim and instances where the claim is merely being repeated or derivatively reported across various websites. This is crucial for breaking the cycle of self-confirming rumors.

3. Flag unverified claims: Explicitly mark any claim that cannot be independently verified. This transparency is vital for users to understand the confidence level of the information provided.

The impact of this "RumorKiller" prompt is described as massive. By implementing this single line, users can transform Claude's output from potentially misleading aggregations of rumors into a clear breakdown of:

What's real: Information that has been independently confirmed and traced to credible original sources. What's unconfirmed: Information that is present but lacks sufficient independent verification. * What's just a rumor: Claims that have spread widely but lack a verifiable original source or consistent independent confirmation.

This enhanced output is significantly more valuable for senior engineers and other professionals who rely on AI for making decisions, writing content, or conducting thorough research, as it provides a robust and verified information base rather than simply reflecting the consensus of widely propagated (but potentially baseless) claims.

Mojo🔥 is now open source

Simon Willison · 2026-08-18 · 2 min read

Mojo, a Python-inspired language built for high-performance GPU programming, has released its compiler and toolchain as open source under Apache 2 after shipping version 1.0, having quietly dropped its original goal of being a full Python superset. This matters because it's now a production-ready, openly auditable option for GPU workloads where Python's performance falls short, with a migration path assisted by AI tooling rather than direct compatibility.

Practitioner Voice: The Writing Category Nobody has Named Yet

Martin Fowler · 2026-08-19 · 8 min read

TLDR: There's a distinct writing mode that neither academic writing nor thought leadership captures — one where practitioners lead with their conclusion, keep their personal judgment visible throughout, and leave tensions unresolved rather than forcing tidy takeaways. Fowler calls it "Practitioner Voice," and its authority comes from having been accountable for outcomes, not from credentials or platform. The category matters now because without a name for it, it can't be taught, recognized, or defended against the rising tide of AI-generated prose that mimics the other two styles effortlessly.

llm-gemini 0.33

Simon Willison · 2026-08-13 · 2 min read

The llm-gemini plugin v0.33 adds support for several new Gemini models (including 3.7 Flash with its updated thinking effort levels) and two new embedding models, while upgrading compatibility with LLM 0.32 to expose reasoning traces and server-side tools like code execution directly from the CLI. This matters because if you're integrating Gemini models into workflows via Simon Willison's LLM framework, this update gives you programmatic access to the latest models and agentic capabilities like sandboxed Python execution in a single command, plus a practical heads-up that SVG output from Gemini has cross-browser rendering inconsistencies worth accounting for.

Ritual Brilliance: How a pair of Shrek ears shaped Linden Lab culture by making failure funny — and safe

Charity Majors · 2023-05-30 · 12 min read

TLDR: A pair of novelty ogre ears at Linden Lab functioned as an early, informal version of blameless post-mortems: engineers who broke production voluntarily wore them, triggering peer storytelling and support rather than blame. The ritual's power was that it reframed failure as inevitable and even honorable, which systematically dismantled fear of production and encouraged transparency across the whole company. The key insight is that a lightweight, opt-in social symbol can instill psychological safety faster and more durably than any formal policy.

Questionable Advice: “People Used To Take Me Seriously. Then I Became A Software Vendor”

Charity Majors · 2023-03-29 · 14 min read

TLDR: Transitioning from engineer to software vendor forces a reckoning with open-source culture's deeply embedded contempt for commercial software — contempt that turns out to be largely unfounded. The real insight is that good software creates genuine value, and sales at its best is a repeated-game relationship built on delivering that value honestly, not manipulation. Vendors worth listening to are mostly just engineers who crossed the aisle and still care about the same problems.