Showing posts with label AI Coding Agents. Show all posts
Showing posts with label AI Coding Agents. Show all posts

Sunday, 10 May 2026

From git clone to llm clone

No Software Is Safe

When Linus Torvalds shipped the first version of Git in 2005, he solved the coordination problem of distributed software development. git clone became the foundational primitive of modern open source — a single command that collapsed the distance between "knowing software exists" and "having the software." Before Git, replication required permission, proximity, and manual effort. After Git, replication became free.

We are at an equivalent inflection point. The primitive is different and the implications are more intense. The new command is not git clone <repo>. It does not require the source code. It does not require a repository. It does not require permission from anyone. It requires only a public interface, a test suite, and a frontier model with a feedback loop.


# The old world
$ git clone https://github.com/vercel/next.js
# Requires: public source · open licence · maintainer permission

# The new world
$ llm clone https://nextjs.org
→ Observing public API surface...
→ Generating test suite from documentation...
→ Running 800 agent sessions against correctness oracle...
→ vinext v0.1 ready. Cost: $1,100. Time: 1 week.

# Source code not required. Licence not required. Permission: irrelevant.

Cloudflare ran this command. Anthropic's own agents ran a version of it on a C compiler and a Linux kernel. A pair of developers ran it in the middle of the night on Anthropic's own flagship product, after Anthropic accidentally left the source in a public S3 bucket. The market watched all of this happen in real time and drew the correct conclusion. Nearly a trillion dollars of software market capitalisation was repriced in six weeks.

This post is about what "no software is safe" actually means for how we think about building and defending technology businesses.

Four Months That Changed Everything

The events are discrete but their meaning is cumulative. Taken individually, each looks like an interesting technical demonstration. Taken together, they constitute proof of a new capability regime — and the market treated them accordingly, selling off nearly a trillion dollars in software equity between January and March 2026.

February 5, 2026
Anthropic: 16 agents build a C compiler

16 Claude Opus 4.6 agents, running in parallel Docker containers on a shared Git repository, produce a 100,000-line Rust-based C compiler capable of compiling Linux 6.9 on x86, ARM, and RISC-V. Cost: $20,000. Time: 2 weeks. No human wrote a line of the compiler. The binding constraint was not model intelligence — it was the test harness and GCC oracle that let the agents self-correct.

~February 2026
Cloudflare: Next.js rebuilt in one engineering week

One Cloudflare engineer, using OpenCode and Opus 4.5, rebuilds Next.js as vinext — a Cloudflare Workers-native runtime. Cost: ~$1,100 in tokens. Time: 1 week. 800 agent sessions. No access to Vercel's source code. The specification was Next.js's own public documentation and observable API surface. They ship a migration skill alongside it, so the clone can clone itself into customer codebases.

February 20, 2026
Anthropic launches Claude Code Security → Cyber stocks crash

Claude Code Security, using Opus 4.6, identifies over 500 vulnerabilities in production open-source codebases — bugs undetected for decades. The market immediately reprices the entire cybersecurity sector. CrowdStrike -8%, Okta -9.2%, Zscaler -5.5%, Cloudflare -8.1%, SailPoint -9.4%. The Global X Cybersecurity ETF closes at its lowest since November 2023.

March 27, 2026
Claude Mythos leaked → Second cyber crash

A draft blog post describing Anthropic's next model, Mythos — described internally as "far ahead of any other AI model in cyber capabilities" — is found in a publicly accessible content management cache. Cyber stocks crash again: CrowdStrike -7%, Palo Alto -6%, Zscaler -4.5%, Okta and SentinelOne -3% each. Analysts: "We read this as having the potential to become the ultimate hacking tool."

March 31, 2026 — 04:23 UTC
Anthropic leaks Claude Code. Developers clone it before dawn.

Claude Code v2.1.88 ships to npm with a 59.8MB source map pointing to a public ZIP on Anthropic's own Cloudflare R2 bucket. 512,000 lines of TypeScript, 1,906 files, exposed. Two developers spend the night using OpenAI's Codex to perform a clean-room Python rewrite — claw-code — and push it before sunrise. It reaches 110,000 stars and 100,000 forks. Likely the fastest-growing GitHub repository in history.

Wall Street Understood Before the Engineers Did

Mr Market is crazy and very emotional. It is reactive, emotion-prone, and frequently wrong about timing. But it is extremely sensitive to structural shifts in the economics of entire industries. The software sell-off that began in January 2026 and accelerated through February and March was not panic. It was correct pricing of a structural shift that the industry had been talking about for years but the market had not yet fully priced.

The trigger was not a single event. It was a sequence, each one confirming the same thesis from a different angle. First came Claude Cowork on January 12 — an agent platform that replaced entire categories of knowledge work software. The S&P 500 Software and Services Index began a sustained decline that wiped roughly a trillion dollars in market value in its first six weeks.



If an AI can autonomously perform legal document review, contract compliance, and financial analysis, the per-seat subscription fees that LegalZoom and Thomson Reuters charge are no longer defensible. If an AI can rebuild Next.js in a week for $1,100, the switching cost moat that Vercel built over a decade is no longer defensible.


The "AI won't replace SaaS" camp is not entirely wrong. Enterprise systems of record — the databases, payroll systems, compliance infrastructure — survive not because AI cannot understand them but because they encode institutional trust and regulatory accountability that cannot be repriced in a weekend. But the middle layer of software — the workflow tools, the reporting layers, the task-specific applications whose only moat was "it would take a team six months to build this" — that layer is the one the market is correctly repricing to zero.


How llm clone Actually Works

The metaphor of llm clone as a primitive deserves unpacking, because the power of the primitive comes from understanding exactly what it does and does not require.

git clone requires source code. The repository must be public or you must be authorized. The clone is bit-for-bit identical to the original. You get the implementation, the history, and the architecture as the author intended it.


llm clone requires none of those things. It requires only a *specification of correctness* — which, for almost every piece of successful software, is freely available in the form of public documentation, observable API behaviour, and user-facing functionality. The clone is not bit-for-bit identical. It is *behaviourally equivalent* — it passes the same tests, produces the same outputs, satisfies the same user needs. The implementation is different. The moat is gone.





The three concrete examples each demonstrate a different variant of this primitive. 

The C compiler was a specification clone — the spec was industry-standard C, and GCC was the oracle. 

Vinext was an interface clone — the spec was Next.js's public API documentation and observable routing behaviour. 

Claw-code was a source-assisted clone — they had the leaked TypeScript, but they deliberately did not copy it, using an agent to produce a clean-room Python rewrite that was legally distinct. 

Three different inputs. Same technique. All three produced working software.

Company That Proved the Theorem, Then Demonstrated It on Itself

There is a particular flavour of irony that only happens in silicon valley. 

Anthropic spent the first quarter of 2026 methodically proving that LLMs can clone any sufficiently observed software system. They published the C compiler research. Their agents helped build vinext. Their Code Security product crashed the cybersecurity market by demonstrating that proprietary vulnerability detection could be commoditised. 

Then on March 31st, they accidentally demonstrated all of this on their own most valuable product.

Within four hours of the source being public, the community had done something that now stands as the defining event of the year. 

Two developers — two people, ten OpenClaw accounts, one MacBook Pro — fed the leaked architectural patterns into OpenAI's Codex and began a clean-room Python rewrite. 

The entire process was orchestrated end-to-end by an agent workflow. 

They did not copy the TypeScript. They used the architecture as a specification and let the model generate a behaviourally equivalent implementation in a different language. They pushed it before dawn. By end of day it had 110,000 stars.

Anthropic's own CEO had stated that significant portions of Claude Code were written by Claude. If the code was not written by humans, Anthropic's copyright claim over it is legally murky. The torrents of code are seeded. The Python port &  Rust port is live.

No Software Is Safe. Here Is What That Actually Means.

The phrase "no software is safe" requires careful unpacking, because it is easy to misread it as hyperbole. It is not. It is a precise technical claim with a specific scope, and understanding that scope is important for thinking clearly about what happens next.

The claim is this: any software whose correctness can be defined by a test suite and whose interface is publicly observable is now within reach of an agent team with a well-designed scaffold. The cost of such a clone is no longer a function of how many engineers the original vendor employed or how many years of institutional knowledge are baked into the codebase. It is a function only of token cost and the quality of the test harness. Both of those are trending to zero.





What the matrix reveals is harsh reality  for most of the software industry. The vast majority of B2B SaaS products sit in the bottom-right quadrant. They have public APIs, documented behaviour, and well-understood correctness criteria — because that is what makes them useful to customers. The same properties that make software legible to users make it clonable by agents.

The products that survive in this regime are not those with the most sophisticated code. They are those whose value is not primarily in the code at all. 

The payroll system that processes $10 billion annually survives not because its code is unclonable but because switching it requires regulatory re-certification, contractual unwinding, and institutional trust built over years of not losing anyone's payslip. 

Databases survives because AI applications need a reliable, governable database underneath the agent layer, and databases has a decade of operational credibility that a weekend clone does not. 

The cybersecurity vendor who can demonstrate human accountability for a missed detection survives in a way that an LLM-generated signature database does not.

The Doubling Clock Is Already Running

Everything described above is the current state. The trajectory is what should focus the mind. METR, the Model Evaluation and Threat Research organisation, published research showing that AI autonomous task duration doubles approximately every 196 days — roughly every six months, an AI agent can handle twice the complexity of task it could handle before, for the same duration before requiring human intervention.

The C compiler took 16 agents and two weeks. Vinext took one engineer and one week. Claw-code took two developers and one night. These are not the same task — claw-code had the advantage of an architectural specification in the form of the leaked source. But the cost and time compression is directional: each successive clone in 2026 was faster and cheaper than the last.

If the doubling clock holds, is that by early 2027 the tasks that took a week in early 2026 will take a day. The tasks that took a month will take a week. The tasks that required 16 agents and $20,000 will require one agent and $200. The frontier of what is clonable will advance steadily rightward and upward on the matrix, eating into the "clonable soon" quadrant and shrinking the region that was ever genuinely safe.

This is not a doomsday claim. Newspapers were not destroyed by the internet — they were structurally weakened, consolidated, and the value migrated to platforms and aggregators. Software will not be destroyed by LLM cloning. The value will migrate. 

Friday, 24 October 2025

Memorization Machine:Why AI Coding Agents Aren't Really Programming Yet

This is further exploration and sharing of experience of using Coding Agents tool. You can read some of old post 



If you believe the internet, AI has essentially solved programming. Every day brings new viral videos of LLMs building complete applications in minutes, fixing complex bugs instantly, and dramatically boosting developer productivity. The narrative is clear: AI coding agents are revolutionizing software development.

But there's a fundamental truth being obscured by all the hype: current AI coding agents are sophisticated memorization machines, not genuine programmers. And understanding this distinction explains both their impressive capabilities and their critical limitations.

Programming as Crystallized History

Here's an insight that might seem obvious once stated but has profound implications: programming is fundamentally built on accumulated patterns and historical knowledge. Every framework, algorithm, and design pattern represents decades of collective problem-solving. When we write code, we're rarely inventing something truly novel—we're recombining established solutions in contextually appropriate ways.

This makes programming uniquely suited to pattern-matching systems like LLMs. Unlike fields requiring real-time sensory input or physical manipulation, programming creates an enormous corpus of documented solutions, discussions, and examples. Stack Overflow, GitHub, documentation sites, and millions of code repositories form a vast memory bank that LLMs can internalize during training.


The memorization works at multiple levels:

  • Syntactic patterns: How code is structured
  • Semantic patterns: What code means in context
  • Pragmatic patterns: How code is actually used
  • Meta-patterns: Common problem-solving approaches

Why LLMs Excel at Coding (Within Limits)

This memorization-based architecture explains why LLMs punch above their weight in programming tasks:

Pattern Density: Code has extraordinarily high pattern density. The same structures appear repeatedly across different contexts, creating clear patterns for memorization.
Explicit Structure: Programming languages have formal syntax and semantics, making patterns more distinct and recognizable than natural language.
Solution Reusability: Most programming problems are variations of previously solved problems. An LLM that has "memorized" solutions can adapt them to new contexts with surprising effectiveness.
Rich Training Data: The internet contains millions of code examples with explanations, making it possible for LLMs to learn not just syntax but usage patterns and common approaches.
This is genuinely impressive! Sophisticated pattern matching can solve a remarkable range of programming tasks. But it's not the same as genuine programming expertise.





The Wall: Where Memorization Breaks Down

Real programming requires capabilities that pattern matching simply cannot provide:

System-Level Thinking

Great programmers understand how code fits into larger systems, considering performance, maintainability, security, and business constraints simultaneously. They think architecturally, not in isolated snippets.

LLMs can generate architecturally-sound code patterns they've memorized, but they can't make real architectural trade-offs based on your specific traffic patterns, team structure, regulatory requirements, or budget limitations.

Long-Term Reasoning

Professional programming means writing code thinking about how it will be maintained, modified, and scaled over months or years. It requires understanding technical debt, anticipating future requirements, and building for evolution.

LLMs have no persistent understanding. Each interaction is essentially fresh—they can't build up knowledge of a codebase over time like human programmers do.

Context Beyond Code

Real programming involves understanding business requirements, user needs, team capabilities, and reading between the lines of incomplete specifications.

LLMs work with the text you give them. They can't interview stakeholders, understand implicit requirements, or navigate organizational politics that shape technical decisions.

Novel Problem Solving

When you encounter a problem that doesn't match memorized patterns—a genuinely novel requirement, an unusual constraint, or an emerging technology—memorization-based systems struggle.

They can combine patterns creatively, but they can't reason from first principles or develop entirely new approaches.





The Real Test: Maintenance Programming

The biggest gap becomes obvious when you move beyond initial implementation to maintenance programming:

A viral demo might show: "I built a complete e-commerce site in 30 minutes!"

What's not shown:

  • No authentication system worth deploying
  • No error handling for edge cases
  • No data validation or security considerations
  • No scalability planning
  • No testing strategy
  • Breaks on inputs the demo didn't consider
  • Requires extensive refactoring for production

This is the difference between code that runs initially and code that serves a business reliably for years.

Experienced programmers understand why code evolved the way it did, recognize technical debt patterns, assess risks of changes, and make judgment calls about when to refactor versus work around issues. These capabilities come from experiential learning that memorization cannot replicate.

So Why All the Success Stories?

If current AI coding agents are fundamentally limited, why is the internet overflowing with success stories? The disconnect is real and worth understanding:

The Demo Problem

Success stories showcase clean, isolated problems with clear specifications: "Build a todo app," "Implement quicksort," "Create a REST API endpoint."

They don't showcase real programming work: debugging memory leaks in 500K line codebases, integrating with undocumented legacy systems, refactoring critical infrastructure without breaking anything, or making architectural decisions under business pressure.

Cherry-Picking at Scale

Even if LLMs only work impressively 10% of the time, that's still thousands of viral examples from millions of attempts. Hundreds of failures disappear without a trace.



Economic Incentives

Companies promoting these tools have billions of dollars at stake. OpenAI, Microsoft, Google, and countless startups need to demonstrate transformative results to justify valuations and drive adoption.

"Our AI can replace junior developers" sells better than "Our AI can help with boilerplate code sometimes."

The Experience Gap

Beginners are amazed by any working code generation and often can't assess code quality deeply. Experts notice subtle issues, architectural problems, and maintenance nightmares—but most viral content comes from impressed beginners.

This creates a distortion where surface-level success gets amplified while deeper limitations remain hidden until you actually try to use AI-generated code in production.

Definition Games

What counts as "success"? Code that runs initially or code that's maintainable? Solving toy problems or real business challenges? Individual productivity or team productivity? Short-term output or long-term quality?

The goalposts keep moving. As AI gets better at basic tasks, "success" shifts to whatever AI can currently do.


The Uncanny Valley of AI Programming

This creates an uncanny valley effect. AI coding agents seem very capable on surface-level tasks but fail unpredictably on deeper challenges. They can write code that looks professional but may have subtle issues that only become apparent months later.




What This Means Practically

This isn't an argument against using AI coding tools—I use them regularly and find them valuable. But it's crucial to understand their nature and limitations:

Use AI coding agents as powerful assistants, not autonomous programmers. They excel at accelerating experienced developers but can't replace the deep thinking that programming requires.

Trust but verify. AI-generated code needs careful review by someone who understands the broader context. The code might work in isolation but introduce problems in your specific system.

Focus on the right problems. AI tools shine on well-defined, pattern-matching tasks. They struggle with ambiguous requirements, system design, and novel challenges.

Beware the productivity illusion. Writing code faster doesn't mean programming faster if that code requires extensive debugging and refactoring later.


Looking Forward




For AI to move beyond sophisticated memorization to genuine programming capability, systems would need:

We're not there yet. Current AI coding agents are impressive pattern-matching systems that happen to work well in a domain built on historical patterns. That's genuinely useful, but it's not the same as artificial programming intelligence.

Memorization foundation makes them brittle in exactly the situations where you need the most help—the complex, ambiguous, high-stakes decisions that define excellent programming.