Just some years in the past, AI coding assistants have been little greater than autocomplete curiosities—instruments that might end your variable names or recommend a line of boilerplate. At the moment, they’ve change into an on a regular basis a part of thousands and thousands of builders’ workflows, with complete merchandise and startups constructed round them. Relying on who you ask, they signify both the daybreak of a brand new programming period or the top of programming as we all know it. Amid the hype and skepticism, one factor is obvious: The panorama of coding assistants is increasing quickly, and it may be laborious to zoom out and see the larger image.
I’m Sam Lau from UC San Diego, and my colleague Philip Guo and I are presenting a analysis paper on the Visible Languages and Human-Centric Computing convention (VL/HCC) on this very subject. We needed to know: How have AI coding assistants developed over the previous few years, and the place is the sphere headed?
To reply this query, we analyzed 90 AI coding assistants created between 2021 and 2025: 58 trade merchandise and 32 tutorial prototypes. Some have been broadly used industrial assistants, whereas others have been experimental analysis programs that explored completely new methods of working with AI. Somewhat than specializing in who was “greatest” or which system was strongest, we took a unique strategy. We constructed a design house framework: a type of map that highlights the key decisions designers and researchers make when constructing coding assistants. By evaluating trade and tutorial programs facet by facet, we hoped to uncover each patterns and blind spots in how these instruments are being formed.
The result’s the primary complete snapshot of the house at this essential second in 2025 when AI coding assistants are beginning to mature however their future instructions stay very a lot in flux.
Right here’s a abstract of our findings:

10 Dimensions That Outline These Instruments
What makes one coding assistant really feel like a useful copilot and one other really feel like a clunky distraction? In our evaluation, we recognized 10 dimensions of design, grouped into 4 broad themes:
- Interface: How the assistant reveals up (inline autocomplete, proactive solutions, full IDEs).
- Inputs: What you’ll be able to feed it (textual content, design recordsdata, code evaluation, customized challenge guidelines).
- Capabilities: What it will possibly do (self-correct, run code, name exterior instruments).
- Outputs: The way it delivers outcomes (code blocks, interactive outputs, reasoning traces, references).
For instance, some assistants like GitHub Copilot are optimized for velocity and minimal friction: autocomplete a couple of keystrokes, press tab, hold coding. Educational tasks like WaitGPT and DBox are designed for exploration and studying by slowing customers all the way down to replicate on trade-offs, providing explanations, or scaffolding programming ideas for learners. (Hyperlinks to all 90 tasks are in our paper PDF.)
One of many clearest findings from our survey is a cut up between trade and academia.
- Trade merchandise give attention to velocity, effectivity, and seamless integration. Their pitch is easy: write code sooner, with fewer errors. Consider instruments like Cursor, Claude Code, or GitHub Copilot, which promise “coding on the velocity of thought.”
- Educational prototypes, in contrast, diverge in lots of instructions. Some intentionally decelerate the coding course of to encourage reflection. Others give attention to scaffolding studying for college kids, supporting accessibility, or enabling completely new methods of prompting, like letting customers sketch a UI as a substitute of writing a text-based immediate.
This divergence displays two completely different priorities: one optimized for productiveness in skilled software program engineering, the opposite for exploring what programming might be or needs to be. Each approaches have worth, and to us essentially the most fascinating query is whether or not the 2 cultures may finally converge, or no less than be taught from one another.
Six Personas, Six Methods of Coding with AI
One other method to make sense of the house is to ask: Who’re these instruments actually for? We recognized six consumer personas that saved reappearing throughout programs:
- Software program engineers, who search instruments to speed up skilled workflows
- HCI researchers and hobbyists, who create prototypes and new methods of working with AI
- UX designers, who use assistants to rapidly prototype and iterate on interface concepts
- Conversational programmers, who’re nontechnical professionals that have interaction in vibe coding by describing concepts in pure language
- Knowledge scientists, who want explainability and fast iterations on code-driven experiments
- College students studying to code, who profit from scaffolding, steering, and explanations
Every persona requires completely different designs, which we spotlight inside our design house. For instance, instruments designed for software program engineers like Claude Code and Aider are built-in into their current code editors and terminals, help a excessive diploma of customization, and have autonomy to write down and run code with out human intervention. In distinction, instruments for designers like Lovable and Vercel v0 are browser-based and may create purposes utilizing a visible mockup like a Figma design file.
What Comes After Autocomplete, Chat, and Brokers?
So the place does this go away us? Coding assistants are not experimental toys. They’re woven into manufacturing workflows, lecture rooms, design studios, and analysis labs. However their future is much from settled.
From our perspective, the central problem is that academia and trade are innovating in parallel but not often in dialog with each other. Whereas trade instruments optimize for velocity, producing a lot of code rapidly shouldn’t be the identical as constructing good software program. In truth, latest research have proven that though AI coding assistants have claimed to spice up productiveness by 10x, actuality thus far is nearer to incremental enhancements. (See Addy Osmani’s latest weblog submit for a abstract.) What if academia and trade might work collectively to mix rigorous examine of actual limitations to productiveness with the sensible expertise of scaling instruments in manufacturing? If this might occur, we’d transfer past merely making code sooner to write down towards making software program improvement itself extra fast and sustainable.
Take a look at our paper right here and electronic mail us when you’d like to debate something associated to it!


Leave a Reply