The 2025 state of AI Development

The 2025 state of AI Development

Vellum · Writing · Business

The 2025 state of AI Development is a report by Vellum drawn from a survey of more than 1,250 AI developers and builders about what they shipped in 2024 and what comes next.

Interface preview of The 2025 state of AI Development

About The 2025 state of AI Development

What Is The 2025 state of AI Development

The 2025 state of AI Development is a research report published by Vellum, the AI development platform. It pulls together answers from more than 1,250 developers and builders who work with large language models, and turns them into a snapshot of how teams actually build with AI rather than how vendors say they should.

The report focuses on the gap between talk and practice. Around a quarter of companies had pushed an AI feature all the way to production by the end of 2024, and only a fraction of those could point to a measurable result. Most teams sat earlier in the pipeline, still drafting a strategy or running a proof of concept. That gap is the thread running through the whole document: tooling is young, use cases are still being picked, and the noise around AI outruns the deployments.

Vellum frames 2025 as the year tooling matures, with agentic workflows expected to move from demos into everyday products. The report is free to read on the web, has no signup gate, and is aimed at developers, product leads, and founders deciding where to invest their next quarter.

Getting Started

  1. Open the report on the Vellum website in any browser.
  2. Read the opening summary for the headline numbers on production adoption and model usage.
  3. Move through the sections on use cases, modalities, model providers, and tooling to compare them against your own stack.
  4. Check the evaluation and monitoring findings if you run models in production, since they cover where teams most often skip work.
  5. Use the closing predictions as a checklist for what to prioritize in 2025.

Product Information

A quick look at The 2025 state of AI Development's pricing, supported platforms, and performance.

Free PlanYes
Paid PlansN/A
PlatformWeb
DeveloperVellum
CategoryWriting · Business
Release DateJan 2025
Latest UpdatedJan 2025
Website Visits416K
Website Global Rank126K
API AvailabilityNo

Best for

The users, tasks, and scenarios where this tool fits best.

Users

  • Developers choosing a stack
  • Product leads scoping an AI feature
  • Founders and investors sizing the market
  • Anyone who wants a data-backed view of AI hype

Tasks

  • Picking a model provider
  • Deciding between RAG and fine-tuning
  • Planning an evaluation setup
  • Justifying a tooling budget

Scenarios

  • Standing up a first AI feature
  • Reviewing an existing pipeline
  • Preparing a 2025 roadmap
  • Briefing a non-technical stakeholder

Key features

Adoption stages from concept to production

The survey sorts teams by how far they've taken AI, from talking to users about needs up through a strategy and proof of concept, a beta, and finally a live production deployment. Roughly a quarter of companies had something in production, with the rest spread across earlier stages. The breakdown matters because it shows the field is not one wave but a spread, so a team that feels behind is often just at the same stage as most peers.

What teams actually build with AI

Document parsing and analysis came out on top as the most common use case, followed by customer service and chat assistants, then natural language analysis. Content generation, recommendation systems, code generation, and research automation filled out the list. The pattern points to work that involves reading and sorting existing text, not just producing new text, which is a useful signal about where the demand sits.

Model and provider usage

OpenAI held the largest share of usage, largely through GPT-4o and GPT-4o Mini, with Microsoft Azure, Anthropic, and AWS Bedrock close behind. Larger companies leaned more on cloud platforms, and Azure's share climbed with company size. Hosted open models from providers such as Groq, Fireworks AI, and Together AI picked up ground, which the report reads as a sign that teams want more than one option in the mix.

RAG over fine-tuning

Retrieval-augmented generation dominated the architectures teams described, with a majority using a vector database. Only about a third fine-tuned a model at all. The report ties the low fine-tuning figure to falling costs and rising model quality, since a good base model plus retrieval often covers the job without a custom training run.

Evaluation and monitoring gaps

Most developers said they evaluate their AI, but the methods skew manual, with test-and-review far outpacing automated evaluation tools. Monitoring split similarly, with in-house dashboards ahead of third-party tools. Managing hallucinations and prompt issues ranked as the top challenge, which lines up with how thin the automated checks still are.

Predictions for 2025

The report closes with a forward look, predicting that 2025 turns into a year of tooling and that agentic workflows move from experiments to shipped features. It also flags rising multi-model setups and continued cost pressure as forces that shape what teams build next.

Pros and cons

Pros

  • The sample of more than 1,250 developers is large enough to show patterns rather than one team's experience.
  • Numbers on model usage, architectures, and evaluation come from practitioners, not vendor marketing.
  • The stage-by-stage adoption data gives a realistic benchmark for teams planning their first release.
  • The use-case breakdown points to concrete jobs worth building, like document analysis and support chatbots.
  • Free to read with no signup, so it works as a quick reference during planning.

Cons

  • The findings reflect a moment in late 2024, so fast-moving model shares and tooling names date quickly.
  • Survey answers are self-reported, which means reported impact can overstate what teams measured.
  • There is no public dataset or API behind it, so you cannot pull the numbers into your own analysis.
  • Coverage leans on the kind of teams that answer developer surveys, which may undercount quiet or internal projects.

Frequently asked questions

It is a research report from Vellum built on a survey of more than 1,250 AI developers and builders. It covers what teams built with AI in 2024, which models and architectures they used, and where they expect the field to go in 2025.