Models

DeepSeek's low-cost coding model posts frontier-shaped numbers, with an asterisk

Two measurements describe the same model on the same test, and they don't agree. That gap is the most useful thing to understand before you move a coding workflow onto DeepSeek V4.1 Flash.

Daniel HarrisDaniel Harris
Heat: 1,240
Terminal pane of score bars beside a rising bar chart in blue and amber

Two measurements describe the same model on the same test, and they don't agree. That gap is the most useful thing to understand before you move a coding workflow onto DeepSeek V4.1 Flash.

What DeepSeek V4.1 Flash actually is

The 1017 build is an open-weight reasoning model with a context window of 1,048,576 tokens, which is long enough to hold a mid-sized repository. Earlier V4 Flash builds are superseded by this one.

Its shape is odd. Unsloth's guide and the model card describe a 552B backbone paired with a 196B Engram parameter set. Engram conditional memory works through n-gram lookups of up to four tokens, so the lookup table doesn't have to sit in GPU memory. DSpark adds speculative decoding, which drafts several tokens ahead and checks them in one pass.

That design is why people who run their own hardware care. Most of the parameters don't need to be resident.

DeepSeek benchmarks on the model card, and the 74.5% reply

Here's the split that matters. The model card reports 90.6% on Terminal-Bench 2.1, a benchmark built around multi-step command-line work in a container. Vals AI, which runs models against its own setup, measured 74.5% for the same model.

Sixteen points isn't a rounding difference. It's the gap between best in class and competitive with the tier below. Same weights, different scaffolding, different pass criteria.

The rest of the card, for reference:

DeepSeek V4.1 Flash, model card

Score

Terminal-Bench 2.1

90.6%

GPQA-Diamond

90.9%

CyberGym

88.1%

DeepSWE

77.0%

NL2Repo

68.2%

AutomationBench

60.5%

Terminal-Bench 4.0

42.30%

HLE

42.6%

Agents' Last Exam

35.4%

FrontierMath v2 Tier 4

26.8%

Codeforces

3471

The bottom half is as informative as the top. Long-horizon work and genuinely hard reasoning are where the numbers fall away, which is also true of most models at this tier.

Artificial Analysis adds a third view. It puts the Intelligence Index at 39.5%, with an Omniscience hallucination rate of 96.5% and an Omniscience Index of -5.3%. A model can be good at running commands and still invent facts at a rate you have to plan around in production, which is the number to quote when someone asks whether it can replace a reviewer.

What BenchLM's 65.41 and rank 31 actually cover

BenchLM scores DeepSeek V4.1 Flash at 65.41 out of 100 overall and ranks it 31st of 1,016 models. The same entry notes coverage of 53 of 759 benchmarks and calls its own overall score conservative because of it.

That's an honest caveat and a real limit. A rank built on a seventh of the available tests is a rough sort, not a verdict. It puts this model in the conversation with strong mid-tier systems. It doesn't tell you it beats any named model on your workload.

DeepSeek pricing in structural terms

The useful way to describe DeepSeek pricing here is position within the lineup, not a rate card you can copy into a budget. This release sits in the cheap tier of DeepSeek's own lineup, and legacy names such as deepseek-v4-flash are still accepted and billed at the Flash price. The API model name deepseek-flash is now served by DeepSeek-V4.1-Flash-1017.

For exact rates, check the live trackers and DeepSeek's own docs on the day you commit, since per-token prices move and a figure printed here would be wrong within a quarter.

Position matters more than the decimal anyway. A model at this capability level in the low-cost tier changes the arithmetic on high-volume work. A batch classification job that was too expensive to run across a whole corpus becomes cheap enough to run twice and compare the output.

DeepSeek local inference needs 128GB of RAM

Unsloth's guide puts local runs at 128GB of RAM or more, or 64GB with SSD offloading and a slower run. The UD-Q8_K_XL quant is 508.4GB and UD-Q4_K_XL is 500.7GB. That tells you what kind of machine this is: a workstation or a small server.

Not a laptop.

Two settings catch people out. Thinking is on by default with reasoning_effort at 75 on a 1 to 100 scale, where the template maps low to 50, medium to 62, high to 75 and max to 100. DeepSeek recommends allowing at least 256K output tokens for long generations, which is a bigger bill than most defaults assume.

Unsloth also says its own quant builds show 10-15% higher accuracy and 30% less token usage than other quants of the same size, plus roughly 3x faster inference than other CPU, VRAM or ngram repos. Those are vendor claims about its own files. Test them on your hardware.

How to read Terminal-Bench 2.1 before you switch

Benchmarks measure a setup as much as a model. So which number do you believe? The 90.6% and the 74.5% came from two different ones, and yours will be a third.

So run the tasks you actually do. Take twenty tickets your team closed last month, replay them with the tools and permissions an agent would get, and count how many results you'd merge. That number beats any leaderboard, because it includes your repo's odd build script and your flaky test suite.

The model earns a trial on that basis. It's open-weight, it's cheap by position, and its long-context behavior is the part worth testing hardest. The asterisk on the headline score isn't a reason to skip it. It's a reason to measure before you trust anyone else's number.

Share This Story

Sources

Related AI News

Terminal pane of code lines next to a shield outline
Models

GPT-6 Cyber ships behind Daybreak Red, with benchmark gains of a few points

OpenAI built a model that says yes more often to security researchers, then locked it behind an identity check. The benchmark deltas are real. They're also small.

Heat: 1,310
Filmstrip frames with a play glyph, above a falling price line
Models

Gemini Omni 1.2 Flash goes GA with 15-second clips and a 30% price cut

Two numbers decide whether this model belongs in your production budget: fifteen seconds and seven cents. The rest is workflow, and the workflow is where the money actually moves.

Heat: 1,250
Concentric memory rings around a bright core in violet and amber
Models

Meta used Muse Wonder to train the cheaper models and shipped them to free users

Meta didn't hand free users its frontier model. It used that model to teach smaller ones and shipped those instead, which is a stranger decision than a benchmark bump.

Heat: 1,339
Browser window outline containing a glowing audio waveform on a teal gradient
Models

Underdog put a text-to-speech model in 32MB and it runs in a browser tab

Underdog announced Woof on November 5: a text-to-speech model that weighs 31.7MB and runs in a browser tab. The demo is charming. The more interesting part is what a model that small does to the cost of putting a voice on a web page.

Heat: 1,040