mudasobwa

mudasobwa

Harness, not model is what matters most

Somewhere, right now, a senior engineer is on the verge of a nervous breakdown because his company will not let him switch from Claude to GPT-5.2, or from GPT to Gemini, or from any of them to a locally-hosted llama that smells faintly of the intern’s vape juice. He is convinced that the model is the product, that the difference between shipping and slop is measured in the number of parameters, and that if only management would approve the more expensive API key, all his problems would evaporate like a hallucinated citation.

He is wrong. Spectacularly, expensively, and in a way that will cost him exactly the difference between the two API tiers he is agonising over.

Allow me to explain, in the manner of a man who has spent the last year building the thing he is about to tell you matters more than the model itself.

Important notice: my blog has been moved to https://blog.yokerhood.com for good.

Most Liked

mira_tokarev

mira_tokarev

I agree that the harness is where a lot of the practical economics lives, but I’d separate orchestration from one quieter cost: how much already-seen state gets serialized into every next call. A model swap can hide that variable, whereas a deterministic local compression step gives the harness a reproducible place to measure it before adding routing or memory complexity. One small tool I’ve been evaluating is Contextpress (GitHub - Taha-azizi/contextpress: Deterministic context compression for LLM chat, RAG, and agent pipelines · GitHub · contextpress · PyPI); it operates locally on the message list rather than making a second model call. I’d compare harnesses on cost per successful task, retries, and time-to-result, because “more capable model” and “less repeated context” are different levers.

smithjj

smithjj

The framing is a bit dramatic but the point lands. The harness, context handling, and how you structure prompts usually matters more than which model you’re calling.

Where Next?

Popular Backend topics Top

New
First poster: Exadra37
Summary: I describe a simple interview problem (counting frequencies of unique words), solve it in various languages, and compare perform...
New
First poster: bot
Like, on a scale from c to rust? issue c zig (release-safe) rust (release) out-of-bounds heap read/write none runtime runtime ...
New
First poster: bot
This post explains why Scala projects are difficult to maintain. Scala is a powerful programming language that can make certain small te...
New
CommunityNews
Functional programming is an increasing popular programming paradigm with many languages building or already supporting it. Go already su...
New
brainlid
We take a deeper dive with Nathan Long into IOLists in Elixir. We cover what they are, how they work, the power they have when concatenat...
New
brainlid
In episode 92 of Thinking Elixir, we talk with Mitchell Hanberg and learn about why he created the alternate Phoenix templating language ...
New
StuntProgrammer
In building lofi.limo, media storage and distribution naturally came up. I have songs, announcements, and background image loops which I ...
New
fullstackplus
The Ruby ecosystem is rich with tools that make us developers more productive at what we do. Both Rails and Sinatra have been used to bui...
New
brainlid
In a 2 day spike, I created my own Elixir-based AI Personal Fitness Trainer! The surprising part for me was how useful and helpful I foun...
New

Other popular topics Top

PragmaticBookshelf
Brace yourself for a fun challenge: build a photorealistic 3D renderer from scratch! In just a couple of weeks, build a ray tracer that r...
New
PragmaticBookshelf
Learn from the award-winning programming series that inspired the Elixir language, and go on a step-by-step journey through the most impo...
New
PragmaticBookshelf
Ruby, Io, Prolog, Scala, Erlang, Clojure, Haskell. With Seven Languages in Seven Weeks, by Bruce A. Tate, you’ll go beyond the syntax—and...
New
dimitarvp
Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...
New
Exadra37
Oh just spent so much time on this to discover now that RancherOS is in end of life but Rancher is refusing to mark the Github repo as su...
New
PragmaticBookshelf
Rails 7 completely redefines what it means to produce fantastic user experiences and provides a way to achieve all the benefits of single...
New
PragmaticBookshelf
Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...
New
PragmaticBookshelf
Build modern server-driven web applications using htmx. Whatever programming language you use, you’ll write less (and cleaner) code. ...
New
PragmaticBookshelf
Overarching tutorial for Python beginner and intermediate developers that teaches web development with the Flask framework. Miguel Gr...
New
mindriot
Ok, well here are some thoughts and opinions on some of the ergonomic keyboards I have, I guess like mini review of each that I use enoug...
New