In my opinion, this post misses the forest for the trees. Yes, the model of an OS running various off-the-shelf apps for various tasks will soon become obsolete. But it's not the idea of the OS that's outdated - it's the idea of apps. Why would you ever want to ask an AI to make an app for you to complete some task, if you can instead ask the AI to complete the task directly? The future isn't a bunch of extremely personalized apps - the future is a single AI assistant doing all the work.
> if you can instead ask the AI to complete the task directly?
Going to entirely depend on the nature of the task and where AI pricing goes in the future.
Would you like to spend $0.10 on every task or would you like to spend $1.00 to make an app that does it free for you forever?
I don't think it'll be one or the other.
But also I don't see things like video games ever being replaced by 1 off AI. If for no other reason then the fact that a lot of games are fun because of multiplayer capabilities. That's not something you can do a 1 and done with AI (unless you only want to play games with family and close friends).
Like browsing TikTok or messaging your friends? People want their devices to work like their friends’ devices do. Your prediction seems to be out of touch with how and why people actually use computing devices. Nobody actually uses them to "perform tasks".
An AI assistant can give different answers for the same inputs. An application written by an AI assistant, if it doesn't just call an LLM at runtime, will mostly likely produce the same answer for the same inputs. That is, unless there's something intrinsic to its business logic that makes it nondeterministic.
Sometimes you really want the latter even if the former is less effort.
And when applicable, the program would be much more efficient than the LLM.
So it would really be beneficial for the LLMs to be able to have their own environments to write and run code, but also to store those programs for later use automatically.
I want an agent studio and execution sandbox where my LLM driven assistant builds and maintains my apps with a receipt or SBOM like history of what it did to create each app. Determinism built per use case with non deterministic assistance orchestrating the build and management layer. Extra credit if I can trivially share and collaborate with others per “deterministic silo” via a shared link. Something like Claude Code + AWS Lambda|(Docker|Podman) + Tangled.org with LLM code generation for my phone and workstation.
The LLMs empower for building, the determinism improves output-expectation alignment. It’s fundamentally an on device software factory, hypervisor, and storage system.
If the code works good enough, it works good enough. If good enough is insufficient for success criteria, you’ll have to trade app evolution velocity and flexibility for more determinism via more human effort (“artisanal hand crafted”), evaluated on a per use case basis. “Does this software have to be good? How good? Have I hit diminishing returns yet?”
Pros and cons to code being cheap to generate now, it’s always about tradeoffs. I don’t want to build cars, I want to drive cars.
> Yes, the model of an OS running various off-the-shelf apps for various tasks will soon become obsolete.
I doubt it. Most people would rather stab at their phone to download an app that just does what they want than explain to a chatbot over a period of minutes/hours and several reiterations to get it to spew out what they want, let alone what kind of software they want it to make for them. Most people can barely articulate what they want in the first place.
The market for applications isn't going anywhere and neither is the OS. I can't imagine booting a computer directly into a chat window where I have to explain to a bot what I wish would show up on my screen, where on my screen, and how it should look. What a total nightmare that would be!
Even if what passes for "AI" these days was as smart and capable as the computers on Star Trek (and it very much isn't) you wouldn't want to ask it for everything. Even the Enterprise had an OS that people interacted with. What they also had though was an OS with configurable interfaces that people could customize according to their current task and preferred workflow.
That sort of thing is maybe possible in the future for "AI" empowered operating systems we might live to see, but 90% of the people using computers aren't going to bother with any of that, just like they've never seen the settings/options in most of their applications or their operating system right now. Not because it couldn't make their time working the computer better, but because they just can't be bothered.
The writer of this piece remembers how, as a child, computers promised to let him write his own software and games and it seemed like there were endless possibilities until the reality that programing takes effort killed a little of that enthusiasm (although not enough that he didn't eventually become a programmer), but many people never see a computer as anything more than a means to an end or a device for mainly passive content consumption.
Inputs for the ui might be me talking, or typing, or having someone else talk or type. They might also be GPS, temperature, BLE devices nearby. Or maybe a button I smash because I don't feel like re explaining something.
What happens after an input is still the best part of a UI. We like seeing/hearing/feeling things in different ways.
It’s funny you say this because Apple resisted an App Store for apps. They originally expected web based apps. The market demanded an App Store. Remember web snippets where one could clip a portal to view a small section of a website?
Had this thought this morning after seeing DHH announcing that Basecamp isn't writing code by hand anymore and they're using AI to write Rust for Hey's backend.
To me they're failing to see the even bigger picture that maybe even Hey itself is outdated in the Ai era and not only is its Ruby framework antiquated... the whole Hey service is too.
> That makes a lot of sense in a world where we’re importing all our software from strangers. It makes less sense in the world we’re heading to, where most of the software we’re carving up fiefdoms for has the same provenance.
If I'm running software written by an LLM, even if I was the one who prompted the LLM, I would still want my OS to treat it as if written by a stranger.
I know he's not necessarily talking about relaxing security models here, but he's not being very specific about his vision otherwise.
I think OP may be onto something real, while you are definitely right if we translate concepts directly. But maybe the challenge, with current platforms included, is because we try to cram identities by reference. If a phone had its own identity, with which you transact as with any party then lots of the security concerns would dissolve. To tone down crankiness, I refer to identity in the technical sense, not personality etc. This doesn’t solve the challenge but it might point to a different foundation for a security model.
Nope. There has never been a "good" post written in this genre ("I'm leaving my last team, here's my new project") and I'm not going to waste interesting bits on my pro-forma transition post.
I didn't submit this! Happy to chat about it, but I feel like I was pretty clear in the post that I wasn't bidding for the front page.
The OS is the distilled wisdom of other experts. Wisdom that neither I, nor the current generation of next-word-guessers, could possibly keep pace with; no matter how many reddit bots the frontier lab operates in its attempt to extract complex concepts into simpler vectors. It will be the collection of things that are so unbelievably expensive to reinvent and re-learn for each machine and user, that they are not subject to to the market forces that come with making the slop cheaper. Any well-maintained OS will maintain that role. And be ever more important in the future, as apps diverge into even lower quality and even less shared benefit from improving them (for the other approx. 2 users).
I love the idea that normal people building software to solve real problems in their life is, necessarily, a toy; the only real software is blessed by our sacred priesthood of PLT experts.
Is this how the internet finally dies? Not with a bang but with the whimper of thousands of AI slop apps scrapping websites into oblivion?
Most of these problems the slop apps can solve are dependent on gathering information to answer questions. If no one ever visits weather.com to get weather information, ad revenue will completely dry up and the site will go under. Then the slop stops slopping and I can’t get my hyper local weather app to work.
I’m not going to go as far as to say this article is wrong, in fact in this cursed timeline it’s probably right. I just don’t see how it’s good.
Ironically this may finally force the fulfillment of the Web 2.0 paid API service dream. Remember when people were pushing companies that just provided a paid API?
Uncharitably... because eventually they hope to produce a phone that isn't running iOS or Android?
More charitably because the title is actually an important question right now in the abstract for almost everything, not just operating systems.
But the forces that shape the question are so large and hard to get a handle on when we are living through the moment that you have to start thinking about it somewhere, why not OSes?
It's the thing that runs your AI agent, that runs your AI pocket bot (AIBI looks cute btw), that runs the software doing the training of AI models, that runs the datacenters doing the inference, etc.
There's still data. There are still bits moving. Filesystems and networking aren't going anywhere.
In a charitable reading the title is something like "what is even a desktop OS now?" or "what is even a consumer OS now?".
As for the new project, I've got one bet: there's Linux involved to host it.
Linux is an OS.
P.S: as a sidenote the entire "users don't install apps anymore" was already true to some extent. A shitload of users are totally fine with an OS that runs a browser and that's it. And they're fully operational. And we still all know what an OS is, even for, say, a Chromebook. Heck, I'm not even sure "installing apps" as ever been, except during the first install of the OS, what an OS was ever about.
I think operating systems have changed. They don't interact directly with hardware much anymore and computers are filled with SoCs all running systems of their own, sometimes with entire network stacks, communicating with devices and each other, collecting and processing data and that activity can be totally invisible to the operating system the user gets to work with.
Oh, ok. I guess computer science is finished, then. I should have known. It's not like there's any evidence that it's been blown wide open recently.
(The irony is that all the reading that's gone into our design is like, old CSAIL papers. Maybe it's true! Maybe everything we're doing is just crate-digging through old settled computer science. That would be on brand. I should find a way to work Athena into it. Maybe we'll use Zephyr for messaging.)
I guess it really is over if this is what professionals (supposedly) seem to think.
OP is right though, an OS remains an OS, same as it’s always been. What’s changed is how we interact with it and what we lay on top of it. Nothing magical or philosophical about it.
There could be some interesting actual OS design innovations for new permissions, access control, and sandboxing systems that are designed from the ground up for these "conjurable" experiences (or even OS components themself).
Finding some balance between access and safety for vibe-conjuring parts of the OS in a way that's still powerful but won't accidentally nuke or corrupt itself.
I do think there's some interesting space to be explored in capability-based systems, but even then I think it would mostly end up looking similar to how existing systems are, just with one more element added
Taking it at face value, it seems to me this will also collapse and get folded into the model.
Unclear what will be left next to it. It will just live on your phone and take care of everything. The apps will be markdown files describing what they do, probably compiled ahead of time for latency.
But the model will be in control, so what else is left to implement besides giving it bash, a compiler and a display?
I guess there is value in the year before that happens.
I agree with the gist of how weird everything is going to get, and how we are living in a time where people haven't come close to internalizing the shift.
IMO even this AI phone is doomed in the slightly longer run.
One more step into the weirdness and people will just be working with AI to build their own bespoke phone with the specs sent over to a manufacturer that is "like PCBWay, but spits out whole devices".
I have no idea what this does to society, the economy, etc when we reach a point where nobody really "needs" any kind of middleman for almost anything (well, except for things they actually really need, like food and shelter), but it looks like I'll see it happen for a bit before I die.
Hardware is still constrained by compromise. If I want a screen for movies with a battery that lasts and doesn't burn my leg when it's in my pocket, I give up a physical keyboard and nice speakers and a bigass physical camera lens.
The physical device that is best for me is probably the best car compromise for several million other people.
if my ex calls and I want my glass brick to flash the "help me" in SOS on the screen, play Hector Berlioz, and dim all the lights in the room – I can have that. I don't have to want the same thing a million other people do.
> Consider: what does computing look like in a world where many (maybe most) applications have an audience of just 1-2 people? How is software distributed? What does it run on?
The same. The slop apps remain just that. They may do something useful for you, but that's it. A bit like a branch in a repository.
It's the same thing as looking down your nose at people who use Excel as a database because it's not a "real" database.
Yes, I'm sure we all have horror stories about spreadsheets that got out of hand, but that ignores the thousands (or more) spreadsheets that are silently productive everyday.
Going to entirely depend on the nature of the task and where AI pricing goes in the future.
Would you like to spend $0.10 on every task or would you like to spend $1.00 to make an app that does it free for you forever?
I don't think it'll be one or the other.
But also I don't see things like video games ever being replaced by 1 off AI. If for no other reason then the fact that a lot of games are fun because of multiplayer capabilities. That's not something you can do a 1 and done with AI (unless you only want to play games with family and close friends).
Sometimes you really want the latter even if the former is less effort.
So it would really be beneficial for the LLMs to be able to have their own environments to write and run code, but also to store those programs for later use automatically.
The LLMs empower for building, the determinism improves output-expectation alignment. It’s fundamentally an on device software factory, hypervisor, and storage system.
Remember when everyone was talking about treating computers as cattle rather than pets?
This seems like a weird inversion. Programs as pets instead of cattle. Toxoplasmosis, ahoy...
Pros and cons to code being cheap to generate now, it’s always about tradeoffs. I don’t want to build cars, I want to drive cars.
I doubt it. Most people would rather stab at their phone to download an app that just does what they want than explain to a chatbot over a period of minutes/hours and several reiterations to get it to spew out what they want, let alone what kind of software they want it to make for them. Most people can barely articulate what they want in the first place.
The market for applications isn't going anywhere and neither is the OS. I can't imagine booting a computer directly into a chat window where I have to explain to a bot what I wish would show up on my screen, where on my screen, and how it should look. What a total nightmare that would be!
Even if what passes for "AI" these days was as smart and capable as the computers on Star Trek (and it very much isn't) you wouldn't want to ask it for everything. Even the Enterprise had an OS that people interacted with. What they also had though was an OS with configurable interfaces that people could customize according to their current task and preferred workflow.
That sort of thing is maybe possible in the future for "AI" empowered operating systems we might live to see, but 90% of the people using computers aren't going to bother with any of that, just like they've never seen the settings/options in most of their applications or their operating system right now. Not because it couldn't make their time working the computer better, but because they just can't be bothered.
The writer of this piece remembers how, as a child, computers promised to let him write his own software and games and it seemed like there were endless possibilities until the reality that programing takes effort killed a little of that enthusiasm (although not enough that he didn't eventually become a programmer), but many people never see a computer as anything more than a means to an end or a device for mainly passive content consumption.
I don't understand why people are still thinking that clicking on stuff will still be a desirable thing in the future.
What happens after an input is still the best part of a UI. We like seeing/hearing/feeling things in different ways.
To me they're failing to see the even bigger picture that maybe even Hey itself is outdated in the Ai era and not only is its Ruby framework antiquated... the whole Hey service is too.
If I'm running software written by an LLM, even if I was the one who prompted the LLM, I would still want my OS to treat it as if written by a stranger.
I know he's not necessarily talking about relaxing security models here, but he's not being very specific about his vision otherwise.
'Transacting' requires not only identity but accountability, a completely controlled-by-you phone cannot meaningfully transact separately from you.
I didn't submit this! Happy to chat about it, but I feel like I was pretty clear in the post that I wasn't bidding for the front page.
Roblox is a game where you make the game. This sounds like an OS where you make the OS.
Probably could have spelled it out more, being too pithy perhaps
Most of these problems the slop apps can solve are dependent on gathering information to answer questions. If no one ever visits weather.com to get weather information, ad revenue will completely dry up and the site will go under. Then the slop stops slopping and I can’t get my hyper local weather app to work.
I’m not going to go as far as to say this article is wrong, in fact in this cursed timeline it’s probably right. I just don’t see how it’s good.
Uncharitably... because eventually they hope to produce a phone that isn't running iOS or Android?
More charitably because the title is actually an important question right now in the abstract for almost everything, not just operating systems.
But the forces that shape the question are so large and hard to get a handle on when we are living through the moment that you have to start thinking about it somewhere, why not OSes?
It's the thing that runs your AI agent, that runs your AI pocket bot (AIBI looks cute btw), that runs the software doing the training of AI models, that runs the datacenters doing the inference, etc.
There's still data. There are still bits moving. Filesystems and networking aren't going anywhere.
In a charitable reading the title is something like "what is even a desktop OS now?" or "what is even a consumer OS now?".
As for the new project, I've got one bet: there's Linux involved to host it.
Linux is an OS.
P.S: as a sidenote the entire "users don't install apps anymore" was already true to some extent. A shitload of users are totally fine with an OS that runs a browser and that's it. And they're fully operational. And we still all know what an OS is, even for, say, a Chromebook. Heck, I'm not even sure "installing apps" as ever been, except during the first install of the OS, what an OS was ever about.
1. spyware launcher
2. adware launcher
3. sales-funnel/app-store launcher
4. web-browser and game-engine launcher
5. content-production and accounting applications
6. nerd stuff that 5 other people care about...
I could be wrong, but have yet to see evidence to the contrary with users. =3
https://youtu.be/q225u-qGpas?si=9QH6gw4gOUxnAKZy&t=9
(The irony is that all the reading that's gone into our design is like, old CSAIL papers. Maybe it's true! Maybe everything we're doing is just crate-digging through old settled computer science. That would be on brand. I should find a way to work Athena into it. Maybe we'll use Zephyr for messaging.)
I guess it really is over if this is what professionals (supposedly) seem to think.
OP is right though, an OS remains an OS, same as it’s always been. What’s changed is how we interact with it and what we lay on top of it. Nothing magical or philosophical about it.
Finding some balance between access and safety for vibe-conjuring parts of the OS in a way that's still powerful but won't accidentally nuke or corrupt itself.
Unclear what will be left next to it. It will just live on your phone and take care of everything. The apps will be markdown files describing what they do, probably compiled ahead of time for latency.
But the model will be in control, so what else is left to implement besides giving it bash, a compiler and a display?
I guess there is value in the year before that happens.
IMO even this AI phone is doomed in the slightly longer run.
One more step into the weirdness and people will just be working with AI to build their own bespoke phone with the specs sent over to a manufacturer that is "like PCBWay, but spits out whole devices".
I have no idea what this does to society, the economy, etc when we reach a point where nobody really "needs" any kind of middleman for almost anything (well, except for things they actually really need, like food and shelter), but it looks like I'll see it happen for a bit before I die.
The physical device that is best for me is probably the best car compromise for several million other people.
if my ex calls and I want my glass brick to flash the "help me" in SOS on the screen, play Hector Berlioz, and dim all the lights in the room – I can have that. I don't have to want the same thing a million other people do.
The same. The slop apps remain just that. They may do something useful for you, but that's it. A bit like a branch in a repository.
Yes, I'm sure we all have horror stories about spreadsheets that got out of hand, but that ignores the thousands (or more) spreadsheets that are silently productive everyday.
not just startup nerd, he also make gas town and drunken rant