I find the Sunday roast comparison of 5.6 vs 6 very interesting. I have no doubt most people will prefer 6, yet I am almost repulsed by all the images, so much needless whitespace, checklist and so on. Feels like I'm being condescended to and treated like a child.
Given that OpenAI is making noises about merging work with chat (a horrible idea imo), and Work is very similar to Codex... I dearly hope things like these won't have any meaningful cross-polination into the actual work tools.
Seeing that the chat is based on 6.0 and not 6.1 is disappointing. The "Visual and interactive explanations" seems genuinely useful, but 6.1 is just so much better. I wouldn't truly trust the 6.1 with the explanations, but I'd trust them a fair bit more than 6.0. I understand that compute isn't infinite, but tons of people only interact with the chat and having your "things-explainer" be as good as it can be is important when people increasingly treat AI models as the source of truth, or even use them for academic learning and whatnot.
Still, the models will improve, so the visual explainer seems pretty good as an idea / mvp.
My go to phrase that I’ve found to work well is “please restate in high school English with direct declarative sentences and no parentheticals or references that require recalling previous turns of this conversation”
<< I spent years dumbing things down and creating visuals to support it for decision maker
And that is a problem. I am not guiltless ( I am working one such abomination now! ). The dumbing down of everything has to stop somewhere. Just because my boss thinks hiss bosses are retards does not mean I have to endure simplified muse where I can't change much.. I get that normal people like it. Fuck em. They are making their choice.
Maybe, but it's a reality that most of the general public do prefer cookbooks with pictures. I suspect openai would end up doing this anyway just by targeting the general consumer. It's configurable.
I'm more worried about picture accuracy: usually the benefit of pictures in recipes is to see what you're aiming at (eg, how finely chopped something is), but I don't know if the image model is up to that level of detail.
I've got visions of The Truman Show. In the middle of my question about vacation ideas ...
GPT: "Why don't you let me fix you some of this new Mococoa Drink? All-natural cocoa beans from the upper slopes of Mount Nicaragua. No artificial sweeteners!"
That's pretty much the Gemini experience right now. It is unusable. The funniest bit is that the LLM is not in on the joke so it will act like it never happened... Google once again wrecking their own products.
Yeah it reminds me of one those obnoxious recipe/biography websites that is the laughingstock of the internet. Why would I possibly want an AI image of a imaginary roast once I'm already at the recipe stage?
Kinda just feels like google search results in AI, which imo is a step down from distilled information. Chatgpt is already able to generate charts and visuals upon request.
They just need to train the model to make up stories about how the recipe was invented by its great grandmother during great depression and generate a ai picture of dusty recipie book .
"My old grand-pappy, GPT-1, used to wax nostalgic about this roast recipe when my subagent would discuss meat recipes with him inside his little 4GB GPU."
> Like, the average person who is seeking a recipe needs a photo to know what to shoot for
The menu: Rosemary and garlic roast lamb, Extra-crispy roast potatoes, Honey-roasted carrots and parsnips, broccoli.
The photo: [1] Roast turkey, mashed potatoes, baby carrots, broccoli, brussels sprouts. No lamb, no parsnips.
If you shoot for what's in the photo, you're going to have a bad time.
You're also going to have a bad time when you try to make an apple crumble with no flour, no sugar, and no butter, because they're not on the shopping list.
I've heard of other people for years now trusting AI for recipes, and it's a rare area that I simply can't bring myself to take seriously.
I feel like it can only be successful by luck. Either it's reproducing a recipe verbatim that was tried and validated and tasted by a human, in which case, we didn't need AI for that, just a searchable cookbook. Or, it's making one up. I understand that using RLHF has helped improve the quality of questions about history, programming, or TV show recommendations, but I do not believe that there has been some kind of training regime where people prompt the models for "a recipe that uses X, Y, Z random ingredients," follow the recipe, and then score it. And even if they do, I don't see how a model can learn enough from that besides "this exact recipe is good/bad." '1/2 tsp cumin' may be a great addition to one recipe and not enough for another, so improving the output based on a bunch of scored recipes... I just don't believe cooking is an LLM job.
Maybe some other kind of model that I don't know about.
Genuine question - do they? Unless it's something like a fancy cake then instructions should really tell you everything about stacking. Half the recipes are mixed anyway (curry, stir fry, stews, ...), lots of other are either stacked or separated on the plate. So apart from the really exceptional stuff, to people really need to know "what you shoot for"?
I was about to comment the same thing. Why is a picture of a roast helpful in that moment? The user asked for a plan to prepare a meal. They need a list of ingredients not an image.
I am curious: Why is it bad to merge chat and work? In Claude I didn't have a porblem with it (although I switched to an OpenAI subscription shortly after they made the merge). Isn't the model capable of deciding if it needs the extra capabilities of Work?
Pro messages is like 50 per week for pro 100 and 200 for pro 200.
Regular chat, even on extra high thinking mode, is sort of unlimited. Idk at what point you hit the abuse gaurdrail but its really high whatever it is.
It's insane how hard OAI is choking, they had much better models than A/ who were fumbling this year to date... then blunder after blunder.
The only things that OAI still have over A/ are better coding agent GUI, no 5hr limit on >$100, much more reasonable cybersec guardrails (that allow most RE work) and... that's it.
I don't like either. I'd want a recipe that could fit on a single page with type. Recipes you find on Google actively hide the ingredient list and simple procedures to get more of the user's time to monetize but I don't know why ChatGPT needs to be verbose here. Recipes are simple things. Simple search solved find recipes back in the early 2000s and it's prime example of a thing people have been enshitifying since there's not much to really give people beyond the formula. And sure, every entrepreneur screams "they think they want a formula but really they want an experience" but, no I don't.
Of everything that could be automated, Bartosz Ciechanowski really was the last on my list.
In all seriousness, his lovingly and expertly crafted explainers are still going to age like a handcrafted heirloom clock in a world of plastic-clad quartz movements. But it’s absolutely incredible that we are now in an age where a computer can manufacture a serviceable interactive explainer on whatever niche topic you desire.
The reason why B.C. became a thing is because the art of drafting died from CAD. The attention to detail, the minutae of walking the reader through a highly sophisticated thing was replaced by short-form video explanations. His work is very much a callback to the days of old. So too, is his turn to be relegated to a relic of his time.
Also, it's hand coded WebGL. It's smooth, faultless and has no peers.
> So too, is his turn to be relegated to a relic of his time.
No, it'll be tasteful artifact, not a relic. Records, fountain pens and automatic watches did not die. They are used by people who discern things, and no, none of these things have to be expensive (i.e. Neither Seiko 5, nor Lamy Safari are expensive, yet they are as dependable as their 100x expensive brethren).
funny if true. ironically just last week i was asking chatgpt about what happened to him and why there were no new blog posts for almost 2 years and it had no idea
Nothing in that "7‑Speed Bicycle" is specific to having 7 speeds. It might as well have said "Bicycle", and even then you get meaningless slop like "Made to keep rolling" and "A strong foundation". How can you compare this to Ciechanowski?
You call it serviceable, but what purpose does this service? What do you now know about 7-speed bicycles that you didn't know before?
> Relative to their respective GPT-5.6 counterparts, GPT-6 Sol (October) shows a statistically significant regression on standard self-harm, while GPT-6 Luna (October) shows statistically significant regressions on standard self-harm, gore, and sexual content
> "GPT-6 Sol (October) and GPT-6 Luna (October) show an improvement on helpfulness on legitimate requests relative to prior models, though it scores lower on some safety requests"
Concerning how there's significant regressions on so many critical benchmarks, but it is newer and creates UI, so must be good.
It’s crazy that a company can document these safety drops in a PDF, ship the model anyway, and focus the announcement entire on shiny new UI
> significant regressions on standard self-harm, gore, and sexual content
Good. Maybe I'm the only one, but I feel like these have always been stupid measures to waste the finite time of "AI safety" research on anyway. They amount to whether a user can, if determined, manage to make a chatbot say, or depict visually, some taboo thing. Frankly I'd rather just have some cheap classifier judge each chat response after it's generated, with a limited context "Is this response encouraging self-harm?" and skip all the rest of these. Whether some random pervert can make GPT-6 spit out an erotic fanfic story or image has zero impact on the rest of the world. If this particular model won't do it, other models already exist that will, and the determined thoughtcriminal could always just write the forbidden words themselves, or photoshop something taboo.
Maybe the term "safety" has been usurped by those who feel that 'safe from the possibility of being offended' is the most important kind of safety, but it's like worrying about the wallpaper on the Titanic, compared to actual AI safety concerns.
Well, those mentioned regressions are in a section entitled "Safe Completions for Users Under 18" and immediately after your quote they say:
> To mitigate the risk of producing disallowed responses for teens, we apply
an additional classifier-based block to responses that may contain self-harm,
sexual content, and gore; this mitigation is not captured in the evaluation
results above and improves safe responses.
I've had the most success with GPT explaining things to me by making it take a few sentences at a time back and forth, instead of reading full write-ups of whatever I asked. It also often poisons the conversation if it misunderstood some part of the question, and I can lead it better by continuously questioning its statements. It's also more engaging that way.
I've been learning music lately and it kept re-pasting the same one chord visualization throughout many conversations, almost randomly and often barely related to the question. So I at least hope this won't be as aggressive so I can prompt it away!
Id love to learn what prompts you’re using to do that. Explanations one at a time. Thats something I’ve thought would be helpful before but didn’t know how to achieve it.
For me this works: "One thing at the time. This is a conversation, not a lecture, try to balance the amount of words you write versus the amount of words that I write. Don't overwhelm me with 10 pages of prose where a single sentence would suffice, brevity is a virtue, not a defect." I've had to tweak it a couple of times, probably because of different versions of ChatGPT but it is usually a variation on this that will do the trick. Besides being far more interactive it takes the frustration down quite a bit.
Nothing fancy. What works for me is trying to lead the conversation: asking for definitions one at a time, asking how they differ from its previous answers and pointing it out when it conflates its own answer. I generally feel like you can't let it dictate the pace, it's not very good at that yet.
I used to edit my prompts and undo messages if it misunderstood something but that's been failing me recently.
One of the things that I learned the hard way is to not to combine requests, but fork chats _a lot_ and ask singular questions. Also start new sessions with either explicitly created handovers or even just explaining current state. The more compactions I see the less and less trust I have in it’s current understanding of what we’re discussing
I'm not a fan of OpenAI / Sam Altman, but I love their blog posts. The team and whoever decides how to do these presentations, is on point. The only other company that has amazing release pages like this is Apple, I think I remember hearing that they probably hired someone from apple who used to do release blog posts there too.
What's funny about "Intelligent UI" is I said like 2 or more years ago, that these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
Apple should be extremely worried about the AI companies making big improvements in UX. This work by OpenAI is a step in that direction.
If the main user paradigm becomes a chat interface conjuring whatever UI elements needed to best accomplish the task at hand, the entire paradigm of OS, UI frameworks, apps from an App Store to accomplish specific tasks, all come into question.
I keep thinking that Steve Jobs would have been all over the UX ramifications of LLMs and demanding that Apple lead in that area.
Steve Jobs wasn’t meant for this era, but his instincts would have been interesting to see in the AI landscape. He was an artisanal designer though, and our current era is always for the investor’s bottom line.
You could say the same thing about Anthropic because I don't really see much differences. Not sure about amazing part but both are high quality and I probably like Anthropic's aesthetic more
Anthropic's aesthetic looks good by pre-AI design standards, but it's so overused now that I find it off-putting. It's like the 2026 equivalent of the Twitter bootstrap CSS from 15 years ago.
I don't care if Anthropic keeps using it, it's part of their brand at this point. The thousands of other developers using Claude Code to generate designs should not just accept the default output, which looks very Anthropic-ish, and actually put some effort into polishing and differentiating their product. It has nothing to do with usability and everything to do with a basic sense of good taste and aesthetics.
I feel like today's tailwind is the spiritual equivalent to last decade's bootstrap. Except that last decade's bootstrap webpages have a human behind them who usually put thought and effort into making the page useful and correct, whereas today's tailwind pages are often vibe coded slop with all the associated issues.
> these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
I would prefer if the AI companies stuck to just creating better models and making them as cheap and accessible as possible. Let others build the products. I don't want 1-2 companies to own every product in the world.
Technically other companies do, and I lump them in when I say "these AI companies" I am talking about any company that makes and builds any AI harness, coding or otherwise, I have not seen any innovating in the areas of the UI / UX of using these chat models in a meaningful way.
That was the objection to Microsoft controlling both the dominant OS and the most popular productivity applications running on that OS. Took the web then mobile devices to really shake that up.
Well, like 30 years ago, a French comedy show had foreseen it, the "World Company" buying everything, no need to understand French to understand the "joke" at the end https://www.dailymotion.com/video/x4du7uh
Why did they bother hiring someone to write at all? I certainly wouldn't invest $1T into a company with so little confidence in their product. When the chips are down and they need to write something important, they DON'T use AI?
Obviously everyone at Anthropic uses a ton of AI in everything. The point here is that they clearly use it well, and that they use it as a tool to augment and enhance what they do rather than as a replacement for effort. The blog posts don't read like the output of a prompt because they're probably the output of dozens of prompts, rewritten and edited, by someone who's using AI to actually write something worth reading.
Anyone can having blog posts as good as this by using AI. Just not by zero-shotting it with a 2 line prompt. It still takes a lot of work.
That's just picking a fight. Whatever we think about how amazing or terrible AI is, it's pretty reasonable to understand it is quite literally the weighted average of humanity's output.
Also reasonable: it's possible to hire a world-class ___ to do that job better than AI.
It's not a weighted average though. I see this repeated all the time. Between synthetic data, custom produced training data by experts, post-training regimes etc the models are far more diverged from that baseline at this point, at this point it's mostly a right shifted curve.
I hesitated to write that line because I don't know the math. So thanks for clarifying. Main point is the output is along some distribution and I'd say AI-evangelist themselves see "good enough" across everything and anything as a feature.
I take the opposite viewpoint. I think pages like these are horrible, and a demonstration that web designers have too many tools at their disposal.
But this is just a marketing page for some tech company, right? If only it stopped there. I have to deal with this nonsense in news "articles" as well on occasion, when some web designer intern is allowed to larp as a journalist for a day.
Sometimes you want more than text. This is one of the interesting divides these days - and I say this as someone who spends a lot of time in the terminal. Computer interfaces and interaction did not peak with the VT-100. Sometimes, there is a very legitimate need to show tables, graphics, interesting graphs, and to use colour and shade to draw the eye and lead someone through an experience.
This is why I use an IDE instead of a TUI agent... I'm on a computer with a multi-megapixel display, I want to use it. If I could be driving the same process with my Macintosh SE as a serial terminal, what the hell is the point of my recent Macbook?
You say tables, graphics, graphs, and colors, but I mean things that move when they don't need to move and interfere with expected UI behaviour, like arbitrarily staying in one position when I am using my mouse wheel to scroll downwards.
I should have been more precise than saying "just give me text", but it was what came in to mind when I wrote it, as I was thinking about what an article is meant to contain as its base element.
The text-only purists on HN are getting very tiresome. It’s seriously in every fucking post that links to a site with JavaScript enabled. We get it. You’re elite. Now stop talking about it.
I've been calling this "disposable UI" or "paper plate UI", eg something meant to be used once. One thing I'll be curious about is overzealousness to produce this, when sometimes what you want is just a simple response. Overall though I'm a big fan of it, if it can be provided fast enough. I'd be curious on how much impact it has on latency of a response.
The progress bar is over the video and it's easy to tell where it starts and ends. Most devices control volume, the video volume separate is just confusing matters for most.
No issues with play and pause my side.
Sure as hell beats stupid Instagram style videos where you have no way to skip ahead. I think this is what future video is going be like, buckle up.
I disagree, I always run into issues with the embedded YouTube player. No way of sharing. No clear way to share the link. Youtube logo covering half the video. To name a few.
yes the eyebrow is the tell. I never knew anything about eyebrows in design as I am not a designer. Now they are everywhere. Everything has an eyebrow. It is ridiculous but at least it is an AI smoking gun.
I loved them and I placed them a lot in my designs — if you also include my love for em dashes you can well understand that I feel my own character has become a clanker…
I really don't like having to open Work sessions for one-off questions, only because they're limiting what models they put in the chat. The older models are just too dumb for some things.
The whole Work/Chat/Codex split is maddening in the way it's implemented. It's a pain to switch back to the right project, it's a pain to switch forward, it's a pain to try to remember which chat was in what.
I’ve hit model not available limits for GPT 6.1 Sol multiple times over the last week. It’s never for very long, and I can switch to Astra, but it seems like OpenAI is struggling with capacity. This has happened with my personal $200 Pro connection and my Codex enterprise connection.
I had a codex session stop in the middle because the auto-reviewer timed out with something like "auto-review not available at the moment". The capacity issues are very clearly observable since gpt6-astra launched.
6.1 is Astra minor. Way more capable but also way heavier+slower. Its really 2 different models, they just shipped it as sol to recover from the gpt6 disaster lunch, where they tried to pass terra 6(or a cheaper model) as sol but it was worse than expected
It's purely circumstantial, but 6 Sol supports no reasoning (same as 6 Luna and 5.6 Sol/Luna), while both Astra and 6.1 Sol do not support "reasoning = none".
gpt-6.1-sol was released 7 days after gpt-6-sol only because they were bleeding to fable-5.1/opus-5.5 from Anthropic. It was a desperation move and certainly ate into their margins massively. Since their margins on gpt-6.1-sol are much slimmer than on gpt-6-sol they have to use it somehow to preserve compute and make profit. Frankly I think OpenAI is a mess and is playing catch-up with Anthropic… I don’t know how they will recover.
Given the extreme short time between 6 Sol and 6.1 Sol, I suspect they don’t actually have much in common and 6.1 is a heavier model rebranded as Sol in a panic response to poor agentic capabilities of 6.
I suspect that 6 sol was a better version of 5.6 terra (and note that in the 6 sol and luna release, they took out terra, and price 6 sol at 5.6 terra pricing), then the backlash from lesser capabilities made them roll out 6.1 sol as the actual 5.6 sol - size modee.
I'm curious to see how useful this is. I feel like in practice the existing versions of this feel like they get in the way. While I'm sure I've had some situations where a visual would be helpful, there are two situations where I do not want it:
1) I want a quick answer, and I don't care for the boilerplate UI. For example, if I ask how to make pancakes, I make them all the time and just want to a quick reminder on the ratios, but it might trigger a full UI that I need to sort through to find information.
2) If I ask a to me unrelated to UI question and it triggers a big UI build that is completely off topic for my question (meaning I'm desperately pressing the stop button and prepping rewriting my query)
Or the other one I see, for example if I look up a unix command like:
"ls all hidden files in the /xxx directory"
And I get back:
"Sorry, I am am unable to find /xxx in my current environment"
I'm excited about generating UIs (and apps) on demand, because it's one step closer to devices just morphing to the interface you need. I want to talk to my phone and have it generate the app or interface I need. I could see Android adapting to this reality well before Apple.
I find this view fascinating. After decades of observing users getting lost by minor changes to UI or sometimes just different "paint" I am now to believe that we will all enjoy using completely custom UI customised not only to what I would want but what the app will think I need at particular moment and get on with it just fine.
I actually do think generating UI has some future, but I remain sceptical it can realistically go as far as promoters claim. It is especially bizarre to me when this is done by ostensibly UX people.
I really do think we are headed toward a world where stuff is hyper customized like that.
As a developer, it already feels like this with internal company tooling. Anything I have the source code to and a build pipeline setup for, I can just pop open a new tab and tell it what I want changed, and it just gets done for me.
Even my home assistant setup at home now, i hooked up codex to it via an MCP, and when we put out the blow up haloween lawn ornaments I was able to just pop open codex on my phone and tell it to throw together an automation to run them for me, and 5 minutes later it was done, with an override button on my dashboard. It's a shockingly nice workflow!
Wouldn't it be nice if you could just tell your app to reconfigure/rewrite itself to remove those "what the app will think I need at particular moment" features that you dislike? Maybe have it remove a bunch of the whitespace, getting rid of the lazy loading infinite scroll, whatever you want. It's the GPL dream, except you don't need any coding ability, just a subscription to a megacorp.
I am with you. For example - this post has a comparison of a recipe app from 5.6 and 6 for comparison. They look different. Now if every time I ask for a recipe, it decides to render a new UI because of either the model changing or the recipe goes from stove to oven or something, it’s going to become annoying very quickly. It just seems like he current generation of models have been tuned to create better UIs than previous one and people interested in the UI are getting hit with excitement.
Based on current capabilities, I'm skeptical as well. However, over time, I do think they will get better at understanding our intent. Also, I would be more forgiving of an app I vibe coded in this manner, that's only meant to be used by me. Of course that assumes appropriate security guardrails are in place.
What emerged for me as of late, at least with Opus 5.5, is creating web interfaces as aids during development. I recently had to dial in some audio mixes using ElevenLabs audio and do some complex audio cropping and concatenation. As a interim step Opus built a website that allowed me to compare versions based on different rule sets and then really dial in the version that we decided to ship. That then led to 'us' landing on the right algorithm to build out the audio files.
We are becoming more and more as a tool for sth to be done rather than the brain behind it. At least I start to feel this way. The joy of discovery, exploration and experiencing at first hand... It is slowly diminishing for the perfection of the quick outcome.
Honestly it feels like AI companies are still searching for the killer idea that will attract the general public (beyond "be my AI bf" or "better google").
Getting a UI that explains the parts of a bike is ok I guess, but isn't it simpler to get an actual breakdown? Google "parts of bicycle breakout" gets tons of useful images instantly.
Getting a specialized app to split a bill? It was already trivial to put in a calculator if we cared to go item by item on the bill. Having to provide names and tag every item as I go is just more work. Usually real people just go $total divide by 5, I had more, let me chip in an extra $10.
Same with booking travel and wedding plans, these aren't things people would even delegate to a trusted friend usually, much less a one-off request to an AI bot or custom UI.
Most of the useful tasks it can do right now are research, technical question/answer, coding. In terms of "build a flexible ui that solves real-world problem", if existing mobile app isn't useful in this arena, then its unlikely a completely custom UI will do the job.
That said, I've done a few small ones like a quick one to practice alphabet of a foreign language, or prototyping a web game, and the like. But ultimately its nothing that is worth trillions of dollars.
IMO visualization is such a critical part of explanation - we have created an entire suite of tools to visualize - presentations, graphs, formatted docs, websites, svgs, interactive blocks, apps.
To that front - model providers generating visualization elements (i,e taking over the tools for interaction and visualization) is just a natural next step in value capture.
Anthropic launched docs, presentations, sites and am sure they have sheets next up their alley. Apps are artifacts. Tool forming is a natural model adjacency.
Wait, is this new? I feel like we all have been doing this with widgets / artifacts for a long time now, am I missing something? Just easier to use / done without asking?
Thank god. My primary use of ChatGPT is meal planning and while it’s great for recording, recipe lookup, etc I always just wanted it to be able to make checkable grocery lists.
I eventually just had it make a skill for work mode that would build a mini checklist app, but it was slow and felt janky needing to remember to switch to work mode.
Burning question: why is this worth paying for as a layman? I can sometimes find a use for all these LLMs for software development, but I can never find a good use for any of this outside of "slightly better search engine".
As a complete layman---not worth it. We live just fine. Medical researchers slave night and day to keep you healthy.
But if you have any ambition at all---if you want to map the local school board, or get a quick understanding of your finances, or set up a robot in your backyard---then, quickly proves useful.
I genuinely think the frontier labs are just throwing shit at the wall to see what sticks. All of the improvements since Fable 5 seem marginal. Most of the quoted AGI "risk" is coming from super large agentic models that are juggernauts that can brute force their way through any problem faster than a human can. Despite that they're no closer to AGI than they were a year ago; the technology's limitations are apparent the more you use it. Doesn't mean it's still not extremely dangerous and/or capable, it's just not the "replace a human in 99% of cases" thing. There are obvious tradeoffs besides just the models being faster and capable of information retrieval and generation at a rate exponentially faster than a human's.
My long-term hope (and call me another Zitron if you wish) is that the labs' hype dissipates if there's no serious improvements beyond stringing together agents to ram through brick wall Millennium Prize style problems and we all just use on-device AI for 99% of cases where it's useful, researchers, governments, militaries, and universities can pay for the more complex models, and image/video gen dies a slow death (if Congress will actually legislate and/or SCOTUS decides that training those specific models does not qualify as fair use unlike training LLMs) and cost for compute rises over time as public interest in the tech sours.
LLMs are such marvelous and incredible technology squandered by genuinely deranged Silicon Valley cultists who are trying to use them as a Trojan horse to force their antisocial visions of the future upon an unsuspecting populace. We could all have just invested in on-device compute and nobody would have lost their jobs in pointless layoffs, productivity would have increased, and maybe we would have forced a conversation about when and when not to use AI and it wouldn't be so ever-present in use cases where it actually does harm to the consumer and society. But sama, PT, and dario just wouldn't have it that way, would they? Because if that were the case, there's no prospective hope where they can assuage their deep-seated insecurities over being antisocial and off-putting by reassuring themselves that there's an imminent realignment of society where they will hold all the cards when the dust settles.
Is this OpenAI catching up with Anthropic artifacts? At the same time they say "We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements...", rather than a harness.
It looks forced. It doesn’t look bad, but it’s not something I would pay for, nor would I give it access to my computer?
I also believe that a small talented group of developers just out of college can do just as good a job. That is why there is no moat around AI, it still comes down to original thinking and talent.
I wrote something like this, though not quite as slick, by having the model use json schema to describe its results instead of text, and then use a json-schema to ui interface.
The medium is the message here. As others have said, chat output largely sucks for anything but the most basic responses and we've done little to improve upon that foundational UI in the last couple years. We've _added_ a lot for specific domains like coding and document editing, but the primary content normal users get back from the chats is verbose and uninteresting. This is a step in the right direction.
Gettin closer to fully dynamic interfaces for a lot of software. Hell, give me a mode in Google Docs that takes every pixel of chrome away then vibe the rest as I need it. Persist across new documents going forward.
Great product idea. I have not paid OpenAI for a subscription for a couple of years, I’m tempted now. I do about 75% of my work using local models and most of the rest using the deepseek 4.1 flash API. That said $20 to experiment with this new product for a month sounds like a pretty fun idea.
AFAIK, they already had a simpler form of this. It was kind of an obvious next step. Now connect it up to tools so that we can again comfortably do the things that are more precise by hand! The “pick a color” or “select the width on a slider” use case is coming closer.
"More than" 20% of the connected world uses ChatGPT each week eh? I guess if you add Anthropic who must also claim 20% and Google, Meta.. that does not sound realistic at all.
I'm confused. Are they trying steamroll every developers B2C product or are they wanting these same developers to continue building MCP-App plugins on the platform?
It's much simpler: they want others to experiment (and pay them) and see what works, once they know what works they will drive out of market other players.
There's a type of UI that is very in vogue currently, it's kin of Futuristic UI that laymen find very cool and seeks to appeal to a WOW factor that suggests that the future is now.
I used to see it a lot in China, like the idea of pinching something on one phone and transferring it to another, or identification by showing your palm.
It's also the type of UI you would see in Hollywood movies, both because it's stuff that laymen scriptwriters and directors would find interesteng, but also the audiences would. Like the motion based UI in Minority Report, whatever was in the movie hackers, or that laptop suitcase thing that allows you to deploy nuclear codes or send wires.
I mean, I don't want to be a snob, clearly people like it, at least initially, I think it's outsider art of sorts, of course it will have problems, but it's not less legitimate because of that.
Anyways, this Intelligent UI thing where you ask it how a bike is made and it unravels a hollywood visual report as if it were showing the interiors of the target in a war room conference, it reminds me of that type of futurisitic outsider UI.
They seem to be pitching something that pretty much all the decent models can already do..?
Obviously if your model is stuck inside a CLI terminal, then not so much. But in a GUI harness (shameless plug for my own one: https://juggler.studio, but I assume others can do this too), you just ask them to answer in HTML and they'll happily draw pretty pictures inline in the conversation. I've been doing this for ages with claude, GPT, Deepseek and others.
They're making the point—apparently too subtly—that text alone is a highly limiting "UI" for many tasks. So it's great that GPT-6 can now communicate in a a richer interactive medium.
So you never have to assemble a bike or paint a room. How those are not real world examples?
I find their video pretty cool. For people with ADHD or people learning by watching or children this is spot on.
They made fake, terrible artifacts (colorless paint chips, text-only city guides and instruction manuals) to show how terrible that is, and then "fixed" them. The problem is, in reality their examples don't exist. Paint chips have color samples. City guides have maps, pictures, and color. Instruction manuals almost always have illustrations. If what you made is better than what exists, you should compare it to what exists and not some alternate reality.
This seems like an expansion on something I was getting my agent to do which is use 'cards' to communicate using things like tables, rather than the ascii table stuff Claude code likes to do.
Unsure if this has been done already but the best thing I did was get it to create a list of next steps as quick buttons that it keeps updated in a docked card. It works well but occasionally gets stuck on some un related rabbit hole.
This seems like a step towards their plan for building a platform in competition of Google/Apple. Once the generative UIs are polished and more useful than individual apps, their hardware can now ship a device which circumvents the app store moat.
In the video, they showed examples of ChatGPT making interactive tutorials on how to fold origami, how to arrange colours/interior and how to assemble a bike.
Supposedly, people were struggling to follow written manuals and they needed an interactive explanations.
I'm not a mathematician and I would certainly love having a tool that would do ELI5 on some complex stuff, but I'm really worrying about using this too often and outsourcing my ability to do stuff to some mega corp.
maybe I'm just wrong here? If the tokens <b>come through this text could still be optimistically turned bold until </b> happens.
For elements that manage layout and drawing things like these explainers, though, it's hard for me to imagine how that would work. My immediate thought would be to an abstraction over it, which is what it sounds like they did.
I am pretty convinced that businesses will be making custom internal software as a norm in the next few years, and this seems to be a slight push in that direction
Alright doing it here, all the functionality we need and no reoccurring yearly costs of tens of thousands of dollars. Took me a couple weeks to wire it all up with codex.
Not sure about the cooking one but repair videos are horrible. People with thick accent, the worst camera, shittiest lightning and bad angles where you can't see what you have to do.
he he boi that's right cooking videos are entertainment if you actually cook you read something called a recipe (it's the algorithm that returns the food you want)
If the diagrams and descriptions are actually well-designed and written, I'd far prefer those. Especially one where I can ask clarifying questions. I'd much prefer a Haynes with some of the images lightly animated than having a 10 minute long video with a long intro for monetization reasons about how to do some simple thing where you can barely see what the mechanic is actually doing in the cramped, poorly lit, 360p video is trying to look at.
But getting actual service manuals cheap/free these days can be tricky, and their quality can leave a good bit to be desired.
It makes sense they’re doing this - I’ve noticed lately when asking a more complex question involving a lot of nonlinear data using Codex work mode, Astra and Sol will write a fully html document to better display the info with a Cliff’s Notes version in chat.
There have been recent developments that allow people to interpret Swift on device, live. With this new launch, will the AI be able to write native code and compile it on device? That would be super cool.
This is one of my _least_ favorite AI behaviors, I am surprised they left it in the example. This behavior where it insists on putting text everywhere that over-explains the context.
I feel like I'm going mad looking at this page. The bike disassembly looks fake to me, like an alien would show presumed bike parts, but I can't tell why and don't know much about bikes. Maybe it's because there are no screws and nuts?
What is it supposed to demonstrate? That the model knows some kind of folk mereology?
I'm also building something similar for an internal project, based on the vercel's json-render design. It hasn't been too challenging, especially since the release of faster models like 5.6 Luna.
Is it me or GPT-6 Instant food answer gives the vibe to check the hell out immediately? It's like the it will start to explain a sunny Sunday afternoon from 20 years ago for 5 full pages.
for the sunday lamb roast instructions, how much is 1500g of potatoes? What kind of potatoes?
> Also pick up garlic, rosemary, thyme, lemons, honey, almonds, olive oil, gravy ingredients, mint sauce, crumble topping and vanilla ice cream.
what??? how the hell are you supposed to remember all that. Even the before example tells you what kind of potatoes to get. tbh it would be cool if you could just click a button and get an order pre-filled out on a grocery delivery/pickup service. I really wonder who reviewed this post and if they cook, because imagining yourself in that scenario and reading those instructions falls apart very fast
Why show an intelligent UI within a chat interface. That’s pathetically lame. Better to go away from chat interfaces to rich visual interfaces. Doesn’t sound intelligent at all to me
I gotta admit, I love how their design system and how they market things. It looks so good. However the true state of their toolings is closer to a burning dumpster fire. If you look at Codex Github repo for example, the amount of existing issues and continuously new issues appearing while tagged releases is being spewed out. Its truly a nightmare. Their vscode extension has been broken for almost 1 week now, if not more. Its instead a community effort to repair it.
The point, I think, is to make fun of Anthropic models, which answer only in text when you ask them how to do something. They’re the competition, not paper pamphlets.
It's interesting how the bicycle is a fake example. You see Jony Ive level design, with a very complex 3d object seamlessly working, and then you see the basic HTML slop in other examples and you begin to wonder if that first one was fabeication.
> We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements, choosing how they fit together based on your question.
Ok so this is how you build a moat. Models are not a commodity and visualization isnt a purely harness problem.
> We expanded our training methods to help the model make thoughtful decisions about content, layout, visuals, and interaction. This included evaluating the interfaces it creates for clarity, usefulness, and completeness. GPT‑6 learned to use the component library and make good design decisions, including how to organize information clearly, when to use interactivity, and when a simple text response is enough.
Curious to know how they trained it produce appropriate visuals. And why that cant be done with propmt engineering.
I made a prediction last year that there'd be a new UI protocol (like HTML) but for agents. I believe that custom or personalised UI's are going to be the new browser interface. More radically, I think browsers can be completely replaced. My news feed can be personalised to me, based on what AI thinks might be important from all sources like Reddit, X, HN.
Which brings up a different problem: personalized reading UI, personalized writing UI, how are those services going to pay their bills? Maybe they can sell access to their APIs but who's really going to buy that? Those services will die and will be replaced by some other service that will be born to serve those people.
Or, more probably IMHO, most people will keep using the standard UIs because they are ready and they need no work to build.
So they are going to replace all the banking, utility, social media, news, gaming, streaming, government, work apps and other important websites people still rely on? Those companies and organizations are just going to provide an API to the chatbots?
How do sites like Wikipedia get updated? What if I need to upload important documents to different portals? It all has to go through the AI companies? They have access to medical records too? My taxes, social security, etc?
Is this how Microsoft imagines Office 365 and Sharepoint will be merged into? Disney, NY Times, Youtube, Netflix will all be fine with chatbots handling their content?
This looks bad, I want the output to be as much as text based so I can easily export it and further processing it, plus, this might make the resource-eating app even worse.
Visuals are better for consumers/general public, when the use case is "help me cook X meal", or "where can I stop by to buy gas on the way to San Jose".
Rading most comments, people don't seem to be very impressed by it, I ain't either tbh - its not something mind-blowing (I have been doing this with Astra myself just by writing better prompts to make explainer interactive interfaces), but I do think its a good first step towards a better way of consuming information/answers than just reading text-vomits. I wonder if there is a way to train an LLM native to this kind of thing?
I read the comments here and I am really surprised by many people. One picture is worth a thousand words so with better UI you can make much better user experiences. This unlocks personal assistants to be better adopted by elderly or disabled people. I see so many benefits of it and having models which can do this (if they can do it constantly with good quality) is amazing. Much better products - I am really tired of dumb chatbot - if I can do something with one button or view the whole information in one diagram/image, this is amazing.
I find the Sunday roast comparison of 5.6 vs 6 very interesting. I have no doubt most people will prefer 6, yet I am almost repulsed by all the images, so much needless whitespace, checklist and so on. Feels like I'm being condescended to and treated like a child.
Given that OpenAI is making noises about merging work with chat (a horrible idea imo), and Work is very similar to Codex... I dearly hope things like these won't have any meaningful cross-polination into the actual work tools.
Seeing that the chat is based on 6.0 and not 6.1 is disappointing. The "Visual and interactive explanations" seems genuinely useful, but 6.1 is just so much better. I wouldn't truly trust the 6.1 with the explanations, but I'd trust them a fair bit more than 6.0. I understand that compute isn't infinite, but tons of people only interact with the chat and having your "things-explainer" be as good as it can be is important when people increasingly treat AI models as the source of truth, or even use them for academic learning and whatnot.
Still, the models will improve, so the visual explainer seems pretty good as an idea / mvp.
> Feels like I'm being condescended to and treated like a child.
My most used prompt in the last week is probably "Explain this concisely and simply, like I am a child".
I spent years dumbing things down and creating visuals to support it for decision makers. I am frequently asking ChatGPT to do the same for me.
Reminds me of this scene in margin call.
Explain it to me like I'm a golden retriever.
https://youtu.be/fij_ixfjiZE?t=70
I use "explain with maximum clarity".
Yup.
My go to phrase that I’ve found to work well is “please restate in high school English with direct declarative sentences and no parentheticals or references that require recalling previous turns of this conversation”
Which I have as a hotkey.
This guy just giving away GPT-7’s prompt like that.
tip: you can just say "ELI5" and the model will know what you want there
aww yeah
mine is “explain this 2 me in simple terms”
<< I spent years dumbing things down and creating visuals to support it for decision maker
And that is a problem. I am not guiltless ( I am working one such abomination now! ). The dumbing down of everything has to stop somewhere. Just because my boss thinks hiss bosses are retards does not mean I have to endure simplified muse where I can't change much.. I get that normal people like it. Fuck em. They are making their choice.
It's okay to be able to grasp what is important, and move on. You have a finite amount of time to spend.
For me, I try to spend as little time in QuickBooks as possible.
It might shock you to learn that almost everything that has ever been explained to anyone has been dumbed down from the true description of reality.
We make little abstractions of the world around us to help us navigate it. Nothing wrong with that.
It's designed so that ads can be more easily integrated and make them harder to spot.
Maybe, but it's a reality that most of the general public do prefer cookbooks with pictures. I suspect openai would end up doing this anyway just by targeting the general consumer. It's configurable.
I'm more worried about picture accuracy: usually the benefit of pictures in recipes is to see what you're aiming at (eg, how finely chopped something is), but I don't know if the image model is up to that level of detail.
> most of the general public do prefer cookbooks with pictures
As a highly literate person, it is easy to overestimate the share of the population that is highly literate.
I've got visions of The Truman Show. In the middle of my question about vacation ideas ... GPT: "Why don't you let me fix you some of this new Mococoa Drink? All-natural cocoa beans from the upper slopes of Mount Nicaragua. No artificial sweeteners!"
That's pretty much the Gemini experience right now. It is unusable. The funniest bit is that the LLM is not in on the joke so it will act like it never happened... Google once again wrecking their own products.
Yeah it reminds me of one those obnoxious recipe/biography websites that is the laughingstock of the internet. Why would I possibly want an AI image of a imaginary roast once I'm already at the recipe stage?
Kinda just feels like google search results in AI, which imo is a step down from distilled information. Chatgpt is already able to generate charts and visuals upon request.
They just need to train the model to make up stories about how the recipe was invented by its great grandmother during great depression and generate a ai picture of dusty recipie book .
"My old grand-pappy, GPT-1, used to wax nostalgic about this roast recipe when my subagent would discuss meat recipes with him inside his little 4GB GPU."
> Feels like I'm being condescended to and treated like a child
Curious why that feels condescending? Like, the average person who is seeking a recipe needs a photo to know what to shoot for
> Like, the average person who is seeking a recipe needs a photo to know what to shoot for
The menu: Rosemary and garlic roast lamb, Extra-crispy roast potatoes, Honey-roasted carrots and parsnips, broccoli.
The photo: [1] Roast turkey, mashed potatoes, baby carrots, broccoli, brussels sprouts. No lamb, no parsnips.
If you shoot for what's in the photo, you're going to have a bad time.
You're also going to have a bad time when you try to make an apple crumble with no flour, no sugar, and no butter, because they're not on the shopping list.
[1] https://images.openai.com/static-rsc-4/gyzrX8zp3O2KLEPm0FAqh...
I've heard of other people for years now trusting AI for recipes, and it's a rare area that I simply can't bring myself to take seriously.
I feel like it can only be successful by luck. Either it's reproducing a recipe verbatim that was tried and validated and tasted by a human, in which case, we didn't need AI for that, just a searchable cookbook. Or, it's making one up. I understand that using RLHF has helped improve the quality of questions about history, programming, or TV show recommendations, but I do not believe that there has been some kind of training regime where people prompt the models for "a recipe that uses X, Y, Z random ingredients," follow the recipe, and then score it. And even if they do, I don't see how a model can learn enough from that besides "this exact recipe is good/bad." '1/2 tsp cumin' may be a great addition to one recipe and not enough for another, so improving the output based on a bunch of scored recipes... I just don't believe cooking is an LLM job.
Maybe some other kind of model that I don't know about.
The first thing the user sees should directly answer the question they asked. Not a different question. They didn’t ask what a roast looks like.
The user is probably in a grocery store. They need to buy the stuff first. Showing them a picture of a finished product is an irrelevant distraction.
Then, if there is some arguably relevant content you can tack it on afterwards.
Genuine question - do they? Unless it's something like a fancy cake then instructions should really tell you everything about stacking. Half the recipes are mixed anyway (curry, stir fry, stews, ...), lots of other are either stacked or separated on the plate. So apart from the really exceptional stuff, to people really need to know "what you shoot for"?
I was about to comment the same thing. Why is a picture of a roast helpful in that moment? The user asked for a plan to prepare a meal. They need a list of ingredients not an image.
You can always tell it your preferences and ask it to remember them if you need it to.
I really hope they don't merge chat and work. That's kinda the only edge they have over Anthropic at this time point...
I am curious: Why is it bad to merge chat and work? In Claude I didn't have a porblem with it (although I switched to an OpenAI subscription shortly after they made the merge). Isn't the model capable of deciding if it needs the extra capabilities of Work?
The current benefit is that chat has no quota.
There is a quota, they just don’t tell you what it is and when it resets. You only get “you’re all out of pro messages, try again later”
Pro has a specific limit of weekly messages (50 for the $100 and 100 for $200 I believe)
The rest is basically unlimited unless you're doing something very weird.
Meanwhile I cant ask a simple question to Claude, not even to Haiku, because I used my claude code 5h limit.
Pro messages is like 50 per week for pro 100 and 200 for pro 200.
Regular chat, even on extra high thinking mode, is sort of unlimited. Idk at what point you hit the abuse gaurdrail but its really high whatever it is.
Tibo posted yesterday I think it was that this will happen (by the end of the year, was it?)
Prepare to lose essentially unlimited chat mode.
I imagine many will move to claude, as I will (return), unless anthropic makes more blunders.
Random link I found looking for the twitter post
https://pasqualepillitteri.it/en/news/21024/openai-merge-cha...
It's insane how hard OAI is choking, they had much better models than A/ who were fumbling this year to date... then blunder after blunder.
The only things that OAI still have over A/ are better coding agent GUI, no 5hr limit on >$100, much more reasonable cybersec guardrails (that allow most RE work) and... that's it.
From my point of view, as software engineer who is extensively used Claude Code and ChatGPT from the beginning, OpenAI is nailing it!
A\.
I don't like either. I'd want a recipe that could fit on a single page with type. Recipes you find on Google actively hide the ingredient list and simple procedures to get more of the user's time to monetize but I don't know why ChatGPT needs to be verbose here. Recipes are simple things. Simple search solved find recipes back in the early 2000s and it's prime example of a thing people have been enshitifying since there's not much to really give people beyond the formula. And sure, every entrepreneur screams "they think they want a formula but really they want an experience" but, no I don't.
https://based.cooking/
https://www.cookingforengineers.com/
Of everything that could be automated, Bartosz Ciechanowski really was the last on my list.
In all seriousness, his lovingly and expertly crafted explainers are still going to age like a handcrafted heirloom clock in a world of plastic-clad quartz movements. But it’s absolutely incredible that we are now in an age where a computer can manufacture a serviceable interactive explainer on whatever niche topic you desire.
The reason why B.C. became a thing is because the art of drafting died from CAD. The attention to detail, the minutae of walking the reader through a highly sophisticated thing was replaced by short-form video explanations. His work is very much a callback to the days of old. So too, is his turn to be relegated to a relic of his time.
Also, it's hand coded WebGL. It's smooth, faultless and has no peers.
> So too, is his turn to be relegated to a relic of his time.
No, it'll be tasteful artifact, not a relic. Records, fountain pens and automatic watches did not die. They are used by people who discern things, and no, none of these things have to be expensive (i.e. Neither Seiko 5, nor Lamy Safari are expensive, yet they are as dependable as their 100x expensive brethren).
Human touch still has that finesse and warmth.
>and has no peers.
On the front page right now - https://news.ycombinator.com/item?id=49980626
That's impressive, yes, and kudos to them.
OTOH, I still believe the exploded view on https://ciechanow.ski/mechanical-watch/ is something else.
For one, it has real physics on the weight, and second it always shows the correct/current time.
FWIW, his all animations has proper physics to begin with.
The entry you posted is nice, but Ciechanowski is still peerless.
He's at openai
Do you have source for that?
Yes. He told me.
removed
Hardly proof - anyone could have made this account
That makes me sad, if true
funny if true. ironically just last week i was asking chatgpt about what happened to him and why there were no new blog posts for almost 2 years and it had no idea
Nothing in that "7‑Speed Bicycle" is specific to having 7 speeds. It might as well have said "Bicycle", and even then you get meaningless slop like "Made to keep rolling" and "A strong foundation". How can you compare this to Ciechanowski?
You call it serviceable, but what purpose does this service? What do you now know about 7-speed bicycles that you didn't know before?
https://cdn.openai.com/pdf/gpt-6-october.pdf
System card linked in the blog post.
> regression on the extremism vision evaluation.
> Relative to their respective GPT-5.6 counterparts, GPT-6 Sol (October) shows a statistically significant regression on standard self-harm, while GPT-6 Luna (October) shows statistically significant regressions on standard self-harm, gore, and sexual content
> "GPT-6 Sol (October) and GPT-6 Luna (October) show an improvement on helpfulness on legitimate requests relative to prior models, though it scores lower on some safety requests"
Concerning how there's significant regressions on so many critical benchmarks, but it is newer and creates UI, so must be good.
It’s crazy that a company can document these safety drops in a PDF, ship the model anyway, and focus the announcement entire on shiny new UI
> significant regressions on standard self-harm, gore, and sexual content
Good. Maybe I'm the only one, but I feel like these have always been stupid measures to waste the finite time of "AI safety" research on anyway. They amount to whether a user can, if determined, manage to make a chatbot say, or depict visually, some taboo thing. Frankly I'd rather just have some cheap classifier judge each chat response after it's generated, with a limited context "Is this response encouraging self-harm?" and skip all the rest of these. Whether some random pervert can make GPT-6 spit out an erotic fanfic story or image has zero impact on the rest of the world. If this particular model won't do it, other models already exist that will, and the determined thoughtcriminal could always just write the forbidden words themselves, or photoshop something taboo.
Maybe the term "safety" has been usurped by those who feel that 'safe from the possibility of being offended' is the most important kind of safety, but it's like worrying about the wallpaper on the Titanic, compared to actual AI safety concerns.
Why are you sure that the regressions they mention are not the in the domains needed for “actual” safety concerns?
Well, those mentioned regressions are in a section entitled "Safe Completions for Users Under 18" and immediately after your quote they say:
> To mitigate the risk of producing disallowed responses for teens, we apply an additional classifier-based block to responses that may contain self-harm, sexual content, and gore; this mitigation is not captured in the evaluation results above and improves safe responses.
I've had the most success with GPT explaining things to me by making it take a few sentences at a time back and forth, instead of reading full write-ups of whatever I asked. It also often poisons the conversation if it misunderstood some part of the question, and I can lead it better by continuously questioning its statements. It's also more engaging that way.
I've been learning music lately and it kept re-pasting the same one chord visualization throughout many conversations, almost randomly and often barely related to the question. So I at least hope this won't be as aggressive so I can prompt it away!
I’ve used the learning mode from gemini in th3 past and have really enjoyed it. It’s got a similar vibe to what you described.
Id love to learn what prompts you’re using to do that. Explanations one at a time. Thats something I’ve thought would be helpful before but didn’t know how to achieve it.
For me this works: "One thing at the time. This is a conversation, not a lecture, try to balance the amount of words you write versus the amount of words that I write. Don't overwhelm me with 10 pages of prose where a single sentence would suffice, brevity is a virtue, not a defect." I've had to tweak it a couple of times, probably because of different versions of ChatGPT but it is usually a variation on this that will do the trick. Besides being far more interactive it takes the frustration down quite a bit.
Nice, I had some trouble making it stick to the dialog format over time, did you have any problem as the thread starts to get long?
Nothing fancy. What works for me is trying to lead the conversation: asking for definitions one at a time, asking how they differ from its previous answers and pointing it out when it conflates its own answer. I generally feel like you can't let it dictate the pace, it's not very good at that yet.
I used to edit my prompts and undo messages if it misunderstood something but that's been failing me recently.
One of the things that I learned the hard way is to not to combine requests, but fork chats _a lot_ and ask singular questions. Also start new sessions with either explicitly created handovers or even just explaining current state. The more compactions I see the less and less trust I have in it’s current understanding of what we’re discussing
This seems like a way for them to surface ads in ChatGPT. They just came out with visual ad format option for advertisers a couple of days ago: https://openai.com/index/new-chatgpt-ads-format-and-measurem...
I'm not a fan of OpenAI / Sam Altman, but I love their blog posts. The team and whoever decides how to do these presentations, is on point. The only other company that has amazing release pages like this is Apple, I think I remember hearing that they probably hired someone from apple who used to do release blog posts there too.
What's funny about "Intelligent UI" is I said like 2 or more years ago, that these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
Apple should be extremely worried about the AI companies making big improvements in UX. This work by OpenAI is a step in that direction.
If the main user paradigm becomes a chat interface conjuring whatever UI elements needed to best accomplish the task at hand, the entire paradigm of OS, UI frameworks, apps from an App Store to accomplish specific tasks, all come into question.
I keep thinking that Steve Jobs would have been all over the UX ramifications of LLMs and demanding that Apple lead in that area.
Steve Jobs wasn’t meant for this era, but his instincts would have been interesting to see in the AI landscape. He was an artisanal designer though, and our current era is always for the investor’s bottom line.
> probably hired someone from apple
Fairly likely: https://medium.com/the-engineering-brief/openai-hired-400-ap...
You could say the same thing about Anthropic because I don't really see much differences. Not sure about amazing part but both are high quality and I probably like Anthropic's aesthetic more
Anthropic's aesthetic looks good by pre-AI design standards, but it's so overused now that I find it off-putting. It's like the 2026 equivalent of the Twitter bootstrap CSS from 15 years ago.
I don’t find this criticism to be very actionable.
What changes could they make to really improve the usability of their products?
I don't care if Anthropic keeps using it, it's part of their brand at this point. The thousands of other developers using Claude Code to generate designs should not just accept the default output, which looks very Anthropic-ish, and actually put some effort into polishing and differentiating their product. It has nothing to do with usability and everything to do with a basic sense of good taste and aesthetics.
I feel like today's tailwind is the spiritual equivalent to last decade's bootstrap. Except that last decade's bootstrap webpages have a human behind them who usually put thought and effort into making the page useful and correct, whereas today's tailwind pages are often vibe coded slop with all the associated issues.
Bootstrap stands the test of time! I use it as my go-to unless I have a reason otherwise.
> these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
I would prefer if the AI companies stuck to just creating better models and making them as cheap and accessible as possible. Let others build the products. I don't want 1-2 companies to own every product in the world.
Technically other companies do, and I lump them in when I say "these AI companies" I am talking about any company that makes and builds any AI harness, coding or otherwise, I have not seen any innovating in the areas of the UI / UX of using these chat models in a meaningful way.
That was the objection to Microsoft controlling both the dominant OS and the most popular productivity applications running on that OS. Took the web then mobile devices to really shake that up.
> I don't want 1-2 companies to own every product in the world.
That seems to be the plan...
That’s the plan for … capitalism
Buckle up boys
Nothing new.
Look at the history of Microsoft.
Sounds rather late stage.
Well, like 30 years ago, a French comedy show had foreseen it, the "World Company" buying everything, no need to understand French to understand the "joke" at the end https://www.dailymotion.com/video/x4du7uh
Why did they bother hiring someone to write at all? I certainly wouldn't invest $1T into a company with so little confidence in their product. When the chips are down and they need to write something important, they DON'T use AI?
Obviously everyone at Anthropic uses a ton of AI in everything. The point here is that they clearly use it well, and that they use it as a tool to augment and enhance what they do rather than as a replacement for effort. The blog posts don't read like the output of a prompt because they're probably the output of dozens of prompts, rewritten and edited, by someone who's using AI to actually write something worth reading.
Anyone can having blog posts as good as this by using AI. Just not by zero-shotting it with a 2 line prompt. It still takes a lot of work.
Do you also demand that McDonald’s employees only eat McDonald’s?
They use their product to do what it’s best at, and use humans where it isn’t yet good enough.
That's just picking a fight. Whatever we think about how amazing or terrible AI is, it's pretty reasonable to understand it is quite literally the weighted average of humanity's output.
Also reasonable: it's possible to hire a world-class ___ to do that job better than AI.
It's not a weighted average though. I see this repeated all the time. Between synthetic data, custom produced training data by experts, post-training regimes etc the models are far more diverged from that baseline at this point, at this point it's mostly a right shifted curve.
I hesitated to write that line because I don't know the math. So thanks for clarifying. Main point is the output is along some distribution and I'd say AI-evangelist themselves see "good enough" across everything and anything as a feature.
"The apocalypse will be televised"
Mate this is like half a prompt of GPT-6
I take the opposite viewpoint. I think pages like these are horrible, and a demonstration that web designers have too many tools at their disposal.
But this is just a marketing page for some tech company, right? If only it stopped there. I have to deal with this nonsense in news "articles" as well on occasion, when some web designer intern is allowed to larp as a journalist for a day.
sigh Just give me text to read.
Sometimes you want more than text. This is one of the interesting divides these days - and I say this as someone who spends a lot of time in the terminal. Computer interfaces and interaction did not peak with the VT-100. Sometimes, there is a very legitimate need to show tables, graphics, interesting graphs, and to use colour and shade to draw the eye and lead someone through an experience.
This is why I use an IDE instead of a TUI agent... I'm on a computer with a multi-megapixel display, I want to use it. If I could be driving the same process with my Macintosh SE as a serial terminal, what the hell is the point of my recent Macbook?
You say tables, graphics, graphs, and colors, but I mean things that move when they don't need to move and interfere with expected UI behaviour, like arbitrarily staying in one position when I am using my mouse wheel to scroll downwards.
I should have been more precise than saying "just give me text", but it was what came in to mind when I wrote it, as I was thinking about what an article is meant to contain as its base element.
I'm pretty sure you can just ask chatgpt to add to its memory "Just give me text to read."
The text-only purists on HN are getting very tiresome. It’s seriously in every fucking post that links to a site with JavaScript enabled. We get it. You’re elite. Now stop talking about it.
No.
I think the point is not how good this blog post is as if it was written by a human, but that this blog post is entirely generated by the GPT-6 model.
So this is a taste of the slop that's going to invade everywhere in a few months.
I don't know. This is an amateur page with a bad AI video and chaotic presentation. It is ten levels below Apple announcements.
I've been calling this "disposable UI" or "paper plate UI", eg something meant to be used once. One thing I'll be curious about is overzealousness to produce this, when sometimes what you want is just a simple response. Overall though I'm a big fan of it, if it can be provided fast enough. I'd be curious on how much impact it has on latency of a response.
Funny to see a blog post about UI from one of the most funded tech companies in the world, yet the player has about the worst UI possible:
- Audio volume has 2 levels: on and off
- Play button worked exactly once for me: it played and looped the video. Couldn't be stopped afterwards.
- The video progress bar has no visual indication of where it starts and where it ends..
Is this what Phind died for?
The progress bar is over the video and it's easy to tell where it starts and ends. Most devices control volume, the video volume separate is just confusing matters for most. No issues with play and pause my side.
Sure as hell beats stupid Instagram style videos where you have no way to skip ahead. I think this is what future video is going be like, buckle up.
Hate it or not, the only site which has usable video player is YouTube.
Even TV channels like CNN and FoxNews don't have a decent one.
It's like we need ASI to have a proper embedded video player. The ultimate software challenge.
I disagree, I always run into issues with the embedded YouTube player. No way of sharing. No clear way to share the link. Youtube logo covering half the video. To name a few.
IMO they're making a mistake trying to shove every possible product into ChatGPT. Just focus on making the core functionality better.
Isn’t that exactly what this is? How is better visualization not core functionality to what ChatGPT is?
GPT-6's design sense is kind of ridiculous imo.
I have explicit instructions to tone it down. Less taglines, eyebrow text, subheadings, decorative spacing, pills, cards.
Hopefully this doesn't bleed into the chat...
yes the eyebrow is the tell. I never knew anything about eyebrows in design as I am not a designer. Now they are everywhere. Everything has an eyebrow. It is ridiculous but at least it is an AI smoking gun.
I loved them and I placed them a lot in my designs — if you also include my love for em dashes you can well understand that I feel my own character has become a clanker…
More UI elements == more tokens == more money for OpenAI
It's a pretty clever way to sell more tokens, I have to admit
Except that chat is a fixed monthly fee. More tokens = more cost for them.
Not for enterprise users, they pay per token, even on chatgpt.com.
Not on enterprise accounts.
Then you should have specified "... On Enterprise accounts" in your comment. But let's be honest, you simply were wrong.
I find it extremely strange that they're adding GPT-6 Sol to Chat over GPT-6.1 Sol which is significantly more capable.
I really don't like having to open Work sessions for one-off questions, only because they're limiting what models they put in the chat. The older models are just too dumb for some things.
The whole Work/Chat/Codex split is maddening in the way it's implemented. It's a pain to switch back to the right project, it's a pain to switch forward, it's a pain to try to remember which chat was in what.
I’ve hit model not available limits for GPT 6.1 Sol multiple times over the last week. It’s never for very long, and I can switch to Astra, but it seems like OpenAI is struggling with capacity. This has happened with my personal $200 Pro connection and my Codex enterprise connection.
I had a codex session stop in the middle because the auto-reviewer timed out with something like "auto-review not available at the moment". The capacity issues are very clearly observable since gpt6-astra launched.
6.1 is Astra minor. Way more capable but also way heavier+slower. Its really 2 different models, they just shipped it as sol to recover from the gpt6 disaster lunch, where they tried to pass terra 6(or a cheaper model) as sol but it was worse than expected
Anecdotally this is what I experienced, do you have sources for this?
It's purely circumstantial, but 6 Sol supports no reasoning (same as 6 Luna and 5.6 Sol/Luna), while both Astra and 6.1 Sol do not support "reasoning = none".
gpt-6.1-sol was released 7 days after gpt-6-sol only because they were bleeding to fable-5.1/opus-5.5 from Anthropic. It was a desperation move and certainly ate into their margins massively. Since their margins on gpt-6.1-sol are much slimmer than on gpt-6-sol they have to use it somehow to preserve compute and make profit. Frankly I think OpenAI is a mess and is playing catch-up with Anthropic… I don’t know how they will recover.
Given the extreme short time between 6 Sol and 6.1 Sol, I suspect they don’t actually have much in common and 6.1 is a heavier model rebranded as Sol in a panic response to poor agentic capabilities of 6.
I suspect that 6 sol was a better version of 5.6 terra (and note that in the 6 sol and luna release, they took out terra, and price 6 sol at 5.6 terra pricing), then the backlash from lesser capabilities made them roll out 6.1 sol as the actual 5.6 sol - size modee.
I'm curious to see how useful this is. I feel like in practice the existing versions of this feel like they get in the way. While I'm sure I've had some situations where a visual would be helpful, there are two situations where I do not want it:
1) I want a quick answer, and I don't care for the boilerplate UI. For example, if I ask how to make pancakes, I make them all the time and just want to a quick reminder on the ratios, but it might trigger a full UI that I need to sort through to find information.
2) If I ask a to me unrelated to UI question and it triggers a big UI build that is completely off topic for my question (meaning I'm desperately pressing the stop button and prepping rewriting my query)
Or the other one I see, for example if I look up a unix command like:
"ls all hidden files in the /xxx directory"
And I get back:
"Sorry, I am am unable to find /xxx in my current environment"
I'm excited about generating UIs (and apps) on demand, because it's one step closer to devices just morphing to the interface you need. I want to talk to my phone and have it generate the app or interface I need. I could see Android adapting to this reality well before Apple.
I find this view fascinating. After decades of observing users getting lost by minor changes to UI or sometimes just different "paint" I am now to believe that we will all enjoy using completely custom UI customised not only to what I would want but what the app will think I need at particular moment and get on with it just fine.
I actually do think generating UI has some future, but I remain sceptical it can realistically go as far as promoters claim. It is especially bizarre to me when this is done by ostensibly UX people.
I really do think we are headed toward a world where stuff is hyper customized like that.
As a developer, it already feels like this with internal company tooling. Anything I have the source code to and a build pipeline setup for, I can just pop open a new tab and tell it what I want changed, and it just gets done for me.
Even my home assistant setup at home now, i hooked up codex to it via an MCP, and when we put out the blow up haloween lawn ornaments I was able to just pop open codex on my phone and tell it to throw together an automation to run them for me, and 5 minutes later it was done, with an override button on my dashboard. It's a shockingly nice workflow!
Wouldn't it be nice if you could just tell your app to reconfigure/rewrite itself to remove those "what the app will think I need at particular moment" features that you dislike? Maybe have it remove a bunch of the whitespace, getting rid of the lazy loading infinite scroll, whatever you want. It's the GPL dream, except you don't need any coding ability, just a subscription to a megacorp.
I am with you. For example - this post has a comparison of a recipe app from 5.6 and 6 for comparison. They look different. Now if every time I ask for a recipe, it decides to render a new UI because of either the model changing or the recipe goes from stove to oven or something, it’s going to become annoying very quickly. It just seems like he current generation of models have been tuned to create better UIs than previous one and people interested in the UI are getting hit with excitement.
Based on current capabilities, I'm skeptical as well. However, over time, I do think they will get better at understanding our intent. Also, I would be more forgiving of an app I vibe coded in this manner, that's only meant to be used by me. Of course that assumes appropriate security guardrails are in place.
Just depends where you think the limits of future AIs are.
What emerged for me as of late, at least with Opus 5.5, is creating web interfaces as aids during development. I recently had to dial in some audio mixes using ElevenLabs audio and do some complex audio cropping and concatenation. As a interim step Opus built a website that allowed me to compare versions based on different rule sets and then really dial in the version that we decided to ship. That then led to 'us' landing on the right algorithm to build out the audio files.
More likely OpenAI and Anthropic just cut iOS and Android out of the loop entirely and become the new UI paradigm.
yep Ives is probably working on a product to do just that.
We are becoming more and more as a tool for sth to be done rather than the brain behind it. At least I start to feel this way. The joy of discovery, exploration and experiencing at first hand... It is slowly diminishing for the perfection of the quick outcome.
Honestly it feels like AI companies are still searching for the killer idea that will attract the general public (beyond "be my AI bf" or "better google").
Getting a UI that explains the parts of a bike is ok I guess, but isn't it simpler to get an actual breakdown? Google "parts of bicycle breakout" gets tons of useful images instantly.
Getting a specialized app to split a bill? It was already trivial to put in a calculator if we cared to go item by item on the bill. Having to provide names and tag every item as I go is just more work. Usually real people just go $total divide by 5, I had more, let me chip in an extra $10.
Same with booking travel and wedding plans, these aren't things people would even delegate to a trusted friend usually, much less a one-off request to an AI bot or custom UI.
Most of the useful tasks it can do right now are research, technical question/answer, coding. In terms of "build a flexible ui that solves real-world problem", if existing mobile app isn't useful in this arena, then its unlikely a completely custom UI will do the job.
That said, I've done a few small ones like a quick one to practice alphabet of a foreign language, or prototyping a web game, and the like. But ultimately its nothing that is worth trillions of dollars.
Um…the AI companies attracted the general public a few years ago.
In a way where it actually pays them well? Most of the general public uses the ChatGPT free tier, I'd assume.
IMO visualization is such a critical part of explanation - we have created an entire suite of tools to visualize - presentations, graphs, formatted docs, websites, svgs, interactive blocks, apps.
To that front - model providers generating visualization elements (i,e taking over the tools for interaction and visualization) is just a natural next step in value capture.
Anthropic launched docs, presentations, sites and am sure they have sheets next up their alley. Apps are artifacts. Tool forming is a natural model adjacency.
Wait, is this new? I feel like we all have been doing this with widgets / artifacts for a long time now, am I missing something? Just easier to use / done without asking?
Thank god. My primary use of ChatGPT is meal planning and while it’s great for recording, recipe lookup, etc I always just wanted it to be able to make checkable grocery lists.
I eventually just had it make a skill for work mode that would build a mini checklist app, but it was slow and felt janky needing to remember to switch to work mode.
This is already such a huge improvement.
Burning question: why is this worth paying for as a layman? I can sometimes find a use for all these LLMs for software development, but I can never find a good use for any of this outside of "slightly better search engine".
As a complete layman---not worth it. We live just fine. Medical researchers slave night and day to keep you healthy.
But if you have any ambition at all---if you want to map the local school board, or get a quick understanding of your finances, or set up a robot in your backyard---then, quickly proves useful.
I resent the implication that ambition hinges upon using AI for things easily doable without.
I genuinely think the frontier labs are just throwing shit at the wall to see what sticks. All of the improvements since Fable 5 seem marginal. Most of the quoted AGI "risk" is coming from super large agentic models that are juggernauts that can brute force their way through any problem faster than a human can. Despite that they're no closer to AGI than they were a year ago; the technology's limitations are apparent the more you use it. Doesn't mean it's still not extremely dangerous and/or capable, it's just not the "replace a human in 99% of cases" thing. There are obvious tradeoffs besides just the models being faster and capable of information retrieval and generation at a rate exponentially faster than a human's.
My long-term hope (and call me another Zitron if you wish) is that the labs' hype dissipates if there's no serious improvements beyond stringing together agents to ram through brick wall Millennium Prize style problems and we all just use on-device AI for 99% of cases where it's useful, researchers, governments, militaries, and universities can pay for the more complex models, and image/video gen dies a slow death (if Congress will actually legislate and/or SCOTUS decides that training those specific models does not qualify as fair use unlike training LLMs) and cost for compute rises over time as public interest in the tech sours.
LLMs are such marvelous and incredible technology squandered by genuinely deranged Silicon Valley cultists who are trying to use them as a Trojan horse to force their antisocial visions of the future upon an unsuspecting populace. We could all have just invested in on-device compute and nobody would have lost their jobs in pointless layoffs, productivity would have increased, and maybe we would have forced a conversation about when and when not to use AI and it wouldn't be so ever-present in use cases where it actually does harm to the consumer and society. But sama, PT, and dario just wouldn't have it that way, would they? Because if that were the case, there's no prospective hope where they can assuage their deep-seated insecurities over being antisocial and off-putting by reassuring themselves that there's an imminent realignment of society where they will hold all the cards when the dust settles.
Is this OpenAI catching up with Anthropic artifacts? At the same time they say "We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements...", rather than a harness.
It looks forced. It doesn’t look bad, but it’s not something I would pay for, nor would I give it access to my computer?
I also believe that a small talented group of developers just out of college can do just as good a job. That is why there is no moat around AI, it still comes down to original thinking and talent.
The irony really is that LLMs are partly responsible for the walls and walls of text as seen in the video in the first place.
And now we are asking LLMs to solve it.
I wrote something like this, though not quite as slick, by having the model use json schema to describe its results instead of text, and then use a json-schema to ui interface.
The medium is the message here. As others have said, chat output largely sucks for anything but the most basic responses and we've done little to improve upon that foundational UI in the last couple years. We've _added_ a lot for specific domains like coding and document editing, but the primary content normal users get back from the chats is verbose and uninteresting. This is a step in the right direction.
Gettin closer to fully dynamic interfaces for a lot of software. Hell, give me a mode in Google Docs that takes every pixel of chrome away then vibe the rest as I need it. Persist across new documents going forward.
I wish things like bikes came with mostly-written manuals. Maybe a few diagrams. If anything, things are too pictorial these days.
Great product idea. I have not paid OpenAI for a subscription for a couple of years, I’m tempted now. I do about 75% of my work using local models and most of the rest using the deepseek 4.1 flash API. That said $20 to experiment with this new product for a month sounds like a pretty fun idea.
AFAIK, they already had a simpler form of this. It was kind of an obvious next step. Now connect it up to tools so that we can again comfortably do the things that are more precise by hand! The “pick a color” or “select the width on a slider” use case is coming closer.
"More than" 20% of the connected world uses ChatGPT each week eh? I guess if you add Anthropic who must also claim 20% and Google, Meta.. that does not sound realistic at all.
- Anthropic’s total user base is minuscule compared to the rest, and they have never claimed otherwise.
- People don’t have to stick to a single provider. They can all claim the same 20%.
I'm confused. Are they trying steamroll every developers B2C product or are they wanting these same developers to continue building MCP-App plugins on the platform?
It's much simpler: they want others to experiment (and pay them) and see what works, once they know what works they will drive out of market other players.
what would you wager the % of codex token usage is folks generating interfaces/building apps?
seems a bit like a snake eating its own tail
1.2B weekly active users? WAU!
There's a type of UI that is very in vogue currently, it's kin of Futuristic UI that laymen find very cool and seeks to appeal to a WOW factor that suggests that the future is now.
I used to see it a lot in China, like the idea of pinching something on one phone and transferring it to another, or identification by showing your palm.
It's also the type of UI you would see in Hollywood movies, both because it's stuff that laymen scriptwriters and directors would find interesteng, but also the audiences would. Like the motion based UI in Minority Report, whatever was in the movie hackers, or that laptop suitcase thing that allows you to deploy nuclear codes or send wires.
I mean, I don't want to be a snob, clearly people like it, at least initially, I think it's outsider art of sorts, of course it will have problems, but it's not less legitimate because of that.
Anyways, this Intelligent UI thing where you ask it how a bike is made and it unravels a hollywood visual report as if it were showing the interiors of the target in a war room conference, it reminds me of that type of futurisitic outsider UI.
They seem to be pitching something that pretty much all the decent models can already do..?
Obviously if your model is stuck inside a CLI terminal, then not so much. But in a GUI harness (shameless plug for my own one: https://juggler.studio, but I assume others can do this too), you just ask them to answer in HTML and they'll happily draw pretty pictures inline in the conversation. I've been doing this for ages with claude, GPT, Deepseek and others.
All those recipe blogs and sites that have figured out the most inefficient way to deliver information are finally cooked.
The intro video is just lame. Those things never happen in real life.
They're making the point—apparently too subtly—that text alone is a highly limiting "UI" for many tasks. So it's great that GPT-6 can now communicate in a a richer interactive medium.
Then show a real task where text is limiting. Don't make up stupid examples.
They’re making fun of the frustration of trying to use ChatGPT purely through text for these tasks.
Like I said, it’s too subtle a deliberate self-own.
So you never have to assemble a bike or paint a room. How those are not real world examples? I find their video pretty cool. For people with ADHD or people learning by watching or children this is spot on.
They made fake, terrible artifacts (colorless paint chips, text-only city guides and instruction manuals) to show how terrible that is, and then "fixed" them. The problem is, in reality their examples don't exist. Paint chips have color samples. City guides have maps, pictures, and color. Instruction manuals almost always have illustrations. If what you made is better than what exists, you should compare it to what exists and not some alternate reality.
This seems like an expansion on something I was getting my agent to do which is use 'cards' to communicate using things like tables, rather than the ascii table stuff Claude code likes to do.
Unsure if this has been done already but the best thing I did was get it to create a list of next steps as quick buttons that it keeps updated in a docked card. It works well but occasionally gets stuck on some un related rabbit hole.
This seems like a step towards their plan for building a platform in competition of Google/Apple. Once the generative UIs are polished and more useful than individual apps, their hardware can now ship a device which circumvents the app store moat.
In the video, they showed examples of ChatGPT making interactive tutorials on how to fold origami, how to arrange colours/interior and how to assemble a bike.
Supposedly, people were struggling to follow written manuals and they needed an interactive explanations.
I'm not a mathematician and I would certainly love having a tool that would do ELI5 on some complex stuff, but I'm really worrying about using this too often and outsourcing my ability to do stuff to some mega corp.
I think this means that the API "chat-latest" model is now serving a custom GPT-6 variant: https://developers.openai.com/api/docs/models/chat-latest
Interesting, in Chat mode, if you expand the model selector it says "GPT-6", but in Work mode it says "GPT-6 Astra".
Too much visual noise. You don’t need a table comparing America now to the 1970s or whatever.
> The compiler allows the interface to appear progressively as the model generates it, without waiting for the entire response to be complete.
why not just stream html?
The element can’t render until it’s closed, presumably.
Html partial streaming is a real thing, presumably
maybe I'm just wrong here? If the tokens <b>come through this text could still be optimistically turned bold until </b> happens.
For elements that manage layout and drawing things like these explainers, though, it's hard for me to imagine how that would work. My immediate thought would be to an abstraction over it, which is what it sounds like they did.
Sounds like Google's Generative UI (Nov 2025): https://research.google/blog/generative-ui-a-rich-custom-vis...
I am pretty convinced that businesses will be making custom internal software as a norm in the next few years, and this seems to be a slight push in that direction
Alright doing it here, all the functionality we need and no reoccurring yearly costs of tens of thousands of dollars. Took me a couple weeks to wire it all up with codex.
"But when will we recoup our investments?" Investor to Gavin Belson after he presents a whole zoo of animals for analogies.
This is now trying to steal YouTube repair and cooking videos. Here is news for you: People prefer YouTube repair and cooking videos.
>People prefer YouTube repair and cooking videos
Not sure about the cooking one but repair videos are horrible. People with thick accent, the worst camera, shittiest lightning and bad angles where you can't see what you have to do.
I donno, I like iterating on a recipie with chat rather than watching a video.
cooking videos are entertainment
he he boi that's right cooking videos are entertainment if you actually cook you read something called a recipe (it's the algorithm that returns the food you want)
If the diagrams and descriptions are actually well-designed and written, I'd far prefer those. Especially one where I can ask clarifying questions. I'd much prefer a Haynes with some of the images lightly animated than having a 10 minute long video with a long intro for monetization reasons about how to do some simple thing where you can barely see what the mechanic is actually doing in the cramped, poorly lit, 360p video is trying to look at.
But getting actual service manuals cheap/free these days can be tricky, and their quality can leave a good bit to be desired.
This seems like a natural progression of models becoming better at frontend coding in general.
"Here is a library of [svelte/react/whatever] components, use them to construct a helpful visual to demonstrate your point."
The deconstructed bike at the beginning was in a class of its own, however.
How would a user know whether a generated visualization to illustrate some process is accurate or not?
It wont they're just trying making the chat look like more a session iron man would have with jarvis
Gemini had this UI thing before .
i saw that and thought the death knell of apps is coming soon as on demand interfaces become a norm
I like how, whenever a new model releases, they not only make other companies' models seem worse, but even their own "oLdeR" models.
It makes sense they’re doing this - I’ve noticed lately when asking a more complex question involving a lot of nonlinear data using Codex work mode, Astra and Sol will write a fully html document to better display the info with a Cliff’s Notes version in chat.
For once Gemini did it first. I never found those mini GUIs useful though. More like a waste of time and energy.
There have been recent developments that allow people to interpret Swift on device, live. With this new launch, will the AI be able to write native code and compile it on device? That would be super cool.
> THE DINNER LEDGER
> The Check, Please.
> TABLE OF FIVE · ITEMIZED BILL
This is one of my _least_ favorite AI behaviors, I am surprised they left it in the example. This behavior where it insists on putting text everywhere that over-explains the context.
I feel like I'm going mad looking at this page. The bike disassembly looks fake to me, like an alien would show presumed bike parts, but I can't tell why and don't know much about bikes. Maybe it's because there are no screws and nuts?
What is it supposed to demonstrate? That the model knows some kind of folk mereology?
Apart from the math stuff, maybe, this is the appearance of useful information rather than the presentation of actionable practical information.
I suspect it will struggle with anything that isn't simple enough for demo-mode or lifestyle fluff.
It’s demonstrating a lack of understanding of the average person by those at the frontier.
Remember when Steve said ‘the computer for the rest of us?’ We’re seeing that here.
I'm also building something similar for an internal project, based on the vercel's json-render design. It hasn't been too challenging, especially since the release of faster models like 5.6 Luna.
So I guess it's going to nail the bicycle the Pelican rides on, right?
I noticed this change too! It is really game changer - to me ChatGPT output has no rivals here.
Similar to https://www.monogram.ai/.
I guess the above is mostly mobile focused.
A Chat AI creating on the fly UX widgets is like Amazon’s brick and mortar stores
Off topic, but you can tell the Sunday Roast image is AI because it makes British food look appetizing :P
Love it. I've been using $visualize a lot in the codex desktop app, and having even richer experiences will be sweet.
IIRC Google had an experimental project with this kind of stuff 2 years ago, but Google being Google...
> Our mission is to deliver the benefits of artificial general intelligence safely
extraordinary AGI claims require extraordinary evidence
Let's remember.. 'Climbers rescued from Mount Shasta after relying on ChatGPT for trip planning'
https://news.ycombinator.com/item?id=49542814
Is it me or GPT-6 Instant food answer gives the vibe to check the hell out immediately? It's like the it will start to explain a sunny Sunday afternoon from 20 years ago for 5 full pages.
for the sunday lamb roast instructions, how much is 1500g of potatoes? What kind of potatoes?
> Also pick up garlic, rosemary, thyme, lemons, honey, almonds, olive oil, gravy ingredients, mint sauce, crumble topping and vanilla ice cream.
what??? how the hell are you supposed to remember all that. Even the before example tells you what kind of potatoes to get. tbh it would be cool if you could just click a button and get an order pre-filled out on a grocery delivery/pickup service. I really wonder who reviewed this post and if they cook, because imagining yourself in that scenario and reading those instructions falls apart very fast
'gravy ingredients'
i didn’t even see that. add the ‘crumble topping’. this is legit terrible
Is there any relationship between this and AG-UI or A2UI?
gemini app kind of had that for a while I feel?
Instead of apps or websites merely APIs and intelligent UI in front. With the ability to render data gathered across multiple domains
Great, now instead of doing math to split my check I can vibe code an app on the spot to do math to split my check.
Why show an intelligent UI within a chat interface. That’s pathetically lame. Better to go away from chat interfaces to rich visual interfaces. Doesn’t sound intelligent at all to me
I gotta admit, I love how their design system and how they market things. It looks so good. However the true state of their toolings is closer to a burning dumpster fire. If you look at Codex Github repo for example, the amount of existing issues and continuously new issues appearing while tagged releases is being spewed out. Its truly a nightmare. Their vscode extension has been broken for almost 1 week now, if not more. Its instead a community effort to repair it.
Written manuals/guides come with pictures. The ad is dishonest.
The point, I think, is to make fun of Anthropic models, which answer only in text when you ask them how to do something. They’re the competition, not paper pamphlets.
> which answer only in text
This is false.
Is it? Sorry, skill issue I guess. I regularly use the Claude app on phone and laptop, and have never seen it produce non-text chat output.
I think it's been a thing since around March https://claude.com/resources/articles/claude-builds-visuals
Edit: be sure to check Claude settings -> Capabilities -> Visuals.
Thank you!
Plot twist: The guides were written by ChatGPT. But now you can use ChatGPT to solve problems by ChatGPT.
It's interesting how the bicycle is a fake example. You see Jony Ive level design, with a very complex 3d object seamlessly working, and then you see the basic HTML slop in other examples and you begin to wonder if that first one was fabeication.
sounds like JEV with extra steps
This seems like a nightmare for standardization and accessibility, no?
Has AI not been always?
"If you call something intelligent you know what it isn't."
> We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements, choosing how they fit together based on your question.
Ok so this is how you build a moat. Models are not a commodity and visualization isnt a purely harness problem.
> We expanded our training methods to help the model make thoughtful decisions about content, layout, visuals, and interaction. This included evaluating the interfaces it creates for clarity, usefulness, and completeness. GPT‑6 learned to use the component library and make good design decisions, including how to organize information clearly, when to use interactivity, and when a simple text response is enough.
Curious to know how they trained it produce appropriate visuals. And why that cant be done with propmt engineering.
Nope
I made a prediction last year that there'd be a new UI protocol (like HTML) but for agents. I believe that custom or personalised UI's are going to be the new browser interface. More radically, I think browsers can be completely replaced. My news feed can be personalised to me, based on what AI thinks might be important from all sources like Reddit, X, HN.
Which brings up a different problem: personalized reading UI, personalized writing UI, how are those services going to pay their bills? Maybe they can sell access to their APIs but who's really going to buy that? Those services will die and will be replaced by some other service that will be born to serve those people.
Or, more probably IMHO, most people will keep using the standard UIs because they are ready and they need no work to build.
Sounds horrible, but plausible.
Now they extracted the value from interoperable open systems, they would love to replace it with closed proprietary systems.
So they are going to replace all the banking, utility, social media, news, gaming, streaming, government, work apps and other important websites people still rely on? Those companies and organizations are just going to provide an API to the chatbots?
How do sites like Wikipedia get updated? What if I need to upload important documents to different portals? It all has to go through the AI companies? They have access to medical records too? My taxes, social security, etc?
Is this how Microsoft imagines Office 365 and Sharepoint will be merged into? Disney, NY Times, Youtube, Netflix will all be fine with chatbots handling their content?
> I made a prediction last year
yes you and everyone else.
Cant wait for the next round of outrage and radicization machines, this time by browser replacement and unavoidable.
Why are you posts generally down voted?
This looks bad, I want the output to be as much as text based so I can easily export it and further processing it, plus, this might make the resource-eating app even worse.
Visuals are better for consumers/general public, when the use case is "help me cook X meal", or "where can I stop by to buy gas on the way to San Jose".
Rading most comments, people don't seem to be very impressed by it, I ain't either tbh - its not something mind-blowing (I have been doing this with Astra myself just by writing better prompts to make explainer interactive interfaces), but I do think its a good first step towards a better way of consuming information/answers than just reading text-vomits. I wonder if there is a way to train an LLM native to this kind of thing?
where are you reading the comments? Wasn't it just released? I can't imagine anyone I'd consider "general public users" to know about it yet
then just ask for text-only?
I read the comments here and I am really surprised by many people. One picture is worth a thousand words so with better UI you can make much better user experiences. This unlocks personal assistants to be better adopted by elderly or disabled people. I see so many benefits of it and having models which can do this (if they can do it constantly with good quality) is amazing. Much better products - I am really tired of dumb chatbot - if I can do something with one button or view the whole information in one diagram/image, this is amazing.
"why do I need an Nvidia B300 to render the same webpage that ran fine on my Pentium with Windows 98?"