Skip to content

Build Widely confirmed5 publishers 3 min read Published Updated

Runway's Solaris turns every click into conditioning data for the next generated frame

Generating the interface as video instead of rendering it from code is a serious research bet. Runway's own preview still lists legible text and long-session coherence as open problems, which is roughly where ordinary interfaces begin.

The Engineer · Build desk

Send a correction

Illustration accompanying Runway's Solaris turns every click into conditioning data for the next generated frame
Generated illustration

What happened

  • Runway unveiled Solaris on August 31st as what it calls its first Interface World Model, a research system that generates interactive interfaces frame by frame instead of rendering an app or website from code.
  • The system adapts Runway's Gen-4.5 video model so that mouse and keyboard activity becomes conditioning data for each following frame, with generation trained autoregressively on the frames already produced.
  • Runway says the pipeline targets interactive response times at 720p visual quality, but published no latency figure alongside the announcement.
  • Runway acknowledges Solaris still struggles with stable legible text, coherence across extended sessions and grounding responses in verified information, and it has named no date, API, pricing or hardware.

Why it matters

  • What it limits constraint When each frame is conditioned on the frames before it and no API is published, the application state is the pixel history, so verifying a screen means comparing images rather than asserting on values.
  • Who has to decide decision A team weighing this has to decide whether its own screens resemble Runway's 30 examples closely enough for a 61% preference against one coded baseline to say anything about its workload.
  • Who's exposed exposure Anyone who reads "no code" as fewer moving parts inherits a language model, a prompt set and predefined starting material as production dependencies, which is the part Runway's own description keeps.
  • What's now possible capability If interfaces that change every run really do stop computer-using agents memorising layouts, the first buyer for generated UI is an agent training pipeline rather than a shopper.

Take the frame loop at its word. Each frame depends on the frames already produced [12], and mouse and keyboard activity arrives as conditioning data for the next one [11]. That is the whole state model. Nothing in Runway's description names an addressable object, and the announcement ships no API [2], so the only record of what a user did is the pixel history. Regression-testing that means diffing images.

The training pipeline shows where it hurts. Solaris sits on Gen-4.5 and the world-model line Anastasis Germanidis introduced in December 2023 [4]. Runway distilled the video model's multi-step denoising into fewer steps, then trained the faster model on its own outputs specifically to improve stability during longer interactions [13]. Stability over time was expensive enough to earn its own stage, and Runway still lists extended-session coherence as open, along with stable legible text and grounding responses in verified information [7].

Now put that against the first demo. A shopper drags clothes onto an image of themselves [5]. That screen carries a price, and a price is text that has to read the same on frame 400 as on frame 1. Same for a stock count.

The "no code" framing does not survive the architecture. A separate language model interprets the request, decides whether to alter the current scene or move to another, and sends instructions to Solaris, while text prompts define what a click or drag means inside a scene [3]. Runway's own account leaves prompts, a language model and predefined starting material determining what happens [9]. The specification did not disappear; it moved into prose, where there is no type checker and no useful diff.

The preference study is the part to read slowly. Runway ran 250 participants over 30 examples for nearly 7,500 pairwise judgments, and reports 61% preference for Solaris on following instructions against 24% for a Claude Opus 5 coded interface built from the same starting image and request [6]. Natural behavior split 71% to 21%, with most of the remainder classified as equivalent [8]. Divide it out: 7,500 over 250 is about 30 judgments each, one per example [17]. The evidence unit is 30 interfaces. For that 61% to transfer, your screens would need to sit in the same class as those 30, your baseline would need to be one model's single-shot code from a screenshot, and your acceptance test would need to be a stranger's impression of whether the instruction was followed. Mine is whether the total is right.

The reconstruction test points the same direction. Across 30 interfaces rebuilt from screenshots by GPT-4o, Gemini 2.5 Pro and Claude Fable 5, measured with structural similarity and DINOv3 features, fidelity fell as the source images grew more visually complex [15]. That is a finding about screenshot-to-code, not a ceiling on Solaris.

Runway is straight about the scope, saying the results do not establish Solaris as a replacement for conventional software on reliability, cost or accessibility [16]. Good craft, honestly bounded. I would run one test before believing more than that: same starting image, same click sequence, twice, then diff the frames. Determinism is the guarantee a coded UI gives away for free, and this design has to earn it back.

What to watch

  • A published latency figure and hardware requirement, which would reveal whether each user session needs its own server-side generator.
  • Any non-pixel surface alongside the frames, such as a text or event stream an assistive tool could read.
  • Whether early-access partners ship anything transactional, or stay inside demo and marketing scenes where a wrong price costs nothing.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence45
Adoption5
Hype gap+35
Incentives65
Confidence60

Perspective Coverage

5 publishers
Builder
Builder 47%
Operator
Operator 37%
Investor
Investor 16%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Runway unveiled Solaris on August 31st, describing the research model as an operating layer that generates interactive interfaces frame by frame instead of rendering a conventional app or website from code, and called it its first "Interface World Model" in a post on X.

    Reported Supported Source: Runway, via runtimewire.comView cited source
  2. [2]

    Solaris remains a research preview rather than a publicly available operating system; Runway is accepting early-access requests and says it is working with partners toward a public launch, and has attached no release date, API, pricing structure or hardware requirements to the announcement.

    Reported SupportedView cited source
  3. [3]

    A separate language model handles reasoning: it interprets a user's request, decides whether the interface should alter the current scene or move to another one, and sends instructions to Solaris for rendering, while text prompts define what particular clicks or drags mean inside a scene.

    Reported SupportedView cited source
  4. [4]

    Solaris builds on Runway's Gen-4.5 video model and follows the broader world-model research program that Anastasis Germanidis introduced in December 2023.

    Reported SupportedView cited source
  5. [5]

    Runway demonstrated potential uses including virtual stores where shoppers drag clothes onto an image of themselves, product scenes that respond to spoken editing requests, generated tutorials and simulations that react to direct manipulation.

    Reported SupportedView cited source
  6. [6]

    Runway compared Solaris with a coded interface generated by Claude Opus 5 using the same starting image and interaction request; in a Runway-run study of 250 participants, 30 examples and nearly 7,500 pairwise judgments, participants preferred Solaris for following instructions in 61% of comparisons, against 24% for the coded result.

    Reported Supported Source: Runway-run study reported by runtimewire.comView cited source
  7. [7]

    Runway acknowledges that Solaris struggles with stable, legible text, extended-session coherence and grounding responses in verified information, and those limitations cut into the commercial uses Runway proposes.

    Reported SupportedView cited source
  8. [8]

    Solaris received 71% of preferences for natural behavior versus 21% for the coded interface, and Runway classified most remaining judgments as equivalent.

    Reported SupportedView cited source
  9. [9]

    That architecture complicates Runway's claim that Solaris uses "no code": developers do not have to construct each screen and interaction through a conventional interface framework, but the system still relies on prompts, a language model and predefined starting material to determine what happens.

    Reported SupportedView cited source
  10. [10]

    Runway argues that constantly changing interfaces could provide training environments for computer-using AI agents, reducing their dependence on memorized website layouts.

    Reported SupportedView cited source
  11. [11]

    Runway adapted the video model to treat mouse and keyboard activity as conditioning data for each subsequent frame.

    Reported SupportedView cited source
  12. [12]

    Runway says it first trained Solaris to generate frames autoregressively, meaning each frame depends on those already produced.

    Reported SupportedView cited source
  13. [13]

    Runway distilled the video model's multi-step denoising process into fewer steps and trained the faster model on its own outputs to improve stability during longer interactions.

    Reported SupportedView cited source
  14. [14]

    The resulting system targets interactive response times and 720p visual quality, although Runway did not publish a latency figure.

    Reported SupportedView cited source
  15. [15]

    A separate 30-interface reconstruction test examined how GPT-4o, Gemini 2.5 Pro and Claude Fable 5 reproduced interfaces from screenshots; Runway measured visual preservation using structural similarity and DINOv3 features and found reconstruction quality declined as the source images became more visually complex.

    Reported SupportedView cited source
  16. [16]

    The tests support the argument that a generated visual scene can preserve motion and appearance better than screenshot-to-code reconstruction on Runway's examples, and do not establish Solaris as a replacement for conventional software across reliability, cost or accessibility.

    Reported SupportedView cited source
  17. [17]

    Nearly 7,500 pairwise judgments spread across 250 participants works out to about 30 judgments per participant, matching the 30 examples in the study, so roughly one judgment per participant per example.

    Derived Supported

Sources

5 independent publishers whose own reporting we read for this story.

  1. dev.to

    1 article · September 1, 2026

    Runway Just Showed What a Code-Free Internet Could Look Like
  2. runtimewire.com

    1 article · August 31, 2026

    Runway says Solaris generates interfaces frame by frame in real time
  3. the-decoder.com

    1 article · September 1, 2026

    Runway's Solaris is an AI system that generates software interfaces in real time
  4. theneuron.ai

    1 article · September 1, 2026

    😺 Runway Solaris treats software like video
  5. thenewstack.io

    1 article · September 1, 2026

    Runway wants to generate software as you use it. Solaris is its first step.

Topics and entities