AD SPACE AVAILABLE · BRAND PARTNERS WELCOME

How 3D Artists Use Krea Realtime Screen with Blender and ZBrush Viewports

365Finds Editorial
Indexed 11,430 Wiki articles

Put 365 Wiki to work with your AI

Copy the prompt below, paste it into the AI you already use, then ask your question.

Download full Skill

Try it with the prompt first. If you use 365 Wiki often, install the full 365Wiki Skill so you do not have to paste it again. No regular AI? Gemini or Microsoft Copilot on the web will work.

365Wiki Skill

In pre-production pipelines for video games and visual effects, visual ideation has long been bottlenecked by the gap between raw 3D geometry and final concept rendering. Concept artists and 3D environment designers spend hours blocking out greybox levels or sculpting preliminary silhouettes, only to wait on lengthy offline rendering passes or painstaking 2D paint-overs to evaluate lighting, mood, and material read.

Krea Realtime alters this dynamic through its live screen streaming architecture. By capturing the real-time viewport of applications like Blender or ZBrush as an active canvas input, Krea continuously transforms tumbling 3D meshes, dynamic camera adjustments, and live clay sculpts into rendered, stylized concept imagery without queues or render buttons.

This guide details how 3D artists and concept designers set up, tune, and leverage Krea Realtime Screen to turn interactive 3D viewport manipulation into high-velocity visual development.


The Core Problem: The Greybox Ideation Bottleneck

Traditional concept design pipelines suffer from a well-known friction point during early development:

  1. Camera and Spatial Drift in Pure 2D AI: Generating concept art solely through text prompts in standard diffusion engines often produces visually striking images, but they lack spatial coherence. Directors and level designers cannot easily convert these images into playable 3D spaces because the perspective, lens distortion, and architectural dimensions are ungrounded.
  2. Offline Rendering Delays in 3D Suites: When artists build accurate greybox primitives or proxy models in Blender, Maya, or ZBrush, getting realistic materials, complex atmospheric scattering, and surface patina requires setting up multi-node shader graphs and waiting for path-tracers like Cycles or Arnold.
  3. Paint-over Overhead: Concept painters frequently take raw solid-shaded viewport screengrabs into 2D painting software to manually paint textures, light bounces, and micro-details, which slows down iterative speed when pitching alternative camera angles.

Streaming 3D viewports directly into Krea Realtime unites 3D spatial precision with generative speed. The 3D viewport provides the spatial grounding—accurate perspective, scale, silhouette, and camera angle—while the AI engine delivers instantaneous rendering of materials, mood, and atmospheric details as the artist manipulates the scene.


Technical Architecture: How Krea Realtime Screen Works

Krea Realtime is built as an interactive generation surface split into two live panels:

When using Screen Record mode, Krea uses standard browser screen capture APIs to tap directly into an OS window or specific display. The incoming video stream is sampled on the fly and mapped into Krea's neural conditioning network.

+--------------------------+       Screen Stream       +-------------------------+
|     3D Host Software     | ------------------------> |   Krea Realtime Input   |
| (Blender Workbench /     |   (Window / Viewport)     |      (Left Panel)       |
|  ZBrush DynaMesh Sculpt) |                           +-------------------------+
+--------------------------+                                        |
             ^                                                      v
             | Camera orbit & blockout                 +-------------------------+
             | tweaks happen live                      |  Text Prompt & Steer    |
             |                                         |  - AI Strength Slider   |
             |                                         |  - Concept Fast / CGI   |
             v                                         +-------------------------+
+--------------------------+                                        |
|   Immediate Art Read     |                                        v
| (Materials, lighting,    | <------------------------ +-------------------------+
|  mood, atmosphere)       |       Zero-Queue Feed     |   Live AI Output Feed   |
+--------------------------+                           |      (Right Panel)      |
                                                       +-------------------------+

As the artist orbits the camera in Blender or pushes clay volumes in ZBrush, every viewport frame is processed against the active text prompt.


Prepping the 3D Viewport: Blender and ZBrush Optimizations

Feeding a cluttered viewport full of UI menus, gizmos, and wireframes confuses neural generation models. For Krea to interpret geometric intent cleanly, artists should calibrate their 3D viewport shading specifically for AI conditioning.

1. Blender Viewport Setup (Workbench / Solid Mode)

Blender's default Solid Mode or Workbench engine provides clean visual cues:

2. ZBrush Viewport Setup

When sketching creature silhouettes or hard-surface chassis in ZBrush:


Step-by-Step Implementation Guide

Follow these steps to establish an active link between your 3D application and Krea Realtime.

Step 1: Initialize Krea Realtime and Screen Capture

  1. Open your browser and navigate to the Krea Realtime workspace.
  2. In the bottom control strip below the prompt box, locate the Draw Modes selector (which defaults to Draw).
  3. Select Screen Record.
  4. When your browser requests screen sharing permissions, choose Window and select your Blender or ZBrush window (or select a dedicated secondary monitor if running multi-display setups).
  5. Set your aspect ratio (1:1, 3:2, or 2:3) to match your intended concept orientation.

(Note: Krea also distributes an official Krea for Blender add-on, installable via Blender's Preferences > Add-ons > Install from Disk, which embeds generation panels directly inside the 3D Viewport sidebar; however, the browser-based Screen Record mode remains universally compatible across all 3D tools including ZBrush, 3ds Max, Maya, and Unreal Engine.)

Step 2: Select the Generation Model

Click the Model selector at the bottom left of Krea's interface:

Model CategorySpecific ModelResolutionBest Production Use Case
Fast LatencyConcept Fast512pxRapid silhouette sketching; painterly entertainment concept art; immediate responsiveness during camera orbit.
Fast LatencyCGI Fast512pxHard-surface vehicles; mech blockouts; photorealistic 3D game asset validation.
Fast LatencyPhoto Fast512pxArchitectural visualization; real-world material testing on greybox environment geometry.
High FidelityHD Quality1024pxCamera locked; refining final keyframes; verifying intricate detailing before export.
High FidelityFlux Realtime Quality1024pxStyle-consistent studio branding; complex compositions with customized visual tokens.

For interactive sculpting and real-time camera orbits, start with Concept Fast or CGI Fast. Their sub-second frame turnaround ensures you never experience visual drag while manipulating 3D assets.

Step 3: Craft the Conditioning Prompt

Because Krea Realtime recalculates output interactively, prompts should focus on materials, atmosphere, lighting conditions, and specific art direction rather than composition or camera placement (which are already dictated by your 3D viewport).

Step 4: Calibrate the AI Strength Slider

The AI Strength slider governs the balance between strict viewport geometry adherence and neural hallucination. Finding the right threshold is crucial:

Low AI Strength (0.2 - 0.4) <===================> High AI Strength (0.7 - 0.9)
Tight mesh fidelity                               Loose ideation
Retains exact primitives and seams                 AI hallucinates rich textures & props
Can look like basic shaded geometry               Can deviate from 3D camera & proportions

Step 5: Direct the Scene in Real Time

With Krea running on one screen and your 3D software on another:

  1. Orbit and Frame: Move your 3D camera. Notice how Krea's live output changes its lighting bounce and perspective in sync with your navigation.
  2. Move Directional Lights: In Blender Workbench, drag the viewport light direction ball. Watch shadows shift across the AI concept art dynamically.
  3. Sculpt Live: In ZBrush, grab the Move or ClayBuildup brush to alter character horn size, shoulder width, or jawline mass. Krea instantly reinterprets the anatomical balance.
  4. Iterate Variations: If a particular camera view works well, click the Seed button beneath the prompt bar to generate alternative stylistic interpretations of that exact 3D angle.

Production Hand-off: From Realtime Stream to 4K Master Asset

Realtime 512px or 1024px outputs serve as ideation drafts. Once the creative director or artist approves a specific angle and mood, execute the refinement pipeline:

  1. Capture the Keyframe: Click the Upscale or download button directly below the live output panel in Krea Realtime.
  2. Pass to Krea Enhancer: Open the image in Krea Enhancer.
  3. Configure Enhancer Settings:
    • Upscale Factor: Choose 2x or 4x (producing 2K to 4K resolutions).
    • Strength: Set between 0.3 and 0.5 to introduce micro-surface detail (scratches, fabric weave, pores) without altering the silhouette established by the 3D model.
    • Resemblance: Keep relatively high (0.6 - 0.75) so the generated asset retains structural parity with the viewport blockout.
    • Clarity: Increase moderately to align sharp highlights with your primary light sources.
  4. Final Export: Download the refined asset for pitch presentations, keyframe moodboards, or 2D paint-over passes in Photoshop.

Workflow Comparison: Traditional Pipeline vs. Krea Realtime

Workflow DimensionTraditional 3D Offline RenderPure Text-to-Image AIKrea Realtime 3D Screen
Feedback LatencyMinutes to hours per frame; requires complex lighting/shader setup5 to 30 seconds per prompt generation batchUnder 500 milliseconds; streaming live feedback
Camera & Perspective ControlComplete 3D control, but tedious to preview multiple setupsVery poor; relies on descriptive prompt luck or loose ControlNet inputsComplete 3D viewport control with live visual feedback
Material ExplorationHeavy setup with node graphs, procedural noise, and UV mappingFast, but difficult to isolate specific surfaces on custom geometryInstantaneous via natural language prompt guidance
Direct Asset ApplicabilityFully usable 3D assets, but slow in early pitch phases2D illustration only; rarely translates directly to 3D level geometryBridges 3D greybox level blocking directly with 2D visual target art
Hardware OverheadHigh local GPU load during raytracing and denoisingCloud or local GPU compute queueWeb-streamed cloud inference; light local GPU footprint

Practical Limitations and Workarounds

While Krea Realtime significantly accelerates concept art creation, artists should account for several production realities:

By treating the 3D viewport as a direct visual controller for Krea Realtime, concept artists and 3D generalists eliminate the friction of offline rendering while retaining full creative ownership over geometry, spatial scale, and camera storytelling.


References