In pre-production pipelines for video games and visual effects, visual ideation has long been bottlenecked by the gap between raw 3D geometry and final concept rendering. Concept artists and 3D environment designers spend hours blocking out greybox levels or sculpting preliminary silhouettes, only to wait on lengthy offline rendering passes or painstaking 2D paint-overs to evaluate lighting, mood, and material read.
Krea Realtime alters this dynamic through its live screen streaming architecture. By capturing the real-time viewport of applications like Blender or ZBrush as an active canvas input, Krea continuously transforms tumbling 3D meshes, dynamic camera adjustments, and live clay sculpts into rendered, stylized concept imagery without queues or render buttons.
This guide details how 3D artists and concept designers set up, tune, and leverage Krea Realtime Screen to turn interactive 3D viewport manipulation into high-velocity visual development.
The Core Problem: The Greybox Ideation Bottleneck
Traditional concept design pipelines suffer from a well-known friction point during early development:
- Camera and Spatial Drift in Pure 2D AI: Generating concept art solely through text prompts in standard diffusion engines often produces visually striking images, but they lack spatial coherence. Directors and level designers cannot easily convert these images into playable 3D spaces because the perspective, lens distortion, and architectural dimensions are ungrounded.
- Offline Rendering Delays in 3D Suites: When artists build accurate greybox primitives or proxy models in Blender, Maya, or ZBrush, getting realistic materials, complex atmospheric scattering, and surface patina requires setting up multi-node shader graphs and waiting for path-tracers like Cycles or Arnold.
- Paint-over Overhead: Concept painters frequently take raw solid-shaded viewport screengrabs into 2D painting software to manually paint textures, light bounces, and micro-details, which slows down iterative speed when pitching alternative camera angles.
Streaming 3D viewports directly into Krea Realtime unites 3D spatial precision with generative speed. The 3D viewport provides the spatial grounding—accurate perspective, scale, silhouette, and camera angle—while the AI engine delivers instantaneous rendering of materials, mood, and atmospheric details as the artist manipulates the scene.
Technical Architecture: How Krea Realtime Screen Works
Krea Realtime is built as an interactive generation surface split into two live panels:
- Input Canvas (Left Panel): The feeding source where visual data originates. Under standard workflows, this panel accepts vector brushwork or uploaded assets. In streaming mode, it captures window or screen feeds.
- Live Generation Output (Right Panel): A persistent streaming canvas powered by ultra-low-latency models that regenerates the scene continuously as inputs or prompts change.
When using Screen Record mode, Krea uses standard browser screen capture APIs to tap directly into an OS window or specific display. The incoming video stream is sampled on the fly and mapped into Krea's neural conditioning network.
+--------------------------+ Screen Stream +-------------------------+
| 3D Host Software | ------------------------> | Krea Realtime Input |
| (Blender Workbench / | (Window / Viewport) | (Left Panel) |
| ZBrush DynaMesh Sculpt) | +-------------------------+
+--------------------------+ |
^ v
| Camera orbit & blockout +-------------------------+
| tweaks happen live | Text Prompt & Steer |
| | - AI Strength Slider |
| | - Concept Fast / CGI |
v +-------------------------+
+--------------------------+ |
| Immediate Art Read | v
| (Materials, lighting, | <------------------------ +-------------------------+
| mood, atmosphere) | Zero-Queue Feed | Live AI Output Feed |
+--------------------------+ | (Right Panel) |
+-------------------------+
As the artist orbits the camera in Blender or pushes clay volumes in ZBrush, every viewport frame is processed against the active text prompt.
Prepping the 3D Viewport: Blender and ZBrush Optimizations
Feeding a cluttered viewport full of UI menus, gizmos, and wireframes confuses neural generation models. For Krea to interpret geometric intent cleanly, artists should calibrate their 3D viewport shading specifically for AI conditioning.
1. Blender Viewport Setup (Workbench / Solid Mode)
Blender's default Solid Mode or Workbench engine provides clean visual cues:
- Clean the Frame: Press
Ctrl + Alt + Spaceto toggle Blender into full-screen viewport mode, or disable Viewport Overlays (grid floors, 3D cursor, axes, object origins, and transform gizmos). The AI interprets these interface elements as physical geometry unless hidden. - Enable Cavity Shading: Inside the Viewport Shading menu, switch Cavity to Both (World and Screen), and boost Ridge and Valley contrast. This sharply delineates seams, bevels, and micro-geometry, allowing Krea to place grime, edge wear, and panel seams accurately.
- Turn on Viewport Shadows: Check the Shadow toggle in Viewport Shading and adjust the light angle slider. Even without rendering lights, basic directional shadows tell Krea where primary key lights and secondary bounce surfaces should sit.
- MatCap Selection: For organic characters or creature design, switch lighting to MatCap and pick a neutral grey clay or red wax material. For hard-surface sci-fi and architectural vehicles, a high-contrast reflective MatCap helps define specular highlights.
- Random Color ID Blocking: If blocking out complex multi-part props, set Color in Viewport Shading to Random. Distinct solid colors for walls, vehicles, and foliage act like an automated semantic segmentation mask, helping the prompt assign different materials to distinct shapes.
2. ZBrush Viewport Setup
When sketching creature silhouettes or hard-surface chassis in ZBrush:
- Material Shading: Avoid high-intensity metallic or multicolored MatCaps. Use BasicMaterial, MatCap Gray, or Clay.
- Floor Grid & Gizmo: Press
Shift + Pto toggle off the floor grid. Hide the 3D Gizmo whenever evaluating live generation. - Silhouette Checking: Keep a secondary flat black-and-white material toggle ready. Pushing pure silhouette forms in Flat Color gives Krea unambiguous boundaries to generate dramatic hero shots against sky prompts.
Step-by-Step Implementation Guide
Follow these steps to establish an active link between your 3D application and Krea Realtime.
Step 1: Initialize Krea Realtime and Screen Capture
- Open your browser and navigate to the Krea Realtime workspace.
- In the bottom control strip below the prompt box, locate the Draw Modes selector (which defaults to Draw).
- Select Screen Record.
- When your browser requests screen sharing permissions, choose Window and select your Blender or ZBrush window (or select a dedicated secondary monitor if running multi-display setups).
- Set your aspect ratio (
1:1,3:2, or2:3) to match your intended concept orientation.
(Note: Krea also distributes an official Krea for Blender add-on, installable via Blender's Preferences > Add-ons > Install from Disk, which embeds generation panels directly inside the 3D Viewport sidebar; however, the browser-based Screen Record mode remains universally compatible across all 3D tools including ZBrush, 3ds Max, Maya, and Unreal Engine.)
Step 2: Select the Generation Model
Click the Model selector at the bottom left of Krea's interface:
| Model Category | Specific Model | Resolution | Best Production Use Case |
|---|---|---|---|
| Fast Latency | Concept Fast | 512px | Rapid silhouette sketching; painterly entertainment concept art; immediate responsiveness during camera orbit. |
| Fast Latency | CGI Fast | 512px | Hard-surface vehicles; mech blockouts; photorealistic 3D game asset validation. |
| Fast Latency | Photo Fast | 512px | Architectural visualization; real-world material testing on greybox environment geometry. |
| High Fidelity | HD Quality | 1024px | Camera locked; refining final keyframes; verifying intricate detailing before export. |
| High Fidelity | Flux Realtime Quality | 1024px | Style-consistent studio branding; complex compositions with customized visual tokens. |
For interactive sculpting and real-time camera orbits, start with Concept Fast or CGI Fast. Their sub-second frame turnaround ensures you never experience visual drag while manipulating 3D assets.
Step 3: Craft the Conditioning Prompt
Because Krea Realtime recalculates output interactively, prompts should focus on materials, atmosphere, lighting conditions, and specific art direction rather than composition or camera placement (which are already dictated by your 3D viewport).
- Avoid: Spatial directives like "a car in the bottom left corner facing right" (the 3D viewport already establishes this).
- Adopt: Descriptive surface and lighting language:
- Hard Surface / Mech Example:
Industrial sci-fi rover, scratched matte olive-drab paint, weathered titanium chassis, dirty treads, volumetric dust, late afternoon rim lighting, Unreal Engine 5 render, cinematic concept art. - Environment Greybox Example:
Gothic cathedral interior ruins, overgrown moss, cracked limestone pillars, shafts of golden morning light, volumetric god rays, foggy atmosphere, highly detailed digital painting.
- Hard Surface / Mech Example:
Step 4: Calibrate the AI Strength Slider
The AI Strength slider governs the balance between strict viewport geometry adherence and neural hallucination. Finding the right threshold is crucial:
Low AI Strength (0.2 - 0.4) <===================> High AI Strength (0.7 - 0.9)
Tight mesh fidelity Loose ideation
Retains exact primitives and seams AI hallucinates rich textures & props
Can look like basic shaded geometry Can deviate from 3D camera & proportions
- 0.20 – 0.35 (Structural Lock): Use this range when the 3D geometry is already detailed (e.g., a mid-poly vehicle or architectural model) and you only need surface texturing, realistic reflections, and subtle lighting passes.
- 0.45 – 0.60 (The Golden Zone for Greyboxing): Ideal for basic primitive blockouts (cubes, cylinders, basic character armatures). Krea respects your primary perspective, massing, and eyeline, while filling in believable panel lines, foliage, terrain, and fabric folds.
- 0.70 – 0.85 (Abstract Exploration): Useful when pushing rough clay blobs in ZBrush to brainstorm exotic creature anatomy or monumental landscape vistas. The 3D form acts purely as an emotional prompt for broader generation.
Step 5: Direct the Scene in Real Time
With Krea running on one screen and your 3D software on another:
- Orbit and Frame: Move your 3D camera. Notice how Krea's live output changes its lighting bounce and perspective in sync with your navigation.
- Move Directional Lights: In Blender Workbench, drag the viewport light direction ball. Watch shadows shift across the AI concept art dynamically.
- Sculpt Live: In ZBrush, grab the
MoveorClayBuildupbrush to alter character horn size, shoulder width, or jawline mass. Krea instantly reinterprets the anatomical balance. - Iterate Variations: If a particular camera view works well, click the Seed button beneath the prompt bar to generate alternative stylistic interpretations of that exact 3D angle.
Production Hand-off: From Realtime Stream to 4K Master Asset
Realtime 512px or 1024px outputs serve as ideation drafts. Once the creative director or artist approves a specific angle and mood, execute the refinement pipeline:
- Capture the Keyframe: Click the Upscale or download button directly below the live output panel in Krea Realtime.
- Pass to Krea Enhancer: Open the image in Krea Enhancer.
- Configure Enhancer Settings:
- Upscale Factor: Choose 2x or 4x (producing 2K to 4K resolutions).
- Strength: Set between 0.3 and 0.5 to introduce micro-surface detail (scratches, fabric weave, pores) without altering the silhouette established by the 3D model.
- Resemblance: Keep relatively high (0.6 - 0.75) so the generated asset retains structural parity with the viewport blockout.
- Clarity: Increase moderately to align sharp highlights with your primary light sources.
- Final Export: Download the refined asset for pitch presentations, keyframe moodboards, or 2D paint-over passes in Photoshop.
Workflow Comparison: Traditional Pipeline vs. Krea Realtime
| Workflow Dimension | Traditional 3D Offline Render | Pure Text-to-Image AI | Krea Realtime 3D Screen |
|---|---|---|---|
| Feedback Latency | Minutes to hours per frame; requires complex lighting/shader setup | 5 to 30 seconds per prompt generation batch | Under 500 milliseconds; streaming live feedback |
| Camera & Perspective Control | Complete 3D control, but tedious to preview multiple setups | Very poor; relies on descriptive prompt luck or loose ControlNet inputs | Complete 3D viewport control with live visual feedback |
| Material Exploration | Heavy setup with node graphs, procedural noise, and UV mapping | Fast, but difficult to isolate specific surfaces on custom geometry | Instantaneous via natural language prompt guidance |
| Direct Asset Applicability | Fully usable 3D assets, but slow in early pitch phases | 2D illustration only; rarely translates directly to 3D level geometry | Bridges 3D greybox level blocking directly with 2D visual target art |
| Hardware Overhead | High local GPU load during raytracing and denoising | Cloud or local GPU compute queue | Web-streamed cloud inference; light local GPU footprint |
Practical Limitations and Workarounds
While Krea Realtime significantly accelerates concept art creation, artists should account for several production realities:
- Screen Sampling Latency: Network bandwidth and browser performance dictate viewport streaming smoothness. For low-latency responsiveness, run your browser on hardware-accelerated Chrome or Edge, and avoid running heavy background render jobs on the same workstation.
- Canvas Clutter Confusion: Never leave Blender's transform gizmos or ZBrush's PolyFrame wireframes active across the streaming window. The AI will bake wireframe lines directly into mechanical paneling or character skin.
- Non-Deterministic Details Across Fast Rotations: Because generation updates continuously, small micro-details will flicker or morph as you rotate the camera. Realtime is designed for finding composition, silhouette, and mood; lock the camera before finalizing your keyframe capture.
By treating the 3D viewport as a direct visual controller for Krea Realtime, concept artists and 3D generalists eliminate the friction of offline rendering while retaining full creative ownership over geometry, spatial scale, and camera storytelling.