Generative AI Video Workflow — Radiance Field & Volumetric 3DGS R&D

Category: XR & Virtual Production

Categories: XR & Virtual Production

Technologies & Pipeline: MotionCapture, ImageProcessing, iPhone, RealTime, Dubai

Overview & Technical Breakdown

Exploring and testing the magic of #MotionCapture through #ImageProcessing based on an #iPhone camera wifi feed in #RealTime at BTS | Behind the Stage. Powered by NVIDIA Omniverse, RTX #AI processing. 🌟 #Dubai #CG #RealtimeVFX #GenerativeAI

Engineering Challenge

Synthesizing and calibrating multi-view spatial datasets with high fidelity.

Production Result

Production-grade asset synthesis with verified real-time performance.

TextureLess Splat
TextureLess Splat
AI 4DGS
AI 4DGS
Makeup 3DGS
Makeup 3DGS
Judo 3DGS
Judo 3DGS
Telegram Photo to 3DGS
Telegram Photo to 3DGS
AI-Assisted 3DGS Synthesis
AI-Assisted 3DGS Synthesis
Google Meet 3DGS Avatar
Google Meet 3DGS Avatar
Voice Cloning with GoogleFlow
Voice Cloning with GoogleFlow
GoogleFlow VFX Compositing
GoogleFlow VFX Compositing
Sony Ocellus Tracking Setup
Sony Ocellus Tracking Setup
Studio Green Screen Calibration
Studio Green Screen Calibration
Sony FR7 AI Auto-Framing
Sony FR7 AI Auto-Framing
Blackmagic & G-Ka LiveLink
Blackmagic & G-Ka LiveLink
WorldLabs Marble in UE5
WorldLabs Marble in UE5
Real-Time G-Ka Tracking
Real-Time G-Ka Tracking
3DGS in Unreal Engine 5.7
3DGS in Unreal Engine 5.7
NanoBanana Pro & Veo3
NanoBanana Pro & Veo3
Gemini 3 + NanoBanana Pro
Gemini 3 + NanoBanana Pro
Veo3 AI VFX Composition
Veo3 AI VFX Composition
PointCloud & 3DGS Fusion
PointCloud & 3DGS Fusion
Alif Pavilion GenAI Video
Alif Pavilion GenAI Video
Address Al Marj Visualizer
Address Al Marj Visualizer
Photoshop NanoBanana AI
Photoshop NanoBanana AI
Broadcast AR Layers in UE5
Broadcast AR Layers in UE5
AI Characters in Real Estate
AI Characters in Real Estate
NanoBanana Image Generation
NanoBanana Image Generation
3DGS vs 360°° Photography
3DGS vs 360°° Photography
Varjo Teleport 3DGS Viewer
Varjo Teleport 3DGS Viewer
Wan22 AI Scene Harmonize
Wan22 AI Scene Harmonize
Dubai PostShot 3DGS Splat
Dubai PostShot 3DGS Splat
Veo3 Generative Motion
Veo3 Generative Motion
Google Veo3 Scene Harmonize
Google Veo3 Scene Harmonize
iPad 3DGS in Unreal Engine
iPad 3DGS in Unreal Engine
Gemini + Photoshop AI Pipeline
Gemini + Photoshop AI Pipeline
Lixel CyberColor Handheld Scan
Lixel CyberColor Handheld Scan
AI Metahuman Real Estate Host
AI Metahuman Real Estate Host
Veo3 Dubai Architectural Splat
Veo3 Dubai Architectural Splat
Veo3 Volumetric Motion Test
Veo3 Volumetric Motion Test
LiDAR & 3DGS Integration
LiDAR & 3DGS Integration
XGRIDS Apartment Scan
XGRIDS Apartment Scan
Real Estate RealityScan 3DGS
Real Estate RealityScan 3DGS
PostShot Radiance Optimizer
PostShot Radiance Optimizer
Multi-Scan Fusion 3D Model
Multi-Scan Fusion 3D Model
PostShot UE5 VP Pipeline
PostShot UE5 VP Pipeline
RealityCapture to Splat
RealityCapture to Splat
Virtual Production Splatting
Virtual Production Splatting
PostShot Unreal Engine Sync
PostShot Unreal Engine Sync
UE5 Photogrammetry Alignment
UE5 Photogrammetry Alignment
Generative AI 3DGS Synthesis
Generative AI 3DGS Synthesis
After Effects 3DGS VFX
After Effects 3DGS VFX
6K 3DGS Gallery at 25 FPS
6K 3DGS Gallery at 25 FPS
Real Estate 3DGS Showcase
Real Estate 3DGS Showcase
RealityCapture 3DGS Splat
RealityCapture 3DGS Splat
Volumetric Night Splatting
Volumetric Night Splatting
RealityScan UE5 LiveLink
RealityScan UE5 LiveLink
Green Screen VP Splatting
Green Screen VP Splatting
McLaren 720S MR on Quest 3
McLaren 720S MR on Quest 3
AR Broadcast Spatial Tracking
AR Broadcast Spatial Tracking
iPhone 414-Photo Scanning
iPhone 414-Photo Scanning
Mixed Reality Quest 3 Setup
Mixed Reality Quest 3 Setup
Sharjah Heritage 3DGS
Sharjah Heritage 3DGS
Quest 3 Mixed Reality Splat
Quest 3 Mixed Reality Splat
Quest 3 Hand Tracking MR
Quest 3 Hand Tracking MR
RealityCapture PostShot Splat
RealityCapture PostShot Splat
Turnkey Virtual Production
Turnkey Virtual Production
Mercedes & BMW 3DGS Demo
Mercedes & BMW 3DGS Demo
Gaussian Splatting in Unity
Gaussian Splatting in Unity
4K Gaussian Splatting Video
4K Gaussian Splatting Video
Unity Digital Twin Splats
Unity Digital Twin Splats
Real-Time Splat Optimization
Real-Time Splat Optimization
6K Gaussian Splat Capture
6K Gaussian Splat Capture
RealityCapture High-Res Splat
RealityCapture High-Res Splat
3DGS Volumetric Scene Graph
3DGS Volumetric Scene Graph
Sony Venice 2 VFX Splat
Sony Venice 2 VFX Splat
RealityCapture G-Splats
RealityCapture G-Splats
Visual Effects 3DGS Pipeline
Visual Effects 3DGS Pipeline
PostShot RealityCapture 3DGS
PostShot RealityCapture 3DGS
Real-Time Object Tracking AR
Real-Time Object Tracking AR
Mixed Reality Spatial Capture
Mixed Reality Spatial Capture
Metaverse Immersive Splats
Metaverse Immersive Splats
3DGS VFX Composition
3DGS VFX Composition
Dubai Real Estate 3DGS
Dubai Real Estate 3DGS
VR Digital Twin Radiance
VR Digital Twin Radiance
Volumetric 3DGS Digital Twin
Volumetric 3DGS Digital Twin
AI Generative 3DGS Training
AI Generative 3DGS Training
AI Tools for VFX Production
AI Tools for VFX Production
3DGS Layer Compositing
3DGS Layer Compositing
Sony Venice 2 Volumetric VFX
Sony Venice 2 Volumetric VFX
iPhone PostShot AI Pipeline
iPhone PostShot AI Pipeline
Robotic Arm UE5 VP Stage
Robotic Arm UE5 VP Stage
Unreal Engine Camera Tracking
Unreal Engine Camera Tracking
UE5 Virtual Production Stage
UE5 Virtual Production Stage
Real-Time AR Broadcast UE5
Real-Time AR Broadcast UE5
Interactive LED Robotics Stage
Interactive LED Robotics Stage
Metahuman MoCap Live Link
Metahuman MoCap Live Link
Sony Venice 2 Live VP Studio
Sony Venice 2 Live VP Studio
DMX Stage Lighting UE5 Control
DMX Stage Lighting UE5 Control
Real-Time VFX Raytracing
Real-Time VFX Raytracing
Gaussian Splatting VP Stage
Gaussian Splatting VP Stage
Metahuman 3DGS VFX Pipeline
Metahuman 3DGS VFX Pipeline
Generative AI Video Workflow
Generative AI Video Workflow
GPU DLSS Raytracing Rig
GPU DLSS Raytracing Rig
Blender to UE5 VP Workflow
Blender to UE5 VP Workflow
Shiraz Helishot Aerial Splat
Shiraz Helishot Aerial Splat
Real-Time AR in Unreal Engine
Real-Time AR in Unreal Engine
Metahuman Photogrammetry UE5
Metahuman Photogrammetry UE5
iPad MoCap Image Processing
iPad MoCap Image Processing
DaVinci Resolve VP Color
DaVinci Resolve VP Color
Burj Khalifa Dubai Marina Scan
Burj Khalifa Dubai Marina Scan
NeRF Virtual Production AR
NeRF Virtual Production AR
Unreal Engine Dubai Showcase
Unreal Engine Dubai Showcase
Metahuman CG Characters UE5
Metahuman CG Characters UE5
iPad Virtual Camera Setup
iPad Virtual Camera Setup
Unreal Engine AR Broadcast
Unreal Engine AR Broadcast
Meta Quest 2 Hillside Setup
Meta Quest 2 Hillside Setup
Virtual Camera UE5 Pipeline
Virtual Camera UE5 Pipeline
Mahasti Metahuman Digital Twin
Mahasti Metahuman Digital Twin
XR Stage VP Production
XR Stage VP Production
Unreal Engine 5 VP Pipeline
Unreal Engine 5 VP Pipeline
NeRF AI 3D Modeling
NeRF AI 3D Modeling
Mo-Sys Unreal VP Pipeline
Mo-Sys Unreal VP Pipeline
Mo-Sys Metahuman Real-Time AR
Mo-Sys Metahuman Real-Time AR
101 / 122
XR & Virtual Production

Generative AI Video Workflow

Exploring and testing the magic of #MotionCapture through #ImageProcessing based on an #iPhone camera wifi feed in #RealTime at BTS | Behind the Stage. Powered by NVIDIA Omniverse, RTX #AI processing. 🌟 #Dubai #CG #RealtimeVFX #GenerativeAI

Key Technologies: MotionCapture, ImageProcessing, iPhone, RealTime, Dubai
Challenge: Synthesizing and calibrating multi-view spatial datasets with high fidelity.
Result: Production-grade asset synthesis with verified real-time performance.
Status: Published R&D
View Discussion on LinkedIn