ABU ECOSYSTEM

Hardware & Software Solutions Built for Real-Time Precision

Abu Clock
Software & Hardware-Ready Engine / SMPTE Timecode, Timestep (Hz) & PTP/gPTP Master Clock

Abu Clock

Cross-platform software and hardware-ready timing engine engineered to deliver broadcast-grade SMPTE ST 2059-1 / ST 12-1 timecode (HH:MM:SS:FF.sf) and deterministic frequency timestep (Hz) synchronization across standard local area networks (Gigabit Ethernet, USB-C LAN, and Wi-Fi). Designed as the temporal backbone of the Abu ecosystem alongside Abu Track & Scan and Abu Cam, it bridges Virtual Production (VP), AR broadcast, and 3D Gaussian Splatting (3DGS) spatial capture pipelines with enterprise broadcast timing.

Abu Clock— Technical Specifications & Documentation

Hardware & I/O Specifications
  • Cross-Platform Software Suite: Windows 10/11 (x86_64/ARM64), macOS 13+ (Apple Silicon/Intel), Linux (x86_64/ARM64), iOS 16+ & Android 10+ via Tauri v2 Digital Slate GUI
  • User-Space OverlayClock Virtual PLL & Two-State Kalman Servo with Hybrid Spinlock Timestep Ticker (< 5 μs software jitter, zero root/admin required)
  • Supported Cadences: 23.976, 24, 25, 29.97 (DF/NDF), 30, 48, 50, 59.94 (DF/NDF), 60, 120 fps & LiDAR (10, 15, 20 Hz) + Scheduled Future-Time Capture Triggers (T_now + 50 ms)
  • Optional Phase 3 Dedicated Hardware Grandmaster Appliance: Raspberry Pi CM4 / Pi 5 (/dev/ptp0), Maxim DS3231 TCXO (±2 ppm holdover) & optional Intel I210-T1 PCIe NIC (/dev/ptp1)
Supported Protocols & Standards
  • IEEE 1588-2019 (PTPv2.1), SMPTE ST 2059-1/2 (SM TLV 0x000E9B), IEEE 802.1AS (gPTP), Client-Server PTP (CSPTP) & SNTPv4
  • AbuSync Unprivileged CSPTP over UDP (Ports 50319 / 50320 + Zero-Config mDNS _abuclock._udp.local.)
  • SMPTE RIS OpenTrackIO (OTrk JSON/CBOR) & Extended FreeD-TC (0xD1 / 0xD2) Deterministic Camera Telemetry
  • Mozilla UniFFI SDK (libabuclock) with Native Swift, C/C++ ABI, C# & Python Bindings + .abuscan.json / COLMAP Session Manifests
Compatible Production Engines
  • Unreal Engine 5 via Native AbuClockUE Plugin (UAbuClockTimecodeProvider, UAbuClockCustomTimeStep & FAbuTrackLiveLinkSource)
  • NVIDIA Omniverse via Native omni.abu.clock Kit Extension (Synchronized omni.timeline & OpenUSD Stages)
  • Abu Track & Scan (AbuClockKit iOS Optical Exposure Midpoint Wrapper & AbuClockWinClient Windows C++ Aggregator)
  • RoboSense E1R & XGRIDS L2PRO LiDAR Sensors + RealityCapture, COLMAP, LixelCyberColor & Jawset Postshot
Abu Track & Scan
Software / Spatial Telemetry, LiDAR Scanning & VP Ecosystem

Abu Track & Scan

End-to-end 60Hz spatial tracking, real-time LiDAR point cloud reconstruction, and sub-millisecond camera synchronization suite engineered for Virtual Production (Unreal Engine 5), 3D Gaussian Splatting (Postshot), and High-Precision Photogrammetry (Agisoft Metashape & RealityScan)—combining an iOS App, Windows Workstation Suite, and Native UE5 Live Link C++ Plugin.

Abu Track & Scan— Technical Specifications & Documentation

Hardware & I/O Specifications
  • iOS App (iPhone 13–16 Pro/Max & iPad Pro LiDAR): 60Hz ARKit VIO + LiDAR Depth, 4K H.264/HEVC RTP Video Streamer, Multi-Lens & 180° Parallel Selfie Rig Solver, NTP Sub-ms Clock Sync
  • Windows Workstation Suite: 60FPS Interactive 3D Viewport & AR Comp, Time-Shift Jitter Playout Buffer, PyAV 4K Hardware Decoder, Zero-Copy GPU Spout2 Sender & OpenCV Chessboard Lens Calibrator
  • DSLR / Mirrorless Hot-Shoe Rig Mode: Sub-Second EXIF Timestamp Matching, Quaternion SLERP Pose Interpolation & 3D Lever-Arm Offsets for Sony, Canon, Nikon & RED
  • Live Voxel-Filtered LiDAR Mapping (3cm Grid) with Statistical Outlier Removal (SOR) & 4K WebRTC Pixel Streaming Return Monitor
Supported Protocols & Standards
  • Real-Time 6-DoF UDP Telemetry: AbuTrack JSON, FreeD (D1 29-byte Binary), OpenTrackIO & Raw CSV
  • 4K Ultra-HD Hardware Video Streaming: H.264 (AVC) & H.265 (HEVC) over RTP/UDP (RFC 6184 / RFC 7798) + Zero-Copy Spout2 GPU Texture Sharing
  • Sub-Millisecond NTP Clock Synchronization & Portable Optical Lens Profiles (.atlp with Focal Length, Principal Point & K1..K4, T1..T2 Distortion)
  • One-Click 3DGS & Photogrammetry Exports: Jawset Postshot COLMAP Rigs, Metashape & RealityScan Georeferenced CSVs, Embedded EXIF GPS & Clean .ply Point Clouds
Compatible Production Engines
  • Unreal Engine 5.x via Native C++ Plugin (LiveLinkAbuTrack — ULiveLinkCameraRole, Live Focal Length & K1/K2 Lens Distortion Blueprint Metadata)
  • Jawset Postshot (3D Gaussian Splatting Training from 60Hz Pose Logs & LiDAR Point Clouds)
  • Agisoft Metashape & Epic Games RealityScan / RealityCapture
  • OBS Studio, TouchDesigner & Broadcast Switchers via Zero-Copy Spout2 GPU Texture Sharing
Abu App Builder
Software / Authoring Tool

Abu App Builder

All-in-one creation suite to author, package, and deploy interactive Web and Windows applications directly on top of 3D & 3DGS environments.

Abu App Builder— Technical Specifications & Documentation

Hardware & I/O Specifications
  • Direct SPZ / PLY / Gaussian Splat Asset Ingestion
  • Full WebGPU / WebGL Shader Pipeline
  • One-Click Windows .exe Standalone Packaging
  • Multi-User WebSocket Cloud Collaboration
Supported Protocols & Standards
  • Universal Scene Description (USD / OpenUSD)
  • glTF 2.0 / GLB with PBR Material Extensions
  • WebAudio Spatial 3D Sound
  • REST & GraphQL Content Sync
Compatible Production Engines
  • PlayCanvas Engine 2.0
  • Three.js / WebGPU Compute
  • Next.js App Router Web Apps
  • Electron / Chromium Native Shell
Abu Cam
Software / Blender Add-on & 3DGS Pipeline

Abu Cam

All-in-one production camera rig (Orbital & Volumetric multi-camera dome), procedural Voronoi environment sky sphere, GPU multi-pass reference renderer (RGB, 16-bit Depth, Normal, Wireframe), and automated 3DGS / COLMAP / RealityScan / NeRF dataset exporter for Blender 4.2+ & 5.2 LTS.

Abu Cam— Technical Specifications & Documentation

Hardware & I/O Specifications
  • Dual Capture Systems: 360° Orbital Turntable Rig & Volumetric Multi-Camera Spherical Dome (Fibonacci Spiral, Latitude Rings, Stratified)
  • Pro Environment Sky Sphere (AbuCam_EnvSkySphere) with 6 Shader Modes (Default 3D Voronoi Feature-Matching Preset, HDRI Panorama, Nishita Sky, Cyclorama Gradient)
  • Simultaneous 4-Pass GPU Reference Engine: 8-bit RGB Beauty, 16-bit Linear Depth (65,535 levels), Camera-Space Surface Normals & Anti-Aliased Wireframe
  • Independent Sensor W x H (mm) Optics, Focal Length, Live Resolution Sync & Non-Blocking Telemetry Render Monitor
Supported Protocols & Standards
  • COLMAP PINHOLE Sparse Reconstruction (cameras.txt, images.txt, binary points3D.ply sampled from mesh surface)
  • RealityCapture / RealityScan Exact Pose Schema (cameras.csv & camera_poses.csv with 35mm Equivalent & Distortion)
  • NeRF & 3D Gaussian Splatting Camera Intrinsics & 4x4 Transforms (transforms.json)
  • Automated FFmpeg H.264 MP4 Multi-Pass Video Encoding & glTF 2.0 / GLB Scene Preview Export
Compatible Production Engines
  • Blender 4.2 LTS, 5.1 & 5.2 LTS (EEVEE Next Real-Time GPU & Cycles NVIDIA OptiX RTX)
  • 3DGS & Radiance Field Trainers (Postshot, LichtFeld Studio, Nerfstudio)
  • Photogrammetry & SfM Suites (Epic Games RealityScan / RealityCapture, COLMAP)
  • AI Video & ControlNet Generation Pipelines (Wan, ComfyUI, Multi-Pass Conditioning)
Abu Align & Train
Software / Neural Photogrammetry & 3DGS Studio

Abu Align & Train

Unified, free, and open-source desktop studio that brings AI-driven camera alignment (VGGT-Omega, NVIDIA VGG-T3, Niantic ACE0, cuSFM, OpenSfM), 360° spherical photogrammetry, dataset preparation, and real-time 3D Gaussian Splatting (3DGS) training into a single one-click application.

Abu Align & Train— Technical Specifications & Documentation

Hardware & I/O Specifications
  • Multi-Engine Camera Alignment: VGGT-Omega & NVIDIA VGG-T3 (Feed-Forward 3D Transformers), Niantic Labs ACE0 (ACEZero), NVIDIA Isaac cuSFM (PyCuSFM) & COLMAP
  • 360° Spherical Photogrammetry: Mapillary OpenSfM & 360DVO with 360° Panoramic Virtual Rig Splitter for Insta360, Ricoh Theta & GoPro Max
  • Direct 3D Gaussian Splatting (3DGS) Training: LichtFeld Studio (Real-Time Vulkan + GUT Lens Distortion), Nerfstudio (Splatfacto), NVIDIA 3DGRUT & PFGS360
  • Complete Pre-Processing & Manual Control Suite: 4K/8K/360° Video Frame Extractor & Sharpness Picker, SAM 2 AI Sky/Object Masker & Interactive Manual Control Points (Abu M54)
Supported Protocols & Standards
  • Standardized 3dgs_dataset/ One-Click Export Pipeline
  • COLMAP & Nerfstudio (sparse/0/, transforms.json & dense .ply point clouds)
  • RealityScan / RealityCapture Exact Camera Rigs (.csv & .xml XMP camera rigs)
  • Native .ply & .splat 3D Gaussian Splatting Model Generation
Compatible Production Engines
  • Neural & Metric Alignment: VGGT-Omega, NVIDIA VGG-T3 (VGG-TTT), Niantic ACE0 (ACEZero), NVIDIA cuSFM, COLMAP, Mapillary OpenSfM & 360DVO
  • 3DGS Training: LichtFeld Studio (Vulkan), Nerfstudio (Splatfacto), NVIDIA 3DGRUT & PFGS360
  • Universal Studio Handoff: Jawset Postshot, Epic Games RealityScan / RealityCapture & Nerfstudio
  • Cross-Platform Single-File Installers: Windows 10/11 x64 (.exe), Linux x86_64 (.AppImage) & macOS Universal (.dmg)