Abu Track & Scan
Software / Spatial Telemetry, LiDAR Scanning & VP Ecosystem
Status: iOS v0.0.7 • PC v1.0.1 (Build #94)
Overview
End-to-end 60Hz spatial tracking, real-time LiDAR point cloud reconstruction, and sub-millisecond camera synchronization suite engineered for Virtual Production (Unreal Engine 5), 3D Gaussian Splatting (Postshot), and High-Precision Photogrammetry (Agisoft Metashape & RealityScan)—combining an iOS App, Windows Workstation Suite, and Native UE5 Live Link C++ Plugin.
Hardware & I/O Specifications
- iOS App (iPhone 13–16 Pro/Max & iPad Pro LiDAR): 60Hz ARKit VIO + LiDAR Depth, 4K H.264/HEVC RTP Video Streamer, Multi-Lens & 180° Parallel Selfie Rig Solver, NTP Sub-ms Clock Sync
- Windows Workstation Suite: 60FPS Interactive 3D Viewport & AR Comp, Time-Shift Jitter Playout Buffer, PyAV 4K Hardware Decoder, Zero-Copy GPU Spout2 Sender & OpenCV Chessboard Lens Calibrator
- DSLR / Mirrorless Hot-Shoe Rig Mode: Sub-Second EXIF Timestamp Matching, Quaternion SLERP Pose Interpolation & 3D Lever-Arm Offsets for Sony, Canon, Nikon & RED
- Live Voxel-Filtered LiDAR Mapping (3cm Grid) with Statistical Outlier Removal (SOR) & 4K WebRTC Pixel Streaming Return Monitor
Supported Protocols & Standards
- Real-Time 6-DoF UDP Telemetry: AbuTrack JSON, FreeD (D1 29-byte Binary), OpenTrackIO & Raw CSV
- 4K Ultra-HD Hardware Video Streaming: H.264 (AVC) & H.265 (HEVC) over RTP/UDP (RFC 6184 / RFC 7798) + Zero-Copy Spout2 GPU Texture Sharing
- Sub-Millisecond NTP Clock Synchronization & Portable Optical Lens Profiles (.atlp with Focal Length, Principal Point & K1..K4, T1..T2 Distortion)
- One-Click 3DGS & Photogrammetry Exports: Jawset Postshot COLMAP Rigs, Metashape & RealityScan Georeferenced CSVs, Embedded EXIF GPS & Clean .ply Point Clouds
Compatible Production Engines
- Unreal Engine 5.x via Native C++ Plugin (LiveLinkAbuTrack — ULiveLinkCameraRole, Live Focal Length & K1/K2 Lens Distortion Blueprint Metadata)
- Jawset Postshot (3D Gaussian Splatting Training from 60Hz Pose Logs & LiDAR Point Clouds)
- Agisoft Metashape & Epic Games RealityScan / RealityCapture
- OBS Studio, TouchDesigner & Broadcast Switchers via Zero-Copy Spout2 GPU Texture Sharing
Official Repository: https://github.com/saemranian/abu-track-scan
Direct Download: https://github.com/saemranian/abu-track-scan/raw/main/dist/abu_track_desktop.exe
