Multi-modal generative audio-visual spatial synthesizer with real-time browser WebGPU shader pipeline.
The objective was to produce a fully reactive, high-density WebGL mesh that dynamically shifts vertices based on user interactions, audio frequency inputs, and gyroscope orientation while sustaining locked 60 FPS performance on mobile devices.
We developed custom GLSL fragment shaders coupled with off-screen canvas rendering passes. By leveraging SIMD vector arithmetic and GPU instancing, CPU overhead was reduced by 84%.