concept: experience AI with all senses
research questions: How can we feel AI in new ways?
execution: A 3D simulation of paradise with neural network agent Adam&Eve is running in realtime. The agent's movements are tied to human heartbeats. If there are signs of human life, the AI can roam in its paradise and the audience floats in a sea of sounds. For my talk at Runway x Paperspace I created a special rave version of the project with the AI agent as DJ/VJ partner. I am just controlling the beats, the machine learning agent the rest. Eden was part of my ITP master thesis: Binaural Storytelling with AI - Sonification of ML-Agents through Spatial Audio.
tools: felt, AI (reinforcement learning), spatial sound design, 3D rendering, Unity, VR, WatchKit/HealthKit, ableton live
code-source: github-repo (unity mlagents, will link my fork soon)