The aim of this project was to create an engaging, dynamic, AI driven radio show to create an emergent interactive experience for listeners through Twitch chat.
Five DJ’s endlessly perform their shows, back to back, always and forever until the end of time. No two shows will ever be the same through a combination of real listener interactions and the AI agents autonomy.
A generative and autonomous radio show running 24/7 on Twitch which focusses on realtime interaction, encouraging viewers to converse directly with the AI DJs and the audience to create exciting and emergent user experiences.
Structure
- Show-running system based on agent prompts and show segments to create a lifelike and engaging radio show
- Using a data driven approach through JSON / CSV and prompt engineering to instruct agents.
- Using LLM prompting to create emergent shows which feel different every broadcast.
AI
- Integrating existing AI APIs (OpenAI, Elevenlabs) with Unreal Engine through a combintation of C++ and Bluepritns to create a rich interactive experience.
- REST APIs / HTTP requests
Audio
- Real-time AI music streamed via HTTP and mixed live through an automated audio system which responds to DJ speech and identifies when to duck, go to interludes etc
- Running 24/7 on AWS instance to ensure reliability
Frontend
- Built with Unreal UMG Widgets to provide responsive visuals that respond to the show content.