AI expands creative horizons with 4 new directions including audio and XR

Artificial intelligence continues to evolve beyond text-based applications into new creative domains, opening fresh possibilities for businesses and creators. A recent panel at an Imagination in Action event revealed how AI researchers and companies are expanding neural network technologies into audio processing, gaming analysis, extended reality, and biomimicry. These emerging directions highlight how AI is becoming increasingly multisensory and adaptive, requiring enterprises to understand both technological capabilities and the changing expectations of AI-native generations.

1. Mining the audio world
Audio represents a largely untapped frontier for AI development compared to text-based systems. While text has been the primary focus of large language models due to its tokenization simplicity, sound analysis offers unique opportunities.

• Joanna Pena-Bickley of Vibes AI explained how her company is working with wearables to decode voices and create new sensory experiences.
• This expansion beyond text enables creators to leverage voice commands and audio analysis for developing more intuitive and immersive applications.

2. Dynamic systems for game players
Gaming platforms are evolving from pure entertainment to data-generating environments that can help understand and improve human decision-making patterns.

• Konstantina Yaneva of Harvard Innovation Labs described creating responsive systems that map cognitive science and game design, using AI-driven analytics to study player behaviors.
• This approach transforms gaming into a collaborative experience where entertainment serves as a vehicle for helping players develop better decision-making capabilities.

3. Extended reality in real time
XR (extended reality) technologies are becoming more accessible through AI-assisted content creation, making them increasingly viable for enterprise applications.

• Multidisciplinary artist Rus Gant highlighted AI’s role in generating XR content in near real-time, addressing historical challenges around time-consuming development processes.
• This advancement could accelerate adoption of XR technologies that have long shown promise but faced practical implementation barriers.

4. Mirroring nature
Companies are applying “agentic” approaches to scientific discovery by recognizing and mimicking patterns found in natural systems.

• Armen Mkrtchyan of Flagship Pioneering discussed the growing practice of understanding nature’s strategies and applying them to digital solutions.
• This biomimetic approach represents a shift toward more sophisticated AI systems that can replicate natural intelligence models.

Generational change: Different age groups interact with and respond to AI technologies in fundamentally different ways.

• Gant noted distinct differences in how generations from Boomers to Gen Alpha absorb information and become motivated.
• These generational differences suggest that companies will need to develop varied AI interfaces and experiences tailored to different demographic expectations.