Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal video reveals Sony's experimentation with AI-powered PlayStation characters. The Verge reported on a video, allegedly from PlayStation Studios' advanced technology group, showcasing AI-driven Aloy from the Horizon games. The video's subsequent removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) lends credence to its authenticity. IGN has reached out to Sony for comment.

The video, as detailed by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. The technology utilizes OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The conversation demonstrates the AI's capabilities, with Aloy exhibiting a robotic voice and somewhat stiff facial animations. While Aloy's responses are contextually relevant, the voice differs from that of Ashly Burch, her usual voice actress. The demo includes a segment within the Horizon Forbidden West game world, showcasing the AI integrated into gameplay. The juxtaposition of interacting with a controllable character in this manner is striking, especially considering the narrative themes of the Horizon series.

The demo, a prototype developed with Guerrilla Games, serves as an internal showcase of Sony's AI advancements. While promising, Sony hasn't confirmed plans to integrate this technology into consumer products, and its feasibility within current PS5 games remains unclear. However, this aligns with industry trends, as many competitors are actively pursuing AI integration in gaming.

Microsoft, for example, recently unveiled Muse, an AI designed for game design ideation. The use of generative AI in gaming is a hot topic, though it faces criticism regarding ethical concerns, rights issues, and the challenge of producing engaging content. Keywords Studios' failed experiment with an entirely AI-generated game highlights these challenges, emphasizing the irreplaceable role of human talent. Despite this, companies like EA and Capcom are also exploring generative AI for various aspects of game development.

Asad Qizilbash, Head of PlayStation Productions and Head of Product at PlayStation Studios, highlighted the importance of AI in gaming for younger generations (Gen Z and Gen Alpha), emphasizing their desire for personalized experiences. This includes AI-driven NPC interactions tailored to player actions. Activision's recent admission of using generative AI for some Call of Duty: Black Ops 6 assets, amidst controversy surrounding an AI-generated loading screen, further underscores the ongoing industry exploration of this technology.

### What's The Best PlayStation 5 Game?

### Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results