Footage Surfaces of Sony Director Engaging with AI Aloy Prototype
PlayStation is currently exploring the use of artificial intelligence (AI) within its gaming ecosystem, tapping into some of its most well-known characters. Recently, a video surfaced that featured Sharwin Raghoebardajal, the director of software engineering at PlayStation, showcasing an early prototype of an AI version of Aloy from the popular Horizon Forbidden West. This video, which was originally shared with The Verge, has since been removed due to a copyright complaint from Sony.
During the demonstration, Raghoebardajal engaged with the AI Aloy, showing how the character could interact and respond to questions. Although the voice used in the prototype differs from the one in the actual game, the character model still managed to deliver engaging and intelligent responses, exhibiting synchronized facial expressions and movements. Raghoebardajal explained that this was merely an internal demonstration, highlighting the potential of AI in enhancing player interaction with game characters.
The AI system showcased in the prototype appears to be quite advanced. It leverages several technologies to facilitate its interactions. For speech-to-text capabilities, it utilizes OpenAI’s Whisper, while communication and decision-making processes are powered by GPT-4 and Llama 3, both state-of-the-art AI models known for their capabilities in natural language processing. Furthermore, Sony’s proprietary technology, referred to as Mockingbird, is responsible for the audio-to-facial animation, and Emotional Voice Synthesis (EVS) optimizes the character’s speech.
Despite running the prototype on a PC during the demo, Sony anticipates that similar functionalities can be achieved on PS5 consoles with minimal performance impact or resource overhead. This could mean that players on PlayStation could potentially experience a more immersive form of interaction with their favorite characters in the near future.
However, the discussion around the incorporation of AI in video games does come with some controversy. Recently, the French voice talent team that does the voiceovers for characters in Apex Legends declined to sign contracts that would allow their voices to be used for training AI systems. This situation reflects a broader concern within the gaming industry regarding the ethical implications of using AI to imitate or replicate human performances, particularly in vocal artistry.
As the gaming landscape continues to evolve, the integration of AI technology into gaming character interactions stands to enhance user experience significantly. By allowing characters to have more dynamic and personalized interactions, developers could create a richer narrative experience for players. This kind of innovation also raises questions about the future of voice acting and the role of human talent in creating gaming experiences.
Incorporating AI into gaming can provide numerous advantages but also opens the door to ethical debates that need to be addressed as the technology develops. With PlayStation taking the lead in experimenting with AI characters, it sets a precedent for the gaming industry, potentially transforming how players connect with their favorite franchises and characters.
