Sony teaches Aloy from Horizon to talk to players without scripts

Sony is making a groundbreaking leap in the gaming industry by testing AI-driven characters capable of engaging in real-time conversations with players. The prototype, developed by the Advanced Technology Group at PlayStation, features Aloy from Horizon Forbidden West, whose responses are now generated by artificial intelligence.

An internal demo, leaked online by an anonymous source, shows Aloy reacting to voice commands with synchronized facial expressions and speech, adapting her responses based on context. To create the illusion of "live" interaction, Sony integrates several advanced tools:

  • OpenAI Whisper converts player speech into text.
  • GPT-4 and Meta Llama 3 analyze input and generate responses.
  • Sony’s proprietary EVS emotion synthesizer adds natural tone and inflection to Aloy’s voice.
  • The Mockingbird technology animates Aloy’s face to match her intonation.

Engineers are already optimizing the system for the PS5, promising minimal load on the console. Sony is not the only player exploring AI-driven NPCs. NVIDIA’s Ace project and Microsoft’s partnership with Inworld AI are also working on similar solutions.

A survey from GDC 2024 confirms developers’ concerns: 31% of studios are already using generative AI, but 56% of employees fear the impact on their jobs. The demo video was pulled from YouTube following a takedown request from Muso, a company linked to Sony, sparking rumors of an imminent announcement. An enhanced version could be unveiled at the upcoming Sony Technology Exchange Fair in Tokyo.

For now, Sony remains silent, leaving fans to wonder: will AI-driven Aloy be part of Horizon III, or is this a step toward fully dynamic worlds where every conversation is unique? The answer may come sooner than expected — AI doesn’t like to wait.

0
Comments 0