AES Fall Convention 2023

In this session industry experts alongside experienced practitioners will propose a model for how natural language processors & large-language models (LLMs) could enhance the user experience for those who play video games. The applications for this technology are quite broad, however we will primarily focus on player interaction with Non-Player Characters in video games (NPCs). Imagine talking into your mic and getting a dynamic vocal response with emotion from a natural language processor based on how you talk to it. These tools already exist. There are challenges with this, such as latency, training the LLM, and the long-term storage of user responses in the LLM, among others. To create such an NPC, three APIs would be needed: an LLM trained on character data and dialogue, a real-time transcription API, and a natural language processing API.