IP Library › Granted Patent US 12,539,468
Granted Patent B2
US 12,539,468 · App. 17/899,237 · Granted Feb 3, 2026

AI streamer with feedback to AI streamer based on spectators

Inventor: Kazuyuki Arimatsu (San Mateo, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
A63F13/86A63F13/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,539,468
App. No.
17/899,237
Granted
Feb 3, 2026
Kind
B2
Abstract

A method is provided, including: executing a session of a video game; executing an artificial intelligence (AI) player that performs gameplay in the session of the video game; streaming video of the AI player's gameplay over a network to one or more spectator devices for viewing by one or more spectators respectively associated to the one or more spectator devices; receiving, over the network from the one or more spectator devices, feedback data indicating reactions of the one or more spectators to the video of the AI player's gameplay; adjusting the gameplay by the AI player based on the feedback data.

Claims (30)

1 . A method, comprising:

executing a session of a video game;

executing an artificial intelligence (AI) player that performs gameplay in the session of the video game;

streaming video of the gameplay by the AI player over a network to one or more spectator devices for viewing by one or more spectators respectively associated to the one or more spectator devices, each of the one or more spectator devices having at least one recording device;

receiving, over the network from a respective spectator device, audio data captured by the respective spectator device, wherein the audio data corresponds to speech of a spectator associated to the respective spectator device; and

adjusting the gameplay by the AI player by at least:

identifying positive feedback and negative feedback based on the audio data;

associating the positive feedback and the negative feedback with respective gameplay actions performed by the AI player;

adjusting one or more parameters of a ML model associated with the AI player; and

controlling the execution of the AI player in the session of the video game to increase a performance by the AI player of gameplay actions associated with the positive feedback, and decrease the performance by the AI player of gameplay actions associated with the negative feedback.

2 . The method of claim 1 , wherein adjusting the gameplay by the AI player based on the audio data includes, analyzing the audio data to determine a level of interest of the one or more spectators.

3 . The method of claim 2 , wherein adjusting the gameplay by the AI player is configured to increase the level of interest of the one or more spectators.

4 . The method of claim 1 , wherein the audio data is recorded using a microphone associated with the respective spectator device.

5 . The method of claim 1 , wherein the method is performed in substantial real-time, such that the adjusting of the gameplay by the AI player is responsive to the audio data during the session of the video game.

6 . The method of claim 1 , wherein the ML model is further trained based on a human player's gameplay.

7 . A non-transitory computer-readable medium having program instructions embodied thereon that, when executed by at least one server computer, cause said at least one server computer to perform a method including the following operations:

executing a session of a video game;

executing an artificial intelligence (AI) player that performs gameplay in the session of the video game;

streaming video of the gameplay by the AI player over a network to one or more spectator devices for viewing by one or more spectators respectively associated to the one or more spectator devices, each of the one or more spectator devices having at least one recording device;

receiving, over the network from a respective spectator device, audio data captured by the respective spectator device, wherein the audio data corresponds to speech of a spectator associated to the respective spectator device; and

adjusting the gameplay by the AI player by at least

identifying positive feedback and negative feedback based on the audio data;

associating the positive feedback and the negative feedback with respective gameplay actions performed by the AI player;

adjusting one or more parameters of a ML model associated with the AI player; and

controlling the execution of the AI player in the session of the video game to increase a performance by the AI player of gameplay actions associated with the positive feedback, and decrease the performance by the AI player of gameplay actions associated with the negative feedback.

8 . The non-transitory computer-readable medium of claim 7 , wherein adjusting the gameplay by the AI player based on the audio data includes, analyzing the audio data to determine a level of interest of the one or more spectators.

9 . The non-transitory computer-readable medium of claim 8 , wherein adjusting the gameplay by the AI player is configured to increase the level of interest of the one or more spectators.

10 . The non-transitory computer-readable medium of claim 7 , wherein the audio data is recorded using a microphone associated with the respective spectator device.

11 . The non-transitory computer-readable medium of claim 7 , wherein the method is performed in substantial real-time, such that the adjusting of the gameplay by the AI player is responsive to the audio data during the session of the video game.

12 . The non-transitory computer-readable medium of claim 7 , wherein the ML model is further trained based on a human player's gameplay.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: ARIMATSU, KAZUYUKI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 060952/0935 →
Continuity (1)
Related Publication 20240066413A1 · Feb 29, 2024
References Cited (7)
US 10105608B1 · George · 2018 [cited by examiner]
US 20180139257A1 · Ninoles · 2018 [cited by examiner]
US 20210093968A1 · McCoy et al. · 2021 [cited by applicant]
US 20210299580A1 · Chow · 2021 [cited by examiner]
US 20210394073A1 · Osman et al. · 2021 [cited by applicant]
US 20220203232A1 · Wiggeshoff · 2022 [cited by applicant]
PCT/US2023/072339 Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration, PCT/ISA/220, and the International Search Report, PC… [cited by applicant]