Granted Patent B2

US 12,254,134 · App. 18/165,997 · Granted Mar 18, 2025

Inventors: John Booth (London, GB); Mandana Jenabzadeh (London, GB); Alan Suganuma Murphy (London, GB)

Assignee: Sony Interactive Entertainment Europe Limited

G06F3/016A63F13/285

Abstract

Claims (34)

1. A method for generating feedback in a multimedia entertainment system, the method comprising:

obtaining an output stream to be output by the multimedia entertainment system;

performing feature analysis to identify a feature in the output stream;

determining a first time position of the identified feature;

selecting a visual feedback to be output by a peripheral device based on the identified feature;

determining a time offset between outputting the visual feedback and the output stream based on the identified feature;

controlling a main audiovisual display to output the output stream at the first time position; and

controlling the peripheral device to output the visual feedback at a second time position offset from the first time position based on the time offset.

2. The method according to claim 1 , wherein the identified feature has a first sensory type and the visual feedback has a second sensory type different from the first sensory type.

3. The method according to claim 2 , wherein the first sensory type is audio and the second sensory type is visual.

4. The method according to claim 1 , further comprising:

selecting a haptic feedback to be output by the peripheral device based on the identified feature; and

controlling the peripheral device to output the haptic feedback.

5. The method according to claim 1 , wherein the visual feedback further comprises at least one other sensory type.

6. The method according to claim 1 , wherein controlling the peripheral device further comprises controlling at least one additional peripheral device to output at least a part of the visual feedback.

7. The method according to claim 1 , wherein the feature analysis comprises identifying an instantaneous feature or identifying an event comprising a sequence of instantaneous features.

8. A base unit of a multimedia entertainment system, wherein the base unit is configured to control a main audiovisual display and a peripheral device, and the base unit is configured to perform the method according to claim 1 .

9. A computer program comprising instructions which, when executed by a base unit of a multimedia entertainment system, cause the base unit to perform the method according to claim 1 .

10. A non-transitory storage medium storing instructions which, when executed by a base unit of a multimedia entertainment system, cause the base unit to perform the method according to claim 1 .

11. A signal storing instructions which, when executed by a base unit of a multimedia entertainment system, cause the base unit to perform the method according to claim 1 .

12. A method for generating feedback for a multimedia entertainment system, the method comprising:

obtaining an output stream to be output by the multimedia entertainment system;

performing feature analysis to identify a feature in the obtained output stream;

determining a first time position of the identified feature;

selecting a visual feedback based on the identified feature;

determining a time offset for outputting the visual feedback within the output stream based on the identified feature;

embedding the visual feedback with the output stream; and

outputting the embedded visual feedback at a second time position offset from the first time position based on the time offset.

13. A multimedia entertainment system comprising:

a remote server;

a local base unit connected to the remote server via a network; and

a main audiovisual display and a peripheral device connected to the local base unit,

wherein the server is configured to perform a method for generating feedback according to claim 12 and to stream the output stream with the embedded visual feedback to the local base unit, and

the local base unit is configured to control the main audiovisual display to output the output stream and to control the peripheral device to output the embedded visual feedback.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (15)