IP Library Granted Patent US 10,156,894
Granted Patent B2
US 10,156,894 · App. 16/017,170 · Granted Dec 18, 2018

Detecting an event within interactive media

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,156,894
App. No.
16/017,170
Granted
Dec 18, 2018
Kind
B2
Abstract

As a user is being presented with interactive media by a presenting device, a separate monitoring device may be used to monitor the presentation of the interactive media and detect an event that occurs therein. Such a monitoring device may be configured and positioned to access media content from the presentation of the interactive media. For example, the monitoring device may be configured and positioned to record video content with a camera and record audio content with a microphone. Having accessed this media content, the monitoring device may generate an identifier, such as a fingerprint or watermark, of the media content and compare the generated identifier with a reference identifier that is generated from the source of the media content. Based on the generated identifier matching the reference identifier, the monitoring device may detect that an event has occurred within the interactive media presentation and present a corresponding notification.

Claims (64)

1. A non-transitory machine-readable medium storing instructions executable by a processor to cause a machine to carry out operations including:

accessing a database that stores reference fingerprints, wherein a reference fingerprint among the reference fingerprints is generated from spatialized media content, the spatialized media content being spatialized in three dimensions and indicating a virtual orientation at a virtual location in a virtual world;

detecting that a query fingerprint representing interactive media content playback by a presentation device matches the reference fingerprint among the stored reference fingerprints, wherein the detecting establishes that the interactive media content playback represents the virtual orientation at the virtual location within the virtual world; and

based on the detecting that the query fingerprint representing the interactive media content playback by the presentation device matches the reference fingerprint among the stored reference fingerprints, causing presentation of a notification that corresponds to the virtual orientation at the virtual location within the virtual world.

2. The non-transitory machine-readable medium of claim 1 , wherein the spatialized media content includes spatialized multi-channel audio content that indicates the virtual orientation at the virtual location in the virtual world.

3. The non-transitory machine-readable medium of claim 1 ,

wherein the virtual world is included in an interactive media presentation that enables navigation within the virtual world in response to user input, and

wherein the query fingerprint is generated in response to the playback of the interactive media content occurring during navigation within the virtual world in response to the user input.

4. The non-transitory machine-readable medium of claim 1 ,

wherein the virtual world is included in an interactive media presentation that enables an avatar of a user to selectively move among multiple virtual locations in the virtual world and selectively orient toward any of multiple virtual orientations within the virtual world, and

wherein the query fingerprint is generated in response to the playback of the interactive media content being triggered by the avatar moving to the virtual location and orienting toward the virtual orientation within the virtual world.

5. The non-transitory machine-readable medium of claim 1 ,

wherein the virtual location is a first virtual location in the virtual world,

wherein the spatialized media content indicates the first virtual location and a second virtual location in the virtual world,

wherein the query fingerprint is a first query fingerprint,

wherein the reference fingerprint is a first reference fingerprint, and

wherein the providing the notification is further based on a second reference fingerprint matching a second query fingerprint in conjunction with the first reference fingerprint matching the first query fingerprint.

6. The non-transitory machine-readable medium of claim 1 ,

wherein the spatialized media content further indicates acquisition of a virtual item within the virtual world, and

wherein the notification includes information describing the virtual item.

7. The non-transitory machine-readable medium of claim 1 ,

wherein the spatialized media content further indicates a level of progress within a storyline of an interactive media presentation, and

wherein the notification includes information based on the level of progress within the storyline of the interactive media presentation.

8. The non-transitory machine-readable medium of claim 1 ,

wherein the spatialized media content further indicates an achievement within a game being played by a user, and

wherein the notification includes information corresponding with the achievement within the game.

9. The non-transitory machine-readable medium of claim 1 ,

wherein the spatialized media content further indicates a failure to achieve a goal within a game being played by a user, and

wherein the notification includes information corresponding with the failure to achieve a goal within the game.

10. The non-transitory machine-readable medium of claim 1 , wherein causing presentation of the notification comprises causing the presentation device to present the notification.

11. The non-transitory machine-readable medium of claim 1 ,

wherein the virtual world is included in an interactive media presentation that presents events within the virtual world in response to user input submitted by a user,

wherein the notification include information, and

wherein causing of the presentation of the notification includes communicating the information to a device of the user.

12. The non-transitory machine-readable medium of claim 1 ,

wherein the virtual world is included in an interactive media presentation that presents events within the virtual world in response to user input submitted by a first user,

wherein the notification include information, and

wherein the causing of the presentation of the notification includes communicating the information to a device of a second user that is socially connected to the first user according to a social networking service.

13. A method comprising:

accessing a database that stores reference fingerprints, wherein a reference fingerprint among the reference fingerprints is generated from spatialized media content, the spatialized media content being spatialized in three dimensions and indicating a virtual orientation at a virtual location in a virtual world;

detecting that a query fingerprint representing interactive media content playback by a presentation device matches the reference fingerprint among the stored reference fingerprints, wherein the detecting establishes that the interactive media content playback represents the virtual orientation at the virtual location within the virtual world; and

based on the detecting that the query fingerprint representing the interactive media content playback by the presentation device matches the reference fingerprint among the stored reference fingerprints, causing presentation of a notification that corresponds to the virtual orientation at the virtual location within the virtual world.

14. The method of claim 13 , wherein the spatialized media content includes spatialized multi-channel audio content that indicates the virtual orientation at the virtual location in the virtual world.

15. The method of claim 13 ,

wherein the virtual location is a first virtual location in the virtual world,

wherein the spatialized media content indicates the first virtual location and a second virtual location in the virtual world,

wherein the query fingerprint is a first query fingerprint,

wherein the reference fingerprint is a first reference fingerprint, and

wherein the providing the notification is further based on a second reference fingerprint matching a second query fingerprint in conjunction with the first reference fingerprint matching the first query fingerprint.

16. The method of claim 3 , wherein causing presentation of the notification comprises causing the presentation device to present the notification.

17. A system comprising:

a processing unit;

memory storing instructions that, when executed by at least the processing unit, cause the system to perform operations including:

accessing a database that stores reference fingerprints, wherein a reference fingerprint among the reference fingerprints is generated from spatialized media content, the spatialized media content being spatialized in three dimensions and indicating a virtual orientation at a virtual location in a virtual world,

detecting that a query fingerprint representing interactive media content playback by a presentation device matches the reference fingerprint among the stored reference fingerprints, wherein the detecting establishes that the interactive media content playback represents the virtual orientation at the virtual location within the virtual world, and

based on the detecting that the query fingerprint representing the interactive media content playback by the presentation device matches the reference fingerprint among the stored reference fingerprints, causing presentation of a notification that corresponds to the virtual orientation at the virtual location within the virtual world.

18. The system of claim 17 , wherein the spatialized media content includes spatialized multi-channel audio content that indicates the virtual orientation at the virtual location in the virtual world.

19. The system of claim 17 ,

wherein the virtual location is a first virtual location in the virtual world,

wherein the spatialized media content indicates the first virtual location and a second virtual location in the virtual world,

wherein the query fingerprint is a first query fingerprint,

wherein the reference fingerprint is a first reference fingerprint, and

wherein the providing the notification is further based on a second reference fingerprint matching a second query fingerprint in conjunction with the first reference fingerprint matching the first query fingerprint.

20. The system of claim 17 , wherein causing presentation of the notification comprises causing the presentation device to present the notification.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2018
From: BENSON, JEFF; GUBMAN, MICHAEL; KAWAHARA, CRAIG; CREMER, MARKUS K.; MAI, ANDY; COOVER, ROBERT
To: GRACENOTE, INC.
Reel/Frame 046201/0012 →