IP Library Granted Patent US 9,372,531
Granted Patent B2
US 9,372,531 · App. 13/795,877 · Granted Jun 21, 2016

Detecting an event within interactive media including spatialized multi-channel audio content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,372,531
App. No.
13/795,877
Granted
Jun 21, 2016
Kind
B2
Abstract

As a user is being presented with interactive media by a presenting device, a separate monitoring device may be used to monitor the presentation of the interactive media and detect an event that occurs therein. Such a monitoring device may be configured and positioned to access media content from the presentation of the interactive media. For example, the monitoring device may be configured and positioned to record video content with a camera and record audio content with a microphone. Having accessed this media content, the monitoring device may generate an identifier, such as a fingerprint or watermark, of the media content and compare the generated identifier with a reference identifier that is generated from the source of the media content. Based on the generated identifier matching the reference identifier, the monitoring device may detect that an event has occurred within the interactive media presentation and present a corresponding notification.

Claims (71)

1. A method comprising:

accessing a first fingerprint generated from media content that is presentable as part of an interactive media presentation within which an event that corresponds to the media content is configured to occur in response to a user input, the media content including spatialized multi-channel audio content that indicates a virtual directional orientation towards which a player avatar is facing within a virtual world;

generating a second fingerprint from a playback of the media content as part of the interactive media presentation;

detecting, using at least one processor of a machine, an occurrence of the event within the interactive media presentation based on the second fingerprint matching the first fingerprint; and

presenting a notification that references the occurrence of the event within the interactive media presentation detected based on the second fingerprint matching the first fingerprint and includes information that corresponds to the virtual directional orientation within the virtual world.

2. The method of claim 1 , wherein:

the media content is unique within the interactive media presentation; and

the event corresponds exclusively to the media content.

3. The method of claim 1 , wherein:

the media content is not unique within the interactive media presentation;

the event corresponds nonexclusively to the media content; and

the detecting of the occurrence of the event is based on a third fingerprint generated from further media content of the interactive media presentation matching a fourth fingerprint generated from a playback of the further media content as part of the interactive media presentation.

4. The method of claim 3 , wherein:

the event corresponds exclusively to the playback of the media content being contemporaneous with the playback of the further media content; and

the detecting of the occurrence of the event is based on the event corresponding exclusively to the playback of the media content being contemporaneous with the playback of the further media content.

5. The method of claim 3 , wherein:

the event corresponds nonexclusively to the playback of the media content being contemporaneous with the playback of the further media content; and

the detecting of the occurrence of the event is based on a probability that the playback of the media content is contemporaneous with the playback of the further media content.

6. The method of claim 3 , wherein:

the event corresponds nonexclusively to the playback of the media content being contemporaneous with the playback of the further media content; and

the detecting of the occurrence of the event is based on a history of events that occurred within the interactive media presentation prior to the playback of the further media content.

7. The method of claim 1 , wherein:

the generating of the second fingerprint is in response to a request that a current portion of the interactive media presentation be identified;

the presenting of the notification identifies the current portion of the interactive media presentation; and the method further comprises

receiving the request that the current portion of the interactive media presentation be identified.

8. The method of claim 1 , wherein:

the event includes an achievement within a game by a player of the game; and

the presenting of the notification presents information that references the achievement by the player.

9. The method of claim 1 , wherein:

the event includes acquisition of a virtual item within a virtual world; and

the presenting of the notification presents information that describes the virtual item.

10. The method of claim 1 , wherein:

the media content includes video content that indicates a level of progress within a storyline of a game; and

the presenting of the notification presents information based on the level of progress within the storyline of the game.

11. The method of claim 1 , wherein:

the media content includes audio content that indicates a level of advancement within a game by a player of the game; and

the presenting of the notification presents information based on the level of advancement within the game by the player.

12. The method of claim 1 , wherein:

the media content includes audio content that indicates a virtual location within a virtual world; and

the presenting of the notification presents information that corresponds to the virtual location within the virtual world.

13. The method of claim 1 , wherein:

the media content indicates a failure to achieve a goal within a game by a player of the game; and

the presenting of the notification presents at least one of a suggestion on achieving the goal, an encouragement to the player, or an advertisement for a virtual item within the game.

14. The method of claim 1 , wherein:

a first user that submitted the user input is socially connected to a second user according to a social network; and

the presenting of the notification includes communicating the notification with a reference to the first user to a device of the second user.

15. The method of claim 1 further comprising:

storing a reference to the occurrence of the event in a data record that corresponds to a user that submitted the user input, the stored reference being usable to identify the part of the interactive media presentation within which the event is configured to occur.

16. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing a first fingerprint generated from media content that is presentable as part of an interactive media presentation within which an event that corresponds to the media content is configured to occur in response to a user input, the media content including spatialized multi-channel audio content that indicates a virtual directional orientation towards which a player avatar is facing within a virtual world;

generating a second fingerprint from a playback of the media content as part of the interactive media presentation;

detecting, using at least one of the processors of the machine, an occurrence of the event within the interactive media presentation based on the second fingerprint matching the first fingerprint; and

presenting a notification that references the occurrence of the event within the interactive media presentation detected based on the second fingerprint matching the first fingerprint and includes information that corresponds to the virtual directional orientation within the virtual world.

17. The non-transitory machine-readable storage medium of claim 16 , wherein:

the media content is not unique within the interactive media presentation;

the event corresponds nonexclusively to the media content; and

the detecting of the occurrence of the event is based on a third fingerprint generated from further media content of the interactive media presentation matching a fourth fingerprint generated from a playback of the further media content as part of the interactive media presentation.

18. A system comprising:

a reference module configured to access a first fingerprint generated from media content that is presentable as part of an interactive media presentation within which an event that corresponds to the media content is configured to occur in response to a user input, the media content including spatialized multi-channel audio content that indicates a virtual directional orientation towards which a player avatar is facing within a virtual world;

a fingerprint module configured to generate a second fingerprint from a playback of the media content as part of the interactive media presentation;

a processor configured by a detection module to detect an occurrence of the event within the interactive media presentation based on the second fingerprint matching the first fingerprint; and

a presentation module configured to present a notification that references the occurrence of the event within the interactive media presentation detected based on the second fingerprint matching the first fingerprint and includes information that corresponds to the virtual directional orientation within the virtual world.

19. The system of claim 18 , wherein:

the media content is not unique within the interactive media presentation;

the event corresponds nonexclusively to the media content; and

the detection module configures the processor to detect the occurrence of the event based on a third fingerprint generated from further media content of the interactive media presentation matching a fourth fingerprint generated from a playback of the further media content as part of the interactive media presentation.

20. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing a first watermark embedded within media content that is presentable as part of an interactive media presentation within which an event that corresponds to the media content is configured to occur in response to a user input, the media content including spatialized multi-channel audio content that indicates a virtual directional orientation towards which a player avatar is facing within a virtual world;

detecting a second watermark within a playback of the media content as part of the interactive media presentation;

detecting an occurrence of the event within the interactive media presentation based on the second watermark matching the first watermark, the detecting of the occurrence of the event being performed by the one or more processors of the machine; and

presenting a notification that references the occurrence of the event within the interactive media presentation detected based on the second watermark matching the first watermark and includes information that corresponds to the virtual directional orientation within the virtual world.

Assignments (14)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY AGREEMENT Recorded Aug 12, 2016
From: GRACENOTE, INC.; CASTTV, INC.; TRIBUNE BROADCASTING COMPANY, LLC
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 039667/0565 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →