IP Library Granted Patent US 11,543,729
Granted Patent B2
US 11,543,729 · App. 16/658,833 · Granted Jan 3, 2023

Systems and methods to transform events and/or mood associated with playing media into lighting effects

Inventors: Markus Kurt Cremer (Orinda, CA); Shashank Merchant (Emeryville, CA); Aneesh Vartakavi (Emeryville, CA)
Assignee: Gracenote, Inc.
G02F1/25A63J17/00G02F1/0121G06F16/00G06F16/783G06V10/446G06V40/1347G06V40/1365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,543,729
App. No.
16/658,833
Granted
Jan 3, 2023
Kind
B2
Abstract

Example systems and methods to transform events and/or mood associated with playing media into lighting effects are disclosed herein. An example apparatus includes a content identifier to identify a first event occurring during presentation of media content at a first time. The example apparatus includes a content driven analyzer to determine a first lighting effect to be produced by a light-producing device based on the first event and instruct the light-producing device to produce the first lighting effect based on the first event during presentation of the media content. The content identifier is to identify a second media event occurring during presentation of the media content at a second time after the first time. The content driven analyzer is to instruct the light-producing device to one of maintain the first lighting effect based on the second event or produce a second lighting effect based on the second event during presentation of the media content.

Claims (68)

1. A non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one machine to at least:

determine a first light effect to be produced by a light-producing device during presentation of media content based on metadata associated with the media content;

instruct the light-producing device to produce the first light effect during the presentation of the media content at a first time;

identify a first object in the media content during presentation of the media content;

determine a color associated with the first object in the media content during presentation of the media content;

determine a second light effect to be produced by the light-producing device based on the color; and

instruct the light-producing device to produce the second light effect during presentation of the media content at a second time, the second time after the first time.

2. The non-transitory machine readable storage medium of claim 1 , wherein the media content is video content and the instructions, when executed, cause the at least one machine to identify the color associated with the first object in one or more frames of the video content.

3. The non-transitory machine readable storage medium of claim 2 , wherein the instructions, when executed, cause the at least one machine to identify a dominant color in the one or more frames as the color associated with the first object.

4. The non-transitory machine readable storage medium of claim 1 , wherein the first lighting effect includes a first color of light to be produced by the light-producing device.

5. The non-transitory machine readable storage medium of claim 1 , wherein the instructions, when executed, cause the at least one machine to:

determine a color associated with a second object in the media content; and

in response to the determination of the color associated with the second object, one of instruct the light-producing device to maintain the second light effect or instruct the light-producing device to produce a third light effect at a third time.

6. The non-transitory machine readable storage medium of claim 1 , wherein the first light effect includes a hue or an intensity of light to be produced by the light-producing device.

7. The non-transitory machine readable storage medium of claim 1 , wherein the first light effect includes light having multiple colors associated with a color palette.

8. The non-transitory machine readable storage medium of claim 7 , wherein the color palette includes daytime colors.

9. The non-transitory machine readable storage medium of claim 1 , wherein the instructions, when executed, cause the at least one machine to further determine the color based on fingerprint data associated with the media content.

10. The non-transitory machine readable storage medium of claim 1 , wherein the metadata is indicative of one or more of a mood, a genre, a title, or an event associated with the media content.

11. An apparatus comprising:

a controller to:

determine a first color associated with a first portion of media content during presentation of the media content based on image data including the first portion of the media content and first metadata associated with the first portion of the media content, the first portion of the media content occurring at a first time during the presentation of the media content;

determine a first light effect for the media content based on the first color;

determine a second color associated with a second portion of media content during presentation of the media content based on image data including the second portion of the media content and second metadata associated with the second portion of the media content, the second portion of the media content occurring at a second time during the presentation of the media content, the second time after the first time; and

determine a second light effect for the media content based on the second color; and

a light-generating device to:

receive first instruction from the controller including the first light effect; and

produce the first light effect during presentation of the media content;

receive a second instruction from the controller including the second light effect; and

transition from producing the first light effect to producing the second light effect during presentation of the media content.

12. The apparatus of claim 11 , wherein the media content is video content and the image data including the first portion of the media content corresponds to one or more frames of the video content.

13. The apparatus of claim 11 , wherein the controller is implemented by a user device different than a device by which the media content is presented.

14. The apparatus of claim 11 , wherein the controller is implemented by a device by which the media content is presented.

15. The apparatus of claim 11 , wherein the media content includes sound, the controller to further determine the first light effect based on the sound.

16. The apparatus of claim 11 , wherein the first light effect includes one or more of a hue of a light to be produced by the light-generating device, an intensity of the light, blinking of the light, or strobing of the light.

17. The apparatus of claim 11 , wherein the first metadata includes one or more of a mood tag, a genre tag, a title tag, or an event tag.

18. A non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one machine to at least:

identify a first color associated with a first portion of media content during presentation of the media content based on a first metadata tag associated with the first portion of the media content, the first portion of the media content occurring at a first time during the presentation of the media content;

determine a first light effect to be produced by a light-producing device based on the first color;

instruct the light-producing device to produce the first light effect during the presentation of the media content;

identify a second color associated with a second portion of the media content during presentation of the media content based on a second metadata tag associated with the second portion of the media content, the second portion of the media content occurring at a second time during the presentation of the media content, the second time after the first time;

determine a second light effect to be produced by the light-producing device based on the second color; and

instruct the light-producing device to transition from producing the first light effect to produce the second light effect during presentation of the media content.

19. The non-transitory machine readable storage medium of claim 18 , wherein the media content is video content including a first frame and a second frame and the instructions, when executed, cause the at least one machine to further identify the first color based on the first frame of the video content and to identify the second color based on the second frame of the video content.

20. The non-transitory machine readable storage medium of claim 19 , wherein the instructions, when executed, cause the machine to:

determine color values in the first frame; and

identify the first color as a dominant color in the first frame based on the color values.

21. The non-transitory machine readable storage medium of claim 18 , wherein the first light effect includes a first color of a light to be produced by the light-producing device and the second light effect includes a second color of the light, the first color of the light associated with a first intensity and the second color of the light associated with a second intensity.

22. The non-transitory machine readable storage medium of claim 18 , wherein the first metadata tag includes one or more of a mood tag, a genre tag, or an event tag.

23. An apparatus comprising:

at least one memory;

instructions; and

processor circuitry to execute the instructions to:

determine a first light effect to be produced by a light-producing device during presentation of media content based on metadata associated with the media content;

instruct the light-producing device to produce the first light effect during the presentation of the media content at a first time;

identify a first object in the media content during presentation of the media content;

determine a color associated with the first object in the media content during presentation of the media content;

determine a second light effect to be produced by the light-producing device based on the color; and

instruct the light-producing device to produce the second light effect during presentation of the media content at a second time, the second time after the first time.

24. The apparatus of claim 23 , wherein the media content is video content and the processor circuitry is to identify the color associated with the first object in one or more frames of the video content.

25. The apparatus of claim 23 , wherein the processor circuitry is to identify a dominant color in the one or more frames as the color associated with the first object.

26. The apparatus of claim 23 , wherein the first lighting effect includes a first color of light to be produced by the light-producing device.

27. The apparatus of claim 23 , wherein the processor circuitry is to:

determine a color associated with a second object in the media content; and

in response to the determination of the color associated with the second object, one of instruct the light-producing device to maintain the second light effect or instruct the light- producing device to produce a third light effect at a third time.

28. The apparatus of claim 23 , wherein the first light effect includes a hue or an intensity of light to be produced by the light-producing device.

29. The apparatus of claim 23 , wherein the first light effect includes light having multiple colors associated with a color palette.

30. The apparatus of claim 29 , wherein the color palette includes daytime colors.

31. The apparatus of claim 23 , wherein the processor circuitry is to further determine the color based on fingerprint data associated with the media content.

Assignments (8)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: CREMER, MARKUS KURT; MERCHANT, SHASHANK; VARTAKAVI, ANEESH
To: GRACENOTE, INC.
Reel/Frame 051080/0030 →
Continuity (4)
Continuation 16161830 · Oct 16, 2018
Continuation 15839447 · Dec 12, 2017
Provisional Application 62433018 · Dec 12, 2016
Related Publication 20200050074A1 · Feb 13, 2020