IP Library › Granted Patent US 12,295,081
Granted Patent B2
US 12,295,081 · App. 17/569,822 · Granted May 6, 2025

Video display environmental lighting

Inventor: Ehsan Younessian (Washington, DC)
Assignee: Comcast Cable Communications, LLC
H05B47/105G06V40/16G10L15/22G10L25/57G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,295,081
App. No.
17/569,822
Granted
May 6, 2025
Kind
B2
Abstract

Systems, apparatuses, and methods are described for intelligent control of video display backlighting that provides environmental lighting illumination of an area behind a video display device, such as on a wall behind a video display. The environmental lighting illumination may be based on recognizing images (e.g., objects, patterns, faces, colors, etc.) in video content being displayed via the video display device, recognizing audio (e.g., words, sounds, voices, etc.) in audio content being output in association with video content being displayed via the video display device, and/or recognizing other triggers such as commands associated with video content.

Claims (62)

1. A method comprising:

receiving, by a computing device, video content;

performing object recognition on one or more images of the video content, wherein the object recognition comprises distinguishing foreground and background objects; and

causing, based on the object recognition and while the video content is being displayed by a display device, illumination, in one or more colors that are selected based on a color of a recognized background object, of one or more environmental lights providing illumination behind the display device.

2. The method of claim 1 , wherein the illumination illuminates an area, behind the display device, that is selected based on a location of an object recognized by the object recognition.

3. The method of claim 1 , further comprising selecting the one or more colors to match a color of an object that was recognized by the object recognition.

4. The method of claim 1 , wherein the object recognition comprises text recognition, and the method further comprises causing illumination, at an area behind the display device and adjacent to recognized text on the display device, of one or more colors that are selected based on a color of the recognized text.

5. The method of claim 1 , wherein the object recognition comprises image pattern recognition, and the method further comprises causing illumination, at an area behind the display device and adjacent to a recognized image pattern on the display device, of one or more colors that are selected based on a color of the recognized image pattern.

6. The method of claim 1 , further comprising scheduling the illumination of the one or more environmental lights to occur at a time before a recognized object appears on a screen of the display device.

7. The method of claim 1 , wherein the video content comprises a movie recorded by a digital video recorder (DVR), the method further comprising performing audio pattern recognition on audio associated with the movie, and wherein the causing illumination is further based on the audio pattern recognition.

8. The method of claim 1 , further comprising performing speech recognition on audio associated with the video content, and wherein the causing illumination is further based on the speech recognition.

9. The method of claim 1 , further comprising receiving trigger parameters for environmental lighting illumination, wherein the trigger parameters indicate:

an audio or video pattern for triggering environmental lighting illumination; and

color for the one or more environmental lights, and

wherein the object recognition is based on the trigger parameters.

10. The method of claim 1 , further comprising:

associating different areas of the display device with different corresponding environmental lights; and

selecting the one or more environmental lights based on an area, of the display device, corresponding to an object recognized by the object recognition.

11. The method of claim 1 , wherein the video content comprises a video program selected from a program listing and received from a content server remote from the computing device.

12. The method of claim 1 , wherein the causing illumination comprises causing illumination of a wall behind the display device.

13. An apparatus comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, configure the apparatus to:

receive video content;

perform object recognition on one or more images of the video content, wherein the object recognition comprises distinguishing foreground and background objects; and

cause, based on the object recognition and while the video content is being displayed by a display device, illumination, in one or more colors that are selected based on a color of a recognized background object, of one or more environmental lights providing illumination behind the display device.

14. The apparatus of claim 13 , wherein the illumination illuminates an area, behind the display device, that is selected based on a location of an object recognized by the object recognition.

15. The apparatus of claim 13 , wherein the instructions, when executed by the one or more processors, further configure the apparatus to select the one or more colors to match a color of an object that was recognized by the object recognition.

16. The apparatus of claim 13 , wherein the object recognition comprises text recognition, and the instructions, when executed by the one or more processors, further configure the apparatus to cause illumination, at an area behind the display device and adjacent to recognized text on the display device, of one or more colors that are selected based on a color of the recognized text.

17. The apparatus of claim 13 , wherein the object recognition comprises image pattern recognition, and the instructions, when executed by the one or more processors, further configure the apparatus to cause illumination, at an area behind the display device and adjacent to a recognized image pattern on the display device, of one or more colors that are selected based on a color of the recognized image pattern.

18. The apparatus of claim 13 , instructions, when executed by the one or more processors, further configure the apparatus to schedule the illumination of the one or more environmental lights to occur at a time before a recognized object appears on a screen of the display device.

19. The apparatus of claim 13 , wherein the video content comprises a movie recorded by a digital video recorder (DVR), and wherein the instructions, when executed by the one or more processors, further configure the apparatus to perform audio pattern recognition on audio associated with the movie and cause the illumination further based on the audio pattern recognition.

20. The apparatus of claim 13 , wherein the instructions, when executed by the one or more processors, further configure the apparatus to perform speech recognition on audio associated with the video content and cause the illumination further based on the speech recognition.

21. The apparatus of claim 13 , wherein the instructions, when executed by the one or more processors, further configure the apparatus to receive trigger parameters for environmental lighting illumination, wherein the trigger parameters indicate:

an audio or video pattern for triggering environmental lighting illumination; and

color for the one or more environmental lights; and

wherein the object recognition is based on the trigger parameters.

22. The apparatus of claim 13 , wherein the instructions, when executed by the one or more processors, further configure the apparatus to:

associate different areas of the display device with different corresponding environmental lights; and

select the one or more environmental lights based on an area, of the display device, corresponding to an object recognized by the object recognition.

23. The apparatus of claim 13 , wherein the video content comprises a video program selected from a program listing and received from a content server remote from the apparatus.

24. The apparatus of claim 13 , wherein the instructions, when executed by the one or more processors, configure the apparatus to cause the illumination by causing illumination of a wall behind the display device.

25. One or more non-transitory computer readable medium storing instructions that, when executed, cause:

receiving, by a computing device, video content;

performing object recognition on one or more images of the video content, wherein the object recognition comprises distinguishing foreground and background objects; and

causing, based on the object recognition and while the video content is being displayed by a display device, illumination, in one or more colors that are selected based on a color of a recognized background object, of one or more environmental lights providing illumination behind the display device.

26. The one or more non-transitory computer readable medium of claim 25 , wherein the illumination illuminates an area, behind the display device, that is selected based on a location of an object recognized by the object recognition.

27. The one or more non-transitory computer readable medium of claim 25 , wherein the instructions, when executed, further cause selecting the one or more colors to match a color of an object that was recognized by the object recognition.

28. The one or more non-transitory computer readable medium of claim 25 , wherein the object recognition comprises text recognition, and the instructions, when executed, further cause illumination, at an area behind the display device and adjacent to recognized text on the display device, of one or more colors that are selected based on a color of the recognized text.

29. The one or more non-transitory computer readable medium of claim 25 , wherein the object recognition comprises image pattern recognition, and the instructions, when executed, further cause illumination, at an area behind the display device and adjacent to a recognized image pattern on the display device, of one or more colors that are selected based on a color of the recognized image pattern.

30. The one or more non-transitory computer readable medium of claim 25 , wherein the instructions, when executed, further cause scheduling the illumination of the one or more environmental lights to occur at a time before a recognized object appears on a screen of the display device.

31. The one or more non-transitory computer readable medium of claim 25 , wherein the video content comprises a movie recorded by a digital video recorder (DVR) and the instructions, when executed, further cause performing audio pattern recognition on audio associated with the movie, and wherein the causing illumination is further based on the audio pattern recognition.

32. The one or more non-transitory computer readable medium of claim 25 , wherein the instructions, when executed, further cause performing speech recognition on audio associated with the video content, and wherein the causing illumination is further based on the speech recognition.

33. The one or more non-transitory computer readable medium of claim 25 , wherein the instructions, when executed, further cause receiving trigger parameters for environmental lighting illumination, wherein the trigger parameters indicate:

an audio or video pattern for triggering environmental lighting illumination; and

color for the one or more environmental lights; and

wherein the object recognition is based on the trigger parameters.

34. The one or more non-transitory computer readable medium of claim 25 , wherein the instructions, when executed, further cause:

associating different areas of the display device with different corresponding environmental lights; and

selecting the one or more environmental lights based on an area, of the display device, corresponding to an object recognized by the object recognition.

35. The one or more non-transitory computer readable medium of claim 25 , wherein the video content comprises a video program selected from a program listing and received from a content server remote from the computing device.

36. The one or more non-transitory computer readable medium of claim 25 , wherein the causing illumination comprises causing illumination of a wall behind the display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2022
From: YOUNESSIAN, EHSAN
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 058687/0023 →
Continuity (1)
Related Publication 20230217568A1 · Jul 6, 2023
References Cited (161)
US 4807031A · Broughton et al. · 1989 [cited by applicant]
US 5189412A · Mehta et al. · 1993 [cited by applicant]
US 5655945A · Jani · 1997 [cited by applicant]
US 6014184A · Knee et al. · 2000 [cited by applicant]
US 6166496A · Lys et al. · 2000 [cited by applicant]
US 6415438B1 · Blackketter et al. · 2002 [cited by applicant]
US 6564108B1 · Makar et al. · 2003 [cited by applicant]
US 6611297B1 · Akashi et al. · 2003 [cited by applicant]
US 6698020B1 · Zigmond et al. · 2004 [cited by applicant]
US 6742188B1 · Del Castillo · 2004 [cited by applicant]
US 7071897B2 · Bronson · 2006 [cited by applicant]
US 7180529B2 · Covannon et al. · 2007 [cited by applicant]
US 7269843B2 · Yamaguchi et al. · 2007 [cited by applicant]
US 7316487B2 · Hirata et al. · 2008 [cited by applicant]
US 7369903B2 · Diederiks et al. · 2008 [cited by applicant]
US 7616262B2 · Eves et al. · 2009 [cited by applicant]
US 7752642B2 · Lemmons · 2010 [cited by applicant]
US 7932953B2 · Gutta et al. · 2011 [cited by applicant]
US 7965050B2 · Nieuwlands · 2011 [cited by applicant]
US 8477948B2 · Shon et al. · 2013 [cited by applicant]
US 8576340B1 · Li et al. · 2013 [cited by applicant]
US 8750793B2 · Tysowski · 2014 [cited by applicant]
US 8788080B1 · Kallai et al. · 2014 [cited by applicant]
US 8856535B2 · Wolcott et al. · 2014 [cited by applicant]
US 8878991B2 · Cook · 2014 [cited by applicant]
US 8922124B2 · Reed et al. · 2014 [cited by applicant]
US 9084312B2 · Cook · 2015 [cited by applicant]
US 9866924B2 · Grant et al. · 2018 [cited by applicant]
US 10390078B2 · Zhang et al. · 2019 [cited by applicant]
US 10423632B2 · Armstrong et al. · 2019 [cited by applicant]
US 10554435B2 · Dorrendorf et al. · 2020 [cited by applicant]
US 11281164B1 · Richards · 2022 [cited by examiner]
US 20020038157A1 · Dowling et al. · 2002 [cited by applicant]
US 20020056087A1 · Berezowski et al. · 2002 [cited by applicant]
US 20020171378A1 · Morgan et al. · 2002 [cited by applicant]
US 20030057884A1 · Dowling et al. · 2003 [cited by applicant]
US 20030061607A1 · Hunter et al. · 2003 [cited by applicant]
US 20030081834A1 · Philomin et al. · 2003 [cited by applicant]
US 20030149975A1 · Eldering et al. · 2003 [cited by applicant]
US 20030149980A1 · Hassell et al. · 2003 [cited by applicant]
US 20040015983A1 · Lemmons · 2004 [cited by applicant]
US 20040032536A1 · Islam et al. · 2004 [cited by applicant]
US 20040070565A1 · Nayar · 2004 [cited by examiner]
US 20040117840A1 · Boudreau et al. · 2004 [cited by applicant]
US 20050028208A1 · Ellis et al. · 2005 [cited by applicant]
US 20050078087A1 · Gates et al. · 2005 [cited by applicant]
US 20050223237A1 · Barletta et al. · 2005 [cited by applicant]
US 20060064720A1 · Istvan et al. · 2006 [cited by applicant]
US 20060100880A1 · Yamamoto et al. · 2006 [cited by applicant]
US 20060174275A1 · Gutta · 2006 [cited by applicant]
US 20060225088A1 · Gutta · 2006 [cited by applicant]
US 20070033533A1 · Sull · 2007 [cited by applicant]
US 20070133212A1 · Lin et al. · 2007 [cited by applicant]
US 20070157260A1 · Walker · 2007 [cited by applicant]
US 20070174773A1 · Abernethy et al. · 2007 [cited by applicant]
US 20070242162A1 · Gutta et al. · 2007 [cited by applicant]
US 20080062196A1 · Rackham · 2008 [cited by applicant]
US 20080235200A1 · Washington et al. · 2008 [cited by applicant]
US 20090046477A1 · Salters · 2009 [cited by applicant]
US 20090094628A1 · Lee et al. · 2009 [cited by applicant]
US 20090123086A1 · Iwanami et al. · 2009 [cited by applicant]
US 20090150925A1 · Henderson · 2009 [cited by applicant]
US 20090175536A1 · Gutta et al. · 2009 [cited by applicant]
US 20090193455A1 · Ahn et al. · 2009 [cited by applicant]
US 20090219305A1 · Diederiks et al. · 2009 [cited by applicant]
US 20090249428A1 · White et al. · 2009 [cited by applicant]
US 20100177247A1 · Sekulovski et al. · 2010 [cited by applicant]
US 20100213873A1 · Picard et al. · 2010 [cited by applicant]
US 20100213876A1 · Adamson et al. · 2010 [cited by applicant]
US 20100238664A1 · Steenbergen · 2010 [cited by applicant]
US 20100244745A1 · Wendt · 2010 [cited by applicant]
US 20100262336A1 · Rivas et al. · 2010 [cited by applicant]
US 20100265414A1 · Nieuwlands · 2010 [cited by applicant]
US 20100284612A1 · Peters · 2010 [cited by applicant]
US 20100320819A1 · Cohen et al. · 2010 [cited by applicant]
US 20110013075A1 · Kim · 2011 [cited by examiner]
US 20110125788A1 · Joo et al. · 2011 [cited by applicant]
US 20110125790A1 · Choi et al. · 2011 [cited by applicant]
US 20110190911A1 · Iwanami et al. · 2011 [cited by applicant]
US 20110215725A1 · Paolini · 2011 [cited by applicant]
US 20110291586A1 · Komagata et al. · 2011 [cited by applicant]
US 20110298379A1 · Jung et al. · 2011 [cited by applicant]
US 20120182276A1 · Kee · 2012 [cited by examiner]
US 20130014155A1 · Clarke et al. · 2013 [cited by applicant]
US 20130055330A1 · Igoe · 2013 [cited by applicant]
US 20130093962A1 · Bruhn et al. · 2013 [cited by applicant]
US 20130147395A1 · Cook · 2013 [cited by applicant]
US 20130166777A1 · Chen et al. · 2013 [cited by applicant]
US 20130191745A1 · Vella et al. · 2013 [cited by applicant]
US 20130205212A1 · Sinha et al. · 2013 [cited by applicant]
US 20130215024A1 · Nakayama et al. · 2013 [cited by applicant]
US 20140104498A1 · Li et al. · 2014 [cited by applicant]
US 20140223461A1 · Hatambeiki et al. · 2014 [cited by applicant]
US 20140267906A1 · Mickelsen et al. · 2014 [cited by applicant]
US 20140273841A1 · Behin · 2014 [cited by applicant]
US 20140320825A1 · Kim et al. · 2014 [cited by applicant]
US 20150019975A1 · Morrow et al. · 2015 [cited by applicant]
US 20150199975A1 · Won et al. · 2015 [cited by applicant]
US 20150297989A1 · Nakayama et al. · 2015 [cited by applicant]
US 20170041644A1 · Dalrymple et al. · 2017 [cited by applicant]
US 20170041648A1 · Dalrymple et al. · 2017 [cited by applicant]
US 20170041649A1 · Dalrymple et al. · 2017 [cited by applicant]
US 20170083770A1 · Carlson et al. · 2017 [cited by applicant]
US 20170191695A1 · Bruhn et al. · 2017 [cited by applicant]
US 20170195717A1 · Wang et al. · 2017 [cited by applicant]
US 20170295404A1 · Meredith et al. · 2017 [cited by applicant]
US 20180103287A1 · Reichow et al. · 2018 [cited by applicant]
US 20180292907A1 · Katz · 2018 [cited by examiner]
US 20180336929A1 · Filippini et al. · 2018 [cited by applicant]
US 20190069375A1 · Baker et al. · 2019 [cited by applicant]
US 20190081811A1 · Miller et al. · 2019 [cited by applicant]
US 20190356508A1 · Trikha · 2019 [cited by examiner]
US 20200213662A1 · Wolcott et al. · 2020 [cited by applicant]
US 20210021788A1 · McNelley · 2021 [cited by examiner]
US 20210141444A1 · Speelman · 2021 [cited by examiner]
US 20210231951A1 · Dominguez · 2021 [cited by examiner]
US 20210298157A1 · Olaleye · 2021 [cited by examiner]
US 20210374391A1 · Jorasch · 2021 [cited by examiner]
US 20210392290A1 · McNelley · 2021 [cited by examiner]
US 20210399911A1 · Jorasch · 2021 [cited by examiner]
US 20210400142A1 · Jorasch · 2021 [cited by examiner]
US 20220058382A1 · LiVoti · 2022 [cited by examiner]
US 20220116520A1 · Hsieh · 2022 [cited by examiner]
US 20220124226A1 · Jeong · 2022 [cited by examiner]
US 20220155143A1 · Moeneclaey · 2022 [cited by examiner]
US 20220217828A1 · Linnartz · 2022 [cited by examiner]
US 20220284893A1 · Bani Hani · 2022 [cited by examiner]
US 20220287166A1 · Zang · 2022 [cited by examiner]
US 20220300081A1 · Eirinberg · 2022 [cited by examiner]
US 20220300732A1 · Eirinberg · 2022 [cited by examiner]
US 20220312572A1 · Kumar · 2022 [cited by examiner]
US 20230068798A1 · Etchart · 2023 [cited by examiner]
US 20230162529A1 · Zhou · 2023 [cited by examiner]
US 20230180371A1 · Henderson · 2023 [cited by examiner]
US 20230201517A1 · Rizkalla · 2023 [cited by examiner]
US 20230225035A1 · Krajnc · 2023 [cited by examiner]
US 20230262862A1 · Meerbeek · 2023 [cited by examiner]
US 20230269852A1 · Janssen · 2023 [cited by examiner]
EP 2851894A1 · 2015 [cited by applicant]
GB 2464123A · 2010 [cited by applicant]
WO 2005041110A2 · 2005 [cited by applicant]
WO 2007026283A2 · 2007 [cited by applicant]
WO 2007126781A2 · 2007 [cited by applicant]
WO 2015076623A1 · 2015 [cited by applicant]
“ZigBee RF4CE Overview and Technical Summary”, ZigBee Alliance, 2012. [cited by applicant]
“Captain Power and the Soldiers of the Future”, downloaded from Wikipedia on Mar. 13, 2013, <http://en.wikipedia.org/wiki/Captain_Power>. [cited by applicant]
Garry Whittaker, “Let there be Ambilight—AMBX—How to get the Philip's Ambilight effect in media center without buying a new TV”, Jul. 26, 2010, downloaded from <http://thedigitallifestyle.com/w/index/php/2010/07/26/let-… [cited by applicant]
Ben Holmes, “VenueMagic 2.5 Show Control Software”, Jan. 24, 2012, downloaded from <http://www.venuemagic.com/>, 5 pages. [cited by applicant]
“The Death of Ineffective Conferences and Presentations?”, downloaded from <http://www.ambx.com/>, 3 pages, retrieved Jan. 31, 2012. [cited by applicant]
“Amblone: DIY Ambilight”, downloaded from <http://amblone.com/>, 3 pages, retrieved Jan. 31, 2012. [cited by applicant]
“Philips' new 9000 series Smart LED TV offers the best full HD 3D cinematic experience”, Press Information, Philips Mar. 8, 2011, 4 pages. [cited by applicant]
Thomas Ricker, “Fujikom LeDenQ Z-Wave wireless LED lightbulb is a world's first”, Jan. 13, 2012, downloaded from <http://www.theverge.com/2012/1/13/2705079/wireless-LED-z-wave-fujikon-ledenq>, 19 pages. [cited by applicant]
“Energate Implements ZigBee Smart Energy to Balance the Needs of Utilities and Empower Consumers”, ZigBee Success Story, 2009, 2 pages. [cited by applicant]
“Multi Color LED, Part No. 08L5015RGBC”, product details, Electronix Express, 2 pages, retrieved no later than Mar. 8, 2012. [cited by applicant]
“88W8688 Integrated MAC/Baseband/RF WLAN and Bluetooth SoC Product Brief”, Nov. 30, 2009, Marvell, 6 pages. [cited by applicant]
“Marvell 88EM8080/88EM8081 Digital Flyback PFC Controller for LED Lighting Applications”, product overview, Aug. 2010, Marvell, 2 pages. [cited by applicant]
Partial European Search Report—EP12196159.3—Mailing date: Apr. 2, 2013. [cited by applicant]
Extended European Search Report—EP12196159.3—Mailing Date: Jun. 26, 2013. [cited by applicant]
Dec. 12, 2016—(EP) Office Action—App 12196159.3. [cited by applicant]
Feb. 12, 2020—European Extended Search Report—EP 19220170.5. [cited by applicant]
Oct. 27, 2022—EP Office Action—EP App. No. 19220170.5. [cited by applicant]