IP Library Granted Patent US 12,238,373
Granted Patent B2
US 12,238,373 · App. 18/498,388 · Granted Feb 25, 2025

Apparatus, systems and methods for accessing information based on an image presented on a display

Inventors: Swapnil Tilaye (Westminster, CO); Carlos Garcia Navarro (Boulder, CO)
Assignee: DISH Technologies L.L.C.
H04N21/44008H04N21/40H04N21/41H04N21/4126H04N21/414H04N21/41415H04N21/422H04N21/4223H04N21/43H04N21/43079H04N21/431H04N21/4312H04N21/4316H04N21/4882H04N21/812H04N21/84H04N21/8547H04N21/8586
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,373
App. No.
18/498,388
Granted
Feb 25, 2025
Kind
B2
Abstract

Systems and methods are operable to control operation of a portable media device based on machine readable information of a graphical artifact shown on a display concurrently with presentation of a video portion of a media content event. A portable media device, using a portable media device provisioned with an image capture device, captures at least one image that includes the display that is presenting the graphical artifact and the video portion of the media content event, identifies the graphical artifact in the captured at least one image, determines the machine readable data based on the identified graphical artifact, and operates the portable media device to perform at least one operation based on the determined machine readable data.

Claims (84)

1. A method, comprising:

communicating, from a media device to a display, a video portion of a media content event that is intended to be presented on the display;

identifying, at the media device, a region of the video portion that is suitable for presentation of a graphical artifact;

presenting, by the media device on the display at the identified region, the graphical artifact concurrently with continuing presentation of the video portion of the media content event; and

in response to a portable media device capturing at least one image that includes at least the identified region of the display that is presenting the graphical artifact, determining that a language of an audio portion of the presenting media content event is different from an alternative language and sending supplemental information to the portable media device including at least one of:

a stream of closed captioning text, wherein a language of the presented closed captioning text is different from a language used in a dialogue of the presented media content event; and

accessing an alternative language portion of the media content event.

2. The method of claim 1 , wherein the graphical artifact has machine readable data encoded thereon using a plurality of data marks.

3. The method of claim 1 , further comprising:

identifying, at the portable media device, the graphical artifact in the captured at least one image;

determining, by the portable media device, a machine readable data based on the identified graphical artifact; and

operating the portable media device to perform at least one operation based on the determined machine readable data.

4. The method of claim 3 , wherein the machine readable data of the graphical artifact includes information to communicatively couple the portable media device with a remote information system via a communication network, and wherein the at least one operation performed by the portable media device comprises:

receiving, at the portable media device, supplemental information from the remote information system; and

presenting the supplemental information using the portable media device.

5. The method of claim 4 , wherein presenting the supplemental information using the portable media device comprises:

receiving, at the portable media device, the stream of closed captioning text; and

displaying the stream of closed captioning text on a display of the portable media device,

wherein presentation time information of the closed captioning text is used to synchronize presentation of the closed captioning text being presented on a display of the portable media device with the presenting media content event.

6. The method of claim 4 , wherein presenting the supplemental information using the portable media device comprises:

receiving, at the portable media device, a stream of audio content that corresponds to the audio content of the presenting media content event; and

presenting the stream of audio content using at least one of a speaker of the portable media device or a set of head phones that are communicatively coupled to the portable media device,

wherein presentation time information of the audio content is used to synchronize presentation of the audio content being presented by the portable media device with the presenting media content event.

7. The method of claim 1 , further comprising:

receiving, at the media device, information that defines a plurality of graphical artifacts, wherein each of the graphical artifacts is associated with one of a plurality of media content events scheduled for broadcasting to the media device and a plurality of other media devices;

storing, in a memory of the media device, the received information that defines the plurality of graphical artifacts;

presenting one of the plurality of media content events;

accessing, from the memory of the media device, the received information associated with one of the plurality of graphical artifacts that is associated with the presenting media content event;

generating, at the media device, a graphical artifact based on the accessed information.

8. The method of claim 7 , wherein the information received and stored at the media device further includes duration information that defines a duration of presentation of the graphical artifact, wherein the generated graphical artifact is presented only for the duration defined by the duration information, the method further comprising:

ending presentation of the generated graphical artifact at the end of the duration, wherein presentation of the media content event continues.

9. The method of claim 1 , further comprising:

capturing, using the portable media device provisioned with an image capture device, at least one first image or video clip;

operating the portable media device to perform a zoom, focusing, or orientation operation of the image capture device, wherein an increased size, improved clarity, or re-orientation of the display presenting the graphical artifact and the presenting media content event or of the graphical artifact, is detectable by the image capture device;

capturing at least one second image or video clip using the image capture device of the portable media device,

wherein a portion of the captured second image or video clip includes a larger, greater-focused, or adjusted-orientation image of the display that is presenting the graphical artifact concurrently with presentation of the video portion of the media content event.

10. The method of claim 9 , further comprising performing two or more of:

the zoom operation to enlarge the display presenting the graphical artifact and the presenting media content event or the graphical artifact in the captured second image;

the focusing operation with the image capture device to improve the clarity of the display presenting the graphical artifact and the presenting media content event or the graphical artifact in the captured second image; and

the orientation operation to re-orient the display presenting the graphical artifact and the presenting media content event or the graphical artifact into a center of the captured second image.

11. The method of claim 9 , wherein the zoom, focusing, or orientation operation performed by the image capture device is a first zoom, focusing, or orientation operation, and when machine readable data of the graphical artifact is not determinable from the second captured image, the method further comprising:

automatically operating the portable media device to perform a second zoom, focusing, or orientation operation of the image capture device, wherein a further increased size, improved clarity, or re-orientation of the display presenting the graphical artifact and the presenting media content event is detectable by the image capture device;

capturing at least one third image using the image capture device of the portable media device,

wherein a portion of the captured third image includes another increased size, improved clarity, or re-orientation of the display that is presenting the graphical artifact concurrently with presentation of the video portion of a media content event; and

identifying, at the portable media device, the graphical artifact in the captured third image,

wherein the machine readable data of the graphical artifact is determined from the captured third image.

12. A system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the system to perform a process comprising:

communicating, from a media device to a display, a video portion of a media content event that is intended to be presented on the display;

identifying, at the media device, a region of the video portion that is suitable for presentation of a graphical artifact;

presenting, by the media device on the display at the identified region, the graphical artifact concurrently with continuing presentation of the video portion of the media content event; and

in response to a portable media device capturing at least one image that includes at least the identified region of the display that is presenting the graphical artifact, determining that a language of an audio portion of the presenting media content event is different from an alternative language and sending supplemental information to the portable media device including at least one of:

a stream of closed captioning text, wherein a language of the presented closed captioning text is different from a language used in a dialogue of the presented media content event; and

accessing an alternative language portion of the media content event.

13. The system of claim 12 , wherein the graphical artifact has machine readable data encoded thereon using a plurality of data marks.

14. The system of claim 12 , wherein the process further comprises:

identifying, at the portable media device, the graphical artifact in the captured at least one image;

determining, by the portable media device, a machine readable data based on the identified graphical artifact; and

operating the portable media device to perform at least one operation based on the determined machine readable data.

15. The system of claim 14 , wherein the machine readable data of the graphical artifact includes information to communicatively couple the portable media device with a remote information system via a communication network, and wherein the process further comprises:

receiving, at the portable media device, supplemental information from the remote information system; and

presenting the received supplemental information using the portable media device.

16. The system of claim 12 , wherein the process further comprises:

receiving, at the media device, information that defines a plurality of graphical artifacts, wherein each of the graphical artifacts is associated with one of a plurality of media content events scheduled for broadcasting to the media device and a plurality of other media devices;

storing, in a memory of the media device, the received information that defines the plurality of graphical artifacts;

presenting one of the plurality of media content events;

accessing, from the memory of the media device, the received information associated with one of the plurality of graphical artifacts that is associated with the presenting media content event; and

generating, at the media device, the graphical artifact based on the accessed information.

17. A non-transitory computer-readable medium storing instructions that, when executed by a computing system, cause the computing system to perform operations comprising:

communicating, from a media device to a display, a video portion of a media content event that is intended to be presented on the display;

identifying, at the media device, a region of the video portion that is suitable for presentation of a graphical artifact;

presenting, by the media device on the display at the identified region, the graphical artifact concurrently with continuing presentation of the video portion of the media content event; and

in response to a portable media device capturing at least one image that includes at least the identified region of the display that is presenting the graphical artifact, determining that a language of an audio portion of the presenting media content event is different from an alternative language and sending supplemental information to the portable media device including at least one of:

a stream of closed captioning text, wherein a language of the presented closed captioning text is different from a language used in a dialogue of the presented media content event; and

accessing an alternative language portion of the media content event.

18. The non-transitory computer-readable medium of claim 17 , wherein the graphical artifact has machine readable data encoded thereon using a plurality of data marks.

19. The non-transitory computer-readable medium of claim 17 , wherein the operations further comprise:

identifying, at the portable media device, the graphical artifact in the captured at least one image;

determining, by the portable media device, a machine readable data based on the identified graphical artifact; and

operating the portable media device to perform at least one operation based on the determined machine readable data.

20. The non-transitory computer-readable medium of claim 19 , wherein the machine readable data of the graphical artifact includes information to communicatively couple the portable media device with a remote information system via a communication network, and wherein the operations further comprise:

receiving, at the portable media device, supplemental information from the remote information system; and

presenting the received supplemental information using the portable media device.

Assignments (3)
CONVERSION Recorded Nov 6, 2023
From: ECHOSTAR TECHNOLOGIES L.L.C.
To: DISH TECHNOLOGIES L.L.C.
Reel/Frame 065474/0434 →
CHANGE OF NAME Recorded Nov 2, 2023
From: ECHOSTAR TECHNOLOGIES L.L.C.
To: DISH TECHNOLOGIES L.L.C.
Reel/Frame 065444/0622 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2023
From: GARCIA NAVARRO, CARLOS; TILAYE, SWAPNIL
To: ECHOSTAR TECHNOLOGIES L.L.C.
Reel/Frame 065413/0001 →
Continuity (4)
Continuation 16986153 · Aug 5, 2020
Continuation 15686914 · Aug 25, 2017
Continuation 14807178 · Jul 23, 2015
Related Publication 20240064371A1 · Feb 22, 2024
References Cited (58)
US 7070103B2 · Melick et al. · 2006 [cited by applicant]
US 7986913B2 · Wang · 2011 [cited by applicant]
US 8090579B2 · DeBusk et al. · 2012 [cited by applicant]
US 8150096B2 · Alattar · 2012 [cited by applicant]
US 8401224B2 · Rhoads · 2013 [cited by applicant]
US 8688600B2 · Barton · 2014 [cited by applicant]
US 8944322B2 · White · 2015 [cited by applicant]
US 9047516B2 · Archer · 2015 [cited by applicant]
US 9749685B2 · Tilaye · 2017 [cited by examiner]
US 10506295B2 · Chen · 2019 [cited by examiner]
US 10750237B2 · Tilaye · 2020 [cited by examiner]
US 10785546B2 · Lynar · 2020 [cited by applicant]
US 10820038B2 · Friedman · 2020 [cited by applicant]
US 11812100B2 · Tilaye · 2023 [cited by examiner]
US 20060049262A1 · Elo · 2006 [cited by applicant]
US 20060187358A1 · Lienhart · 2006 [cited by applicant]
US 20060248569A1 · Lienhart · 2006 [cited by applicant]
US 20070226019A1 · Carlson · 2007 [cited by applicant]
US 20080187219A1 · Chen · 2008 [cited by applicant]
US 20090078772A1 · Ofek · 2009 [cited by applicant]
US 20090136092A1 · Springer · 2009 [cited by applicant]
US 20100287580A1 · Harding et al. · 2010 [cited by applicant]
US 20110098056A1 · Rhoades · 2011 [cited by applicant]
US 20110255842A1 · Hindle · 2011 [cited by applicant]
US 20120008821A1 · Sharon et al. · 2012 [cited by applicant]
US 20120037695A1 · Liu et al. · 2012 [cited by applicant]
US 20120114303A1 · Chung · 2012 [cited by examiner]
US 20120176540A1 · Labrozzi et al. · 2012 [cited by applicant]
US 20130006951A1 · Yu et al. · 2013 [cited by applicant]
US 20130091519A1 · Mclauchlan · 2013 [cited by applicant]
US 20130156255A1 · Varadharajan · 2013 [cited by applicant]
US 20130182182A1 · Mountain · 2013 [cited by applicant]
US 20130246457A1 · Stojancic et al. · 2013 [cited by applicant]
US 20140020005A1 · Amselem et al. · 2014 [cited by applicant]
US 20140079374A1 · Gehring · 2014 [cited by applicant]
US 20140082646A1 · Sandland · 2014 [cited by applicant]
US 20140143806A1 · Steinberg · 2014 [cited by applicant]
US 20140156364A1 · Zalewski · 2014 [cited by applicant]
US 20140184721A1 · Zhang · 2014 [cited by applicant]
US 20140195548A1 · Harron · 2014 [cited by applicant]
US 20140250466A1 · Lieberkuhn et al. · 2014 [cited by applicant]
US 20140280265A1 · Wang · 2014 [cited by applicant]
US 20150014417A1 · Finlow-Bates · 2015 [cited by applicant]
US 20160225131A1 · Babbar · 2016 [cited by applicant]
US 20160249096A1 · Ortiz · 2016 [cited by examiner]
US 20160301953A1 · Garcia Navarro · 2016 [cited by applicant]
US 20160323482A1 · Chung · 2016 [cited by examiner]
US 20170078718A1 · Ioffe · 2017 [cited by applicant]
US 20170257660A1 · Liu · 2017 [cited by applicant]
US 20180020215A1 · Ramamurthy · 2018 [cited by examiner]
US 20180288494A1 · Grover · 2018 [cited by applicant]
US 20200154156A1 · Roach · 2020 [cited by applicant]
US 20200366957A1 · Tilaye · 2020 [cited by applicant]
CA 2875891A1 · 2012 [cited by applicant]
EP 2278497 · 2011 [cited by applicant]
Flingo, “Flingo Industry-leading Automatic Content Recognition (ACR) Technology,” Jun. 15, 2015. [cited by applicant]
TVTAK, “TVTAK is Like Shazam for TV”, Apr. 5, 2011. [cited by applicant]
Shazham, “Shazam Introduces Visual Recognition Capabilitis, Opening Up A New World of Shazamable Content,” May 28, 2015. [cited by applicant]