IP Library › Granted Patent US 11,064,266
Granted Patent B2
US 11,064,266 · App. 16/847,224 · Granted Jul 13, 2021

Methods and devices for clarifying audible video content

Inventors: Ingrid McAulay Trollope (Richmond, GB); Ant Oztaskent (Sutton, GB); Yaroslav Volovich (Cambridge, GB)
Assignee: Google LLC
H04N21/8133G06F16/7844G06F17/40G06F40/00G06Q10/06G10L15/26H04N21/233H04N21/235H04N21/2393
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,064,266
App. No.
16/847,224
Granted
Jul 13, 2021
Kind
B2
Abstract

The various implementations described herein include methods, devices, and systems for clarifying media content. In one aspect, a method is performed at a client device that includes a microphone, memory, and one or more processors. The method includes: (1) while a media content item is playing on a second client device in proximity to the client device, receiving, via the microphone, a verbal query from a user of the client device; (2) sending a request to a remote server system; (3) receiving from the remote server system information responsive to the verbal query for a portion of the media content item; and (4) presenting the information to the user.

Claims (37)

1. A method, comprising:

at a client device having a microphone, one or more processors, and memory:

while a media content item is playing on a second client device in proximity to the client device, receiving, via the microphone, a verbal query from a user of the client device concerning the media content item that is playing on the second client device;

in response to receiving the verbal query while the media content item is playing on the second client device, sending a request to a remote server system, the request including at least a portion of the media content item and the verbal query concerning the media content item that is playing on the second client device;

in response to sending the request, receiving, from the remote server system, information responsive to the verbal query for the portion of the media content item; and

presenting, using a display of the client device, a card interface of an application executing on the client device that presents the information responsive to the verbal query to the user.

2. The method of claim 1 , wherein the verbal query is a query regarding the portion of the media content item.

3. The method of claim 1 , wherein the verbal query is a request to clarify the portion of the media content item.

4. The method of claim 1 , wherein the at least the portion of the media content is audio content.

5. The method of claim 1 , wherein the information comprises song lyrics.

6. The method of claim 1 , wherein the information comprises a transcription of speech.

7. The method of claim 1 , wherein the portion of the media content item corresponds to a plurality of persons speaking; and wherein the verbal query comprises a request to clarify the speech of a particular person of the plurality of persons.

8. The method of claim 1 , wherein the information comprises subtitle data associated with the media content item.

9. The method of claim 1 , wherein the information comprises information obtained from an online document.

10. The method of claim 1 , wherein the portion of the media content item includes speech in a first language; and wherein the information comprises a translation of the speech to a second language.

11. The method of claim 1 , wherein the verbal query comprises a request to translate content within the portion of the media content item; and wherein the information comprises a translation of the content.

12. The method of claim 1 , wherein the media content item is live television content.

13. The method of claim 1 , wherein the media content item is previously broadcast television content.

14. The method of claim 1 , wherein the media content item is recorded content.

15. The method of claim 1 , wherein the media content item is streaming content.

16. An electronic device, comprising:

a microphone;

memory;

one or more processors; and

one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions for:

while a media content item is playing on a second client device in proximity to the electronic device, receiving, via the microphone, a verbal query from a user of the client device concerning the media content item that is playing on the second client device;

in response to receiving the verbal query while the media content item is playing on the second client device, sending a request to a remote server system, the request including at least a portion of the media content item and the verbal query concerning the media content item that is playing on the second client device;

in response to sending the request, receiving, from the remote server system, information responsive to the verbal query for the portion of the media content item; and

presenting, using a display of the electronic device, a card interface of an application executing on the electronic device that presents the information responsive to the verbal query to the user.

17. The electronic device of claim 16 , further comprising a display, wherein the information is presented to the user via the display.

18. The electronic device of claim 16 , further comprising a speaker, wherein the information is presented to the user via the speaker.

19. A non-transitory computer-readable storage medium storing one or more programs to be executed by an electronic device with a microphone, memory, and one or more processors, the one or more programs comprising instructions for:

while a media content item is playing on a second client device in proximity to the electronic device, receiving, via the microphone, a verbal query from a user of the electronic device concerning the media content item that is playing on the second client device;

in response to receiving the verbal query while the media content item is playing on the second client device, sending a request to a remote server system, the request including at least a portion of the media content item and the verbal query concerning the media content item that is playing on the second client device;

in response to sending the request, receiving, from the remote server system, information responsive to the verbal query for the portion of the media content item; and

presenting, using a display of the electronic device, a card interface of an application executing on the electronic device that presents the information responsive to the verbal query to the user.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the portion of the media content item corresponds to a plurality of persons speaking; and wherein the verbal query comprises a request to clarify the speech of a particular person of the plurality of persons.

Continuity (6)
Continuation 16240608 · Jan 4, 2019
Continuation 14488213 · Sep 16, 2014
Continuation In Part 14311204 · Jun 20, 2014
Continuation In Part 14311211 · Jun 20, 2014
Continuation In Part 14311218 · Jun 20, 2014
Related Publication 20200245037A1 · Jul 30, 2020
Cited By (1)
US 12,443,272