IP Library › Granted Patent US 10,638,203
Granted Patent B2
US 10,638,203 · App. 16/240,608 · Granted Apr 28, 2020

Methods and devices for clarifying audible video content

Inventors: Ingrid McAulay Trollope (Richmond, GB); Ant Oztaskent (Sutton, GB); Yaroslav Volovich (Cambridge, GB)
Assignee: GOOGLE LLC
H04N21/8133G06F16/7844G06F17/40G06F40/00G06Q10/06G10L15/265H04N21/233H04N21/235H04N21/2393
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,638,203
App. No.
16/240,608
Granted
Apr 28, 2020
Kind
B2
Abstract

The various implementations described herein include methods, devices, and systems for clarifying media content. In one aspect, a method is performed at a client device that includes a microphone, memory, and one or more processors. The method includes: (1) receiving, via the microphone, audio content of a media content item playing on a second client device in proximity to the client device; (2) receiving, via the microphone, a verbal query from a user of the client device to clarify a portion of the media content item; (3) sending a request to a remote server system; (4) receiving from the remote server system information responsive to the verbal user query for the portion of the media content item; and (5) presenting the information to the user.

Claims (47)

1. A method, comprising:

at a client device having a microphone, one or more processors, and memory:

receiving, via the microphone, audio content of a media content item playing on a second client device in proximity to the client device;

receiving, via the microphone, a verbal query from a user of the client device to clarify a portion of the media content item;

in response to receiving the verbal query sending a request to a remote server system, the request including at least a portion of the audio content and the verbal query;

in response to sending the request, receiving from the remote server system information responsive to the verbal query for the portion of the media content item; and

presenting the information to the user.

2. The method of claim 1 , wherein the information comprises song lyrics.

3. The method of claim 1 , wherein the information comprises a transcription of speech.

4. The method of claim 1 , wherein the portion of the media content item corresponds to a plurality of persons speaking; and

wherein the verbal query comprises a request to clarify the speech of a particular person of the plurality of persons.

5. The method of claim 1 , wherein the information comprises subtitle data associated with the media content item.

6. The method of claim 1 , wherein the information comprises information obtained from an online document.

7. The method of claim 1 , wherein the portion of the media content item includes speech in a first language; and

wherein the information comprises a translation of the speech to a second language.

8. The method of claim 1 , wherein the verbal query comprises a request to translate content within the portion of the media content; and

wherein the information comprises a translation of the content.

9. The method of claim 1 , wherein the media content item is live television content.

10. The method of claim 1 , wherein the media content item is previously broadcast television content.

11. The method of claim 1 , wherein the media content item is recorded content.

12. The method of claim 1 , wherein the media content item is streaming content.

13. An electronic device, comprising:

a microphone;

memory;

one or more processors; and

one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions for:

receiving, via the microphone, audio content of a media content item playing on a second client device in proximity to the electronic device;

receiving, via the microphone, a verbal query from a user of the electronic device to clarify a portion of the media content item;

in response to receiving the verbal query sending a request to a remote server system, the request including at least a portion of the audio content and the verbal query;

in response to sending the request, receiving from the remote server system information responsive to the verbal query for the portion of the media content item; and

presenting the information to the user.

14. The electronic device of claim 13 , further comprising a display, wherein the information is presented to the user via the display.

15. The electronic device of claim 13 , further comprising a speaker, wherein the information is presented to the user via the speaker.

16. The electronic device of claim 13 , wherein the portion of the media content item corresponds to a plurality of persons speaking; and

wherein the verbal query comprises a request to clarify the speech of a particular person of the plurality of persons.

17. The electronic device of claim 13 , wherein the verbal query comprises a request to translate content within the portion of the media content; and

wherein the information comprises a translation of the content.

18. A non-transitory computer-readable storage medium storing one or more programs to be executed by an electronic device with a microphone, memory, and one or more processors, the one or more programs comprising instructions for:

receiving, via the microphone, audio content of a media content item playing on a second client device in proximity to the electronic device;

receiving, via the microphone, a verbal query from a user of the electronic device to clarify a portion of the media content item;

in response to receiving the verbal query sending a request to a remote server system, the request including at least a portion of the audio content and the verbal query;

in response to sending the request, receiving from the remote server system information responsive to the verbal query for the portion of the media content item; and

presenting the information to the user.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the portion of the media content item corresponds to a plurality of persons speaking; and

wherein the verbal query comprises a request to clarify the speech of a particular person of the plurality of persons.

20. The non-transitory computer-readable storage medium of claim 18 , wherein the verbal query comprises a request to translate content within the portion of the media content; and

wherein the information comprises a translation of the content.

Continuity (5)
Continuation 14488213 · Sep 16, 2014
Continuation In Part 14311204 · Jun 20, 2014
Continuation In Part 14311211 · Jun 20, 2014
Continuation In Part 14311218 · Jun 20, 2014
Related Publication 20190141413A1 · May 9, 2019