IP Library Granted Patent US 9,516,259
Granted Patent B2
US 9,516,259 · App. 14/060,515 · Granted Dec 6, 2016

Capturing media content in accordance with a viewer expression

Inventor: Ying Zheng (Mountain View, CA)
Assignee: GOOGLE INC.
H04N5/76A61B5/0022A61B5/0077A61B5/165G02B7/34G02B27/0093G02B27/017G02B27/34G06F3/011G06F3/017G06K9/00302H04N1/00336H04N5/23219A61B2503/12G02B2027/0187G06F2203/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,516,259
App. No.
14/060,515
Granted
Dec 6, 2016
Kind
B2
Abstract

Systems and methods for capturing media content in accordance with viewer expression are disclosed. In some implementations, a method includes: at a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors: detecting display of a media content item; while the media content item is being displayed: detecting a viewer expression corresponding to a predefined viewer expression; and in response to detecting the viewer expression: identifying a portion of the media content item corresponding in time to the viewer expression. In some implementations, the viewer expression—selected from one of: a facial expression, a body movement, a voice, or an arm, leg or finger gesture—is presumed to be a viewer reaction to the portion of the media content item.

Claims (62)

1. A method comprising:

at a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors:

while a media content item is being presented to a user, capturing a momentary reaction of the user to a portion of the media content item;

comparing the captured user reaction with one or more previously captured reactions of the user, wherein each previously captured reaction of the one or more previously captured reactions corresponds to a particular reaction type of a plurality of reaction types; and

identifying the user reaction as one of the plurality of reaction types based on the comparison;

in response to identifying the captured user reaction, identifying the portion of the media content item; and

storing, at the computer system, a first association between the identified user reaction and the portion of the media content item.

2. The method of claim 1 , further comprising: determining whether the viewer expression is a viewer reaction to the portion of the media content item.

3. The method of claim 1 , further comprising:

capturing (i) the viewer expression or (ii) a reference to the viewer expression, in a second media content item.

4. The method of claim 3 , further comprising:

receiving a communication from a viewer identified in the viewer expression; and

in response to receiving the communication:

causing the second media content item to be shared with one or more other users.

5. The method of claim 1 , wherein the predefined viewer expression is selected from one of: a facial expression, a body movement, a voice, or an arm, leg or finger gesture.

6. The method of claim 1 , wherein the portion of the media content is one of:

a video or audio clip, a text, or a photo.

7. The method of claim 1 , further comprising:

uploading (i) the portion of the media content item or (ii) a reference to the portion of the media content item, to a server.

8. The method of claim 1 , further comprising:

transmitting information identifying the viewer expression to a server.

9. The method of claim 1 , further comprising:

storing the identified viewer expression and the identified portion of the media content item corresponding to the identified viewer expression as a pair.

10. The method of claim 1 , further comprising aggregating a plurality of stored associations of the viewer, including the first association, to determine a user viewing preference.

11. The method of claim 1 , further comprising, prior to capturing the momentary reaction of the user to the portion of the media content item:

obtaining a prior user reaction of the user;

presenting the prior user reaction to the user;

receiving characterization of the user reaction from the user; and

storing the prior user reaction as a previously captured reaction of the one or more previously captured reactions with a corresponding reaction type.

12. A computer system, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

while a media content item is being presented to a user, capturing a momentary reaction of the user to a portion of the media content item;

comparing the captured user reaction with one or more previously captured reactions of the user, wherein each previously captured reaction of the one or more previously captured reactions corresponds to a particular reaction type of a plurality of reaction types; and

identifying the user reaction as one of the plurality of reaction types based on the comparison;

in response to identifying the captured user reaction, identifying the portion of the media content item; and

storing, at the computer system, a first association between the identified user reaction and the portion of the media content item.

13. The system of claim 12 , wherein the one or more programs further comprise instructions for:

determining whether the viewer expression is a viewer reaction to the portion of the media content item.

14. The system of claim 12 , wherein the one or more programs further comprise instructions for:

capturing (i) the viewer expression or (ii) a reference to the viewer expression, in a second media content item.

15. The system of claim 14 , wherein the one or more programs further comprise instructions for:

receiving a communication from a viewer identified in the viewer expression; and

in response to receiving the communication:

causing the second media content item to be shared with one or more other users.

16. The system of claim 12 , wherein the predefined viewer expression is selected from one of: a facial expression, a body movement, a voice, or an arm, leg or finger gesture.

17. The system of claim 12 , wherein the one or more programs further comprise instructions for:

uploading (i) the portion of the media content item or (ii) a reference to the portion of the media content item, to a server.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer system with one or more processors, cause the computer system to:

while a media content item is being presented to a user, capture a momentary reaction of the user to a portion of the media content item;

compare the captured user reaction with one or more previously captured reactions of the user, wherein each previously captured reaction of the one or more previously captured reactions corresponds to a particular reaction type of a plurality of reaction types; and

identify the user reaction as one of the plurality of reaction types based on the comparison; in response to identifying the captured user reaction, identify the portion of the media content item; and

store, at the computer system, a first association between the identified user reaction and the portion of the media content item.

19. The non-transitory computer readable storage medium of claim 18 , wherein the one or more programs further comprise instructions for:

determining whether the viewer expression is a viewer reaction to the portion of the media content item.

20. The non-transitory computer readable storage medium of claim 18 , wherein the one or more programs further comprise instructions for:

capturing (i) the viewer expression or (ii) a reference to the viewer expression, in a second media content item.

21. The non-transitory computer readable storage medium of claim 20 , wherein the one or more programs further comprise instructions for:

receiving a communication from a viewer identified in the viewer expression; and

in response to receiving the communication:

causing the second media content item to be shared with one or more other users.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2015
From: ZHENG, YING
To: GOOGLE INC.
Reel/Frame 036185/0804 →
Continuity (1)
Related Publication 20150110471A1 · Apr 23, 2015