IP Library Granted Patent US 9,508,387
Granted Patent B2
US 9,508,387 · App. 12/976,148 · Granted Nov 29, 2016

Flick intel annotation methods and systems

Inventors: Richard Krukar (Albuquerque, NM); Luis Ortiz (Albuquerque, NM); Kermit Lopez (Albuquerque, NM)
Assignee: Flick Intelligence, LLC
G11B27/11G11B27/34H04N21/431H04N21/4316H04N21/4725H04N21/812H04N21/8586H04N9/8205
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,508,387
App. No.
12/976,148
Granted
Nov 29, 2016
Kind
B2
Abstract

Video content is a time varying presentation of scenes or video frames. Each frame can contain a number of scene elements such as actors, foreground items, background items, or other items. A person enjoying video content can select a scene element by specifying a screen coordinate while the video content plays. Frame specification data identifies the specific frame or scene being displayed when the coordinate is selected. The coordinate in combination with the frame specification data is sufficient to identify the scene element that the person has chosen, information about the scene element can then be presented to the person. An annotation database can relate the scene elements to the frame specification data and coordinates.

Claims (39)

1. A system comprising:

a display device that displays video content to a person wherein the video content comprises a plurality of frames;

a media device that provides the video content to the display device;

a pointing device that the person uses to choose a screen coordinate on the display device;

frame specification data that identifies the video content and which of the frames was displayed on the display device when the person chose the screen coordinate;

a query comprising the screen coordinate and the frame specification data; and

an element identifier provided by an annotation database in response to receiving the query wherein the annotation service comprises a human worker who determines the element identifier based upon the query.

2. The system of claim 1 wherein the video content is a movie, show, advertisement, or sporting event.

3. The system of claim 2 wherein the frame specification data comprises a timestamp and a media tag wherein the media tag uniquely identifies the video content to distinguish the video content from other prerecorded content, wherein the timestamp identifies a frame of the video content and wherein the frame was displayed to the user when the user chose the screen coordinate.

4. The system of claim 3 further comprising:

an additional data server that produces element data based on the element identifier; and

a data presentation that displays the element data to the person.

5. The system of claim 4 wherein the element identifier corresponds to an item for sale and the data presentation comprises an offer for the user to purchase the item.

6. The system of claim 4 wherein the element identifier corresponds to a person and the data presentation provides information about that person.

7. The system of claim 4 wherein the element identifier corresponds to a song and the data presentation comprises an offer for the user to purchase a copy of the song.

8. The system of claim 4 wherein the element identifier corresponds to a location and the data presentation comprises travel information for reaching the location.

9. The system of claim 1 further comprising:

an additional data server that produces element data based on the element identifier;

and a data presentation that displays the element data to the person.

10. A system comprising:

a display device that displays video content to a person wherein the video content comprises a plurality of frames;

a media device that provides the video content to the display device;

a pointing device that the person uses to choose a screen coordinate on the display device;

frame specification data that identifies the video content and which of the frames was displayed on the display device when the person chose the screen coordinate;

a query comprising the screen coordinate and the frame specification data; and

an element identifier provided by an annotation service in response to receiving the query wherein the annotation service is provided by a service provider wherein the annotation service comprises a human worker who determines the element identifier based upon the query.

11. The system of claim 10 wherein the annotation service comprises an annotation database running on a remote server and wherein the annotation database receives the query and provides the element identifier.

12. The system of claim 10 further comprising an annotation database wherein the human worker causes the frame specification data, the screen coordinate, and the element identifier to be entered into the annotation database.

13. The system of claim 10 further comprising an additional data server that produces element data based on the element identifier and wherein the human worker causes the element data to be provided to the person.

14. A method comprising:

receiving, by an annotation service, a query specifying a screen coordinate, video content and a frame of the video content, wherein the screen coordinate specifies a location within the frame, and wherein a person selected the screen coordinate within the frame; and

producing, by the annotation service, an element identifier corresponding to a scene element visible in the frame and located at the screen coordinate to thereby identify an on-screen item to the person wherein a human worker determines the element identifier based upon the query.

15. The method of claim 14 further comprising querying an annotation database to thereby obtain the element identifier.

16. The method of claim 15 wherein the element identifier specifies a purchasable item and wherein the element data comprises an offer for the user to buy the purchasable item.

17. The method of claim 15 wherein the scene element is a person.

18. The method of claim 14 further comprising:

locating element data relating to the element identifier; and

presenting the element data to the person.

19. The method of claim 18 wherein the element identifier specifies a purchasable item and wherein the element data comprises an offer for the user to buy the purchasable item.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2019
From: FLICK INTEL, LLC
To: FLICK INTELLIGENCE, LLC
Reel/Frame 049951/0783 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2012
From: KRUKAR, RICHARD H.; ORTIZ, LUIS M.; LOPEZ, KERMIT
To: FLICKINTEL, LLC
Reel/Frame 027570/0511 →
Continuity (3)
Provisional Application 61291837 · Dec 31, 2009
Provisional Application 61419268 · Dec 3, 2010
Related Publication 20110158603A1 · Jun 30, 2011