IP Library Granted Patent US 8,141,112
Granted Patent B2
US 8,141,112 · App. 12/177,183 · Granted Mar 20, 2012

Video signal content indexing and linking to information sources

Assignee: Overlay.tv Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,141,112
App. No.
12/177,183
Granted
Mar 20, 2012
Kind
B2
Abstract

A method for identifying object images in a display of a video signal, storing object identification information in an overlay directory, and extracting object information relevant to identified objects from respective information databases is disclosed. Overlay directories from several video signals and associated object information are assembled in an overlay server accessed by computers directly or through a telecommunication network. Object images are selected by users of authoring computers accessing the overlay server. An overlay directory for a video recording indicates temporal and spatial coordinates of images of selected objects, a network address of a video source providing the video recording, descriptions of the selected objects, and addresses of servers providing detailed information of the selected objects. The objects may include commercial products, services, or educational material. The disclosed method therefore may be used for advertising or general information dissemination purposes.

Claims (103)

1. A method for generating an overlay directory for a video signal, the method comprising employing a computer having stored thereon computer-executable instructions for:

displaying static images of candidate objects on a screen;

assigning for each of said static images a respective index with an initial value;

initializing an interruption period;

producing a display of said video signal on said screen;

in response to pointing to both a position within each of selected appearances of an object image in said display and a respective static image:

entering information relevant to said object image in a specific section of said overlay directory provided that a particular index corresponding to said respective static image equals said initial value;

determining, for each appearance of said object image, a pointing time based on said interruption period and a current time indication at which said computer detects said pointing;

interrupting said display;

determining respective coordinates of a spatial contour overlapping said object image;

entering said pointing time and respective coordinates in said specific section;

updating said particular index;

resuming said display; and

increasing said interruption period by a time gap between said interrupting and said resuming.

2. The method of claim 1 further comprising a step of selecting said spatial contour from a set of standardized contours.

3. The method of claim 2 wherein said spatial contour encircles said image.

4. The method of claim 2 wherein said spatial contour has a predetermined size independent of a size of said image.

5. The method of claim 2 wherein said spatial contour is of a rectangular shape and said coordinates of said spatial contour comprise coordinates of two diagonal points defining said rectangular shape.

6. The method of claim 1 further comprising steps of:

acquiring a global object directory from a video-overlay server; and

verifying that said candidate objects belong to said global object directory.

7. The method of claim 1 further comprising using interpolation to determine a spatial contour between two selected appearances of a moving object image.

8. The method of claim 1 further comprising sending said overlay directory to a video-overlay server for distribution to at least one viewing computer.

9. A method for generating an overlay directory for a video signal, the method comprising employing a computer having stored thereon computer-executable instructions for:

displaying, on a screen, static images, each identifying an object from a set of designated objects;

initializing tracking records having a one-to-one correspondence to said designated objects;

initializing a cumulative interruption period;

producing a display of said video signal on said screen;

in response to a user of said computer pointing to both a position within each of selected appearances of an object image and a corresponding static image:

interrupting said display;

determining, for each appearance of said object image:

a pointing time derived from said cumulative interruption period and a current time indication of said computer; and

an enclosing contour for said each image;

adding said pointing time and said enclosing contour to a tracking record corresponding to said each image;

resuming said display; and

updating said cumulative interruption period, accounting for a time gap between said interrupting and said resuming;

and

displaying contents of said tracking records, and for each tracking record having at least one entry:

acquiring further information relevant to a designated object of said each tracking record; and

inserting said each tracking record and said further information in a section of said overlay directory corresponding to said designated object.

10. The method of claim 9 further comprising:

determining a frame number of said video signal corresponding to said pointing time, said video signal being organized into frames; and

inserting said frame number to a respective tracking record to facilitate identifying a respective object image in a replay of said signal.

11. The method of claim 9 further comprising:

acquiring a global object directory from a video-overlay server; and

extracting said set of designated objects from said global object directory according to instructions of said user of said computer.

12. The method of claim 9 further comprising linking said computer to a search engine to acquire said further information.

13. The method of claim 9 further comprising:

acquiring network addresses of servers providing information on a designated object corresponding to said object identifier;

retrieving said relevant information from said servers; and

annotating said relevant information by said user of said computer.

14. A system for generating an overlay directory for a video signal, the system comprising a plurality of computers each computer having a memory device storing computer-executable instructions which cause said each computer to:

display static images of candidate objects;

assign for each of said static images a respective index with an initial value;

initialize an interruption period;

producing a display of said video signal on a screen;

in response to pointing to both a position within each of selected appearances of an object image in said display and a respective static image:

enter information relevant to said object image in a specific section of said overlay directory provided that a particular index corresponding to said respective static image equals said initial value;

determine, for each appearance of said object image, a pointing time based on said interruption period and a current time at which said each computer detects said pointing;

interrupt said display;

determine respective coordinates of a spatial contour overlapping said object image;

enter said pointing time and said respective coordinates in said specific section;

update said particular index;

resume said display at a subsequent time; and

increase said interruption period according to said current time and said subsequent time.

15. The system of claim 14 further comprising a video-overlay server accessed by said each computer and containing:

said computer-executable instructions;

a global object directory including object information;

video-source directory containing network addresses of video sources;

a set of standardized spatial contours; and

a video-content directory.

16. The system of claim 15 wherein said each computer accesses said video-overlay server to:

acquire a network address of said video signal;

acquire said information relevant to said object image;

acquire a standardized contour; and

add said overlay directory to said video-content directory.

17. The system of claim 14 wherein said computer-executable instructions further cause said each computer to include in said overlay directory information provided by a user of said computer, said information comprising:

a description of an object represented by said object image; and

a list of network addresses of sites providing further information on said object.

18. A system for generating overlay directories for a plurality of video signals, the system comprising a plurality of computers each computer having a memory device storing computer-executable instructions which cause said each computer to:

acquire a video signal;

display, on a screen, static images, each identifying an object from among a set of designated objects;

initialize tracking records having a one-to-one correspondence to said designated objects;

initialize a cumulative interruption period;

produce a display of said video signal on said screen;

in response to a user of said computer pointing to both a position within each of selected appearances of an object image and a corresponding static image:

interrupt said display;

determine, for each appearance of said object image:

a pointing time derived from said cumulative interruption period and a current time of said computer; and

an enclosing contour for said each image;

add said pointing time and said enclosing contour to a tracking record corresponding to said each image;

resume said display at a subsequent time; and

update said cumulative interruption period according to said current time and said subsequent time;

and

display contents of said tracking records and for each tracking record having at least one entry:

acquire further information relevant to a designated object of said each tracking record; and

insert said each tracking record and said further information in a section of said overlay directory corresponding to said designated object.

19. The system of claim 18 wherein said computer-executable instructions further cause said each computer to:

determine a frame number of said video signal corresponding to said pointing time, said video signal being organized into frames; and

insert said frame number to a respective tracking record to facilitate identifying a respective object image in a replay of said signal.

20. The system of claim 18 wherein said computer-executable instructions further cause said each computer to:

acquire a global object directory from a video-overlay server; and

extract said set of designated objects from said global object directory according to instructions of said user of said computer.

Assignments (3)
CONFIRMATION OF COMPANY NAME AND ADDRESS Recorded Dec 7, 2016
From: OVERLAY.TV INC.
To: OVERLAY TV INC.
Reel/Frame 040837/0846 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2016
From: OVERLAY TV INC.
To: OVERLAY TV HOLDINGS LIMITED
Reel/Frame 040844/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2008
From: COPE, TYLER ANDREW, MR; REYNOLDS, JOSHUA JAMES, MR
To: OVERLAY.TV INC.
Reel/Frame 021325/0824 →
Continuity (2)
Provisional Application 60951230 · Jul 22, 2007
Related Publication 20090022473A1 · Jan 22, 2009