IP Library Granted Patent US 9,684,432
Granted Patent B2
US 9,684,432 · App. 14/023,404 · Granted Jun 20, 2017

Web-based system for collaborative generation of interactive videos

Inventors: Michael Fink (Jerusalem, IL); Ryan Junee (San Francisco, CA); Sigalit Bar (Cupertino, CA); Aviad Barzilai (Haifa, IL); Isaac Elias (Haifa, IL); Julian Frumar (San Francisco, CA); Herbert Ho (San Jose, CA); Nir Kerem (Har Adar, IL); Simon Ratner (San Francisco, CA); Jasson Arthur Schrock (Mountain View, CA); Ran Tavory (Haifa, IL); Virginia Wang (San Francisco, CA); Leora Wiseman (Zichron Yaakov, IL); Shanmugavelayutham Muthukrishnan (Palo Alto, CA); Mihai Badoiu (New York, NY); Ankur Bhargava (Cambridge, MA); Igor Kofman (San Francisco, CA)
Assignee: Google Inc.
G06F3/0482G06F3/048G06F17/3082H04N7/17318H04N21/25875H04N21/2743H04N21/454H04N21/4781H04N21/47205H04N21/8541H04N21/8583A63F2300/6018A63F2300/632A63F2300/69H04N21/252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,684,432
App. No.
14/023,404
Filed
Sep 10, 2013
Granted
Jun 20, 2017
Kind
B2
Art Unit
2156
USPC
707/782
Abstract

Systems and methods are provided for adding and displaying interactive annotations for existing online hosted videos. A graphical annotation interface allows the creation of annotations and association of the annotations with a video. Annotations may be of different types and have different functionality, such as altering the appearance and/or behavior of an existing video, e.g. by supplementing it with text, allowing linking to other videos or web pages, or pausing playback of the video. Authentication of a user desiring to perform annotation of a video may be performed in various manners, such as by checking a uniform resource locator (URL) against an existing list, checking a user identifier against an access list, and the like. As a result of authentication, a user is accorded the appropriate annotation abilities, such as full annotation, no annotation, or annotation restricted to a particular temporal or spatial portion of the video.

Claims (54)

1. A computer-implemented method comprising:

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types;

receiving a selection from the user of one of the annotation types;

providing to the user a second web-based user interface portion comprising at least one input area for specifying a link for a new annotation for the visual object;

receiving a request from the user to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the link for the annotation;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video;

adding the annotation to an annotation database in association with the digital video such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object, and such that selection of the annotation redirects to a target of the link; and

responsive to receiving a request for the digital video from a client device:

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

2. The computer-implemented method of claim 1 , further comprising determining, by the computer, whether the user is authorized to annotate the digital video.

3. The computer-implemented method of claim 2 , wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises comparing a URL associated with the user to a URL associated with the digital video.

4. The computer-implemented method of claim 2 , wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises determining whether the user is on a list of users authorized to perform annotation for the digital video.

5. The computer-implemented method of claim 2 , wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises monitoring actions of a contributor of the digital video with respect to the user.

6. The computer-implemented method of claim 2 , wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises monitoring actions of other users with respect to the user.

7. The computer-implemented method of claim 2 , further comprising determining, by the computer, whether the user is authorized to annotate a particular temporal or spatial portion of the digital video.

8. The computer-implemented method of claim 2 , wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises determining whether an owner of the digital video has disabled annotation for the digital video.

9. The computer-implemented method of claim 1 , further comprising adding a pause annotation at a specified time within the digital video, the pause annotation causing playback of the digital video to halt when the specified time is reached.

10. The computer-implemented method of claim 1 , wherein the annotation has a graphical appearance that when selected displays information associated with the identified visual object.

11. The computer-implemented method of claim 1 , further comprising:

responsive to receiving a request for the digital video from a viewer:

identifying annotations associated with the digital video;

filtering the identified annotations by the identity of a viewer, thereby producing a modified set of annotations;

providing the modified set of annotations to the viewer.

12. The computer-implemented method of claim 1 , wherein the target of the link is a target video and the link separately encodes both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.

13. The computer-implemented method of claim 1 , wherein the target of the link is a web page for a video channel of a contributing user, the video channel comprising a set of videos contributed by the contributing user.

14. A non-transitory computer-readable storage medium having executable computer program instructions embodied therein, the instructions when executed by a processor performing actions comprising:

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a web-based user interface for annotating the digital video;

receiving a request from the user to add an annotation to the visual object;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video; and

adding the annotation to an annotation database in association with the digital video such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object; and

responsive to receiving a request for the digital video from a client device:

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the request to add the annotation comprises a designation of a link for the annotation, wherein the target of the link is a target video, the link separately encoding both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.

16. The non-transitory computer-readable storage medium of claim 14 , the instructions when executed by the processor performing actions comprising adding a pause annotation at a specified time within the digital video, the pause annotation causing playback of the digital video to halt when the specified time is reached.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the annotation has a graphical appearance that when selected displays information associated with the identified visual object.

18. A computer system comprising:

a computer processor;

an annotation database storing annotation data; and

a non-transitory computer-readable storage medium having executable computer program instructions embodied therein, the instructions when executed by the computer processor performing actions comprising:

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types;

receiving a selection from the user of one of the annotation types;

providing to the user a second web-based user interface portion comprising at least one input area for specifying a link for a new annotation for the visual object;

receiving a request from the user to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the link for the annotation;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video; and

associating the annotation with the digital video in the annotation database, such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object, and such that selection of the annotation redirects to a target video of the link; and

responsive to receiving a request for the digital video from a client device:

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

19. The computer system of claim 18 , wherein the target of the link is a target video, wherein the link separately encodes both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.

Assignments (3)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER FROM 12388365 TO 14023404 PREVIOUSLY RECORDED ON REEL 042383 FRAME 0875. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT DOCUMENT. Recorded Jun 3, 2017
From: FINK, MICHAEL; JUNEE, RYAN; BAR, SIGALIT; BARZILAI, AVIAD; ELIAS, ISAAC; FRUMAR, JULIAN; HO, HERBERT; KEREM, NIR; RATNER, SIMON; SCHROCK, JASSON ARTHUR; TAVORY, RAN; WANG, VIRGINIA; WISEMAN, LEORA; MUTHUKRISHNAN, SHANMUGAVELAYUTHAM; BADOIU, MIHAI; BHARGAVA, ANKUR; KOFMAN, IGOR
To: GOOGLE INC.
Reel/Frame 042676/0523 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2017
From: FINK, MICHAEL; JUNEE, RYAN; BAR, SIGALIT; BARZILAI, AVIAD; ELIAS, ISAAC; FRUMAR, JULIAN; HO, HERBERT; KEREM, NIR; RATNER, SIMON; SCHROCK, JASSON ARTHUR; TAVORY, RAN; WANG, VIRGINIA; WISEMAN, LEORA; MUTHUKRISHNAN, SHANMUGAVELAYUTHAM; BADOIU, MIHAI; BHARGAVA, ANKUR; KOFMAN, IGOR
To: GOOGLE INC.
Reel/Frame 042383/0875 →
Continuity (3)
Continuation 12388365 · Feb 18, 2009
Provisional Application 61058459 · Jun 3, 2008
Related Publication 20140019862A1 · Jan 16, 2014