IP Library Granted Patent US 9,727,546
Granted Patent B1
US 9,727,546 · App. 13/902,307 · Granted Aug 8, 2017

Creating a narrative description of media content and applications thereof

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,727,546
App. No.
13/902,307
Granted
Aug 8, 2017
Kind
B1
Abstract

This invention relates to creating a narrative description of media content. In an embodiment, a computer-implemented method describes content of a group of images. The group of images includes a first image and a second image. A first object in the first image is recognized to determine a first content data. A second object in the second image is recognized to determine a second content data. Finally, a narrative description of the group of images is determined according to a parameterized template and the first and second content data.

Claims (42)

1. A computer-implemented method comprising:

recognizing a first object in a first image to determine a first content data that identifies the first object, wherein recognizing the first object comprises recognizing a first landmark;

recognizing a second object in a second image to determine a second content data that identifies the second object, wherein recognizing the second object comprises recognizing a second landmark;

determining a parameter value based at least in part on the first content data and the second content data, wherein determining the parameter value comprises identifying a first location of the first landmark and a second location of the second landmark; and

generating a narrative description according to a parameterized template, wherein the narrative description includes the parameter value.

2. The computer-implemented method of claim 1 , wherein determining the parameter value further comprises:

determining a region that encompasses the first location and the second location based on a hierarchy of regions.

3. The computer-implemented method of claim 2 , wherein the region is the smallest region in the hierarchy of regions that encompasses the first location and the second location.

4. The computer-implemented method of claim 1 , further comprising:

determining a third location associated with a third image, based at least in part on metadata of the third image, wherein determining the parameter value is further based on the third location.

5. The computer-implemented method of claim 1 , further comprising:

inserting the parameter value into the parameterized template.

6. The computer-implemented method of claim 1 , further comprising:

determining a first timestamp associated with the first image;

determining a second timestamp associated with the second image;

calculating a time period that encompasses the first timestamp and the second timestamp; and

inserting the time period into the parameterized template.

7. A computer-implemented method comprising:

recognizing a first object in a first image to determine a first content data that identifies the first object, wherein recognizing the first object comprises recognizing a first face and wherein the first content data corresponds to a first name associated with the first face;

recognizing a second object in a second image to determine a second content data that identifies the second object, wherein recognizing the second object comprises recognizing a second face and wherein the second content data corresponds to a second name associated with the second face;

determining a parameter value based at least in part on the first content data and the second content data, wherein the determining comprises aggregating the first name and the second name into a list; and

generating a narrative description according to a parameterized template, wherein the narrative description includes the parameter value.

8. The computer-implemented method of claim 7 , further comprising inserting the parameter value into the parameterized template.

9. The computer-implemented method of claim 7 , further comprising:

determining a first timestamp associated with the first image;

determining a second timestamp associated with the second image;

calculating a time period that encompasses the first timestamp and the second timestamp; and

inserting the time period into the parameterized template.

10. A non-transitory computer-readable medium with instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising:

recognizing a first object in a first image to determine a first content data that identifies the first object, wherein recognizing the first object comprises recognizing a first landmark;

recognizing a second object in a second image to determine a second content data that identifies the second object, wherein recognizing the second object comprises recognizing a second landmark;

determining a parameter value based at least in part on the first content data and the second content data, wherein determining the parameter value comprises identifying a first location of the first landmark and a second location of the second landmark; and

generating a narrative description according to a parameterized template, wherein the narrative description includes the parameter value.

11. The non-transitory computer-readable medium of claim 10 , wherein determining the parameter value further comprises determining a region that encompasses the first location and the second location based on a hierarchy of regions.

12. The non-transitory computer-readable medium of claim 11 , wherein the region is the smallest region in the hierarchy of regions that encompasses the first location and the second location.

13. The non-transitory computer-readable medium of claim 10 , with further instructions stored thereon that cause the processor to perform operations comprising determining a third location associated with a third image, based at least in part on metadata of the third image, wherein determining the parameter value is further based on the third location.

14. The non-transitory computer-readable medium of claim 10 , with further instructions stored thereon that cause the processor to perform operations comprising inserting the parameter value into the parameterized template.

15. The non-transitory computer-readable medium of claim 10 , with further instructions stored thereon that cause the processor to perform operations comprising:

determining a first timestamp associated with the first image;

determining a second timestamp associated with the second image;

calculating a time period that encompasses the first timestamp and the second timestamp; and

inserting the time period into the parameterized template.

Assignments (2)
CHANGE OF NAME Recorded Dec 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044695/0115 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2017
From: NOSHADI, HYDUKE
To: GOOGLE INC.
Reel/Frame 043746/0292 →