IP Library Granted Patent US 8,799,756
Granted Patent B2
US 8,799,756 · App. 14/205,047 · Granted Aug 5, 2014

Systems and methods for generating autoflow of content based on image and user analysis as well as use case data for a media-based printable product

Inventors: Aryk Erwin Grosz (Palo Alto, CA); Anthony Jan Fung Lai (Mountain View, CA); Dan Schultz (Sunnyvale, CA); Denys Barushev (Mountain View, CA); Anton Vladimirovich Astashov (Palo Alto, CA)
Assignee: Interactive Memories, Inc.
G06K9/6217H04L67/141G06K9/00268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,799,756
App. No.
14/205,047
Granted
Aug 5, 2014
Kind
B2
Abstract

In some embodiments, a server for creating photo-based projects is disclosed. The server executes a method for establishing a client-server connection between the server and a user-operated computer connected to the network, receiving images from the computer and storing the images in the a data repository, receiving a use-case identifier, performing photo analysis on the images, comprising: identifying similar images, identifying faces in the images, identifying objects in the images, identifying undesirable images and identifying relevant portions of the images, performing use-case specific heuristics on the images, comprising: grouping similar images, grouping images having identical faces, grouping images having identical objects, removing undesirable images, and cropping images to highlight relevant portions of said images, and, generating an ordered project subsequent to execution of the use-case specific heuristics, wherein the ordered project comprises the images placed in a particular order and pre-processed for printing in book form.

Claims (54)

1. A server, communicably coupled with a communications network, for automatically creating a photo-based project based on photo analysis and a use case context of the photo-based project, the server comprising a processor, a data repository having multimedia content, and a non-transitory physical medium comprising executable instructions for:

establishing a client-server connection between the server and a user-operated computer connected to the communications network;

receiving a plurality of images from the user-operated computer, reading embedded metadata from the plurality of images, and storing said plurality of images and the embedded metadata in the data repository;

receiving a use-case identifier identifying the use case context for which the photo-based project would be utilized from the user-operated computer;

performing photo analysis on the plurality of images in the data repository at the direction of the user-operated computer, wherein the photo analysis comprises one or more of: identifying similar images, identifying faces in the images, identifying objects in the images, identifying dimensions of the images, identifying undesirable images, and identifying relevant portions of the images, wherein the use-case identifier is utilized to guide the photo analysis;

customizing the photo-based project automatically based on the use-case identifier and the results of the photo analysis performed on the plurality of images, wherein one or more automatic customization actions are performed comprising one or more of: matching images automatically to a use case specific theme, grouping similar images, grouping images having identical faces, grouping images having identical objects, removing undesirable images, and cropping images to highlight relevant portions of said images;

placing the plurality of images automatically in a particular layout of the photo-based project based on the use-case identifier and the results of the photo analysis performed;

adding text to the particular layout based on a subset of said embedded metadata; and

generating a printed project corresponding to the particular layout at the direction of the user-operated computer.

2. The server of claim 1 , wherein said photo analysis further comprises one or more of: identifying images with an incorrect orientation, identifying images with incorrect color, brightness or contrast, and identifying images with red-eye.

3. The server of claim 2 , wherein said physical medium further stores executable instructions for:

performing correction functions on the plurality of images subsequent to said photo analysis at the direction of the user-operated computer, wherein the correction functions comprise one or more of: orienting images to an appropriate orientation, adjusting images to correct color, brightness or contrast, and removing red-eye from images.

4. The server of claim 1 , wherein said physical medium further stores executable instructions for:

organizing images based on the embedded metadata from the plurality of images.

5. The server of claim 1 , wherein said physical medium further stores executable instructions for:

reading embedded location metadata from the plurality of images;

performing a lookup of additional location data based on the embedded location metadata; and

adding text boxes to the ordered project reflecting said additional location data.

6. The server of claim 1 , wherein the printed project is selected from the group consisting of a photo-book, a photo-card, and a photo-calendar.

7. The server of claim 1 , wherein the use-case context is selected from the group consisting of a wedding, a night out, an event with friends, a baby, a year in review, a trip, a water-related event, a beach trip, a lake trip, a pool trip, a snow-related event, a ski trip, and a road trip.

8. The server of claim 1 , wherein the use case context identifies a wedding, and wherein said photo analysis further comprises one or more of: identifying images that include a wedding cake, identifying images that include an altar, and identifying images that include a bride and a groom.

9. The server of claim 8 , wherein said automatic customization actions further comprise one or more of: grouping images that include the wedding cake, grouping images that include the altar, and grouping images that include the bride and the groom.

10. The server of claim 1 , wherein said physical medium further stores executable instructions for:

performing user analysis on an expected user of the photo-based project.

11. The server of claim 10 , wherein said physical medium further stores executable instructions for:

obtaining user data about the expected user of the photo-based project by utilizing data from a social media platform.

12. The server of claim 10 , wherein said physical medium further stores executable instructions for:

utilizing the user analysis about the expected user to optimize the photo analysis.

13. A non-transitory, computer-readable storage medium storing executable instructions, which when executed by a computing device, cause the computing device to perform a method for automatically creating a photo-based project based on photo analysis and a use case context of the photo-based project over a communications network, the storage medium comprising executable instructions for:

establishing a client-server connection between the server and a user-operated computer connected to the network;

receiving a plurality of images from the user-operated computer, reading embedded metadata from the plurality of images, and storing said plurality of images and the embedded metadata in the data repository;

receiving a use-case identifier identifying the use case context for which the photo-based project would be utilized from the user-operated computer;

performing photo analysis on the plurality of images in the data repository at the direction of the user-operated computer, wherein the photo analysis comprises one or more of: identifying similar images, identifying faces in the images, identifying objects in the images, identifying dimensions of the images, identifying undesirable images, and identifying relevant portions of the images, wherein the use-case identifier is utilized to guide the photo analysis;

customizing the photo-based project automatically based on the use-case identifier and the results of the photo analysis performed on the plurality of images, wherein one or more automatic customization actions are performed comprising one or more of: matching images automatically to a use case specific theme, grouping similar images, grouping images having identical faces, grouping images having identical objects, removing undesirable images, and cropping images to highlight relevant portions of said images;

placing the plurality of images automatically in a particular layout of the photo-based project based on the use-case identifier and the results of the photo analysis performed;

adding text to the particular layout based on a subset of said embedded metadata; and

generating a printed project corresponding to the particular layout at the direction of the user-operated computer.

14. The storage medium of claim 13 , wherein said storage medium further stores executable instructions for:

identifying images with an incorrect orientation, identifying images with incorrect color, brightness or contrast, and identifying images with red-eye.

15. The storage medium of claim 14 , wherein said storage medium further stores executable instructions for:

performing correction functions on the plurality of images subsequent to said photo analysis at the direction of the at least one user-operated computer, wherein the correction functions comprise one or more of: orienting images to an appropriate orientation, adjusting images to correct color, brightness or contrast, and removing red-eye from images.

16. The storage medium of claim 13 , wherein said storage medium further stores executable instructions for:

organizing images based on the embedded metadata from the plurality of images.

17. The storage medium of claim 13 , wherein the use-case context is selected from the group consisting of a wedding, a night out, an event with friends, a baby, a year in review, a trip, a water-related event, a beach trip, a lake trip, a pool trip, a snow-related event, a ski trip, and a road trip.

18. A method for automatically creating a photo-based project based on photo analysis and a use case context of the photo-based project, comprising:

receiving a plurality of images from a user-operated computer, reading embedded metadata from the plurality of images, and storing said plurality of images and the embedded metadata in a data repository;

receiving a use-case identifier identifying the use case context for which the photo-based project would be utilized;

performing photo analysis, guided by the use-case identifier, on the plurality of images in the data repository, the photo analysis comprising one or more of: identifying similar images, identifying faces in the images, identifying objects in the images, identifying dimensions of the images, identifying undesirable images, and identifying relevant portions of the images;

customizing the photo-based project automatically based on the use-case identifier and the results of the photo analysis performed by performing one or more automatic customization actions comprising one or more of: grouping similar images, grouping images having identical faces, grouping images having identical objects, removing undesirable images, and cropping images to highlight relevant portions of said images;

placing the plurality of images automatically in a particular layout of the photo-based project based on the use-case identifier and the results of the photo analysis performed;

adding text to the particular layout based on a subset of said embedded metadata; and

generating a printed project corresponding to the particular layout.

19. The method of claim 18 , wherein the printed project is selected from the group consisting of a photo-book, a photo-card, and a photo-calendar.

20. The method of claim 18 , wherein the use-case context is selected from the group consisting of a wedding, a night out, an event with friends, a baby, a year in review, a trip, a water-related event, a beach trip, a lake trip, a pool trip, a snow-related event, a ski trip, and a road trip.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2014
From: GROSZ, ARYK ERWIN; SCHULTZ, DANIEL THANH; ASTASHOV, ANTON VLADIMIROVICH; BARUSHEV, DENYS; LAI, ANTHONY JAN FUNG
To: INTERACTIVE MEMORIES, INC.
Reel/Frame 033397/0509 →
Continuity (4)
Continuation In Part 13771393 · Feb 20, 2013
Provisional Application 61776089 · Mar 11, 2013
Provisional Application 61707007 · Sep 28, 2012
Related Publication 20140193047A1 · Jul 10, 2014