IP Library Granted Patent US 9,443,146
Granted Patent B2
US 9,443,146 · App. 14/569,778 · Granted Sep 13, 2016

Photo diary

Inventors: Hui Deng (San Ramon, CA); Jin Wang (Hangzhou, CN); Shuaibin Chen (Hangzhou, CN); Lianbo Xu (Hangzhou, CN); Chengping Yang (Jiangsu, CN); Kaixuan Mao (Dublin, CA)
Assignee: Multimedia Image Solution Limited
G06K9/00744G06K9/00288G06K9/00718G06K9/6215G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,443,146
App. No.
14/569,778
Granted
Sep 13, 2016
Kind
B2
Abstract

A method to create a photo diary includes creating an entry for a time period in the photo diary. Creating the entry includes selecting candidate frames from digital videos created or received in the time period. Selecting the candidate frames includes performing people and pet detection on the digital videos, extract frames with people and pets from the digital videos perform people recognition on the frames with people to identify frames with recognized persons. The method further includes sorting the candidate frames with recognized persons and pets into groups based on criteria, selecting representative frames from the groups, and presenting the representative frames in the entry.

Claims (24)

1. A method to create a photo diary, comprising:

receiving user input specifying a frequency for creating entries in the photo diary, the frequency being every day, every several days, every week, or every month;

creating an entry for a time period in the photo diary, comprising:

selecting candidate frames from digital videos created or received in the time period, comprising:

performing people and pet detection on the digital videos;

extract frames with people and pets from the digital videos; and

perform people recognition on the frames with people to identify frames with recognized persons;

sorting the candidate frames with recognized persons and pets into groups based on criteria, wherein sorting the candidate frames with recognized persons and pets into groups based on criteria comprises sorting the frames by time increments, scenarios, and locations;

selecting representative frames from the groups; and

presenting the representative frames in the entry; and

creating another entry in the photo diary for a subsequent time period.

2. The method of claim 1 , further comprising detecting the scenarios and the locations from the candidate frames, wherein detecting the scenarios comprises detecting time and objects in the candidate frames and determining the scenarios based on the time and the objects detected in the candidate frames.

3. The method of claim 1 , further comprising evenly spreading the representative frames across the time increments, the scenarios, and the locations, or setting different priorities for the time increments, the scenarios, and the locations.

4. The method of claim 1 , further comprising sorting the candidate frames into the groups by content similarity and image quality.

5. The method of claim 4 , further comprising comparing contents in the candidate frames and analyzing image qualities of the candidate frames.

6. The method of claim 1 , further comprising:

presenting a calendar view visually indicating dates with the entries in the photo diary; and

in response to user input, presenting a corresponding entry in the photo diary.

7. The method of claim 1 , wherein the entry comprises a photo album view, a timeline view, or a collage view.

8. The method of claim 7 , further comprising deleting one or more of the representative frames from the entry or adding one or more new frames to the entry based on user input.

9. The method of claim 7 , further comprising displaying an enlarged representative frame based on user input.

10. The method of claim 7 , further using a photo album template to generate the photo album view.

11. The method of claim 1 , further comprising combining the photo diary with another photo diary.

12. The method of claim 1 , wherein performing people detection comprises performing face recognition or human characteristic recognition.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2015
From: MULTIMEDIA IMAGE SOLUTION LIMITED
To: HANGZHOU CLOSELI TECHNOLOGY CO., LTD.
Reel/Frame 037322/0473 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2014
From: DENG, HUI; WANG, JIN; CHEN, SHUAIBIN; XU, LIANBO; YANG, CHENGPING; MAO, KAIXUAN
To: MULTIMEDIA IMAGE SOLUTION LIMITED
Reel/Frame 034519/0067 →
Priority Claims (1)
CN 2014 1 0559301 · Oct 20, 2014 · national
Continuity (1)
Related Publication 20160110608A1 · Apr 21, 2016