IP Library Granted Patent US 11,093,839
Granted Patent B2
US 11,093,839 · App. 15/953,299 · Granted Aug 17, 2021

Media object grouping and classification for predictive enhancement

Inventors: David Ayman Shamma (San Francisco, CA); Lyndon Kennedy (San Francisco, CA); Francine Chen (Menlo Park, CA); Yin-Ying Chen (Sunnyvale, CA)
Assignee: FUJIFILM BUSINESS INNOVATION CORP.
G06N5/04G06F16/5866
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,093,839
App. No.
15/953,299
Granted
Aug 17, 2021
Kind
B2
Abstract

A computer implemented method of grouping media objects is provided, as well as systems, interfaces and devices therefor. The method includes generating a group from the media objects based on a combination of a script of sequential events and an actor associated with one or more of the media objects in the script, segmenting the group into segments each including one or more of the media objects, based on clustering or classification, providing titling and captioning for the segments, and generating filter and annotation recommendations based on knowledge associations in the media objects, data, and the combination of the script and the actor, across the media objects of the group.

Claims (30)

1. A computer implemented method of grouping media objects, comprising:

generating a group from the media objects based on a combination of a script of sequential events and an actor associated with one or more of the media objects in the script;

segmenting the group into segments each including one or more of the media objects, based on clustering or classification;

providing titling and captioning for the segments; and

generating recommendations based on knowledge associations in the media objects, data, and the combination of the script and the actor, across the media objects of the group.

2. The computer implemented method of claim 1 , wherein the recommendations comprise at least one of filter effect recommendations and sticker recommendations, and the recommendations are predictive based on data associated with a knowledge base.

3. The computer implemented method of claim 2 , wherein the filter effect recommendations are based on the data including online feedback received from one or more other users.

4. The computer implemented method of claim 2 , wherein the sticker recommendations are based on the data including information associated with the images.

5. The computer implemented method of claim 2 , wherein the recommendations comprise one or more of a type, a location and a density of at least one of a sticker, a text box and an emoji.

6. The computer implemented method of claim 1 , wherein the generating the group further comprises basing the grouping on a layout of the actor and one or more other actors in the group of media objects.

7. A non-transitory computer readable medium including a processor configured to execute instructions stored in a storage, the instructions comprising:

generating a group from the media objects based on a combination of a script of sequential events and an actor associated with one or more of the media objects in the script;

segmenting the group into segments each including one or more of the media objects, based on clustering or classification;

providing titling and captioning for the segments; and

generating recommendations based on knowledge associations in the media objects, data, and the combination of the script and the actor, across the media objects of the group.

8. The non-transitory computer readable medium of claim 7 , wherein the recommendations comprise at least one of filter effect recommendations and annotation recommendations, and the recommendations are predictive based on data associated with a knowledge base.

9. The non-transitory computer readable medium of claim 8 , wherein the filter effect recommendations are based on the data including online feedback received from one or more other users.

10. The non-transitory computer readable medium of claim 8 , wherein the sticker recommendations are based on the data including information associated with the images.

11. The non-transitory computer readable medium of claim 8 , wherein the recommendations comprise one or more of a type, a location and a density of at least one of a sticker, a text box and an emoji.

12. The non-transitory computer readable medium of claim 7 , wherein the generating the group further comprises basing the grouping on a layout of the actor and one or more other actors in the group of media objects.

13. An image capture device configured to capture one or more images, and generate media objects, the image capture device including a processor and storage, the processor performing:

generating a group from the media objects based on a combination of a script of sequential events and an actor associated with one or more of the media objects in the script;

segmenting the group into segments each including one or more of the media objects, based on clustering or classification;

providing titling and captioning for the segments; and

generating recommendations based on knowledge associations in the media objects, data, and the combination of the script and the actor, across the media objects of the group.

14. The image capture device of claim 13 , wherein the recommendations comprise at least one of filter effect recommendations and annotation recommendations, and the recommendations are predictive based on data associated with a knowledge base.

15. The image capture device of claim 14 , wherein the filter effect recommendations are based on the data including online feedback received from one or more other users.

16. The image capture device of claim 14 , wherein the sticker recommendations are based on the data including information associated with the images.

17. The image capture device of claim 13 , wherein the recommendations comprise one or more of a type, a location and a density of at least one of a sticker, a text box and an emoji.

18. The image capture device of claim 13 , wherein the generating the group further comprises basing the grouping on a layout of the actor and one or more other actors in the group of media objects.

Assignments (2)
CHANGE OF NAME Recorded May 25, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056392/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2018
From: SHAMMA, DAVID AYMAN; KENNEDY, LYNDON; CHEN, FRANCINE; CHEN, YIN-YING
To: FUJI XEROX CO., LTD.
Reel/Frame 045539/0797 →
Continuity (1)
Related Publication 20190318252A1 · Oct 17, 2019