IP Library Granted Patent US 10,498,799
Granted Patent B2
US 10,498,799 · App. 15/985,807 · Granted Dec 3, 2019

Intelligent routing of media items

Inventors: Matthew D. Zeiler (New York, NY); Keith Ito (New York, NY); Adam L. Berenzweig (New York, NY)
Assignee: CLARIFAI, INC.
H04L67/06H04L67/306H04L67/327
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,498,799
App. No.
15/985,807
Granted
Dec 3, 2019
Kind
B2
Abstract

In certain embodiments, automated routing of media items between user devices may be facilitated. In some embodiments, a routing computer system may automatically obtain images or videos from one or more sources. The routing computer system may perform object recognition on the contents of the images or videos to identify individuals or other objects in the images or videos. The routing computer system may assign first and second images or videos of the images or videos to a first media item group based on (i) the first and second images or videos having similar metadata and (ii) the object recognition identifying an individual or object in the first image or video and an individual or object in the second image or video that are similar to each other. The routing computer system may automatically transmit the first image or video to one or more user devices based on the assignment.

Claims (61)

1. A system for facilitating routing of media items between user devices, the system comprising:

a routing computer system comprising one or more processors programmed with computer program instructions that, when executed, cause the routing computer system to:

obtain images or videos from one or more sources;

obtain, from the images or videos, metadata associated with the images or videos;

perform object recognition on contents of the images or videos to identify individuals or other objects in the images or videos;

assign first and second images or videos of the images or videos to a first media item group based on (i) the first and second images or videos having similar metadata and (ii) the object recognition identifying an individual or object in the first image or video and an individual or object in the second image or video that are similar to each other;

automatically transmit the first image or video to one or more user devices of one or more users based on (i) the assignment of the first image or video to the first media item group and (ii) the one or more users being associated with the first media item group, the first image or video being automatically transmitted to the one or more user devices without receiving a user input specifically identifying the first image or video to be provided to the one or more user devices;

determine a group criteria for the first media item group based on the assignment of the first and second images or videos to the first media item group;

generate one or more advertisements based on the group criteria;

assign the one or more advertisements to the first media item group; and

cause the one or more advertisements to be provided to the one or more user devices of the one or more users based on (i) the assignment of the one or more advertisements to the first media item group and (ii) the one or more users being associated with the first media item group.

2. The system of claim 1 , wherein the routing computer system is caused to:

determine a particular date or time at which a given image or video was taken by recognizing a configuration of objects in the given image or video known to have uniquely occurred at a particular date or time.

3. The system of claim 1 , wherein obtaining the images or videos comprises automatically obtaining the first image or video from at least one source of the one or more sources without the at least one source receiving a user input specifically identifying the first image or video to be provided to the routing computer system.

4. The system of claim 1 , wherein the one or more sources comprises a user device, and wherein obtaining the images or videos comprises automatically obtaining the first image or video from the user device without the user device receiving a user input specifically identifying the first image or video to be provided to the routing computer system.

5. The system of claim 1 , wherein performing object recognition on the contents of the images or videos comprises recognizing faces in the images or videos, and

wherein assigning the first and second images or videos to the first media item group is based (i) a face in the first image or video being similar to a face in the second image or video and (ii) the metadata associated with the first image or video being similar to the metadata associated with the second image or video.

6. The system of claim 1 , wherein the routing computer system is caused to:

detect motion or a change in lighting conditions in the first image or video; and

generate one or more suggested actions to be taken by the one or more users based on the detected motion or change in lighting conditions in the first image or video.

7. The system of claim 6 , wherein the routing computer system is caused to:

detect motion in the second image or video; and

generate one or more additional suggested actions to be taken by a user based on the detected motion in the second image or video.

8. The system of claim 6 , wherein the routing computer system is caused to:

detect a change in lighting conditions in the second image or video; and

generate one or more additional suggested actions to be taken by a user based on the detected change in lighting conditions in the second image or video.

9. A method for facilitating routing of media items between user devices, the method being implemented by a routing computer system comprising one or more processor executing computer program instructions that, when executed, perform the method, the method comprising:

obtaining images or videos from one or more sources;

performing object recognition on contents of the images or videos to identify individuals or other objects in the images or videos;

assigning first and second images or videos of the images or videos to a first media item group based on (i) the first and second images or videos having similar metadata and (ii) the object recognition identifying an individual or object in the first image or video and an individual or object in the second image or video that are similar to each other;

automatically transmit the first image or video to one or more user devices of one or more users based on (i) the assignment of the first image or video to the first media item group and (ii) the one or more users being associated with the first media item group, the first image or video being automatically transmitted to the one or more user devices without receiving a user input specifically identifying the first image or video to be provided to the one or more user devices;

determining a group criteria for the first media item group based on the assignment of the first and second images or videos to the first media item group;

generating one or more advertisements based on the group criteria;

assigning the one or more advertisements to the first media item group; and

causing the one or more advertisements to be provided to the one or more user devices of the one or more users based on (i) the assignment of the one or more advertisements to the first media item group and (ii) the one or more users being associated with the first media item group.

10. The method of claim 9 , further comprising:

determining a particular date or time at which a given image or video was taken by recognizing a configuration of objects in the given image or video known to have uniquely occurred at a particular date or time.

11. The method of claim 9 , wherein obtaining the images or videos comprises automatically obtaining the first image or video from at least one source of the one or more sources without the at least one source receiving a user input specifically identifying the first image or video to be provided to the routing computer system.

12. The method of claim 9 , wherein the one or more sources comprises a user device, and wherein obtaining the images or videos comprises automatically obtaining the first image or video from the user device without the user device receiving a user input specifically identifying the first image or video to be provided to the routing computer system.

13. The method of claim 9 , wherein performing object recognition on the contents of the images or videos comprises recognizing faces in the images or videos, and

wherein assigning the first and second images or videos to the first media item group is based (i) a face in the first image or video being similar to a face in the second image or video and (ii) the metadata associated with the first image or video being similar to the metadata associated with the second image or video.

14. The method of claim 9 , further comprising:

detecting motion or a change in lighting conditions in the first image or video; and

generating one or more suggested actions to be taken by the one or more users based on the detected motion or change in lighting conditions in the first image or video.

15. A system for facilitating routing of media items between user devices, the system comprising:

a routing computer system comprising one or more processors programmed with computer program instructions that, when executed, cause the routing computer system to:

automatically obtain images or videos from one or more sources without the one or more sources receiving a user input specifically identifying the images or videos to be provided to the routing computer system;

perform object recognition on contents of the images or videos to identify individuals or other objects in the images or videos;

assign first and second images or videos of the images or videos to a first media item group based on (i) the first and second images or videos having similar metadata and (ii) the object recognition identifying an individual or object in the first image or video and an individual or object in the second image or video that are similar to each other;

automatically transmit the first image or video to one or more user devices of one or more users based on (i) the assignment of the first image or video to the first media item group and (ii) the one or more users being associated with the first media item group, the first image or video being automatically transmitted to the one or more user devices without receiving a user input specifically identifying the first image or video to be provided to the one or more user devices;

determine a group criteria for the first media item group based on the assignment of the first and second images or videos to the first media item group;

generate one or more advertisements based on the group criteria;

assign the one or more advertisements to the first media item group; and

cause the one or more advertisements to be provided to the one or more user devices of the one or more users based on (i) the assignment of the one or more advertisements to the first media item group and (ii) the one or more users being associated with the first media item group.

16. The system of claim 15 , wherein the routing computer system is caused to:

determine a particular date or time at which a given image or video was taken by recognizing a configuration of objects in the given image or video known to have uniquely occurred at a particular date or time.

17. The system of claim 15 , wherein performing object recognition on the contents of the images or videos comprises recognizing faces in the images or videos, and

wherein assigning the first and second images or videos to the first media item group is based (i) a face in the first image or video being similar to a face in the second image or video and (ii) the metadata associated with the first image or video being similar to the metadata associated with the second image or video.

18. The system of claim 15 , wherein the routing computer system is caused to:

detect motion or a change in lighting conditions in the first image or video; and

generate one or more suggested actions to be taken by the one or more users based on the detected motion or change in lighting conditions in the first image or video.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2026
From: CLARIFAI, INC.
To: NEBIUS BV
Reel/Frame 075712/0109 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2018
From: ZEILER, MATTHEW D.; ITO, KEITH; BERENZWEIG, ADAM L.
To: CLARIFAI, INC.
Reel/Frame 045868/0387 →
Continuity (3)
Continuation 15002221 · Jan 20, 2016
Provisional Application 62107021 · Jan 23, 2015
Related Publication 20180270293A1 · Sep 20, 2018