IP Library Granted Patent US 8,948,515
Granted Patent B2
US 8,948,515 · App. 13/212,215 · Granted Feb 3, 2015

Method and system for classifying one or more images

Inventors: Oren Boiman (Givat Brener, IL); Alex Rav-Acha (Modi'in, IL)
Assignee: Sightera Technologies Ltd.
G11B27/28G11B27/329G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,948,515
App. No.
13/212,215
Granted
Feb 3, 2015
Kind
B2
Abstract

A method for determining a predictability of a media entity portion, the method includes: receiving or generating (a) reference media descriptors, and (b) probability estimations of descriptor space representatives given the reference media descriptors; wherein the descriptor space representatives are representative of a set of media entities; and calculating a predictability score of the media entity portion based on at least (a) the probability estimations of the descriptor space representatives given the reference media descriptors, and (b) relationships between the media entity portion descriptors and the descriptor space representatives. A method for processing media streams, the method may include: applying probabilistic non-parametric process on the media stream to locate media portions of interest; and generating metadata indicative of the media portions of interest.

Claims (39)

1. A method for classifying at least one image, the method comprises:

partitioning the at least one image to multiple media entities or receiving a partition information indicative of a partition of the at least one image to multiple media entities;

receiving or generating (a) media class descriptors for each media entity class out of a set of media entity classes, and (b) probability estimations of descriptor space representatives given each of the media entity classes; wherein the descriptor space representatives are representative of a set of media entities;

calculating, for each pair of media entity and media class, a predictability score based on (a) the probability estimations of the descriptor space representatives given the media class descriptors of the media class, and (b) relationships between descriptors of the media entity and the descriptor space representatives;

classifying each media entity of the multiple media entities based on predictability scores of the media entity given each media class; and

providing at least one image classification, based on classes of each of the multiple media entities.

2. The method according to claim 1 wherein the at least one image comprises multiple images and wherein the classifying comprising classifying each image.

3. The method according to claim 1 wherein the at least one image forms a video stream.

4. The method according to claim 1 , wherein the at least one image is a single image.

5. The method according to claim 1 , comprising applying a human body detection algorithm on the at least one image to provide human body detection results; and partitioning the at least one image based on the human body detection results.

6. The method according to claim 1 , comprising applying a face detection algorithm on the at least one image to provide face detection results; and partitioning the at least one image based on the face detection results.

7. The method according to claim 1 , comprising applying a human skin detection algorithm on the at least one image to provide human skin detection results; and partitioning the at least one image based on the human skin detection results.

8. The method according to claim 1 , comprising determining whether the at least one image should be prevented from being displayed.

9. The method according to claim 1 , comprising defining a dominant class and classifying an image out of the at least one image as belonging to the dominant class if at least one media entity of the image is classified as belonging to the dominant class.

10. The method according to claim 1 , comprising executing multiple iterations of a sequence of stages that comprises the stages of receiving or generating, calculating, and classifying; wherein different iterations differ from each other by accuracy of execution and speed of execution.

11. The method according to claim 10 , wherein the decision of whether to apply each iteration is based on the output of previous iterations.

12. The method according to claim 10 , comprising filtering out an image based on an outcome of at least one iteration of the multiple iterations.

13. The method according to claim 1 comprising:

detecting a human organ;

determining, based on a location of the human organ, an expected location of at least one other human organ; and

verifying the expected location of the at least one other human organ by processing at least one portion of an image that corresponds to the expected location of the at least one other human organ.

14. The method according to claim 1 , comprising executing multiple iterations of a sequence of stages that comprises the stages of receiving or generating, calculating, and classifying; wherein different iterations differ from each other by a complexity level.

15. The method according to claim 14 , wherein at least two iterations further comprise partitioning the at least one image.

16. The method according to claim 14 , comprising performing multiple iterations, each iteration associated with a higher complexity level.

17. The method according to claim 14 , wherein the decision of whether to apply each iteration is based on the output of previous iterations.

18. The method according to claim 1 , comprising executing multiple iterations of a sequence of stages that comprises the stages of receiving or generating, calculating, and classifying; wherein different iterations differ from each other by a number of descriptors of the media entities.

19. The method according to claim 17 , wherein at least two iterations further comprise partitioning the at least one image.

20. The method according to claim 10 , comprising performing multiple iterations while increasing the number of descriptors of the media entities.

21. The method according to claim 1 , comprising executing multiple iterations of a sequence of stages that comprises the stages of receiving or generating, calculating, and classifying; wherein different iterations differ from each other by a selection of media class descriptors that are taken into account during the iteration.

22. The method according to claim 18 , wherein at least two iterations further comprise partitioning the at least one image.

23. The method according to claim 1 , comprising executing multiple iterations of a sequence of stages that comprises the stages of receiving or generating, calculating, and classifying; wherein different iterations differ from each other by descriptors of the media entity that are taken into account during the iteration.

24. The method according to claim 23 , wherein at least two iterations further comprise partitioning the at least one image.

25. The method according to claim 1 , comprising applying a motion detection algorithm on the at least one image to provide motion detection results; and partitioning the at least one image based on the motion detection results.

26. A computer program product that comprises a non-transitory computer readable medium that stores instructions for:

partitioning the at least one image to multiple media entities or receiving a partition information indicative of a partition of the at least one image to multiple media entities;

receiving or generating (a) media class descriptors for each media entity class out of a set of media entity classes, and (b) probability estimations of descriptor space representatives given each of the media entity classes; wherein the descriptor space representatives are representative of a set of media entities;

calculating, for each pair of media entity and media class, a predictability score based on (a) the probability estimations of the descriptor space representatives given the media class descriptors of the media class, and (b) relationships between descriptors of the media entity and the descriptor space representatives;

classifying each media entity of the multiple media entities based on predictability scores of the media entity given each media class; and

providing at least one image classification, based on classes of each of the multiple media entities.

Assignments (10)
SECURITY INTEREST Recorded May 4, 2026
From: VIMEO.COM, INC.
To: INTESA SANPAOLO S.P.A., AS SECURITY AGENT
Reel/Frame 074553/0001 →
RELEASE OF PATENT SECURITY INTERESTS FILED FEBRUARY 12, 2021 AT REEL/FRAME 055288/0371 Recorded Jul 3, 2023
From: JPMORGAN CHASE BANK, N.A.
To: VIMEO.COM, INC. (FKA VIMEO, INC.)
Reel/Frame 064193/0449 →
CHANGE OF NAME Recorded Jun 25, 2021
From: VIMEO, INC.
To: VIMEO.COM, INC.
Reel/Frame 056754/0261 →
SECURITY AGREEMENT Recorded Feb 12, 2021
From: VIMEO, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 055288/0371 →
RELEASE OF SECURITY INTEREST Recorded Jul 7, 2020
From: KREOS CAPITAL V (EXPERT FUND) LP
To: MAGISTO LTD. (NOW KNOWN AS NOLAN LEGACY LTD)
Reel/Frame 053136/0297 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SERIAL NO. 15/374,023 SHOULD BE 15/012,875 PREVIOUSLY RECORDED ON REEL 041151 FRAME 0899. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 27, 2020
From: MAGISTO LTD.
To: KREOS CAPITAL V (EXPERT FUND) L.P.
Reel/Frame 052497/0880 →
CHANGE OF NAME Recorded Jan 23, 2020
From: SIGHTERA TECHNOLOGIES LTD.
To: MAGISTO LTD.
Reel/Frame 051597/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: MAGISTO LTD.
To: VIMEO, INC.
Reel/Frame 051435/0430 →
SECURITY INTEREST Recorded Feb 2, 2017
From: MAGISTO LTD.
To: KREOS CAPITAL V (EXPERT FUND) L.P.
Reel/Frame 041151/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2013
From: BOIMAN, OREN; RAV-ACHA, ALEXANDER
To: SIGHTERA TECHNOLOGIES LTD
Reel/Frame 031015/0505 →
Continuity (4)
Continuation In Part 13041457 · Mar 7, 2011
Provisional Application 61311524 · Mar 8, 2010
Provisional Application 61374671 · Aug 18, 2010
Related Publication 20120039539A1 · Feb 16, 2012