IP Library Granted Patent US 10,607,355
Granted Patent B2
US 10,607,355 · App. 14/608,880 · Granted Mar 31, 2020

Method and system for determining the dimensions of an object shown in a multimedia content item

Inventors: Igal Raichelgauz (New York, NY); Karina Odinaev (New York, NY); Yehoshua Y. Zeevi (Haifa, IL)
Assignee: Cortica, Ltd.
G06T7/60G06F16/434G06F16/7837G06F16/957G06K9/64G06T1/0021G09B19/0092H04H60/48H04H60/59H04N7/17318H04N21/25891H04N21/2668H04N21/466H04N21/8106H04H2201/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,355
App. No.
14/608,880
Granted
Mar 31, 2020
Kind
B2
Abstract

A method and system for determining at least a size dimension of objects shown in multimedia content items are presented. The method includes receiving an input multimedia content item; identifying objects shown in the multimedia content item; generating at least a first signature for at least a first object of the plurality of objects and at least a second signature for at least a second object; identifying at least one concept that matches the at least a first object; determining an actual size of the first object respective of the match to the at least one concept; determining a size scale between the first object and the second object using the at least a first signature and the at least a second signature; and determining the at least size dimension of the second object respective of the size scale and the actual size of the first object.

Claims (35)

1. A method for determining at least a size dimension of objects shown in multimedia content items, comprising:

receiving an input multimedia content item;

identifying a plurality of objects shown in the input multimedia content item;

generating at least one first signature for at least one first object of the plurality of objects and at least one second signature for at least one second object of the plurality of objects;

identifying, using the at least one first signature, at least one matching concept, wherein each matching concept of the at least one matching concept includes at least one signature that matches the at least one first signature; wherein each matching concept comprises a cluster of signatures of multiple multimedia content items and metadata related to the multiple multimedia content items; wherein each matching concept undergoes a cluster reduction process that comprises reducing a number of signatures of the matching cluster while remaining a minimal number of signatures that still identify all of the multiple multimedia content items; wherein for each matching cluster the cluster reduction process comprises matching signatures of each of the multimedia content items associated with the matching cluster, with a reduced cluster having one or more signatures removed there from to provide results; and determining whether to remove the one or more signatures from the concept based on the results;

determining an actual size of the at least one first object respective of the at least one matching concept, wherein the actual size of the at least one first object is determined respective of an actual size of the at least one matching concept maintained in a data warehouse;

determining a size scale between the at least one first object and the at least one second object of the plurality of objects using the at least one first signature and the at least one second signature; and

determining the at least size dimension of the at least one second object of the plurality of objects respective of the size scale and the actual size of the first object.

2. The method of claim 1 , further comprising: storing the determined size dimension of the at least one second object in the data warehouse.

3. The method of claim 1 , wherein identifying the at least one matching concept further comprises:

querying, a deep content classification (DCC) system, using the at least one first signature to find the at least one matching concept.

4. The method of claim 1 , wherein the size scale between the at least one first object and the at least one second object of the plurality of objects is determined respective of at least one of: a ratio between the at least one first signature and the at least one second signature, and the distance of the at least one first object and the at least one second object from a reference point.

5. The method of claim 1 , wherein the at least one first signature for at least one first object represents a response of multiple leaky integrated-to-threshold unit nodes to the at least one first object.

6. The method of claim 1 , wherein the received multimedia content item is any one of: an image, a graphic, a video frame, and a photograph.

7. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to claim 1 .

8. A system for determining at least a size dimension of objects shown in a multimedia content item containing a plurality of objects, comprising:

an interface to a network for receiving an input multimedia content item;

a processing unit; and

a memory connected to the processing unit and configured to contain a plurality of instructions that when executed by the processor configure the system to:

identify a plurality of objects shown in the input multimedia content item;

identify, using the at least one first signature, at least one matching concept; wherein each matching concept of the at least one matching concept includes at least one signature that matches the at least one first signature; wherein each matching concept comprises a cluster of signatures of multiple multimedia content items and metadata related to the multiple multimedia content items; wherein each matching concept undergoes a cluster reduction process that comprises reducing a number of signatures of the matching cluster while remaining a minimal number of signatures that still identify all of the multiple multimedia content items; wherein for each matching cluster the cluster reduction process comprises matching signatures of each of the multimedia content items associated with the matching cluster, with a reduced cluster having one or more signatures removed there from to provide results; and determining whether to remove the one or more signatures from the concept based on the results;

determine an actual size of the at least one first object respective of the at least one matching concept, wherein the actual size of the at least one first object is determined respective of an actual size of the at least one matching concept maintained in a data warehouse;

determine a size scale between the at least one first object and at least one second object of the plurality of objects using the at least one first signature and at least one second signature; and

determine the at least size dimension of the at least one second object of the plurality of objects respective of the size scale and the actual size of the at least one first object.

9. The system of claim 8 , wherein the plurality of instructions further configure the system to: store the determined size dimension of the at least one second object in the data warehouse.

10. The system of claim 8 , further comprising:

a deep content classification (DCC) system for querying the at least one first signature to find the at least one matching concept, wherein the DCC is communicatively connected to the system.

11. The system of claim 8 , wherein the signatures of each object are generated by a signature generator system (SGS), wherein the SGS is communicatively connected to the system.

12. The system of claim 11 , wherein the least one first signature for at least one first object represents a response of multiple leaky integrated-to-threshold unit nodes to the at least one first object.

13. The system of claim 8 , wherein the size scale between the at least one first object and the at least one second object of the plurality of objects is determined respective of at least one of: a ratio between the at least one first signature and the at least one second signature, and the distance of the at least one first object and the at least one second object from a reference point.

14. The system of claim 8 , wherein the received multimedia content item is any one of: an image, a graphic, a video frame, and a photograph.

15. The method of claim 1 , wherein the at least one first signature for at least one first object is generated by a plurality of at least partially statistically independent computational cores that comprise multiple leaky integrated-to-threshold unit nodes.

16. The method of claim 15 , wherein the plurality of at least partially statistically independent computational cores are implemented in one or more integrated circuits.

17. The system of claim 8 , wherein the at least one first signature for at least one first object is generated by a plurality of at least partially statistically independent computational cores of the SGS that comprise multiple leaky integrated-to-threshold unit nodes.

18. The system of claim 17 , wherein the plurality of at least partially statistically independent computational cores are implemented in one or more integrated circuits.

Assignments (3)
LICENSE Recorded Jan 31, 2022
From: CORTICA LTD.
To: CORTICA AUTOMOTIVE
Reel/Frame 058917/0479 →
AMENDMENT TO LICENSE Recorded Jan 31, 2022
From: CORTICA LTD.
To: CARTICA AI LTD.
Reel/Frame 058917/0495 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2015
From: RAICHELGAUZ, IGAL; ODINAEV, KARINA; ZEEVI, YEHOSHUA Y
To: CORTICA, LTD.
Reel/Frame 035197/0217 →
Priority Claims (3)
IL 171577 · Oct 26, 2005 · national
IL 173409 · Jan 29, 2006 · national
IL 185414 · Aug 21, 2007 · national
Continuity (8)
Continuation In Part 14096865 · Dec 4, 2013
Continuation In Part 13624397 · Sep 21, 2012
Continuation In Part 13344400 · Jan 5, 2012
Continuation 12434221 · May 1, 2009
Continuation In Part 12195863 · Aug 21, 2008
Continuation In Part 12084150
Provisional Application 62030085 · Jul 29, 2014
Related Publication 20150139569A1 · May 21, 2015