IP Library › Granted Patent US 9,508,009
Granted Patent B2
US 9,508,009 · App. 15/167,818 · Granted Nov 29, 2016

Fast recognition algorithm processing, systems and methods

Inventors: Kamil Wnuk (Playa Del Rey, CA); Bing Song (La Canada, CA); Matheen Siddiqui (Culver City, CA); David McKinnon (Venice, CA); Jeremi Sudol (Los Angeles, CA); Patrick Soon-Shiong (Los Angeles, CA); Orang Dialameh (Santa Monica, CA)
Assignee: Nant Holdings IP, LLC
G06K9/00671G06F19/321G06K9/6202G06T7/0014G06T2207/10016G06T2207/20004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,508,009
App. No.
15/167,818
Granted
Nov 29, 2016
Kind
B2
Abstract

Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.

Claims (30)

1. A medical image scanning device comprising:

a processor;

a non-transitory, tangible computer readable memory storing software instructions executable by the processor; and

a recognition engine executable on the processor according to the software instructions and that is configurable to:

obtain a digital image comprising a plurality of objects;

determine a recognition strategy from the digital image, the recognition strategy comprising rules for executing at least one recognition algorithm on the digital image;

generate at least one recognition feature by executing the at least one recognition algorithm on the digital image according to the rules;

identify known modeled objects by matching the at least one recognition feature to similar known features of known modeled objects;

identify key frame bundles associated with the known modeled objects, wherein a key frame bundle includes a link to content; and

retrieve content related to the known modeled objects via at least one link in at least one key frame bundle.

2. The medical image scanning device of claim 1 , wherein the digital image comprises a scanned image.

3. The medical image scanning device of claim 1 , wherein the at least one recognition feature comprises a scale.

4. The medical image scanning device of claim 1 , wherein the at least one recognition feature comprises at least one of a shape and an edge.

5. The medical image scanning device of claim 1 , wherein the at least one recognition feature is related to a point of interest related to the known modeled objects.

6. The medical image scanning device of claim 1 , wherein determination of the recognition strategy depends on a context of the digital image.

7. The medical image scanning device of claim 1 , further comprising a camera.

8. The medical image scanning device of claim 7 , wherein the recognition engine is further configurable to capture the digital image via the camera.

9. The medical image scanning device of claim 1 , wherein the digital image comprises video data.

10. The medical image scanning device of claim 1 , wherein the recognition strategy comprises a prioritized ordering of the at least one recognition algorithm.

11. The medical image scanning device of claim 1 , wherein the recognition strategy comprises a time-based ordering of the at least one recognition algorithm.

12. The medical image scanning device of claim 1 , wherein the recognition strategy includes rules based on feature richness.

13. The medical image scanning device of claim 1 , wherein the known modeled objects are grouped based on a classification.

14. The medical image scanning device of claim 1 , wherein the content comprises mask data.

15. The medical image scanning device of claim 1 , wherein the content comprises text data.

16. The medical image scanning device of claim 1 , wherein the content is accessible within an electronic medical record storage.

17. The medical image scanning device of claim 1 , wherein the recognition engine is further configurable to identify objects within the digital image via the key frame bundles at a rate of at least 100 objects per second.

18. The medical image scanning device of claim 17 , wherein the recognition engine is further configurable to identify objects within the digital image via the key frame bundles at a rate of at least 1000 objects per second.

19. The medical image scanning device of claim 1 , wherein the recognition engine is further configurable to differentiate objects within the digital image via the key frame bundles at a rate of at least 100 objects per second.

20. The medical image scanning device of claim 19 , wherein the recognition engine is further configurable to differentiate objects within the digital image via the key frame bundles at a rate of at least 1000 objects per second.

21. The medical image scanning device of claim 1 , wherein the key frame bundles are contextually relevant to the digital image.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: WNUK, KAMIL
To: NANT VISION, INC.
Reel/Frame 038740/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: NANTMOBILE, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 038740/0944 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: SONG, BING
To: NANTWORKS, LLC
Reel/Frame 038740/0968 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: NANT VISION, INC.
To: NANT HOLDINGS IP, LLC
Reel/Frame 038740/0980 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: SOON-SHIONG, PATRICK
To: NANT HOLDINGS IP, LLC
Reel/Frame 038740/0987 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: SIDDIQUI, MATHEEN
To: NANT VISION, INC.
Reel/Frame 038740/0997 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: DIALAMEH, ORANG
To: NANTMOBILE, LLC
Reel/Frame 038741/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: NANTWORKS, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 038741/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: SUDOL, JEREMI
To: NANT VISION, INC.
Reel/Frame 038741/0034 →
EMPLOYEE PROPRIETARY INFORMATION AND INVENTION ASSIGNMENT AGREEMENT Recorded May 27, 2016
From: MCKINNON, DAVID
To: NANTVISION, INC.
Reel/Frame 038831/0948 →
Continuity (3)
Continuation 14332371 · Jul 15, 2014
Provisional Application 61856580 · Jul 19, 2013
Related Publication 20160275353A1 · Sep 22, 2016