IP Library Granted Patent US 10,509,821
Granted Patent B2
US 10,509,821 · App. 16/154,547 · Granted Dec 17, 2019

Data capture and identification system and process

Inventors: Wayne C. Boncyk (Evergreen, CO); Ronald H. Cohen (Pasadena, CA)
Assignee: NANT HOLDINGS IP, LLC
G06F16/5838G06F16/21G06F16/248G06F16/24578G06F16/51G06F16/5866G06K9/00G06K9/228G06K9/4652G06K9/4671G06K9/6203H04L67/141H04M1/0202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,509,821
App. No.
16/154,547
Granted
Dec 17, 2019
Kind
B2
Abstract

A mobile system that performs object recognition, identifying real-world objects in a scene from captured digital data of the scene. The mobile system identifies the real-world objects based on derived salient characteristics from the digital data, and retrieves stored object information corresponding to the identified object such that a CPU can execute a software process based on the retrieved object information about the real-world object.

Claims (43)

1. A mobile system that performs object recognition, comprising:

at least one data capture device;

a computer system programmed to:

store reference characteristics corresponding to a plurality of target objects and object information associated with each of the plurality of target objects;

receive, from the at least one data capture device, digital data of a scene captured by the at least one data capture device, the digital data comprising at least one of image data and position data related to a digital representation of at least one real-world object within the scene;

derive salient characteristics for the at least one real-world object based on the digital representation including the position data;

identify the at least one real-world object as at least one target object among the plurality of target objects based on the derived salient characteristics and the stored reference characteristics;

retrieve the object information associated with the identified at least one target object; and

execute a software process based on the object information.

2. The mobile system that performs object recognition of claim 1 , wherein the computer system is further programmed to determine the position and orientation of the at least one real-world object relative to the at least one data capture device based on the object information.

3. The mobile system that performs object recognition of claim 2 , wherein the at least one real-world object comprises at least one of a person or a vehicle.

4. The mobile system that performs object recognition of claim 1 , wherein the at least one real-world object comprises a machine and the computer system is further programmed to establish a communication link with the machine based on the object information.

5. The mobile system that performs object recognition of claim 4 , wherein the computer system is further programmed to enable a user to interact with the machine via a display screen.

6. The mobile system that performs object recognition of claim 1 , wherein the at least one data capture device comprises at least two data capture devices.

7. The mobile system that performs object recognition of claim 1 , wherein the digital representation of the at least one real-world object comprises a depiction of at least a portion of the at least one real-world object within the image data.

8. The mobile system that performs object recognition of claim 7 , wherein the image data comprises video data.

9. The mobile system that performs object recognition of claim 1 , wherein the at least one data capture device, and the computer system are integral to a single device.

10. The mobile system that performs object recognition of claim 1 , wherein the computer system is further programmed to present, via a display, information about the real-world object based on the object information.

11. A method for object recognition by a mobile system, comprising:

storing, by a computer system, reference characteristics corresponding to a plurality of target objects and object information associated with each of the plurality of target objects;

capturing, by at least one data capture device, digital data of a scene, the digital data comprising at least one of image data and position data related to a digital representation of at least one real-world object within the scene;

receiving, by the computer system and from the at least one data capture device, the digital data of the scene;

deriving, by the computer system, salient characteristics for the at least one real-world object based on the digital representation including the position data;

identifying, by the computer system, the at least one real-world object as at least one target object among the plurality of target objects based on the derived salient characteristics and the stored reference characteristics;

retrieving, by the computer system, the object information associated with the identified at least one target object;

executing, by the computer system, a software process based on the object information.

12. The method of claim 11 , wherein the step of executing the software process comprises determining, by the computer system, the position and orientation of the at least one real-world object relative to the at least one data capture device based on the object information.

13. The method of claim 12 , wherein the at least one real-world object comprises at least one of a person or a vehicle.

14. The method of claim 11 , wherein the at least one real-world object comprises a machine and the step of executing the software process comprises establishing, by the computer system, a communication link with the machine based on the object information.

15. The method of claim 14 , wherein the step of executing the software process further comprises enabling, by the computer system, a user to interact with the machine via a display screen.

16. The method of claim 11 , wherein the at least one data capture device comprises at least two data capture devices.

17. The method of claim 11 , wherein the digital representation of the at least one real-world object comprises a depiction of at least a portion of the at least one real-world object within the image data.

18. The method of claim 17 , wherein the image data comprises video data.

19. The method of claim 11 , wherein the at least one data capture device and the computer system are integral to a single device.

20. The method of claim 11 , wherein the step of executing the software process comprises the presenting, by the computer system and via a display, information about the real-world object based on the object information.

21. A non-transitory computer readable medium comprising instructions executable by a computer processor to execute processing comprising:

storing, by a computer system, reference characteristics corresponding to a plurality of target objects and object information associated with each of the plurality of target objects;

capturing, by at least one data capture device, digital data of a scene, the digital data comprising at least one of image data and position data related to a digital representation of at least one real-world object within the scene;

receiving, by the computer system and from the at least one data capture device, the digital data of the scene;

deriving, by the computer system, salient characteristics for the at least one real-world object based on the digital representation including the position data;

identifying, by the computer system, the at least one real-world object as at least one target object among the plurality of target objects based on the derived salient characteristics and the stored reference characteristics;

retrieving, by the computer system, the object information associated with the identified at least one target object;

executing, by the computer system, a software process based on the object information.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2020
From: EVRYX TECHNOLOGIES, INC.
To: EVRYX ACQUISITION LLC
Reel/Frame 051601/0716 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2019
From: BONCYK, WAYNE C.; COHEN, RONALD H.
To: EVRYX TECHNOLOGIES, INC.
Reel/Frame 051351/0328 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2019
From: EVRYX ACQUISITION, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 049731/0921 →
Continuity (14)
Division 15818312 · Nov 20, 2017
Division 15392935 · Dec 28, 2016
Division 14615162 · Feb 5, 2015
Division 14251480 · Apr 11, 2014
Division 13968666 · Aug 16, 2013
Division 13633533 · Oct 2, 2012
Division 13464410 · May 4, 2012
Division 13005716 · Jan 13, 2011
Continuation 12505714 · Jul 20, 2009
Continuation 11342094 · Jan 26, 2006
Continuation In Part 09992942 · Nov 5, 2001
Provisional Application 60317521 · Sep 5, 2001
Provisional Application 60246295 · Nov 6, 2000
Related Publication 20190042599A1 · Feb 7, 2019
Cited By (3)
US 12,322,071 US 12,560,995 US 12,566,491