IP Library › Granted Patent US 9,536,168
Granted Patent B2
US 9,536,168 · App. 14/683,953 · Granted Jan 3, 2017

Image capture and identification system and process

Inventors: Wayne C. Boncyck (Evergreen, CO); Ronald H. Cohen (Pasadena, CA)
Assignee: Nant Holdings IP, LLC
G06K9/46A61F9/08A63F13/00A63F13/12A63F13/45G06F3/0482G06F17/2235G06F17/30014G06F17/3025G06F17/3028G06F17/30241G06F17/30244G06F17/30247G06F17/30253G06F17/30256G06F17/30259G06F17/30268G06F17/30386G06F17/30879G06F17/30882G06K9/0063G06K9/00536G06K9/00664G06K9/18G06K9/228G06K9/3241G06K9/4652G06K9/4671G06K9/6201G06K9/6202G06K9/6203G06K9/6212G06K9/6215G06K9/64G06K9/78G06Q10/02G06Q20/202G06Q20/208G06Q20/24G06Q20/327G06Q20/3567G06Q20/40145G06Q30/0217G06Q30/0241G06Q30/0253G06Q30/0257G06Q30/0267G06Q30/0268G06Q30/0269G06Q30/0277G06Q30/0601G06Q30/0623G06Q30/0643G06Q40/00G06Q90/00G06T7/0079H04L67/02H04L67/10H04N1/00244H04N5/225H04N5/23206H04N5/23222H04N5/23229H04N5/91H04N7/183H04N7/185H04N21/23109H04N21/23418H04N21/254H04N21/41407H04N21/4223H04N21/44222H04N21/4722H04N21/4782H04N21/6582H04N21/812H04N21/8126H04N21/8173G06T2207/20144H04N2201/3253H04N2201/3254H04N2201/3274
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,536,168
App. No.
14/683,953
Granted
Jan 3, 2017
Kind
B2
Abstract

A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

Claims (41)

1. A terminal device comprising:

an image sensor;

a memory;

a processor coupled with the image sensor and the memory; and

an object recognition platform configured to execute on the processor according to software instructions stored in the memory, where the software instructions configure the processor to:

capture a digital representation of a physical object proximate to a mobile device via the image sensor;

recognize the physical object represented in the digital representation as a target object based on salient features derived from the digital representation;

determine object attributes, including an information address, associated with the target object;

cause execution of an action associated with the physical object based on the object attributes, including the information address.

2. The device of claim 1 , wherein the digital representation comprises a digital image data captured by the image sensor.

3. The device of claim 1 , wherein the digital representation comprises video data captured by the image sensor.

4. The device of claim 1 , wherein the image sensor comprises a camera.

5. The device of claim 4 , wherein the camera comprises a CMOS camera or a CCD camera.

6. The device of claim 1 , wherein the object recognition platform is further configured to recognize the physical object as the target object via an identification server having a known objects database indexed by salient features.

7. The device of claim 6 , further comprising the identification server.

8. The device of claim 6 , wherein the identification server is remote over a network relative to the terminal device.

9. The device of claim 1 , further comprising a known object database storing target object information for a plurality of known target objects indexed according to salient features.

10. The device of claim 9 , wherein the known object database stores at least some of the object attributes as target object information.

11. The device of claim 1 , wherein the software instructions configure the processor to determine the object attributes by deriving the object attributes from the digital representation.

12. The device of claim 1 , wherein the object attributes comprise at least one of: an identity, a name, a number, a classification, a position, an orientation, a size, a color, a status, decoded information, and text.

13. The device of claim 1 , wherein the terminal device comprises a cell phone.

14. The device of claim 1 , wherein the execution of the action is performed by at least one of the following: a vending machine, a kiosk, a point-of-sales terminal, a computer-based game, a personal data assistant, a vehicle, a television, a robot, a cell phone, and the terminal device.

15. The device of claim 1 , wherein the physical object comprises at least one of the following: a person, a building, a vehicle, a sign, a magazine, a newspaper, a poster, a billboard, a consumer product, a game object, a point-of-sales terminal, a vending machine, a passport, a driver's license, a box, a machine part, and a television.

16. The device of claim 1 , wherein the execution of the action is further based on a location.

17. The device of claim 1 , wherein the execution of the action is further based on a time.

18. The device of claim 1 , wherein the physical object lacks a tag.

19. The device of claim 1 , wherein the physical object comprises a tag.

20. The device of claim 19 , wherein the execution of the action is further based on information decoded from the tag.

21. The device of claim 19 , wherein the tag comprises at least one of the following: a bar code, a matrix code, a 2D code, and alphanumeric text.

22. The device of claim 1 , wherein the action comprises a transaction with an account.

23. The device of claim 22 , wherein the account includes at least one of the following: an on-line account, a credit card account, a bank account, an account linked to the device, and an account linked to a user.

24. The device of claim 1 , wherein the action comprises an on-going interaction.

25. The device of claim 1 , wherein the action comprises accessing a web site or web service over a network.

26. The device of claim 1 , wherein the action comprises initiating a software process on the terminal device.

27. The device of claim 1 , wherein the action comprises initiating a phone call.

28. The device of claim 1 , wherein the action comprises initiating a radio communication.

29. The device of claim 1 , wherein the action comprises reading a portion of a printed media object related to the physical object.

30. The device of claim 1 , wherein the action comprises sending information related to the target object to a web site.

31. The device of claim 1 , wherein the action comprises sending information related to the target object to a browser.

32. The device of claim 1 , wherein the action comprises displaying information related to the physical object on a display screen.

33. The device of claim 32 , wherein the information related to the physical object comprises at least some of the object attributes.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2015
From: EVRYX TECHNOLOGIES, INC.
To: EVRYX ACQUISITION LLC.
Reel/Frame 037048/0570 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2015
From: EVRYX ACQUISITION, LLC
To: NANT HOLDINGS IP, LLC.
Reel/Frame 037048/0985 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2015
From: BONCYK, WAYNE C.; COHEN, RONALD H.
To: EVRYX TECHNOLOGIES
Reel/Frame 037040/0192 →
Continuity (11)
Division 14083210 · Nov 18, 2013
Division 13856197 · Apr 3, 2013
Division 13693983 · Dec 4, 2012
Continuation 13069112 · Mar 22, 2011
Division 13037317 · Feb 28, 2011
Division 12333630 · Dec 12, 2008
Division 10492243
Continuation In Part 09992942 · Nov 5, 2001
Provisional Application 60317521 · Sep 5, 2001
Provisional Application 60246295 · Nov 6, 2000
Related Publication 20160012308A1 · Jan 14, 2016