IP Library › Granted Patent US 9,844,468
Granted Patent B2
US 9,844,468 · App. 15/299,604 · Granted Dec 19, 2017

Image capture and identification system and process

Inventors: Wayne C. Boncyk (Evergreen, CO); Ronald H. Cohen (Pasadena, CA)
Assignee: NANT HOLDINGS IP LLC
A61F9/08A63F13/00A63F13/12A63F13/213A63F13/335A63F13/35A63F13/45A63F13/65A63F13/792A63F13/92G06F3/0482G06F17/2235G06F17/30014G06F17/3025G06F17/3028G06F17/30241G06F17/30244G06F17/30247G06F17/30253G06F17/30256G06F17/30259G06F17/30268G06F17/30386G06F17/30879G06F17/30882G06K9/0063G06K9/00536G06K9/00664G06K9/00671G06K9/18G06K9/228G06K9/3241G06K9/34G06K9/46G06K9/4652G06K9/4671G06K9/6201G06K9/6202G06K9/6203G06K9/6212G06K9/6215G06K9/64G06K9/78G06Q10/02G06Q20/102G06Q20/14G06Q20/202G06Q20/208G06Q20/24G06Q20/327G06Q20/3567G06Q20/40145G06Q30/0217G06Q30/0241G06Q30/0253G06Q30/0257G06Q30/0267G06Q30/0268G06Q30/0269G06Q30/0277G06Q30/04G06Q30/0601G06Q30/0623G06Q30/0635G06Q30/0643G06Q40/00G06Q90/00G06T7/0042G06T7/0079G07F17/3206G07F17/3241G07F17/3244H04L67/02H04L67/10H04N1/00244H04N5/225H04N5/23206H04N5/23222H04N5/23229H04N5/91H04N7/183H04N7/185H04N21/23109H04N21/23418H04N21/254H04N21/41407H04N21/4223H04N21/44222H04N21/4722H04N21/4781H04N21/4782H04N21/47815H04N21/6582H04N21/812H04N21/8126H04N21/8173G06T2207/20144H04N2201/3253H04N2201/3254H04N2201/3274
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,844,468
App. No.
15/299,604
Granted
Dec 19, 2017
Kind
B2
Abstract

A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

Claims (53)

1. A method of interactive content management, comprising:

obtaining, by a first mobile device, a digital representation of an environment, the digital representation comprising image data and location data associated with the first mobile device;

recognizing, by at least one of a server and the first mobile device, an object from the digital representation as a target object considered to be part of a game based at least in part on the digital representation;

identifying, by at least one of a server and the first mobile device, content information associated with the target object based on a location of the target object;

accessing, by at least one of the server and the first mobile device, the content information via an information address associated with the target object; and

visually presenting, by the first mobile device, the content information within the game based on the location data associated with the first mobile device and a position of the target object relative to the first mobile device.

2. The method of claim 1 , wherein visually presenting the content information further comprises visually presenting, by the first mobile device, the content information based on a proximity of the first mobile device to the target object.

3. The method of claim 2 , wherein the content information comprises at least one of graphical content information, animation content information, video content information and text content information.

4. The method of claim 1 , further comprising enabling an interaction with the target object via the first mobile device based on the location data associated with the first mobile device and a position and orientation of the first mobile device relative to the target object.

5. The method of claim 1 , further comprising visually presenting, by the first mobile device, information regarding the position of the target object.

6. The method of claim 1 , further comprising:

obtaining, by a second mobile device, a second digital representation of the environment, the second digital representation comprising second location data associated with the second mobile device;

recognizing, by at least one of a server and the second mobile device, the object from the second digital representation as the target object considered to be part of the game based at least in part on the second location data;

identifying, by at least one of a server and the second mobile device, the content information associated with the target object based on the location of the target object;

accessing, by at least one of the server and the second mobile device, the content information via the information address associated with the target object; and

visually presenting, by the second mobile device, the content information within the game based on the second location data associated with the second mobile device and a position of the target object relative to the second mobile device.

7. The method of claim 6 , further comprising enabling an interaction with the target object via each of the first and second mobile devices based on the location data associated with the first mobile device, the second location data associated with the second mobile device, and the position and orientation of the first and second mobile devices relative to the target object.

8. The method of claim 7 , further comprising:

displaying, by the first device, the content information associated with the interaction with the target object;

receiving the interaction with the target object from the first mobile device; and

displaying, by the second device, the content information associated with the interaction with the target object.

9. The method of claim 1 , further comprising producing, by the first mobile device, an audio signal based on the position and orientation of the first mobile device relative to the target object.

10. The method of claim 1 , wherein accessing the content information is in response to executing a transaction for the content information.

11. The method of claim 10 , wherein the transaction is a financial transaction and executing the transaction comprises billing a purchase amount for the transaction to an account.

12. The method of claim 1 , further comprising executing a transaction to purchase a product associated with the target object.

13. The method of claim 1 , wherein the object comprises a real-world object.

14. A system comprising:

at least one non-transitory computer readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to:

obtain, from a first mobile device sensor of a first mobile device, a digital representation of an environment, the digital representation comprising image data and location data associated with the first mobile device;

recognize an object from the digital representation as a target object considered to be part of a game based at least in part on the digital representation;

identify, by at least one of a server and the first mobile device, content information associated with the target object based on a location of the target object;

access, by at least one of the server and the first mobile device, the content information via an information address associated with the target object; and

cause the first mobile device to visually present the content information within the game based on the location data associated with the first mobile device and a position of the target object relative to the first mobile device.

15. The system of claim 14 , wherein the instructions that cause the first mobile device to visually present the content information further comprises instructions that cause the first mobile device to visually present the content information based on a proximity of the first mobile device to the target object.

16. The system of claim 15 , wherein the content information comprises at least one of graphical content information, animation content information, video content information and text content information.

17. The system of claim 14 , further comprising instructions that cause the at least one processor to enable an interaction with the target object via the first mobile device based on the location data associated with the first mobile device and a position and orientation of the first mobile device relative to the target object.

18. The system of claim 14 , further comprising instructions that cause the first mobile device to display information regarding the position of the target object relative to the first mobile device.

19. The system of claim 14 , further comprising instructions that cause the at least one processor to:

obtain, from a second mobile device sensor of a second mobile device, a second digital representation of the environment, the second digital representation comprising second location data associated with the second mobile device;

recognize the object from the second digital representation as the target object considered to be part of the game based at least in part on the second location data;

identify the content information associated with the target object based on the location of the target object;

access the content information via the information address associated with the target object; and

cause the second mobile device to visually present the content information within the game based on the second location data associated with the second mobile device and a position of the target object relative to the second mobile device.

20. The system of claim 19 , wherein further comprising instructions that cause the at least one processor to enable an interaction with the target object via each of the first and second mobile devices based on the location data associated with the first mobile device, the second location data associated with the second mobile device, and the position and orientation of the first and second mobile devices relative to the target object.

21. The system of claim 20 , further comprising instructions that cause the at least one processor to:

cause the first mobile device to visually present the content information associated with the interaction with the target object;

receive the interaction with the target object from the first mobile device; and

cause the second mobile device to visually present the content information associated with the interaction with the target object.

22. The system of claim 14 , further comprising instructions that cause the first mobile device to produce an audio signal based on the position and orientation of the first mobile device relative to the target object.

23. The system of claim 14 , further comprising wherein the instructions cause the at least one processor to access the content information in response to the execution of a transaction for the content information.

24. The system of claim 23 , wherein the transaction is a financial transaction and the execution of the transaction comprises billing a purchase amount for the transaction to an account.

25. The system of claim 14 , further comprising instructions that cause the at least one processor to execute a transaction to purchase a product associated with the target object.

26. The system of claim 14 , wherein the object comprises a real-world object.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2016
From: BONCYK, WAYNE C.; COHEN, RONALD H.
To: EVRYX TECHNOLOGIES, INC.
Reel/Frame 040083/0335 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2016
From: EVRYX TECHNOLOGIES, INC.
To: EVRYX ACQUISITION, LLC
Reel/Frame 040083/0379 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2016
From: EVRYX ACQUISITION, LLC
To: NANT HOLDINGS IP LLC
Reel/Frame 040083/0408 →
Continuity (12)
Division 14683953 · Apr 10, 2015
Division 14083210 · Nov 18, 2013
Division 13856197 · Apr 3, 2013
Division 13693983 · Dec 4, 2012
Continuation 13069112 · Mar 22, 2011
Division 13037317 · Feb 28, 2011
Division 12333630 · Dec 12, 2008
Division 10492243
Continuation In Part 09992942 · Nov 5, 2001
Provisional Application 60317521 · Sep 5, 2001
Provisional Application 60246295 · Nov 6, 2000
Related Publication 20170036114A1 · Feb 9, 2017