IP Library › Granted Patent US 9,844,469
Granted Patent B2
US 9,844,469 · App. 15/335,849 · Granted Dec 19, 2017

Image capture and identification system and process

Inventors: Wayne C. Boncyk (Evergreen, CO); Ronald H. Cohen (Pasadena, CA)
Assignee: NANT HOLDINGS IP LLC
A61F9/08A63F13/00A63F13/12A63F13/213A63F13/335A63F13/35A63F13/45A63F13/65A63F13/792A63F13/92G06F3/0482G06F17/2235G06F17/30014G06F17/3025G06F17/3028G06F17/30241G06F17/30244G06F17/30247G06F17/30253G06F17/30256G06F17/30259G06F17/30268G06F17/30386G06F17/30879G06F17/30882G06K9/0063G06K9/00536G06K9/00664G06K9/00671G06K9/18G06K9/228G06K9/3241G06K9/34G06K9/46G06K9/4652G06K9/4671G06K9/6201G06K9/6202G06K9/6203G06K9/6212G06K9/6215G06K9/64G06K9/78G06Q10/02G06Q20/102G06Q20/14G06Q20/202G06Q20/208G06Q20/24G06Q20/327G06Q20/3567G06Q20/40145G06Q30/0217G06Q30/0241G06Q30/0253G06Q30/0257G06Q30/0267G06Q30/0268G06Q30/0269G06Q30/0277G06Q30/04G06Q30/0601G06Q30/0623G06Q30/0635G06Q30/0643G06Q40/00G06Q90/00G06T7/0042G06T7/0079G07F17/3206G07F17/3241G07F17/3244H04L67/02H04L67/10H04N1/00244H04N5/225H04N5/23206H04N5/23222H04N5/23229H04N5/91H04N7/183H04N7/185H04N21/23109H04N21/23418H04N21/254H04N21/41407H04N21/4223H04N21/44222H04N21/4722H04N21/4781H04N21/4782H04N21/47815H04N21/6582H04N21/812H04N21/8126H04N21/8173G06T2207/20144H04N2201/3253H04N2201/3254H04N2201/3274
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,844,469
App. No.
15/335,849
Granted
Dec 19, 2017
Kind
B2
Abstract

A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

Claims (43)

1. A method of enabling object recognition for a game, comprising:

storing, in a database, at least one digital representation of an object, the at least one digital representation including, location information of the object, image data associated with a location of the object indicated by the location information, and being of a modality corresponding to a mobile device sensor of at least one mobile device;

indexing, by at least one of a server and the at least one mobile device, the object in the database based on the at least one digital representation of the object, such that the object can be identified as a target of interest from a digital representation of the environment that includes location information of the at least one mobile device, received from the mobile device sensor;

associating, by at least one of the server and the at least one mobile device, the object with content information associated with a game via an information address, such that the at least one mobile device can access the content information based on the identified object as the target of interest; and

enabling the at least one mobile device to incorporate the content information into the game.

2. The method of claim 1 , the indexing further comprising indexing the object based on salient parameters derived from the at least one digital representation.

3. The method of claim 1 , wherein the content information comprises at least one of graphical content information, animation content information, video content information and text content information.

4. The method of claim 3 , wherein incorporating the content information into the game further comprises visually presenting, by the at least one mobile device, the content information based on at least one of a position and orientation of the at least one mobile device relative to the object.

5. The method of claim 3 , wherein visually presenting the content information further comprises visually presenting, by the at least one mobile device, the content information based on a proximity of the at least one mobile device to the object.

6. The method of claim 3 , wherein incorporating the content information into the game further comprises visually presenting, by the at least one mobile device, information regarding at least one of a position of the object and the location of the object.

7. The method of claim 1 , wherein incorporating the content information into the game further comprises producing, by the at least one mobile device, an audio signal based on a position of the mobile device relative to the object.

8. The method of claim 1 , wherein incorporating the content information into the representation of the game further comprises enabling, by the at least one mobile device, an interaction with the content information in the game.

9. The method of claim 8 , wherein the at least one mobile device includes a first mobile device and a second mobile device, the method further comprising:

visually presenting, by the first mobile device, the content information associated with the interaction;

receiving the interaction with the content information from the first mobile device; and

visually presenting, by the second mobile device, the content information based on the interaction.

10. The method of claim 9 , wherein the interaction via each of the first and second mobile devices is based at least in part on the location data associated with the first mobile device, the second location data associated with the second mobile device, and the position and orientation of the first and second mobile devices relative to the object.

11. The method of claim 1 , wherein enabling the at least one mobile device to incorporate the content information is in response to executing a transaction for the content information.

12. The method of claim 11 , wherein the transaction is a financial transaction and executing the transaction comprises billing a purchase amount for the transaction to an account.

13. The method of claim 1 , further comprising executing a transaction to purchase a product associated with the object.

14. The method of claim 1 , wherein the object comprises a real-world object.

15. A system for enabling object recognition for a game, comprising:

at least one non-transitory computer readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to:

store, in a database, at least one digital representation of an object, the at least one digital representation including, location information of the object, image data associated with a location of the object indicated by the location information, and being of a modality corresponding to a mobile device sensor of at least one mobile device;

index the object in the database based on the at least one digital representation of the object, such that the object can be identified as a target of interest from a digital representation of the environment that includes location information of the at least one mobile device, received from the mobile device sensor;

associate the object with content information associated with a game via an information address, such that the content information can be accessed based on the identified object as the target of interest; and

enable an incorporation of the content information into the game.

16. The system of claim 15 , the instructions to cause the at least one processor to index further comprising instructions to cause the at least one processor to index the object based on salient parameters derived from the at least one digital representation.

17. The system of claim 15 , wherein the content information comprises at least one of graphical content information, animation content information, video content information and text content information.

18. The system of claim 17 , the instructions to cause the at least one processor to enable the incorporation further comprising instructions to cause the at least one processor to visually present, via the at least one mobile device, the content information based on at least one of a position and orientation of the at least one mobile device relative to the object.

19. The system of claim 17 , the instructions to cause the at least one processor to visually present further comprising instructions to cause the at least one processor to visually present, via the at least one mobile device, the content information based on a proximity of the at least one mobile device to the object.

20. The system of claim 17 , the instructions to cause the at least one processor to enable the incorporation further comprising instructions to cause the at least one processor to visually present, via the at least one mobile device, information regarding at least one of a position of the object and the location of the object.

21. The system of claim 15 , the instructions to cause the at least one processor to enable the incorporation further comprising instructions to cause the at least one processor to produce, via the at least one mobile device, an audio signal based on a position of the mobile device relative to the object.

22. The system of claim 15 , the instructions to cause the at least one processor to enable the incorporation further comprising instructions to cause the at least one processor to enable, via the at least one mobile device, an interaction with the content information in the game.

23. The system of claim 22 , wherein the at least one mobile device includes a first mobile device and a second mobile device, further comprising instructions to cause the at least one processor to:

visually present, via the first mobile device, the content information associated with the interaction;

receive the interaction with the content information via the first mobile device; and

visually present, via the second mobile device, the content information based on the interaction.

24. The system of claim 23 , wherein the interaction via each of the first and second mobile devices is based at least in part on the location data associated with the first mobile device, the second location data associated with the second mobile device, and the position and orientation of the first and second mobile devices relative to the object.

25. The system of claim 15 , wherein enabling the incorporation of the content information is in response to executing a transaction for the content information.

26. The system of claim 25 , wherein the transaction is a financial transaction and executing the transaction comprises billing a purchase amount for the transaction to an account.

27. The system of claim 15 , further comprising instructions that cause the at least one processor to execute a transaction to purchase a product associated with the object.

28. The system of claim 15 , wherein the object comprises a real-world object.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2016
From: BONCYK, WAYNE C.; COHEN, RONALD H.
To: EVRYX TECHNOLOGIES, INC.
Reel/Frame 040150/0988 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2016
From: EVRYX TECHNOLOGIES, INC.
To: EVRYX ACQUISITION, LLC
Reel/Frame 040151/0148 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2016
From: EVRYX ACQUISITION, LLC
To: NANT HOLDINGS IP LLC
Reel/Frame 040151/0203 →
Continuity (12)
Division 14683953 · Apr 10, 2015
Division 14083210 · Nov 18, 2013
Division 13856197 · Apr 3, 2013
Division 13693983 · Dec 4, 2012
Continuation 13069112 · Mar 22, 2011
Division 13037317 · Mar 28, 2011
Division 12333630 · Dec 12, 2008
Division 10492243
Continuation In Part 09992942 · Nov 5, 2001
Provisional Application 60317521 · Sep 5, 2001
Provisional Application 60246295 · Nov 6, 2000
Related Publication 20170046570A1 · Feb 16, 2017