IP Library › Granted Patent US 11,126,846
Granted Patent B2
US 11,126,846 · App. 16/243,716 · Granted Sep 21, 2021

Augmented reality, computer vision, and digital ticketing systems

Inventors: Steven Robert Neumann (Orinda, CA); Marcus Walter Shelksohn (San Francisco, CA); Khashayar Dehdashtinejad (Walnut Creek, CA); Jonathan Xiaohang Zhang (Castro Valley, CA); Edward Tang (Alameda, CA); Garrett Canan Reeb (San Francisco, CA); Ninglin Li (Foster City, CA)
Assignee: eBay Inc.
G06K9/00671G01C21/005G01C21/20G01C21/206G01C21/3602G01C21/3679G06F16/29G06F16/532G06F16/5846G06F16/5866G06K9/3258G06N20/00G06Q10/02G06Q30/0623G06Q30/0641G06Q30/0643
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,126,846
App. No.
16/243,716
Granted
Sep 21, 2021
Kind
B2
Abstract

Augmented reality, computer vision, and digital ticketing system techniques are described that employ a location determination system. In one example, the location determination system is configured to receiving at least one digital image as part of a live camera feed, identify an object included in the at least one digital image using object recognition, determine a location of the object in relation to a digital map of a physical environment, generate augmented reality digital content indicating the determined location in relation to the digital map, and render the augmented reality digital content as part of the live camera feed for display by a display device.

Claims (44)

1. A method implemented by a computing device, the method comprising:

receiving, by the computing device, at least one digital image as part of a live camera feed of a physical environment;

identifying, by the computing device, an object included in the at least one digital image using object recognition;

searching, by the computing device, a resource for a physical location of the identified object;

determining, by the computing device, an object location of the object on a digital map based on the searching;

determining, by the computing device, a computing device location on the digital map of the computing device with respect to the location of the object on the digital map;

generating, by the computing device, augmented reality digital content indicating the computing device location of the computing device on the digital map; and

displaying, by the computing device, the digital map as part of the augmented reality digital content, the digital map indicating the computing device location on the digital map.

2. The method as described in claim 1 , wherein the identifying is performed using a machine-learning model as a classifier as part of machine learning.

3. The method as described in claim 2 , wherein the resource is a digital map of a physical environment and the determining is performed by using the identified object as a search query of the digital map.

4. The method as described in claim 1 , wherein the identifying includes recognizing text associated with the object included in the digital image and the searching is performed using the identified text.

5. The method as described in claim 4 , wherein the object is a sign indicative of the object location with respect to the object location within the physical environment.

6. The method as described in claim 4 , wherein the object is a sign indicative of a service available proximal to the object location with respect to the object location within the physical environment.

7. The method as described in claim 6 , wherein the service offers products or goods for sale proximal to the object location within the physical environment.

8. The method as described in claim 1 , further comprising obtaining ticket information of a user associated with an event at the physical environment and configuring the augmented reality digital content as a map indicating the computing device location of the computing device on the digital map to a location at the physical environment indicated by the ticket information.

9. The method as described in claim 8 , further comprising obtaining ticket information of another user associated with the event at the physical environment and configuring the augmented reality digital content as the map to also indicate a location of the another user with respect to the physical environment.

10. A method implemented by a computing device, the method comprising:

receiving, by the computing device, at least one digital image as part of a live camera feed of a physical environment;

identifying, by the computing device, text associated with an object included in the at least one digital image using object recognition;

searching, by the computing device, a resource for a physical location associated with the identified text;

determining, by the computing device, an object location on a digital map of the object based on the searching;

determining, by the computing device, a computing device location on the digital map of the computing device with respect to the location of the object on the digital map;

generating, by the computing device, augmented reality digital content indicating the computing device location of the computing device on the digital map; and

displaying, by the computing device, the digital map included as part of the augmented reality digital content, the digital map indicating the computing device location as part of the live camera feed for display by a display device.

11. The method as described in claim 10 , wherein the object is a sign indicative of the object location with respect to the object location within the physical environment.

12. The method as described in claim 10 , wherein the object is a sign indicative of a service available proximal to the object location with respect to the object location within the physical environment.

13. The method as described in claim 12 , wherein the service offers products or goods for sale proximal to the object location within the physical environment.

14. The method as described in claim 10 , wherein the searching is performed using natural language understanding as part of machine learning.

15. A computing device comprising:

a digital camera configured to generate a live stream of digital images of a physical environment;

a display device;

a processing system; and

a computer-readable storage medium having instructions stored thereon that, responsive to execution by the processing system, causes the processing system to perform operations comprising:

identifying an object included in at least one digital image of the live stream of digital images using object recognition;

searching a resource for a physical location of the identified object;

determining an object location on a digital map of the object based on the searching;

determining a computing device location on the digital map of the computing device with respect to the object location on the digital map;

generating augmented reality digital content indicating the computing device location of the computing device on the digital map; and

displaying the digital map as part of the augmented reality digital content by the display device, the digital map indicating the computing device location as part of the live stream for display by the display device.

16. The computing device as described in claim 15 , wherein the identifying is performed using a machine-learning model as a classifier as part of machine learning.

17. The computing device as described in claim 16 , wherein the resource is a digital map of a physical environment and the determining is performed by using the identified object as a search query of the digital map.

18. The computing device as described in claim 15 , wherein the identifying includes recognizing text associated with the object included in the digital image and the searching is performed using the identified text.

19. The computing device as described in claim 18 , wherein the text identifies an object location with respect to the object location within the physical environment.

20. The computing device as described in claim 18 , wherein the text identifies a name of the object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2019
From: NEUMANN, STEVEN ROBERT; SHELKSOHN, MARCUS WALTER; DEHDASHTINEJAD, KHASHAYAR; ZHANG, JONATHAN XIAOHANG; TANG, EDWARD; REEB, GARRETT CANAN; LI, NINGLIN
To: EBAY INC.
Reel/Frame 048126/0187 →
Continuity (2)
Provisional Application 62619071 · Jan 18, 2018
Related Publication 20190220665A1 · Jul 18, 2019
Cited By (1)
US 12,253,678