IP Library › Granted Patent US 11,967,147
Granted Patent B2
US 11,967,147 · App. 17/492,184 · Granted Apr 23, 2024

Augmented reality visualization of enclosed spaces

Inventors: Barrett Kreiner (Woodstock, GA); James Pratt (Round Rock, TX); Adrianne Binh Luu (Atlanta, GA); Robert T. Moton, Jr. (Alpharetta, GA); Walter Cooper Chastain (Atlanta, GA); Ari Craine (Marietta, GA); Robert Koch (Peachtree Corners, GA)
Assignee: AT&T Intellectual Proerty I, L.P.
G06V20/20G06T11/00G06T11/60G07C9/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,967,147
App. No.
17/492,184
Granted
Apr 23, 2024
Kind
B2
Abstract

A processing system including at least one processor may detect a first location and a first orientation of an augmented reality endpoint device of a user at a venue, identify an entryway of a first enclosed space of the venue that is within a first field-of-view of the augmented reality endpoint device in accordance with the first location and the first orientation of the augmented reality endpoint device, and present, via the augmented reality endpoint device, first visual information of the first enclosed space. The first visual information may include first imagery of the first enclosed space and may be presented within the first field-of-view.

Claims (58)

1. A method comprising:

detecting, by a processing system including at least one processor, a first location and a first orientation of an augmented reality endpoint device of a user at a venue;

identifying, by the processing system, an entryway of a first enclosed space of the venue that is within a first field-of-view of the augmented reality endpoint device in accordance with the first location and the first orientation of the augmented reality endpoint device;

detecting, by the processing system, a location of at least one object within the first enclosed space, wherein the location of the at least one object is detected via a wireless sensing of at least one wireless tag of the at least one object;

modifying, by the processing system, at least one prior captured image of the first enclosed space to generate a first imagery of the first enclosed space that depicts the at least one object at the location that is detected, wherein the modifying comprises:

extracting visual data of the at least one object from the at least one prior captured image;

infilling, via a machine learning-based process, a portion of the at least one prior captured image from which the visual data of the at least one object is extracted to generate an infilled image; and

inserting imagery of the at least one object into the infilled image in accordance with the location that is detected, to generate the first imagery of the first enclosed space, wherein the imagery of the at least one object is based on the visual data of the at least one object that is extracted; and

presenting, by the processing system via the augmented reality endpoint device, first visual information of the first enclosed space, wherein the first visual information comprises the first imagery of the first enclosed space and wherein the first visual information is presented within the first field-of-view.

2. The method of claim 1 , wherein the user has a reservation with the venue for access to a first type of enclosed space, wherein the first enclosed space is of the first type of enclosed space.

3. The method of claim 2 , wherein the identifying includes identifying that the first enclosed space is of the first type of enclosed space.

4. The method of claim 3 , wherein the presenting the first visual information of the first enclosed space is performed in response to the identifying.

5. The method of claim 1 , wherein the processing system is in communication with the augmented reality endpoint device, the method further comprising:

receiving an input from the user selecting to access the first enclosed space; and

providing, to the augmented reality endpoint device or a mobile computing device associated with the augmented reality endpoint device, an access credential for accessing the first enclosed space.

6. The method of claim 1 , wherein the processing system comprises the augmented reality endpoint device, the method further comprising:

receiving an input from the user selecting to access the first enclosed space; and

providing the input to at least one server associated with the venue.

7. The method of claim 6 , further comprising:

obtaining, from the at least one server, an access credential for accessing the first enclosed space.

8. The method of claim 1 , wherein the first visual information further comprises alphanumeric data regarding the first enclosed space.

9. The method of claim 8 , wherein the alphanumeric data comprises at least one of:

a cost for utilization of the first enclosed space;

data describing at least one feature of the first enclosed space; or

data describing additional information regarding the first enclosed space that can be accessed via the augmented reality endpoint device.

10. The method of claim 9 , wherein the alphanumeric data further includes data describing how to access the additional information regarding the first enclosed space.

11. The method of claim 1 , wherein the first imagery of the first enclosed space is from a perspective of the entryway of the first enclosed space facing into the first enclosed space.

12. The method of claim 1 , further comprising:

detecting a second location and a second orientation of the augmented reality endpoint device of the user at the venue;

identifying that the entryway of the first enclosed space of the venue is beyond a threshold distance from the augmented reality endpoint device and is within a second field-of-view of the augmented reality endpoint device in accordance with the second location and the second orientation of the augmented reality endpoint device; and

presenting, via the augmented reality endpoint device, second visual information of the first enclosed space, wherein the second visual information is presented within the second field-of-view as an overlay on or proximate to the entryway.

13. The method of claim 12 , further comprising:

presenting third visual information regarding at least a second enclosed space of the venue.

14. The method of claim 13 , wherein an entryway of the at least the second enclosed space is within the second field-of-view of the augmented reality endpoint device.

15. The method of claim 1 , wherein the first location and the first orientation of the augmented reality endpoint device are obtained from the augmented reality endpoint device.

16. The method of claim, 1 wherein the entryway of the first enclosed space is identified within the first field-of-view of the augmented reality endpoint device in accordance with at least one augmented reality anchor point of the venue.

17. A non-transitory computer-readable medium storing instructions which, when executed by a processing system including at least one processor, cause the processing system to perform operations, the operations comprising:

detecting a first location and a first orientation of an augmented reality endpoint device of a user at a venue;

identifying an entryway of a first enclosed space of the venue that is within a first field-of-view of the augmented reality endpoint device in accordance with the first location and the first orientation of the augmented reality endpoint device;

detecting a location of at least one object within the first enclosed space, wherein the location of the at least one object is detected via a wireless sensing of at least one wireless tag of the at least one object;

modifying at least one prior captured image of the first enclosed space to generate a first imagery of the first enclosed space that depicts the at least one object at the location that is detected, wherein the modifying comprises:

extracting visual data of the at least one object from the at least one prior captured image;

infilling, via a machine learning-based process, a portion of the at least one prior captured image from which the visual data of the at least one object is extracted to generate an infilled image; and

inserting imagery of the at least one object into the infilled image in accordance with the location that is detected, to generate the first imagery of the first enclosed space, wherein the imagery of the at least one object is based on the visual data of the at least one object that is extracted; and

presenting, via the augmented reality endpoint device, first visual information of the first enclosed space, wherein the first visual information comprises the first imagery of the first enclosed space and wherein the first visual information is presented within the first field-of-view.

18. An apparatus comprising:

a processing system including at least one processor; and

a computer-readable medium storing instructions which, when executed by the processing system, cause the processing system to perform operations, the operations comprising:

detecting a first location and a first orientation of an augmented reality endpoint device of a user at a venue;

identifying an entryway of a first enclosed space of the venue that is within a first field-of-view of the augmented reality endpoint device in accordance with the first location and the first orientation of the augmented reality endpoint device;

detecting a location of at least one object within the first enclosed space, wherein the location of the at least one object is detected via a wireless sensing of at least one wireless tag of the at least one object;

modifying at least one prior captured image of the first enclosed space to generate a first imagery of the first enclosed space that depicts the at least one object at the location that is detected, wherein the modifying comprises:

extracting visual data of the at least one object from the at least one prior captured image;

infilling, via a machine learning-based process, a portion of the at least one prior captured image from which the visual data of the at least one object is extracted to generate an infilled image; and

inserting imagery of the at least one object into the infilled image in accordance with the location that is detected, to generate the first imagery of the first enclosed space, wherein the imagery of the at least one object is based on the visual data of the at least one object that is extracted; and

presenting, via the augmented reality endpoint device, first visual information of the first enclosed space, wherein the first visual information comprises the first imagery of the first enclosed space and wherein the first visual information is presented within the first field-of-view.

19. The apparatus of claim 18 , wherein the user has a reservation with the venue for access to a first type of enclosed space, wherein the first enclosed space is of the first type of enclosed space.

20. The apparatus of claim 19 , wherein the identifying includes identifying that the first enclosed space is of the first type of enclosed space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2021
From: KREINER, BARRETT; PRATT, JAMES; LUU, ADRIANNE BINH; MOTON, ROBERT T., JR.; CHASTAIN, WALTER COOPER; CRAINE, ARI; KOCH, ROBERT
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 057687/0954 →
Continuity (1)
Related Publication 20230107590A1 · Apr 6, 2023
Cited By (1)
US 12,499,634