Granted Patent B2

US 12,299,827 · App. 17/968,687 · Granted May 13, 2025

Inventor: Zheng Fang (McLean, VA)

Assignee: T-Mobile USA, Inc.

G06T19/006G01S19/01G02B27/0172G06F3/0346G06T13/40G06T19/20G06T2200/24

Abstract

Claims (91)

1. A system associated with a telecommunications network, the system in communication with a wireless device and a head-mounted display (HMD) device, the system comprising:

at least one hardware processor; and

at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:

determine a first location of the wireless device on the telecommunications network;

determine a second location of the HMD device communicatively coupled to the telecommunications network,

wherein the wireless device is a mobile phone, a tablet computer, a laptop computer, or a smart watch;

receive, from the wireless device, parameter data of the wireless device,

wherein the parameter data is generated by one or more sensors of the wireless device,

generate mixed reality data based the first location or a relative location of the wireless device and the parameter data,

wherein the relative location corresponds to the first location of the wireless device relative to the second location of the HMD device, and

wherein the mixed reality data anchors a virtual object to a real-world object at the first location of the wireless device and the mixed reality data includes a virtual image of the wireless device based on the parameter data; and

cause the HMD device to display, while the wireless device is in the first location and the HMD device is in the second location, an immersive view to a user wearing the HMD device based on the mixed reality data,

send a command to the wireless device that causes the wireless device to perform a particular action causing a modification on a display of the wireless device, and

concurrently change the mixed reality data to include a modified virtual image of the wireless device corresponding to the modification on the display of the wireless device, wherein the modified virtual image of the wireless device includes the modification on the display of the wireless device.

2. The system of claim 1 , wherein:

the first location is different from the second location, and

the immersive view corresponds to an instance where the user wearing the HMD device has virtually teleported to the first location at which the wireless device is located at, while the user of the HMD device is physically located at the second location.

3. The system of claim 1 , wherein:

the first location is different from the second location, and

the immersive view includes customized features that are associated with the first location.

4. The system of claim 1 , wherein:

the first location is different from the second location, and

the immersive view includes an avatar,

wherein the avatar has an appearance and communicates in a language that is associated with the first location.

5. The system of claim 1 , further caused to:

when the first location corresponds to the second location, the generated mixed reality data includes features associated with the first location, and

after the wireless device changes its position to a third location, that is distinct from the first location, the generated mixed reality data includes features associated with the third location.

6. The system of claim 1 , wherein:

the first location is determined based on a first global positioning system (GPS) signal received from the wireless device, and

the second location is determined based on a second GPS signal received from the HMD.

7. The system of claim 1 , wherein:

the first location is determined based on an input received from a representative of the telecommunications network,

wherein the first location is a space associated with the telecommunications network.

8. The system of claim 1 , wherein:

the wireless device and the HMD are in communication with a common base station of the telecommunications network, and

determining the first location and the second location includes deriving an inference that the first location corresponds to the second location based on the common base station of the telecommunications network.

9. The system of claim 1 , wherein:

the real-world object represents the wireless device.

10. The system of claim 1 , wherein:

the real-world object represents an object different from the wireless device.

11. The system of claim 1 , wherein:

the immersive view displayed by the HMD device is configured to provide a metaverse experience to the user wearing the HMD device,

wherein the metaverse experience includes real-time virtual interactions with spaces and/or people located across a distance from the user wearing the HMD device.

12. The system of claim 1 , wherein:

the user wearing the HMD device is different than a user operating the wireless device.

13. The system of claim 1 , wherein:

the system is in communication with the wireless device via a first base station of the telecommunications network,

the system in in communication with the HMD device via a second base station of the telecommunications network, and

the first base station is different and separate from the second base station.

14. The system of claim 1 , wherein:

the virtual object corresponds to an object in a repair shop of a network operator associated with the telecommunications network,

the mixed reality data further includes avatar data configured to generate an avatar that virtually communicates with the user wearing the HMD device, and

the avatar represents to a service representative of the repair shop.

15. The system of claim 1 further caused to:

receive, from the wireless device, real-world image data captured by a camera of the wireless device,

wherein the mixed reality data is generated based on the real-world image data.

16. A method for generating mixed reality data to be displayed by a head-mounted display (HMD) device, the method comprising:

determining a first location of a wireless device communicatively coupled to a telecommunications network;

determining a second location of the HMD device communicatively coupled to the telecommunications network,

wherein the wireless device is a mobile phone, a tablet computer, a laptop computer, or a smart watch;

receiving, from the wireless device, parameter data of the wireless device,

wherein the parameter data is generated by one or more sensors of the wireless device,

generating mixed reality data based on the parameter data,

wherein the mixed reality data anchors a virtual object to a real-world object at the first location of the wireless device and the mixed reality data includes a virtual image of the wireless device based on the parameter data;

cause the HMD device to display, while the wireless device is in the first location and the HMD device is in the second location, an immersive view to a user wearing the HMD device based on the mixed reality data,

sending a command to the wireless device that causes the wireless device to perform a particular action causing a modification on a display of the wireless device, and

concurrently changing the mixed reality data to include a modified virtual image of the wireless device corresponding to the modification on the display of the wireless device, wherein the modified virtual image of the wireless device includes the modification on the display of the wireless device.

17. The method of claim 16 , wherein:

the first location is different from the second location, and

the immersive view corresponds to an instance where the user wearing the HMD device has virtually teleported to the first location at which the wireless device is located at, while the user of the HMD device is physically located at the second location.

18. The method of claim 16 , wherein:

the first location is different from the second location, and

the immersive view includes customized features that are associated with the first location.

19. A wireless device in communication with a system associated with a telecommunications network and a head-mounted display (HMD) device, the wireless device comprising:

one or more sensors;

at least one hardware processor; and

at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the wireless device to:

transmit, to the system, location data indicating a first location of the wireless device,

wherein the HMD device is located at a second location;

capture, by the one or more sensors, parameter data associated with the wireless device;

send the parameter data to the system;

cause the system to generate mixed reality data based the first location or a relative location of the wireless device and the parameter data,

wherein the relative location corresponds to the first location of the wireless device relative to the second location of the HMD device, and

wherein the mixed reality data anchors a virtual object to a real-world object at the first location of the wireless device and the mixed reality data includes a virtual image of the wireless device based on the parameter data;

cause the HMD device to display, while the wireless device is in the first location and the HMD device is in the second location, an immersive view to a user wearing the HMD device based on the mixed reality data;

send a command to the wireless device that causes the wireless device to perform a particular action causing a modification on a display of the wireless device,

wherein the wireless device is a mobile phone, a tablet computer, a laptop computer, or a smart watch; and

concurrently change the mixed reality data to include a modified virtual image of the wireless device corresponding to the modification on the display of the wireless device, wherein the modified virtual image of the wireless device includes the modification on the display of the wireless device.

20. The device of claim 19 , wherein:

the first location is different from the second location, and

the immersive view corresponds to an instance where the user wearing the HMD device has virtually teleported to the first location at which the wireless device is located at, while the user of the HMD device is physically located at the second location.

Assignments (1)

Continuity (2)

References Cited (181)