IP Library Granted Patent US 11,652,878
Granted Patent B2
US 11,652,878 · App. 17/106,932 · Granted May 16, 2023

Extended-reality system and method

Inventors: Roberto Lopez Mendez (Cambridge, GB); Daren Croxford (Swaffham Prior, GB); Laura Johanna Lähteenmäki (Cambridge, GB)
Assignee: Arm Limited
H04L67/1074G06T1/60G06T7/70H04L67/568
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,652,878
App. No.
17/106,932
Granted
May 16, 2023
Kind
B2
Abstract

An extended-reality system is described which determines extended-reality data to be obtained from the remote network-connected storage based on a location of the extended-reality system. The extended-reality system determines a communication method by which to obtain the extended-reality data, wherein the extended-reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system. A request is sent to at least one of the local device via a peer-to-peer network and the remote network-connected storage in dependence upon the determination by the extended-reality system.

Claims (42)

1. An extended-reality system for providing information to a user, the system comprising:

a data determining unit configured to determine extended-reality data relating to locations within a distance of a location of the extended-reality system to be obtained based on a location and surrounding environment of the extended-reality system;

a communication method determining unit configured to receive, from a third-party device that monitors a number of users in an area over at least one of days, months, and years to generate information identifying numbers of extended-reality systems in an area over different time periods, the generated information and determine a communication method for obtaining the extended-reality data based at least in part on the received information from the third-party device, wherein the extended-reality data may be obtained by one or more requests to a remote network-connected storage or by one or more requests to a local device outside of the extended-reality system via a peer-to-peer network, which local device has previously obtained the extended-reality data from the remote network-connected storage; and

a communication unit configured to send a request to at least one of the local devices via the peer-to-peer network and the remote network-connected storage in dependence upon the determination by the communication method determining unit.

2. An extended-reality system according to claim 1 , wherein the extended-reality system comprises a storage and a portion of the storage is allocated as a cache for extended-reality data, wherein extended reality data stored in the cache may be provided to one or more local devices participating in the peer-to-peer network.

3. An extended-reality system according to claim 2 wherein the extended-reality data stored in the storage includes a data field indicating a time at which the data needs to be refreshed from the remote network-connected storage.

4. An extended-reality system according to claim 1 , wherein the extended-reality data includes information relating to the location of the user.

5. An extended-reality system according to claim 1 , wherein the location of the user is determined using at least one of: a satellite navigation system or cellular network triangulation.

6. An extended-reality system according to claim 1 , further comprising a camera for capturing images and a processor, wherein the processor is configured to process image data from the camera in order to determine a location of the extended reality system.

7. An extended-reality system according to claim 1 , further comprising a network service discovery service configured to identify devices on the peer-to-peer network that can provide or access the extended-reality data determined by the data determining unit.

8. An extended-reality system according to claim 1 , wherein the extended-reality system is configured to send a request to the local device including a request to access a network connection of the local device in order to obtain the extended-reality data.

9. An extended-reality system according to claim 1 , wherein the extended-reality system is configured to receive settings from a user to control at least one of: a data amount transfer on a wireless connection that may be used on request by other devices on the peer-to-peer network, an amount of memory on the extended-reality system that may be used to store data for access by other devices on the peer-to-peer network, whether the device is tethered, a condition on the battery life of the extended-reality system that controls whether or not other devices on the peer-to-peer network may access data from the extended-reality system.

10. An extended-reality system according to claim 1 , wherein the extended-reality system is configured to predict a movement of a wearer of the extended-reality system, wherein the data determining unit is configured to determine extended-reality data to be obtained based on the predicted movement of the wearer.

11. An extended-reality system according to claim 1 , wherein the extended reality system is configured to obtain traffic information relating to movement patterns of users of extended-reality systems and wherein the data determining unit is configured to determine extended-reality data to be obtained based on the obtained traffic information.

12. An extended-reality system according to claim 1 , wherein the extended-reality system is configured to receive a request for extended-reality data from a requesting device via the peer-to-peer network, the extended-reality system being configured to send extended-reality data to the requesting device in dependence upon at least one of:

bandwidth of a connection available between the extended reality system and the requesting device over the peer-to-peer network;

a battery level of the extended-reality system;

a strength of a connection between the extended-reality system and the requesting device;

a power consumption required to communicate with the requesting device over the peer-to-peer network;

and

a trust level of the requesting device.

13. An extended reality system according to claim 1 , wherein the extended reality system is configured to:

receive a request to obtain extended-reality data that is not present on the extended reality system from a requesting device on the peer-to-peer network; and

obtain the extended-reality data from the remote network-connected storage on behalf of the requesting device in dependence upon at least one of:

a rule relating to a quality of at least one of the connection between the extended-reality system and the remote network connected storage and the connection between the extended reality system and the requesting device over the peer-to-peer network;

a battery level of the extended-reality system;

a power consumption required to communicate with at least one of the requesting device and the remote network-connected storage;

a latency involved in retrieving the requested extended-reality data;

and a trust level of the requesting device.

14. An extended reality system according to claim 1 wherein the communication method determining unit is configured to request the extended-reality data to be obtained from the peer-to-peer network before sending a request to the remote network-connected storage.

15. An extended reality system according to claim 14 , wherein the communication method determining unit is configured to send a request for extended-reality data to the remote network-connected storage if no response is received from the peer-to-peer network within a predetermined threshold time period.

16. An extended reality system according to claim 1 , wherein the communication method determining unit is configured to request the extended-reality data to be obtained from the remote network-connected storage before sending a request over the peer-to-peer network.

17. A method for obtaining extended-reality data for an extended-reality system, the method comprising:

determining extended-reality data relating to locations within a distance of a location of the extended reality system to be obtained based on a location and surrounding environment of the extended-reality system;

receiving, from a third-party device that monitors a number of users in an area over at least one of days, months, and years to generate information identifying numbers of extended-reality systems in an area over different time periods, the generated information;

determining a communication method for obtaining the extended-reality data based at least in part on the received information, wherein the extended reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system via a peer-to-peer network, which local device has previously obtained the extended-reality data from the remote network-connected storage; and

sending a request to at least one of the local device via the peer-to-peer network and the remote network-connected storage in dependence upon the determined communication method.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by an extended-reality system, cause the extended-reality system to perform a method comprising:

determining extended-reality data relating to locations within a distance of a location of the extended reality system to be obtained based on a location and surrounding environment of the extended-reality system;

receiving, from a third-party device that monitors a number of users in an area over at least one of days, months, and years to generate information identifying numbers of extended-reality systems in an area over different time periods, the generated information;

determining a communication method for obtaining the extended-reality data based at least in part on the received information, wherein the extended reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system via a peer-to-peer network, which local device has previously obtained the extended-reality data from the remote network-connected storage; and

sending a request to at least one of the local device via the peer-to-peer network and the remote network-connected storage in dependence upon the determined communication method.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: APICAL LIMITED
To: ARM LIMITED
Reel/Frame 060620/0954 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2020
From: LOPEZ MENDEZ, ROBERTO; LÄHTEENMÄKI, LAURA JOHANNA
To: ARM LIMITED
Reel/Frame 054492/0242 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2020
From: CROXFORD, DAREN
To: APICAL LIMITED
Reel/Frame 054492/0296 →
Continuity (1)
Related Publication 20220174111A1 · Jun 2, 2022