Granted Patent B2

US 12,192,680 · App. 18/507,991 · Granted Jan 7, 2025

Inventor: Philip Scott Lyren (Bangkok, TH)

Assignee: Pelagic Concepts LLC

H04N7/157G02B27/017G02B27/0176H04N7/144H04N7/147H04N13/167H04N13/189H04N13/194H04N13/332H04N13/344H04N13/383H04N13/398H04R1/00G02B2027/0134G02B2027/014G02B2027/0178G02B2027/0187H04N2007/145

Abstract

Claims (74)

1. A method comprising:

at a first electronic device in communication with a display and one or more sensors:

presenting, via the display, an environment including one or more physical locations in a field of view of the first electronic device;

while presenting the environment, detecting, via the one or more sensors, a first input corresponding to a request to enter into electronic communication with a second electronic device; and

in response to detecting the first input:

analyzing at least a subset of the one or more physical locations in the field of view of the first electronic device;

determining a first location in the environment; and

entering into the electronic communication with the second electronic device, including:

in accordance with a determination that a first set of criteria is satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying, via the display, a virtual object representing a user of the second electronic device at the first location in the environment; and

in accordance with a determination that the first set of criteria is not satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying the virtual object representing the user of the second electronic device at a second location, different from the first location, in the environment.

2. The method of claim 1 , wherein displaying the virtual object representing the user of the second electronic device includes displaying a three-dimensional image of the user of the second electronic device.

3. The method of claim 1 , wherein the first electronic device and the second electronic device each include a head-mounted display.

4. The method of claim 1 , wherein determining the first location in the environment includes determining a location that in front of a viewpoint of a user of the first electronic device in the field of view of the first electronic device.

5. The method of claim 4 , wherein:

the first set of criteria include a criterion that is satisfied when the first location does not include an object;

the second location does not include an object; and

the second location is within the field of view of the first electronic device.

6. The method of claim 1 , wherein determining the first location in the environment includes determining a location that is at a predetermined distance from a viewpoint of the first electronic device.

7. The method of claim 6 , wherein:

the first set of criteria include a criterion that is satisfied when the first location does not include an object;

the second location does not include an object; and

the second location is a respective distance, different from the predetermined distance, from the viewpoint of the first electronic device.

8. The method of claim 1 , wherein:

analyzing at least a subset of the one or more physical locations in the field of view of the first electronic device includes identifying one or more physical objects at the one or more physical locations in the field of view of the first electronic device; and

the first set of criteria includes a criterion that is satisfied when the first location does not include a physical object.

9. The method of claim 1 , further comprising:

in response to detecting the first input:

identifying one or more virtual objects in the environment;

wherein the first set of criteria includes a criterion that is satisfied when the first location does not include a virtual object.

10. The method of claim 1 , further comprising:

in response to detecting the first input:

transmitting a request to the second electronic device to enter into the electronic communication with the first electronic device, wherein:

the second electronic device analyzes at least a subset of one or more physical locations in a field of view of the second electronic device; and

the second electronic device determines a third location in an environment presented at the second electronic device.

11. The method of claim 10 , wherein:

in accordance with the determination that the first set of criteria is satisfied, a virtual object representing a user of the first electronic device is displayed at the third location in the environment at the second electronic device; and

in accordance with the determination that the first set of criteria is not satisfied, the virtual object representing the user of the first electronic device is displayed at a fourth location, different from the third location, in the environment at the second electronic device.

12. The method of claim 11 , wherein:

in accordance with the determination that the virtual object representing the user of the second electronic device is displayed at the first location and the virtual object representing the user of the first electronic device is displayed at the third location, the first location is a predefined distance from the third location in the environments presented at the first electronic device and the second electronic device; and

in accordance with the determination that the virtual object representing the user of the second electronic device is displayed at the second location and the virtual object representing the user of the first electronic device is displayed at the fourth location, the second location is the predefined distance from the fourth location in the environments presented at the first electronic device and the second electronic device.

13. The method of claim 11 , wherein the first set of criteria includes a first criterion that is satisfied when the first location does not include an object and a second criterion that is satisfied when the third location does not contain an object, the method further comprising:

in response to detecting the first input:

before entering into the electronic communication with the second electronic device:

transmitting, to the second electronic device, a first indication that the first criterion is satisfied because the first location does not contain an object, wherein the first location is a predefined distance from a viewpoint of the first electronic device; and

in response to receiving a second indication from the second electronic device that the second criterion is not satisfied because the third location contains an object in the environment at the second electronic device, transmitting, to the second electronic device, a third indication that the first criterion is satisfied because the second location does not contain an object, wherein the second location is a first distance, different from the predefined distance, from the viewpoint of the first electronic device.

14. The method of claim 13 , further comprising:

in response to receiving a fourth indication from the second electronic device that the second criterion is satisfied because the fourth location does not contain an object, wherein the fourth location is the first distance from a viewpoint of the second electronic device:

entering into the electronic communication with the second electronic device, including:

displaying the virtual object representing the user of the second electronic device at the second location in the environment that is the first distance from the viewpoint of the first electronic device;

wherein the virtual object representing the user of the first electronic device is displayed at the fourth location in the environment at the second electronic device that is the first distance from the viewpoint of the second electronic device.

15. The method of claim 1 , wherein:

an environment at the second electronic device includes a first object; and

entering into the electronic communication with the second electronic device further includes displaying the virtual object representing the user of the second electronic device with a representation of the first object.

16. A first electronic device comprising:

one or more processors;

memory; and

one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising:

presenting, via a display, an environment including one or more physical locations in a field of view of the first electronic device;

while presenting the environment, detecting, via one or more sensors, a first input corresponding to a request to enter into electronic communication with a second electronic device; and

in response to detecting the first input:

analyzing at least a subset of the one or more physical locations in the field of view of the first electronic device;

determining a first location in the environment; and

entering into the electronic communication with the second electronic device, including:

in accordance with a determination that a first set of criteria is satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying, via the display, a virtual object representing a user of the second electronic device at the first location in the environment; and

in accordance with a determination that the first set of criteria is not satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying the virtual object representing the user of the second electronic device at a second location, different from the first location, in the environment.

17. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device, cause the first electronic device to perform a method comprising:

presenting, via a display, an environment including one or more physical locations in a field of view of the first electronic device;

while presenting the environment, detecting, via one or more sensors, a first input corresponding to a request to enter into electronic communication with a second electronic device; and

in response to detecting the first input:

analyzing at least a subset of the one or more physical locations in the field of view of the first electronic device;

determining a first location in the environment; and

entering into the electronic communication with the second electronic device, including:

in accordance with a determination that a first set of criteria is satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying, via the display, a virtual object representing a user of the second electronic device at the first location in the environment; and

in accordance with a determination that the first set of criteria is not satisfied based on the analyzing of at least the subset of the one or more physical locations, displaying the virtual object representing the user of the second electronic device at a second location, different from the first location, in the environment.

Continuity (14)

References Cited (61)