Granted Patent B2

US 12,437,494 · App. 18/471,850 · Granted Oct 7, 2025

Inventors: Guillaume Couche (London, GB); Jonny Yeo (London, GB); William D. Lindmeier (San Francisco, CA); Tony Kobayashi (Berkeley, CA)

Assignee: Apple Inc.

G06T19/20

Abstract

Claims (71)

1. A method comprising:

at an electronic device in communication with a display and one or more input devices including a first input device:

presenting, via the display, a computer-generated environment comprising a preview voxel at a distance from a first end of a representation of the first input device;

detecting, via the first input device, a first input directed to a first physical location corresponding to a first virtual location in the computer-generated environment; and

in accordance with a determination that the first input includes a selection input and a release input directed to the first physical location:

in accordance with a determination that the first virtual location is empty before detecting the first input, depositing a first voxel at the first virtual location, the first voxel corresponding to the preview voxel; and

in accordance with a determination that the first virtual location is filled with a second voxel before detecting the first input, removing the second voxel.

2. The method of claim 1 , further comprising:

in accordance with a determination that the first input includes a movement input between the selection input and the release input from the first physical location to a second physical location corresponding to a second virtual location, different from the first virtual location:

in accordance with a determination that the first virtual location is empty before the first input, depositing a plurality of voxels at a corresponding plurality of virtual locations comprising the first virtual location, the second virtual location, and intervening virtual locations, wherein the plurality of voxels corresponds to the preview voxel; and

in accordance with a determination that the first virtual location is filled with the first voxel before the first input, removing at least the first voxel.

3. The method of claim 1 , further comprising:

in accordance with a determination that the first input includes a different selection input and a movement input between the different selection input and the release input from the first physical location corresponding to the first virtual location to a second physical location corresponding to a second virtual location, different from the first virtual location:

in accordance with a determination that the first virtual location is empty before the first input, filling voxels in a region between the first voxel and the second voxel with a second plurality of voxels corresponding to the preview voxel, wherein the first virtual location and the second virtual location represent opposite vertices of the region; and

in accordance with a determination that the first virtual location is filled with the second voxel before the first input is detected, removing at least the second voxel.

4. The method of claim 3 , further comprising:

in accordance with the determination that the first virtual location is filled with the second voxel before the first input is detected, and in accordance with a determination that virtual locations in a region between the first virtual location and the second virtual location are filled with respective voxels, removing each of the voxels in the region between the first virtual location and the second virtual location, wherein removing the at least the second voxel comprises removing each of the voxels in the region between the first virtual location and the second virtual location.

5. The method of claim 3 , further comprising:

after the different selection input, presenting a first representation of a region around the preview voxel at the first virtual location;

during the movement input, expanding the first representation of the region to a second representation of the region between the first virtual location and the second virtual location; and

after the release input, ceasing displaying the second representation of the region.

6. The method of claim 1 , further comprising:

presenting a three-dimensional grid of virtual locations around the representation of the preview voxel, wherein each virtual location in the three-dimensional grid of virtual locations represents a location that can be filled with a voxel.

7. The method of claim 6 , further comprising moving the three-dimensional grid of virtual locations with the preview voxel based on movement of the preview voxel in accordance with movement of the first input device.

8. An electronic device, comprising:

a display, wherein the electronic device is in communication with one or more input devices including a first input device; and

the electronic device further comprising one or more processors configured to:

present, via the display, a computer-generated environment comprising a preview voxel at a distance from a first end of a representation of the first input device;

detect, via the first input device, a first input directed to a first physical location corresponding to a first virtual location in the computer-generated environment; and

in accordance with a determination that the first input includes a selection input and a release input directed to the first physical location:

in accordance with a determination that the first virtual location is empty before detecting the first input, deposit a first voxel at the first virtual location, the first voxel corresponding to the preview voxel; and

in accordance with a determination that the first virtual location is filled with a second voxel before detecting the first input, remove the second voxel.

9. The electronic device of claim 8 , the one or more processors further configured to:

display a first user interface comprising a plurality of user interface elements representing a plurality of preview voxels including a first user interface element representing the preview voxel and a second user interface element representing a second preview voxel;

receive, via the first input device, a second input selecting the second user interface element representing the second preview voxel; and

present the second preview voxel at the distance from the first end of the representation of the first input device in accordance with the second input.

10. The electronic device of claim 9 , the one or more processors further configured to:

while displaying the first user interface, cease presenting the preview voxel at the distance from the first end of the representation of the first input device.

11. The electronic device of claim 9 , the one or more processors further configured to:

present the first user interface in response to a third input detected via the first input device directed at the representation of the preview voxel.

12. The electronic device of claim 8 , wherein a second end of the representation of the first input device, opposite the first end, includes a representation of the preview voxel.

13. The electronic device of claim 8 , the one or more processors further configured to:

display a second user interface comprising a plurality of user interface elements representing options for translating, rotating, or scaling a virtual object comprising one or more voxels created by the first input device;

receive, via a second input source different than the first input device, a fourth input including a selection input and a movement input;

in accordance with a determination that a translating option is active in the second user interface, translate the virtual object in the computer-generated environment in accordance with the movement input;

in accordance with a determination that a rotating option is active in the second user interface, rotate the virtual object in the computer-generated environment in accordance with the movement input; and

in accordance with a determination that a scaling option is active in the second user interface, scale the virtual object in the computer-generated environment in accordance with the movement input.

14. The electronic device of claim 13 , the one or more processors further configured to:

detect the second input source via a second input device, wherein the second user interface is displayed in accordance with a determination that the second input source satisfies one or more criteria.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device in communication with a display and one or more input devices including a first input device, cause the electronic device to:

present, via the display, a computer-generated environment comprising a preview voxel at a distance from a first end of a representation of the first input device;

detect, via the first input device, a first input directed to a first physical location corresponding to a first virtual location in the computer-generated environment; and

in accordance with a determination that the first input includes a selection input and a release input directed to the first physical location:

in accordance with a determination that the first virtual location is empty before detecting the first input, deposit a first voxel at the first virtual location, the first voxel corresponding to the preview voxel; and

in accordance with a determination that the first virtual location is filled with a second voxel before detecting the first input, remove the second voxel.

16. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, further cause the electronic device to:

in accordance with a determination that the first input includes a movement input between the selection input and the release input from the first physical location to a second physical location corresponding to a second virtual location, different from the first virtual location:

in accordance with a determination that the first virtual location is empty before the first input, deposit a plurality of voxels at a corresponding plurality of virtual locations comprising the first virtual location, the second virtual location, and intervening virtual locations, wherein the plurality of voxels corresponds to the preview voxel; and

in accordance with a determination that the first virtual location is filled with a first voxel before the first input, remove at least the first voxel.

17. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, further cause the electronic device to:

in accordance with a determination that the first input includes a different selection input and a movement input between the different selection input and the release input from the first physical location corresponding to the first virtual location to a second physical location corresponding to a second virtual location, different from the first virtual location:

in accordance with a determination that the first virtual location is empty before the first input, fill voxels in a region between the first voxel and the second voxel with a second plurality of voxels corresponding to the preview voxel, wherein the first virtual location and the second virtual location represent opposite vertices of the region; and

in accordance with a determination that the first virtual location is filled with a second voxel before the first input is detected, remove at least the second voxel.

18. The non-transitory computer readable storage medium of claim 17 , wherein the instructions, when executed, further cause the electronic device to:

in accordance with the determination that the first virtual location is filled with the second voxel before the first input is detected, and in accordance with a determination that virtual locations in a region between the first virtual location and the second virtual location are filled with respective voxels, remove each of the voxels in the region between the first virtual location and the second virtual location, wherein removing the at least the second voxel comprises removing each of the voxels in the region between the first virtual location and the second virtual location.

19. The non-transitory computer readable storage medium of claim 17 , wherein the instructions, when executed, further cause the electronic device to:

after the different selection input, present a first representation of a region around the preview voxel at the first virtual location;

during the movement input, expand the first representation of the region to a second representation of the region between the first virtual location and the second virtual location; and

after the release input, cease displaying the second representation of the region.

20. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, further cause the electronic device to:

present a three-dimensional grid of virtual locations around the representation of the preview voxel, wherein each virtual location in the three-dimensional grid of virtual locations represents a location that can be filled with a voxel.

Assignments (2)

Continuity (2)

References Cited (212)