IP Library Granted Patent US 12,033,240
Granted Patent B2
US 12,033,240 · App. 16/909,620 · Granted Jul 9, 2024

Method and device for resolving focal conflict

Inventors: Alexis Henri Palangie (Palo Alto, CA); Shih Sang Chiu (San Francisco, CA); Bruno M. Sommer (Sunnyvale, CA); Connor Alexander Smith (San Mateo, CA); Aaron Mackay Burns (Sunnyvale, CA)
Assignee: APPLE INC.
G06T11/00G06T5/20G06T5/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,033,240
App. No.
16/909,620
Filed
Jun 23, 2020
Granted
Jul 9, 2024
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

In one implementation, a method of resolving focal conflict in a computer-generated reality (CGR) environment is performed by a device including a processor, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, an image of a scene including a real object in a particular direction at a first distance from the device. The method includes displaying, on the display, a CGR environment including a virtual object in the particular direction at a second distance from the device. In accordance with a determination that the second distance is less than the first distance, the CGR environment includes the virtual object overlaid on the scene. In accordance with a determination that the second distance is greater than the first distance, the CGR environment includes the virtual object with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

Claims (37)

1. A method comprising:

at a device including one or more processors, an image sensor, non-transitory memory, and a display:

capturing, using the image sensor, an image of a scene including a real object; and

displaying, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;

wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and

wherein, in accordance with a determination that the virtual object has moved through the real object further from the device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

2. The method of claim 1 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

3. The method of claim 1 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

4. The method of claim 1 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

5. The method of claim 1 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

6. The method of claim 5 , wherein the virtual world includes a virtual floor.

7. The method of claim 6 , wherein the virtual floor is coplanar with a real floor of the scene.

8. The method of claim 6 , further comprising displaying a virtual shadow of the virtual object on the virtual floor.

9. The method of claim 1 , wherein the obfuscation area occupies the entire display except for the virtual object.

10. The method of claim 1 , wherein displaying the CGR environment includes displaying, on the display, a representation of the scene.

11. An electronic device comprising:

an image sensor;

a display;

a non-transitory memory; and

one or more processors to:

capture, using the image sensor, an image of a scene including a real object; and

display, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;

wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and

wherein, in accordance with a determination that the virtual object has moved through the real object further from then device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

12. The method of claim 1 , wherein the virtual object represents a real object remote from CGR environment that correspondingly moves in the CGR environment when the real object remote from the CGR environment moves.

13. The method of claim 12 , wherein the real object remote from the CGR environment is a person and the virtual object is an avatar.

14. The electronic device of claim 11 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

15. The electronic device of claim 11 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

16. The electronic device of claim 11 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

17. The electronic device of claim 11 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

18. The electronic device of claim 17 , wherein the virtual world includes a virtual floor that is coplanar with a real floor of the scene.

19. The electronic device of claim 11 , wherein the obfuscation area occupies the entire display except for the virtual object.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an image sensor and a display cause the device to:

capture, using the image sensor, an image of a scene including a real object; and

display, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;

wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and

wherein, in accordance with a determination that the virtual object has moved through the real object further from then device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2020
From: PALANGIE, ALEXIS HENRI; CHIU, SHIH SANG; SOMMER, BRUNO M.; SMITH, CONNOR ALEXANDER; BURNS, AARON MACKAY
To: APPLE INC.
Reel/Frame 053026/0921 →
Continuity (2)
Provisional Application 62906929 · Sep 27, 2019
Related Publication 20210097729A1 · Apr 1, 2021