IP Library Granted Patent US 12,475,612
Granted Patent B2
US 12,475,612 · App. 18/673,176 · Granted Nov 18, 2025

Method and device for resolving focal conflict

Inventors: Alexis Henri Palangie (Palo Alto, CA); Shih Sang Chiu (San Francisco, CA); Bruno M. Sommer (Sunnyvale, CA); Connor Alexander Smith (San Mateo, CA); Aaron Mackay Burns (Sunnyvale, CA)
Assignee: APPLE INC.
G06T11/00G06T5/20G06T5/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,612
App. No.
18/673,176
Filed
May 23, 2024
Granted
Nov 18, 2025
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

In one implementation, a method of resolving focal conflict in a computer-generated reality (CGR) environment is performed by a device including a processor, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, an image of a scene including a real object in a particular direction at a first distance from the device. The method includes displaying, on the display, a CGR environment including a virtual object in the particular direction at a second distance from the device. In accordance with a determination that the second distance is less than the first distance, the CGR environment includes the virtual object overlaid on the scene. In accordance with a determination that the second distance is greater than the first distance, the CGR environment includes the virtual object with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

Claims (37)

1 . A method comprising:

at a device including an image sensor, a display, one or more processors, and non-transitory memory:

capturing, using the image sensor, an image of a first real environment including a real object at a first distance from the device in a particular direction; and

displaying, on the display, a computer-generated reality (CGR) environment including a virtual avatar at a first location in the first real environment that represents a person at a second location in a second real environment remote from the first real environment and moves in the first real environment correspondingly with movement of the person in the second real environment;

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is less than the first distance, the CGR environment includes the virtual avatar overlaid on the first real environment; and

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is greater than the first distance, the CGR environment includes the virtual avatar with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

2 . The method of claim 1 , wherein the obfuscation area surrounds the virtual avatar.

3 . The method of claim 1 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

4 . The method of claim 3 , wherein the virtual avatar is not blurred.

5 . The method of claim 1 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

6 . The method of claim 5 , wherein the virtual avatar is not dimmed.

7 . The method of claim 1 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

8 . The method of claim 1 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

9 . The method of claim 8 , wherein the virtual world includes a virtual floor.

10 . The method of claim 9 , wherein the virtual floor is coplanar with a real floor of the scene.

11 . The method of claim 9 , further comprising displaying a virtual shadow of the virtual avatar on the virtual floor.

12 . A device comprising:

an image sensor;

a display;

a non-transitory memory; and

one or more processors to:

capture, using the image sensor, an image of a first real environment including a real object at a first distance from the device in a particular direction; and

display, on the display, a computer-generated reality (CGR) environment including a virtual avatar at a first location in the first real environment that represents a person at a second location in a second real environment remote from the first real environment and moves in the first real environment correspondingly with movement of the person in the second real environment;

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is less than the first distance, the CGR environment includes the virtual avatar overlaid on the first real environment; and

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is greater than the first distance, the CGR environment includes the virtual avatar with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

13 . The device of claim 12 , wherein the obfuscation area surrounds the virtual object.

14 . The device of claim 12 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

15 . The device of claim 12 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

16 . The device of claim 12 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

17 . The device of claim 12 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

18 . The device of claim 17 , wherein the virtual world includes a virtual floor coplanar with a real floor of the scene.

19 . The device of claim 18 , wherein the one or more processors are further to display a virtual shadow of the virtual avatar on the virtual floor.

20 . A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an image sensor and a display cause the device to:

capture, using the image sensor, an image of a first real environment including a real object at a first distance from the device in the particular direction; and

display, on the display, a computer-generated reality (CGR) environment including a virtual avatar at a first location in the first real environment that represents a person at a second location in a second real environment remote from the first real environment and moves in the CGR environment correspondingly with movement of the person in the second real environment;

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is less than the first distance, the CGR environment includes the virtual avatar overlaid on the first real environment; and

wherein, in accordance with a determination that the second location corresponds to the first location that is a second distance from the device in the particular direction that is greater than the first distance, the CGR environment includes the virtual avatar with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

Continuity (3)
Continuation 16909620 · Jun 23, 2020
Provisional Application 62906929 · Sep 27, 2019
Related Publication 20240312073A1 · Sep 19, 2024
References Cited (22)
US 9690374B2 · Clement et al. · 2017 [cited by applicant]
US 20120206452A1 · Geisner et al. · 2012 [cited by applicant]
US 20130194259A1 · Bennett et al. · 2013 [cited by applicant]
US 20150091780A1 · Lyren · 2015 [cited by applicant]
US 20160307374A1 · Kurz et al. · 2016 [cited by applicant]
US 20170053042A1 · Sugden et al. · 2017 [cited by applicant]
US 20170256096A1 · Faaborg et al. · 2017 [cited by applicant]
US 20190221043A1 · Kopper et al. · 2019 [cited by applicant]
US 20190230297A1 · Knorr et al. · 2019 [cited by applicant]
US 20190287308A1 · Luo et al. · 2019 [cited by applicant]
US 20200082601A1 · Jones et al. · 2020 [cited by applicant]
US 20200082629A1 · Jones et al. · 2020 [cited by applicant]
US 20200184653A1 · Faulkner · 2020 [cited by applicant]
CN 1746822A · 2006 [cited by applicant]
CN 103472909A · 2013 [cited by applicant]
CN 103823553A · 2014 [cited by applicant]
First Chinese Office Action issued Jun. 28, 2024, Chinese Patent Application No. 202010721303.8, pp. 1-17 (Includes English Translation of Search Report). [cited by applicant]
Tian Yuan, “Research on Occlusion Handling between Virtual and Real Worlds in Augmented Reality Systems,” Dissertation Submitted in Partial Fufillment of the Requirements for the Degree of Doctor of Philosophy in Scienc… [cited by applicant]
Erick Mendez et al., “Importance Masks for Revealing Occluded in Augmented Reality,” Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology. 2009. [cited by applicant]
Ilyas Hamadouche, “Augmented Reality X-Ray Vision on Optical See-Through Head-Mounted Displays”, Master's Thesis, Degree Programme in Comupter Science and Engineering, University of Oulu, Jun. 2018, pp. 1-62. [cited by applicant]
Chi Xu et al., “Occlusion Handling in Augmented Reality System for Human-Assisted Assembly Task,” Intelligent Robotics and Applications: First International Conference, ICIRA 2008 Wuhan, China, Oct. 15-17, 2008 Proceedi… [cited by applicant]
Second Office Action dated Dec. 13, 2024, Chinese Application No. 2020107213038, pp. 1-4. [cited by applicant]