IP Library Granted Patent US 12,169,902
Granted Patent B2
US 12,169,902 · App. 17/853,557 · Granted Dec 17, 2024

Methods and systems for composing and executing a scene

Inventors: Mark E. Drummond (Palo Alto, CA); Daniel L Kovacs (Santa Clara, CA); Shaun D. Budhram (Los Gatos, CA); Edward Ahn (San Francisco, CA); Behrooz Mahasseni (San Jose, CA); Aashi Manglik (Sunnyvale, CA); Payal Jotwani (Santa Clara, CA); Mu Qiao (Campbell, CA); Bo Morgan (Emerald Hills, CA); Noah Gamboa (San Franciso, CA); Michael J. Gutensohn (San Francisco, CA); Dan Feng (Santa Clara, CA); Siva Chandra Mouli Sivapurapu (Santa Clara, CA)
Assignee: APPLE INC.
G06T19/006G06T19/003G06T2200/24G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,169,902
App. No.
17/853,557
Granted
Dec 17, 2024
Kind
B2
Abstract

In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

Claims (42)

1. A method comprising:

scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;

displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;

scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and

in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

2. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding a size or shape of the first physical object.

3. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding an object type of the first physical object.

4. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding a usability of the first physical object.

5. The method of claim 4 , wherein the criterion regarding the usability of the first physical object is defined with respect to the virtual object.

6. The method of claim 4 , wherein the criterion regarding the usability of the first physical object is defined with respect to a fifth physical object.

7. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying a composite image of the virtual object and the first physical environment.

8. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes projecting the virtual object over a view of the first physical environment.

9. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object over a representation or view of the first physical object or the second physical object.

10. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object proximate to a representation or view of the first physical object or the second physical object.

11. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object interacting with a representation or view of the first physical object or the second physical object.

12. The method of claim 1 , wherein a variance of the second path is different than a variance of the first path.

13. The method of claim 1 , wherein at least one of the first path or the second path is determined to avoid another object.

14. The method of claim 1 , further comprising:

in response to determining that the second physical environment does not include the third physical object that meets the at least one first object criterion:

forgo displaying the virtual object in association with the second physical environment; and

displaying a notification that the second physical environment is missing a physical object that meets the at least one first object criterion.

15. The method of claim 1 , further comprising:

in response to determining that the second physical environment does not include the third physical object that meets the at least one first object criterion or the fourth physical object that meets the at least one second object criterion:

displaying a rescan affordance to rescan the second physical environment;

detecting a user input selecting the rescan affordance; and

in response to detecting the user input selecting the rescan affordance, rescanning the second physical environment to determine whether the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion.

16. A device comprising:

a display;

non-transitory memory; and

one or more processors to:

scan a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;

display, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;

scan a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and

in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, display, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

17. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding a size or shape of the first physical object.

18. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding an object type of the first physical object.

19. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding a usability of the first physical object.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device including a display, cause the device to:

scan a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;

display, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;

scan a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and

in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, display, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2022
From: DRUMMOND, MARK E; KOVACS, DANIEL LASZLO; BUDHRAM, SHAUN D.; AHN, EDWARD; MAHASSENI, BEHROOZ; MANGLIK, AASHI; JOTWANI, PAYAL; QIAO, MU; MORGAN, BO; GAMBOA, NOAH; GUTENSHOHN, MICHAEL J.; FENG, DAN; SIVAPURAPU, SIVA CHANDRA MOULI
To: APPLE INC.
Reel/Frame 060396/0795 →
Continuity (2)
Provisional Application 63246631 · Sep 21, 2021
Related Publication 20230089049A1 · Mar 23, 2023