IP Library Granted Patent US 12,271,521
Granted Patent B2
US 12,271,521 · App. 18/367,214 · Granted Apr 8, 2025

Controlling a user selection queue

Inventors: Geoffrey Grant Stahl (San Jose, CA); Norman Nuo Wang (Saratoga, CA)
Assignee: APPLE INC.
G06F3/013G06F3/04815G06F3/167G06F16/954G06T7/74G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,271,521
App. No.
18/367,214
Granted
Apr 8, 2025
Kind
B2
Abstract

Various implementations disclosed herein include devices, systems, and methods for compositing an affordance in association with a CGR object representing a physical article. In various implementations, a device includes a display, a non-transitory memory, and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a computer-generated reality (CGR) object in a CGR environment. In some implementations, the CGR object represents a physical article. In some implementations, the method includes compositing an affordance in association with the CGR object. In some implementations, the method includes detecting an input directed to the affordance. In some implementations, the method includes, in response to detecting the input, adding an identifier identifying the physical article to a user selection queue.

Claims (57)

1. A method comprising:

at a device including a display, a non-transitory memory, and one or more processors coupled with the display and the non-transitory memory:

displaying a plurality of computer-generated reality (CGR) objects representing respective physical articles from a plurality of sources including a first source and a second source;

detecting a first input selecting a first CGR object of the plurality of CGR objects and a second CGR object of the plurality of CGR objects, wherein the first CGR object represents a first physical article from the first source and the second CGR object represents a second physical article from the second source;

adding an identifier of the first physical article to a first user selection queue that is associated with the first source;

adding an identifier of the second physical article to a second user selection queue that is associated with the second source; and

detecting a second input that concurrently confirms the first user selection queue and the second user selection queue.

2. The method of claim 1 , wherein detecting the first input comprises:

detecting respective contacts with the first and second CGR objects.

3. The method of claim 1 , wherein detecting the first input comprises:

detecting that a CGR representation of a person has touched the first and second CGR objects.

4. The method of claim 1 , wherein detecting the first input comprises:

detecting a gaze input directed to the first and second CGR objects.

5. The method of claim 1 , wherein detecting the first input comprises:

detecting a verbal input directed to the first and second CGR objects.

6. The method of claim 1 , further comprising:

modifying a visual property of the first and second CGR objects in order to indicate the selection of the first and second CGR objects.

7. The method of claim 1 , further comprising:

modifying a visual property of a remainder of the plurality of CGR objects in order to indicate that the remainder of the plurality of CGR objects have not been selected.

8. The method of claim 1 , further comprising:

switching from a web page that includes two-dimensional (2D) representations of the physical articles to the CGR environment in response to an input corresponding to a request to display the plurality of CGR objects.

9. The method of claim 1 , further comprising:

identifying, by a recommendation engine, at least a portion of the CGR objects that are displayed.

10. The method of claim 1 , further comprising:

replacing one of the plurality of CGR objects with a replacement CGR object in response to detecting a replacement input while maintaining display of a remainder of the plurality of CGR objects.

11. The method of claim 1 , wherein the first user selection queue includes a first virtual basket and the second user selection queue includes a second virtual basket.

12. The method of claim 1 , wherein the first user selection queue includes a first list of favorite CGR objects and the second user selection queue includes a second list of favorite CGR objects.

13. A device comprising:

one or more processors;

a display;

a non-transitory memory; and

one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:

display a plurality of computer-generated reality (CGR) objects representing respective physical articles from a plurality of sources including a first source and a second source;

detect a first selecting a first CGR object of the plurality of CGR objects and a second CGR object of the plurality of CGR objects, wherein the first CGR object represents a first physical article from the first source and the second CGR object represents a second physical article from the second source;

add an identifier of the first physical article to a first user selection queue that is associated with the first source;

add an identifier of the second physical article to a second user selection queue that is associated with the second source; and

detect a second input that concurrently confirms the first user selection queue and the second user selection queue.

14. The device of claim 13 , wherein the one or more programs, when executed, cause the device to detect the first input by:

detecting respective contacts with the first and second CGR objects.

15. The device of claim 13 , wherein the one or more programs, when executed, cause the device to detect the first input by:

detecting that a CGR representation of a person has touched the first and second CGR objects.

16. The device of claim 13 , wherein the one or more programs, when executed, cause the device to detect the first input by:

detecting a gaze input directed to the first and second CGR objects.

17. The device of claim 13 , wherein the one or more programs, when executed, further cause the device to:

modify a visual property of the first and second CGR objects in order to indicate the selection of the first and second CGR objects; and

modify a visual property of a remainder of the plurality of CGR objects in order to indicate that the remainder of the plurality of CGR objects have not been selected.

18. The device of claim 13 , wherein the one or more programs, when executed, further cause the device to:

switch from a web page that includes two-dimensional (2D) representations of the physical articles to the CGR environment in response to an input corresponding to a request to display the plurality of CGR objects.

19. The device of claim 13 , wherein the first user selection queue includes a first list of favorite CGR objects and the second user selection queue includes a second list of favorite CGR objects.

20. The method of claim 1 , further comprising displaying a confirmation element to concurrently confirm the first user selection queue and the second user selection queue.

21. The method of claim 20 , wherein detecting the second input includes detecting selection of the confirmation element.

22. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with a display, cause the device to:

display a plurality of computer-generated reality (CGR) objects representing respective physical articles from a plurality of sources including a first source and a second source;

detect a first input selecting a first CGR object of the plurality of CGR objects and a second CGR object of the plurality of CGR objects, wherein the first CGR object represents a first physical article from the first source and the second CGR object represents a second physical article from the second source;

add an identifier of the first physical article to a first user selection queue that is associated with the first source;

add an identifier of the second physical article to a second user selection queue that is associated with the second source; and

detect a second input that concurrently confirms the first user selection queue and the second user selection queue.

Continuity (3)
Continuation 16862473 · Apr 29, 2020
Provisional Application 62855920 · Jun 1, 2019
Related Publication 20230418374A1 · Dec 28, 2023
References Cited (15)
US 9268454B2 · Hamilton · 2016 [cited by examiner]
US 10109003B1 · Jenkins · 2018 [cited by examiner]
US 20060117365A1 · Ueda · 2006 [cited by examiner]
US 20130085894A1 · Chan et al. · 2013 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160125504A1 · Narayanan · 2016 [cited by examiner]
US 20170046024A1 · Dascola et al. · 2017 [cited by applicant]
US 20170357420A1 · Dye et al. · 2017 [cited by applicant]
US 20190087519A1 · Mercury et al. · 2019 [cited by applicant]
US 20190391715A1 · Joyce et al. · 2019 [cited by applicant]
US 20200059603A1 · Van De Sluis · 2020 [cited by examiner]
US 20200341236A1 · Nystrom · 2020 [cited by applicant]
Office Action for corresponding Chinese Application No. 202010470149.1 dated Jun. 14, 2024, 14 pages. Translation of search report provided. [cited by applicant]
Yang Song et al., “Augmented Reality System Designed based on BRISK Feature Extraction,” Software Engineer, vol. 18, No. 4, Apr. 2015, pp. 9-11 (Includes English Translation of Abstract). [cited by applicant]
Robert J. Hall, “An Improved Geocast for Mobile Ad Hoc Networks,” IEEE Transactions on Mobile Computing, vol. 10, No. 2, Feb. 2011, pp. 254-266. [cited by applicant]