IP Library › Granted Patent US 12,646,105
Granted Patent B2
US 12,646,105 · App. 18/270,166 · Granted Jun 2, 2026

Method of displaying products in a virtual environment

Inventors: Brendan J. Scully (Cos Cob, CT); Yang Liu (Sunnyvale, CA); Alexander B. Oser (Minneapolis, MN); Wilson W. Yin (Cupertino, CA); Brandel C. Zachernuk (Sunnyvale, CA); Maxime Montegnies (Alameda, CA); Yiyao Nie (San Jose, CA); Paul C. Hikiji (San Jose, CA); Mark D. Laughlin (Santa Cruz, CA); Weixuan Zhao (Santa Clara, CA); Jaewoong Hwang (Sunnyvale, CA); Wai Ki Chan (Mountain View, CA)
Assignee: Apple Inc.
G06Q30/0643G06F3/017G06T19/006G06T19/20G06V10/54G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,646,105
App. No.
18/270,166
Granted
Jun 2, 2026
Kind
B2
Abstract

Methods for displaying a virtual shopping experiences provide for an efficient and intuitive user experience. In some embodiments, a computer-generated environment can include a virtual product display that includes one or more representations of products. In some embodiments, the computer-generated environment can include stations that provide additional information associated with a respective product. In some embodiments, a user is able to customize a respective product, for example, by selecting an accessory and dragging the accessory to a representation of the respective product. In some embodiments, a user is able to preview a product by placing a representation of the product on a representation of a portion of the user's body.

Claims (70)

1 . A method, comprising:

at an electronic device in communication with a display and one or more input devices:

presenting, via the display, a three-dimensional environment, including a three-dimensional first display station displayed within the three-dimensional environment, wherein the first display station includes a first representation of a first product and one or more representations of one or more features associated with the first product, wherein the one or more representations of the one or more features are different from the first representation of the first product;

while presenting the three-dimensional environment, detecting, via the one or more input devices, a user input selecting a first representation of the one or more representations corresponding to a first feature; and

in response to detecting the selection of the first representation of the one or more representations corresponding to the first feature:

displaying, via the display, a three-dimensional second display station, separate from the first display station, concurrently with the first display station, wherein the second display station includes information associated with the first feature and was not displayed prior to detecting selection of the first representation of the one or more representations corresponding to the first feature.

2 . The method of claim 1 , further comprising:

while presenting the three-dimensional environment, detecting, via the one or more input devices, a second user input selecting a second representation of the one or more representations corresponding to a second feature; and

in response to detecting the selection of the second representation:

updating the second display station to:

cease displaying information associated with the first feature, and

display information associated with the second feature.

3 . The method of claim 1 , further comprising:

while presenting the three-dimensional environment, detecting, via the one or more input devices, a second user input selecting a second representation of the one or more representations corresponding to a second feature; and

in response to detecting the selection of the second representation:

displaying, via the display, a third display station, separate from the first and the second display stations, wherein the third display station includes information associated with the second feature; and

maintaining display of the second display station.

4 . The method of claim 1 , wherein:

the first display station is displayed on a first surface of an object in the three-dimensional environment; and

the second display station is displayed on the first surface, adjacent to the first display station.

5 . The method of claim 1 , further comprising:

while presenting the three-dimensional environment, detecting, via the one or more input devices, a user input selecting the first display station;

in response to detecting the user input selecting the first display station, detecting, via the one or more input devices, movement of the user input from a first location to a second location; and

in response to detecting the movement of the user input from the first location to the second location, relocating the first display station to the second location and relocating the second display station adjacent to the first display station.

6 . The method of claim 1 , further comprising:

while presenting the three-dimensional environment, detecting, via the one or more input devices, a surface in the three-dimensional environment;

in response to a determination that the surface has been detected, displaying the first display station on the surface and displaying the second display station on the surface adjacent to the first display station; and

in response to a determination that the surface has not been detected, displaying the first display station floating in the three-dimensional environment and displaying the second display station adjacent to the first display station.

7 . The method of claim 1 , wherein displaying the second display station includes:

moving the first display station from a first location to a second location, and

displaying the second display station at a location that partially overlaps with the first location.

8 . The method of claim 1 , wherein the information associated with the first feature includes any one of: a textual element associated with the first feature and a graphical element associated with the first feature.

9 . The method of claim 1 , wherein the information associated with the first feature is displayed at a location in the three-dimensional environment above the second display station.

10 . The method of claim 1 , wherein the first representation of the first product is displayed at a location in the three-dimensional environment above the first display station.

11 . The method of claim 1 , further comprising:

while presenting the first display station including the first representation of the first product, receiving, via the one or more input devices, a user input corresponding to a request to customize the first product with a first customization option; and

in response to receiving the user input, updating a visual characteristic of the first representation of the first product in accordance with the first customization option.

12 . The method of claim 1 , further comprising:

while presenting the first display station including the first representation of the first product, receiving, via the one or more input devices, a request to inspect the first product, including detecting a grasping gesture performed by a hand of a user of the electronic device directed to the first representation of the first product and a movement of the hand of the user to a respective location while maintaining the grasping gesture; and

in accordance with a determination that one or more first criteria are satisfied, configuring the first representation in an interactive demonstration mode.

13 . The method of claim 12 , further comprising:

in response to detecting the movement of the hand of the user to the respective location while maintaining the grasping gesture, moving the first representation of the first product in accordance with the movement of the hand.

14 . The method of claim 12 , wherein the one or more first criteria includes a first criterion that is satisfied when the hand of the user has moved to a predetermined location relative to the user.

15 . The method of claim 12 , further comprising:

while the first representation is configured in the interactive demonstration mode, detecting, via the one or more input devices, a rotation of the hand of the user; and

in response to detecting the rotation of the hand of the user:

rotating the first representation in accordance with the rotation of the hand; and

in accordance with a determination that one or more second criteria are satisfied, displaying a first set of information associated with the first product.

16 . The method of claim 15 , wherein the one or more second criteria include a second criterion that is satisfied when an orientation of the first representation is within a predetermined range of orientations.

17 . The method of claim 15 , wherein:

in accordance with a determination that the three-dimensional environment includes the second display station, the first set of information associate with the first product includes information associated with the first feature.

18 . The method of claim 15 , wherein the information associated with the first product includes a three-dimensional visual element.

19 . The method of claim 12 , further comprising:

while presenting the first display station including the first representation of the first product, detecting, via the one or more input devices, a termination of the request to inspect the first product; and

in response to detecting the termination of the request to inspect the first product:

configuring the first representation in a demonstration mode different than the interactive demonstration mode; and

moving the first representation to a location associated with the first display station.

20 . An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

presenting, via a display, a three-dimensional environment, including a three-dimensional first display station displayed within the three-dimensional environment, wherein the first display station includes a first representation of a first product and one or more representations of one or more features associated with the first product, wherein the one or more representations of the one or more features are different from the first representation of the first product;

while presenting the three-dimensional environment, detecting, via one or more input devices, a user input selecting a first representation of the one or more representations corresponding to a first feature; and

in response to detecting the selection of the first representation of the one or more representations corresponding to the first feature:

displaying, via the display, a three-dimensional second display station, separate from the first display station, concurrently with the first display station, wherein the second display station includes information associated with the first feature and was not displayed prior to detecting selection of the first representation of the one or more representations corresponding to the first feature.

21 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

present, via a display, a three-dimensional environment, including a three-dimensional first display station displayed within the three-dimensional environment, wherein the first display station includes a first representation of a first product and one or more representations of one or more features associated with the first product, wherein the one or more representations of the one or more features are different from the first representation of the first product;

while presenting the three-dimensional environment, detecting, via one or more input devices, a user input selecting a first representation of the one or more representations corresponding to a first feature; and

in response to detecting the selection of the first representation of the one or more representations corresponding to the first feature:

display, via the display, a three-dimensional second display station, separate from the first display station, concurrently with the first display station, wherein the second display station includes information associated with the first feature and was not displayed prior to detecting selection of the first representation of the one or more representations corresponding to the first feature.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2026
From: SCULLY, BRENDAN J.; OSER, ALEXANDER B.; ZACHERNUK, BRANDEL C.; HWANG, JAEWOONG; LAUGHLIN, MARK D.; MONTEGNIES, MAXIME; HIKIJI, PAUL C.; CHAN, WAI KI; ZHAO, WEIXUAN; YIN, WILSON W.; LIU, YANG; NIE, YIYAO
To: APPLE INC.
Reel/Frame 073352/0110 →
Continuity (2)
Provisional Application 63132844 · Dec 31, 2020
Related Publication 20240062279A1 · Feb 22, 2024
References Cited (49)
US 9213420B2 · Amacker · 2015 [cited by examiner]
US 9710841B2 · Ainsworth, III · 2017 [cited by examiner]
US 10049276B1 · Harper et al. · 2018 [cited by applicant]
US 11417179B1 · Zalewski · 2022 [cited by examiner]
US 20090234716A1 · Mallick · 2009 [cited by examiner]
US 20100030578A1 · Siddique · 2010 [cited by examiner]
US 20120075168A1 · Osterhout · 2012 [cited by examiner]
US 20130110666A1 · Aubrey · 2013 [cited by examiner]
US 20130215116A1 · Siddique · 2013 [cited by examiner]
US 20140025529A1 · Honeycutt et al. · 2014 [cited by applicant]
US 20140229342A1 · Marlowe · 2014 [cited by examiner]
US 20140363059A1 · Hurewitz · 2014 [cited by examiner]
US 20140365272A1 · Hurewitz · 2014 [cited by examiner]
US 20150371321A1 · Chapuis · 2015 [cited by examiner]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160210602A1 · Siddique · 2016 [cited by examiner]
US 20170132842A1 · Morrison · 2017 [cited by applicant]
US 20170249693A1 · Greenwood · 2017 [cited by examiner]
US 20180040044A1 · Mattingly · 2018 [cited by examiner]
US 20180204174A1 · Soon-Shiong · 2018 [cited by applicant]
US 20180232800A1 · Mattingly et al. · 2018 [cited by applicant]
US 20190065027A1 · Hauenstein et al. · 2019 [cited by applicant]
US 20190266663A1 · Keeler · 2019 [cited by examiner]
US 20190325498A1 · Clark · 2019 [cited by examiner]
US 20200225757A1 · Schwarz et al. · 2020 [cited by applicant]
US 20200302510A1 · Chachek · 2020 [cited by examiner]
US 20200302693A1 · Singh · 2020 [cited by examiner]
US 20210004137A1 · Oser · 2021 [cited by applicant]
US 20210248669A1 · Wade · 2021 [cited by examiner]
US 20220130126A1 · Delgado · 2022 [cited by examiner]
US 20220392171A1 · Baughman et al. · 2022 [cited by applicant]
US 20240273594A1 · Scully et al. · 2024 [cited by applicant]
US 20240273597A1 · Scully et al. · 2024 [cited by applicant]
UploadVR “HoloLens 2 AR Headset: On Stage Live Demonstration,” retrieved at: https://www.youtube.com/watch?v=ulHPPtPBgHK&t=154s, retrieved on Aug. 31, 2020. [cited by applicant]
Magic Leap Augmented Reality Shopping and Voice Control, YouTube, uploaded by Road to VR, Jul. 22, 2016 [online]. Retrieved from the Internet: <https://www.youtube.com/watch?v=Z6Wa6DjHA98>, [retrieved on Dec. 5, 2024], … [cited by applicant]
Morotti, et al. “Fostering Fashion Retail Experience Through Virtual Reality and Voice Assistants”, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, 2020, <DOI:1… [cited by applicant]
Audi R8 Augmented Reality Product Visualiser, Vimeo, uploaded by Engine Creative, Jul. 12, 2018 [online]. Retrieved from the Internet: <https://vimeo.com/279678041>, [retrieved on Feb. 2, 2025], 3 pages. [cited by applicant]
Configure One [online]. Retrieved from the Internet: <https://www.configureone.com>, [retrieved on Jun. 10, 2022], 9 pages. [cited by applicant]
Delphi AR App, Vimeo, uploaded by Engine Creative, Oct. 6, 2017 [online]. Retrieved from the Internet: <https://vimeo.com/237081043>, [retrieved on Feb. 2, 2025], 3 pages. [cited by applicant]
Fully Immersive VR Hot Tub Experience, Vimeo, uploaded by Engine Creative, Sep. 17, 2019 [online]. Retrieved from the Internet: <https://vimeo.com/360577724>, [retrieved on Feb. 2, 2025], 3 pages. [cited by applicant]
Gap Dressing Room AR APP By Avametric, Vimeo, uploaded by Ari Bloom, Jan. 7, 2017 [online]. Retrieved from the Internet: <https://vimeo.com/198481246>, [retrieved on Feb. 2, 2025], 3 pages. [cited by applicant]
KBMax [online]. Retrieved from the Internet: <https://web.archive.org/web/20201027065819/https://kbmax.com/solutions/cpq-for-b2b-ecommerce>, [retrieved on Feb. 2, 2025], 4 pages. [cited by applicant]
Virtual Reality for Automotive Dealerships, FlowFound [online]. Retrieved from the Internet: <https://web.archive.org/web/20200808024625/https://flowfound.com/virtual-reality/>, [retrieved on Jun. 23, 2023.], 4 pages. [cited by applicant]
Powertrak Software, Axonom Inc. [online]. Retrieved from the Internet <https://www.axonom.com/powertrak>, [retrieved on Jun. 10, 2022], 7 pages. [cited by applicant]
Reydar—Modern Office Case Study with AR, Vimeo, uploaded by Engine Creative, Feb. 3, 2020 [online]. Retrieved from the Internet: <https://vimeo.com/389031426>, [retrieved on Feb. 2, 2025], 3 pages. [cited by applicant]
Threekit [online]. Retrieved from <https://www.threekit.com/platform-overview#solution>, [retrieved on Jun. 10, 2022], 20 pages. [cited by applicant]
Álvarez Márquez et al. “In-Store Augmented Reality-Enabled Product Comparison and Recommendation”, Fourteenth ACM Conference on Recommender Systems, ACMPUB27, New York, Sep. 22, 2020, <DOI: 10.1145/3383313.3412266>, pp.… [cited by applicant]
Tudjarov et al. “Web Virtual Reality for Product Customization,” APEM Journal, vol. 4, 2009, pp. 25-34. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/587,657, mailed on Aug. 27, 2025, 17 pages. [cited by applicant]