IP Library Granted Patent US 12,423,742
Granted Patent B2
US 12,423,742 · App. 18/373,575 · Granted Sep 23, 2025

Spatially augmented audio and XR content within an e-commerce shopping experience

Inventors: Charles Dasher (Lawrenceville, GA); Christopher Phillips (Hartwell, GA); Reda Harb (Tampa, FL)
Assignee: Adeia Guides Inc.
G06Q30/0643G06F3/162G06Q30/0625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,742
App. No.
18/373,575
Granted
Sep 23, 2025
Kind
B2
Abstract

Systems and methods are presented herein for creating and rendering supplemental content of a selectable product icon of an e-commerce interface in response to user interaction with the selectable product icon. A list of products with a plurality of selectable icons is retrieved from a server based on at least one parameter of a query from an identified first device. The first device is determined to be communicatively coupled to at least one secondary device. Using an artificial intelligence generative engine, supplemental content corresponding to one or more products is generated based on device information of the at least one secondary device. In response to determining that a position of the at least one selectable icon is within a threshold distance of the subset of the list of products displayed or is being displayed, instructions are transmitted to the at least one secondary device to render the supplemental content.

Claims (92)

1. A computer-implemented method executed via a server, memory, at least one device for rendering supplemental content comprising one or more of audio content, visual content, or extended reality haptic-feedback content, and a primary device communicatively coupled to the server, the method comprising:

retrieving, by control circuitry, a list of products from a database based on at least one parameter of a query received from a first device, wherein:

the list of products comprises a plurality of selectable icons,

a selectable icon of the plurality of selectable icons comprises the supplemental content, and

the supplemental content comprises a first data structure comprising instructions for rendering audio content and a second data structure comprising instructions for rendering the visual content;

identifying an audio output device comprising audio output capabilities, wherein the audio output device is communicatively coupled to the first device;

identifying a visual output device comprising visual output capabilities, wherein the visual output device is communicatively coupled to the first device;

comparing, by the control circuitry, the audio output capabilities to the first data structure;

determining, based on the comparing, that the audio output device comprises audio output capabilities compatible with the first data structure;

comparing, by the control circuitry, the visual output capabilities to the second data structure;

determining, based on the comparing, that the visual output device comprises visual output capabilities compatible with the second data structure;

wherein the visual output device comprises a plurality of visual output devices;

a first visual output device of the plurality of visual output devices comprises device information indicating the first visual output device is a video rendering device; and

a second visual output device of the plurality of visual output devices comprises device information indicating the second visual output device is a light transmission device; and

in response to determining that at least one of (i) a position of the selectable icon is within a threshold distance of a subset of the list of products displayed or (ii) the selectable icon is part of the subset of the list of products displayed, transmitting, via the control circuitry, instructions to the audio output device to provide one or more elements of the audio content and transmitting, via the control circuitry, instructions to the visual output device to render one or more elements of the visual content.

2. The method of claim 1 , wherein:

the audio output device comprises a plurality of audio output devices;

a first audio output device of the plurality of audio output devices comprises device information indicating the first audio output device is a primary audio device; and

a second audio output device of the plurality of audio output devices comprises device information indicating the second audio output device is a secondary audio device.

3. The method of claim 2 , wherein the instructions for rendering the audio content comprises:

instructions to render at least one element of the audio content via the primary audio device; and

instructions to render at least one other element of the audio content via the secondary audio device.

4. The method of claim 3 , further comprising:

determining the device information of the primary audio device indicates the primary audio device is configured to render the at least one element of the audio content;

transmitting instructions to the primary audio device to render the at least one element of the audio content based on the position of the selectable icon on the list of products relative to a display of the first device;

determining the device information of the secondary audio device indicates the secondary audio device is configured to render the at least one other element of the audio content; and

transmitting instructions to the secondary audio device to render the at least one other element of the audio content based on the position of the selectable icon on the list of products relative to a display of the first device.

5. The method of claim 4 , further comprising:

in response to determining the position of the selectable icon corresponding to a product of the list of products is within the threshold distance of the subset of the list of products being displayed, rendering the at least one other element of the audio content via the secondary audio device in response to determining a weight assigned to a second auxiliary audio track indicates the second auxiliary audio track is assigned a highest weight among a plurality of second auxiliary audio tracks; and

in response to determining the position of the selectable icon is part of the subset of the list of products being displayed, rendering the at least one element of the audio content via the primary audio device.

6. The method of claim 1 , wherein the instructions for rendering the visual content comprises:

instructions to render at least one element of the visual content via the video rendering device; and

instructions to render at least one other element of the visual content via the light transmission device.

7. The method of claim 6 , further comprising:

determining the device information of the first visual output device indicates the first visual output device is configured to render the at least one element of the visual content;

transmitting instructions to the first visual output device to render the at least one element of the visual content based on the position of the selectable icon on the list of products relative to a display of the first device;

determining the device information of the second visual output device indicates the second visual output device is configured to render the at least one other element of the visual content; and

transmitting instructions to the second visual output device to render the at least one other element of the visual content based on the position of the selectable icon on the list of products relative to a display of the first device.

8. The method of claim 7 , further comprising:

in response to determining the position of the selectable icon is within the threshold distance of the subset of the list of products being displayed, rendering the at least one other element of the visual content via the second visual output device; and

in response to determining the position of the selectable icon is part of a portion of the list of products being displayed, rendering the at least one element of the visual content via the first visual output device.

9. The method of claim 1 , further comprising:

retrieving one or more of device settings or profile settings corresponding to the first device; and

blending the instructions for rendering the one or more elements of the audio content with the one or more elements of the visual content based on one or more of the device settings or the profile settings corresponding to the first device.

10. A system comprising:

a server;

memory;

at least one device for rendering supplemental content comprising one or more of audio content, visual content, or extended reality haptic-feedback content; and

a primary device communicatively coupled to the server, the primary device comprising control circuitry configured to interface with processing circuitry of the server, wherein the control circuitry is configured to execute instructions to:

retrieve a list of products from a database stored in the memory based on at least one parameter of a query received from a first device, wherein:

the list of products comprises a plurality of selectable icons,

a selectable icon of the plurality of selectable icons comprises the supplemental content, and

the supplemental content comprises a first data structure comprising instructions for rendering audio content and a second data structure comprising instructions for rendering the visual content;

identifying an audio output device comprising audio output capabilities, wherein the audio output device is communicatively coupled to the first device;

identifying a visual output device comprising visual output capabilities, wherein the visual output device is communicatively coupled to the first device;

compare the audio output capabilities to the first data structure;

determine, based on the comparing, that the audio output device comprises audio output capabilities compatible with the first data structure;

compare the visual output capabilities to the second data structure;

determine, based on the comparing, that the visual output device comprises visual output capabilities compatible with the second data structure;

wherein the visual output device comprises a plurality of visual output devices;

a first visual output device of the plurality of visual output devices comprises device information indicating the first visual output device is a video rendering device; and

a second visual output device of the plurality of visual output devices comprises device information indicating the second visual output device is a light transmission device; and

in response to determining that at least one of (i) a position of the selectable icon is within a threshold distance of a subset of the list of products displayed or (ii) the selectable icon is part of the subset of the list of products displayed, transmit instructions to the audio output device to provide one or more elements of the audio content and transmitting instructions to the visual output device to render one or more elements of the visual content.

11. The system of claim 10 , wherein:

the audio output device comprises a plurality of audio output devices;

a first audio output device of the plurality of audio output devices comprises device information indicating the first audio output device is a primary audio device; and

a second audio output device of the plurality of audio output devices comprises device information indicating the second audio output device is a secondary audio device.

12. The system of claim 11 , wherein the instructions for rendering the audio content comprises:

instructions to render at least one element of the audio content via the primary audio device; and

instructions to render at least one other element of the audio content via the secondary audio device.

13. The system of claim 12 , wherein the processing circuitry is further configured to:

determine the device information of the primary audio device indicates the primary audio device is configured to render the at least one element of the audio content;

transmit instructions to the primary audio device to render the at least one element of the audio content based on the position of the selectable icon on the list of products relative to a display of the first device;

determine the device information of the secondary audio device indicates the secondary audio device is configured to render the at least one other element of the audio content; and

transmit instructions to the secondary audio device to render the at least one other element of the audio content based on the position of the selectable icon on the list of products relative to a display of the first device.

14. The system of claim 13 , wherein the processing circuitry is further configured to:

in response to determining the position of the selectable icon corresponding to a product of the list of products is within the threshold distance of the subset of the list of products being displayed, render the at least one other element of the audio content via the secondary audio device in response to determining a weight assigned to a second auxiliary audio track indicates the second auxiliary audio track is assigned a highest weight among a plurality of second auxiliary audio tracks; and

in response to determining the position of the selectable icon is part of the subset of the list of products being displayed, render the at least one element of the audio content via the primary audio device.

15. The system of claim 10 , wherein the instructions for rendering the visual content comprises:

instructions to render at least one element of the visual content via the video rendering device; and

instructions to render at least one other element of the visual content via the light transmission device.

16. The system of claim 15 , wherein the processing circuitry is further configured to:

determine the device information of the first visual output device indicates the first visual output device is configured to render the at least one element of the visual content;

transmit instructions to the first visual output device to render the at least one element of the visual content based on the position of the selectable icon on the list of products relative to a display of the first device;

determine the device information of the second visual output device indicates the second visual output device is configured to render the at least one other element of the visual content; and

transmit instructions to the second visual output device to render the at least one other element of the visual content based on the position of the selectable icon on the list of products relative to a display of the first device.

17. The system of claim 16 , wherein the processing circuitry is further configured to:

in response to determining the position of the selectable icon is within the threshold distance of the subset of the list of products being displayed, render the at least one other element of the visual content via the second visual output device; and

in response to determining the position of the selectable icon is part of a portion of the list of products being displayed, render the at least one element of the visual content via the first visual output device.

18. The system of claim 10 , wherein the processing circuitry is further configured to:

retrieve one or more of device settings or profile settings corresponding to the first device; and

blend the instructions for rendering one or more elements of the audio content with the one or more elements of the visual content based on the one or more of the device settings or the profile settings corresponding to the first device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2023
From: DASHER, CHARLES; PHILLIPS, CHRISTOPHER; HARB, REDA
To: ADEIA GUIDES INC.
Reel/Frame 065906/0556 →
Continuity (1)
Related Publication 20250104133A1 · Mar 27, 2025
References Cited (65)
US 8917971B2 · Woods et al. · 2014 [cited by applicant]
US 9237368B2 · Davis et al. · 2016 [cited by applicant]
US 9532100B2 · Ehlers et al. · 2016 [cited by applicant]
US 10175177B2 · Olsson · 2019 [cited by examiner]
US 10685217B2 · Purandare · 2020 [cited by examiner]
US 11457245B1 · Bhatia et al. · 2022 [cited by applicant]
US 11606220B2 · Jorasch · 2023 [cited by examiner]
US 11635883B2 · Farrell · 2023 [cited by applicant]
US 11902625B2 · Chandrashekar et al. · 2024 [cited by applicant]
US 12311171B2 · Meskens et al. · 2025 [cited by applicant]
US 20030158796A1 · Balent · 2003 [cited by examiner]
US 20040133518A1 · Dryall · 2004 [cited by applicant]
US 20080226119A1 · Candelore · 2008 [cited by examiner]
US 20080279481A1 · Ando · 2008 [cited by examiner]
US 20090063307A1 · Groenovelt · 2009 [cited by examiner]
US 20090128335A1 · Leung · 2009 [cited by examiner]
US 20090154744A1 · Snyder · 2009 [cited by examiner]
US 20090254447A1 · Blades · 2009 [cited by examiner]
US 20100046842A1 · Conwell · 2010 [cited by examiner]
US 20100184375A1 · Ohkita · 2010 [cited by examiner]
US 20110107220A1 · Perlman · 2011 [cited by examiner]
US 20110164121A1 · Ikeda · 2011 [cited by examiner]
US 20110221657A1 · Haddick · 2011 [cited by examiner]
US 20120105608A1 · Ko · 2012 [cited by examiner]
US 20120256954A1 · Soon-Shiong · 2012 [cited by examiner]
US 20120290366A1 · Giles · 2012 [cited by examiner]
US 20130072301A1 · Mallinson · 2013 [cited by examiner]
US 20130127980A1 · Haddick · 2013 [cited by examiner]
US 20130179303A1 · Petrou · 2013 [cited by examiner]
US 20130347018A1 · Limp et al. · 2013 [cited by applicant]
US 20140028712A1 · Keating · 2014 [cited by examiner]
US 20140089967A1 · Mandalia et al. · 2014 [cited by applicant]
US 20140100996A1 · Klein · 2014 [cited by examiner]
US 20140100997A1 · Mayerle · 2014 [cited by examiner]
US 20140143105A1 · Shaw · 2014 [cited by examiner]
US 20140152847A1 · Zomet · 2014 [cited by examiner]
US 20140195337A1 · Taylor et al. · 2014 [cited by applicant]
US 20140267907A1 · Downes et al. · 2014 [cited by applicant]
US 20150031440A1 · Desanti · 2015 [cited by examiner]
US 20150110457A1 · Abecassis et al. · 2015 [cited by applicant]
US 20160026853A1 · Wexler · 2016 [cited by examiner]
US 20160070439A1 · Bostick · 2016 [cited by examiner]
US 20160259528A1 · Foss et al. · 2016 [cited by applicant]
US 20160275031A1 · Lee · 2016 [cited by examiner]
US 20170023492A1 · Olsson · 2017 [cited by examiner]
US 20180276737A1 · Girish · 2018 [cited by examiner]
US 20190007754A1 · Master et al. · 2019 [cited by applicant]
US 20190238952A1 · Boskovich · 2019 [cited by applicant]
US 20190325204A1 · Purandare · 2019 [cited by examiner]
US 20200007921A1 · Ojala · 2020 [cited by applicant]
US 20200014979A1 · Woods et al. · 2020 [cited by applicant]
US 20200175573A1 · Reddy · 2020 [cited by examiner]
US 20200302510A1 · Chachek · 2020 [cited by examiner]
US 20210031106A1 · Alderman et al. · 2021 [cited by applicant]
US 20220150567A1 · Varan et al. · 2022 [cited by applicant]
US 20220303381A1 · Phillips et al. · 2022 [cited by applicant]
US 20230316662A1 · Singh · 2023 [cited by applicant]
US 20240089680A1 · Sheen · 2024 [cited by applicant]
US 20240103799A1 · Kumpf et al. · 2024 [cited by applicant]
US 20250104132A1 · Dasher et al. · 2025 [cited by applicant]
US 20250124148A1 · Hanson, II · 2025 [cited by applicant]
Vazquez-Alvarez, Yolanda, et al. “Designing interactions with multilevel auditory displays in mobile audio-augmented reality.” ACM Transactions on Computer-Human Interaction (TOCHI) 23.1 (2015): 1-30. (Year: 2015). [cited by examiner]
U.S. Appl. No. 18/373,572, filed Sep. 27, 2023, Charles Dasher. [cited by applicant]
Yer, Prakash, “The science behind Echo Show 10,” Amazon Science, https://www.amazon.science/blog/the-science-behind-echo-show-10 (2020). [cited by applicant]
Prakash Iyer, “The science behind Echo Show 10” (Amazon Science), (https://www.amazon.science/blog/the-science-behind-echo-show-10), (4 pages). [cited by applicant]