IP Library › Granted Patent US 12,254,583
Granted Patent B2
US 12,254,583 · App. 18/616,687 · Granted Mar 18, 2025

Systems and methods for dynamic interaction with an augmented reality environment

Inventors: Alexander Mascarin (Kleinburg, CA); Stephan Peralta (Etobicoke, CA); Andrea Tuzi (Innisfil, CA); Matthew David Presta (Vaughan, CA); Michael James Presta (Nobleton, CA)
Assignee: EQPME INC.
G06T19/006G06T7/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,583
App. No.
18/616,687
Granted
Mar 18, 2025
Kind
B2
Abstract

Methods and systems are provided for dynamic interaction with an augmented reality environment. In some embodiments, the systems and methods are directed at dynamically interacting with machinery within the augmented reality environment via an augmented reality device. The method involves analyzing a site in which the machinery is to be operated to capture environment data; displaying on the augmented reality device an augmented reality representation of the machinery as an overlay of a portion of an augmented reality environment; receiving an interaction request for interacting with the augmented reality representation of the machinery; determining whether the interaction request can be completed in respect of the machinery within the site; and in response to determining that the interaction request can be completed, displaying the augmented reality representation of the machinery in accordance with the interaction request, otherwise, indicating that the interaction request cannot be completed within the site.

Claims (66)

1. A method for dynamically interacting with an augmented reality environment via an augmented reality device, the method comprising:

capturing, with the augmented reality device, environment data for estimating a site boundary of a site in which an object is to be engaged;

displaying an augmented reality representation of the object as an overlay of a portion of the augmented reality environment corresponding to the site;

receiving an interaction request via the augmented reality device for interacting with the augmented reality representation of the object, wherein the interaction request comprises an active engagement corresponding to one or more real-world usages of the object;

generating one or more advertisements based on at least one of the object to be engaged and the interaction request; and

displaying, on the augmented reality device, the one or more advertisements and the augmented reality representation of the object in accordance with the interaction request.

2. The method of claim 1 , wherein generating the one or more advertisements based on the at least one of the object to be engaged and the interaction request comprises:

determining one or more features of the object; and

generating at least one advertisement based on the one or more features of the object.

3. The method of claim 2 , wherein the one or more features of the object comprises a component of the object, and generating the at least one advertisement based on the one or more features of the object comprises generating the at least one advertisement related to the component of the object.

4. The method of claim 2 , wherein generating the at least one advertisement based on the one or more features of the object comprises:

identifying one or more alternative options for the object; and

generating the at least one advertisement for at least one alternative option of the one or more alternative options.

5. The method of claim 1 , wherein at least one content of the one or more advertisements is associated with a manufacturer.

6. The method of claim 1 , wherein at least one advertisement of the one or more advertisements comprises a limited time offer related to the object.

7. The method of claim 1 , wherein generating the one or more advertisements based on the at least one of the object to be engaged and the interaction request comprises:

determining one or more characteristics of the interaction request; and

generating at least one advertisement based on the one or more characteristics of the interaction request.

8. The method of claim 7 further comprises:

estimating an interest level based at least on the interaction request; and

generating the at least one advertisement based on the interest level to increase likelihood of a transaction in respect of the object.

9. The method of claim 1 , wherein generating the one or more advertisements based on the at least one of the object to be engaged and the interaction request comprises:

determining an operational area required for completing the interaction request;

identifying an available space for displaying the one or more advertisements based on the determined operational area; and

generating the one or more advertisements based on the available space.

10. The method of claim 9 further comprises:

continuously monitoring the available space during the interaction request in respect of the object, and modifying the one or more advertisements based on the available space.

11. The method of claim 9 wherein generating the one or more advertisements based on the available space comprises:

identifying content for the one or more advertisements suitable for the available space.

12. The method of claim 1 , wherein generating the one or more advertisements based on the at least one of the object to be engaged and the interaction request further comprises:

determining whether to vary a content of the one or more advertisements in response to receiving a subsequent interaction request.

13. The method of claim 1 further comprises generating the one or more advertisements based on a user profile associated with a user engaging with the object via the augmented reality device.

14. The method of claim 1 further comprises receiving an engagement with at least one advertisement of the one or more advertisements for conducting a transaction in respect of the content of the at least one advertisement.

15. The method of claim 1 , wherein the one or more advertisements are engageable via the augmented reality device with one or more of a tactile interaction via a display and a voice control command.

16. A system for dynamically interacting with an augmented reality environment via an augmented reality device, the system comprising a processor operable to:

capture environment data for estimating a site boundary of a site in which an object is to be engaged;

display an augmented reality representation of the object as an overlay of a portion of the augmented reality environment corresponding to the site;

receive an interaction request via the augmented reality device for interacting with the augmented reality representation of the object, wherein the interaction request comprises an active engagement corresponding to one or more real-world usages of the object;

generate one or more advertisements based on at least one of the object to be engaged and the interaction request; and

display, on the augmented reality device, the one or more advertisements and the augmented reality representation of the object in accordance with the interaction request.

17. The system of claim 16 , wherein the processor is operable to:

determine one or more features of the object; and

generate at least one advertisement based on the one or more features of the object.

18. The system of claim 17 , wherein the one or more features of the object comprises a component of the object, and the processor is operable to generate the at least one advertisement related to the component of the object.

19. The system of claim 17 , wherein the processor is operable to:

Identify one or more alternative options for the object; and

generate the at least one advertisement for at least one alternative option of the one or more alternative options.

20. The system of claim 16 , wherein at least one content of the one or more advertisements is associated with a manufacturer.

21. The system of claim 16 , wherein at least one advertisement of the one or more advertisements comprises a limited time offer related to the object.

22. The system of claim 16 , wherein the processor is operable to:

determine one or more characteristics of the interaction request; and

generate at least one advertisement based on the one or more characteristics of the interaction request.

23. The system of claim 22 , wherein the processor is operable to:

estimate an interest level based at least on the interaction request; and

generate the at least one advertisement based on the interest level to increase likelihood of a transaction in respect of the object.

24. The system of claim 16 , wherein the processor is operable to:

determine an operational area required for completing the interaction request;

identify an available space for displaying the one or more advertisements based on the determined operational area; and

generate the one or more advertisements based on the available space.

25. The system of claim 24 , wherein the processor is operable to:

continuously monitor the available space during the interaction request in respect of the object, and modify the one or more advertisements based on the available space.

26. The system of claim 24 , wherein the processor is operable to identify content for the one or more advertisements suitable for the available space.

27. The system of claim 16 , wherein the processor is operable to determine whether to vary a content of the one or more advertisements in response to receiving a subsequent interaction request.

28. The system of claim 16 , wherein the processor is operable to generate the one or more advertisements based on a user profile associated with a user engaging with the object via the augmented reality device.

29. The system of claim 16 , wherein the processor is operable to receive an engagement with at least one advertisement of the one or more advertisements for conducting a transaction in respect of the content of the at least one advertisement.

30. The system of claim 16 , wherein the one or more advertisements are engageable via the augmented reality device with one or more of a tactile interaction via a display and a voice control command.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2024
From: MASCARIN, ALEXANDER; PERALTA, STEPHAN; TUZI, ANDREA; PRESTA, MATTHEW DAVID; PRESTA, MICHAEL JAMES
To: EQPME INC.
Reel/Frame 066915/0704 →
Continuity (5)
Continuation 18229386 · Aug 2, 2023
Continuation In Part 18316498 · May 12, 2023
Continuation 17984338 · Nov 10, 2022
Provisional Application 63394716 · Aug 3, 2022
Related Publication 20240265649A1 · Aug 8, 2024
References Cited (37)
US 5646844A · Gudat et al. · 1997 [cited by applicant]
US 9070216B2 · Golparvar-Fard et al. · 2015 [cited by applicant]
US 9222771B2 · Rosengaus et al. · 2015 [cited by applicant]
US 10580207B2 · Pejic et al. · 2020 [cited by applicant]
US 20080071559A1 · Arrasvuori · 2008 [cited by applicant]
US 20090061901A1 · Arrasvuori et al. · 2009 [cited by applicant]
US 20100185529A1 · Chestnut · 2010 [cited by applicant]
US 20130234850A1 · Lee · 2013 [cited by applicant]
US 20140025481A1 · Kang et al. · 2014 [cited by applicant]
US 20160049005A1 · Mullins et al. · 2016 [cited by applicant]
US 20160165170A1 · McRae · 2016 [cited by applicant]
US 20160267516A1 · Walz · 2016 [cited by examiner]
US 20170116644A1 · Huang et al. · 2017 [cited by applicant]
US 20180349946A1 · Nguyen et al. · 2018 [cited by applicant]
US 20200258144A1 · Chaturvedi et al. · 2020 [cited by applicant]
US 20200402219A1 · Gilbert · 2020 [cited by applicant]
US 20210020141A1 · Yuasa · 2021 [cited by applicant]
CA 3105792A1 · 2021 [cited by applicant]
WO 2018060783A1 · 2018 [cited by applicant]
PIX4D, “Turn your mobile device into a professional 3D scanner”, https://www.pix4d.com/product/pix4dcatch, downloaded May 11, 2022. [cited by applicant]
Sitemark, “Software for solar construction”, https://www.sitemark.com/industries/construction/, downloaded May 11, 2022. [cited by applicant]
ThreeKit, “3D Product Configurator & Augmented Reality for Commerce”, https://www.threekit.com/, downloaded Jun. 28, 2022. [cited by applicant]
JLG, “Product Announcement”, May 2022. [cited by applicant]
Strange, “Now You Can Drive Elon Musk's Tesla Cybertruck in AR from the Comfort of Your Home via iOS & Android”, Dec. 9, 2019, <https://mobile-ar.reality.news/news/now-you-can-drive-elon-musks-tesla-cybertruck-ar-from-c… [cited by applicant]
Makarov, “12 Augmented Reality Trends of 2023: New Milestones in Immersive Technology”, Aug. 2, 2022, <https://mobidev.biz/blog/augmented-reality-trends-future-ar-technologies> retrieved on Jun. 19, 2023. [cited by applicant]
“On-device voice commands in AR Glasses—Vuzix”, <https://vivoka.com/project/vuzix/>, Vivoka, Oct. 2021, retrieved on Jun. 7, 2023. [cited by applicant]
Echo3d, “Top 5 Augmented Reality (AR) Remote Assistance Tools”, <https://medium.com/echo3d/top-5-augmented-reality-ar-remote-assistance-tools-76e830cddf99>, Medium, Jul. 22, 2021, retrieved on Jun. 7, 2023. [cited by applicant]
Virsabi, “Tesla model 3”, <https://virsabi.com/tesla/> (Jul. 15, 2019), retrieved on Jun. 7, 2023. [cited by applicant]
Zero Density, “Augmented Reality—Revolutionize Your Storytelling with Augmented Reality Solutions”, <https://www.zerodensity.tv/solutions/augmented-reality/> (Apr. 6, 2023), retrieved on Jun. 14, 2023. [cited by applicant]
Virsabi, “Metaverse in Business”, <https://virsabi.com/> (Apr. 20, 2017), retrieved on Jun. 14, 2023. [cited by applicant]
Trimble <https://sitevision.trimble.com/> (Oct. 24, 2018), retrieved on Jun. 14, 2023. [cited by applicant]
Mantooth, TJ, “IP Issues for Retail Businesses Advertising in Augmented Reality”, Jul. 26, 2022, <https://ipwatchdog.com/2022/07/26/ip-issues-retail-businesses-advertising-augmented-reality/id=150383/> (retrieved on Jul… [cited by applicant]
Youtube. “Tesla Cybertruck doesn't fit in the average garage!”, Dec. 6, 2019, https://youtu.be/PuZz6OFMW5A (retrieved on Jul. 31, 2023). [cited by applicant]
AR Cybertruck. LuvBug Media, Mar. 8, 2020. Google Play Store, <https://play.google.com/store/apps/details?id=com.luvbug.cybertruck&pli=1> (retrieved on on Jul. 31, 2023). [cited by applicant]
International Search Report and Written Opinion mailed Oct. 25, 2023 in PCT/CA2023/051032. [cited by applicant]
Mourtzis et al., “Real-Time Remote Maintenance Support Based on Augmented Reality (AR)”, 2020. (Year: 2020). [cited by applicant]
Zhao et al., “Voice Interaction for Augmented Reality Navigation Interfaces with Natural Language Understanding”, IEEE, 2020. (Year: 2020). [cited by applicant]