IP Library Granted Patent US 12,243,068
Granted Patent B1
US 12,243,068 · App. 17/938,724 · Granted Mar 4, 2025

Augmented reality store and services orientation gamification

Inventors: Christin Holt Aquilla (Poolesville, MD); Kourtney Eidam (Sunnyside, NY)
Assignee: WELLS FARGO BANK, N.A.
G06Q30/0209G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,068
App. No.
17/938,724
Granted
Mar 4, 2025
Kind
B1
Abstract

A method implemented on an electronic computing device includes identifying a user of an augmented reality (AR) device. Profile information is obtained for the user based on the identity of the user. An interactive game is activated on the AR device. The interactive game is tailored to the user based on the profile information. One or more rewards are provided to the user for implementing aspects of the interactive game.

Claims (59)

1. A method implemented on an electronic computing device and an augmented reality (AR) device including a headset having a wearable computer with a camera and an optical head-mounted display, the method comprising:

establishing a communication session between the AR device and the electronic computing device in response to a proximity of the AR device to another device at a physical location of a financial institution;

transmitting, in response to establishing the communication session, identification information from the AR device to the electronic computing device causing the AR device to synchronize with the electronic computing device;

while the AR device and the electronic computing device are synchronized:

viewing, by the camera, an activating object;

determining, by the electronic computing device and based on the identification information, whether a user of the AR device has an account with the financial institution;

when the user of the AR device does not have an account with the financial institution, displaying, using the AR device, a link configured to download a financial software application;

when the user of the AR device has an account with the financial institution:

selecting, by the electronic computing device and based on the identification information, an interactive game of a plurality of interactive games;

activating, at the physical location of the financial institution, the interactive game on the AR device in response to the viewing of the activating object, the activating being performed by the electronic computing device, the activating causing the interactive game to be displayed on the optical head-mounted display of the AR device;

receiving, using the interactive game, input from the user of the AR device;

identifying, based on the input, an identified employee of a plurality of employees of the financial institution;

as part of the interactive game, generating, by the electronic computing device and on the optical head-mounted display of the AR device, a directive for the user to meet the identified employee at the physical location of the financial institution;

offering, by the electronic computing device and on the optical head-mounted display of the AR device, a reward to the user for meeting the identified employee;

initiating, by the electronic computing device, a scan of the physical location of the financial institution;

in response to the scan, receiving responses, by the electronic computing device, from devices positioned on each of the plurality of employees of the financial institution located at the physical location;

based on the responses, determining, by the electronic computing device, a location of the identified employee; and

displaying, by the electronic computing device and on the optical head-mounted display of the AR device the location of the identified employee.

2. The method of claim 1 , further comprising scheduling one or more appointments for the user with the identified employee.

3. The method of claim 1 , wherein the activating object includes signage, a quick response (QR) code, an advertisement, or a document.

4. The method of claim 1 , wherein the identified employee is a teller or a loan officer.

5. The method of claim 1 , wherein the interactive game is selected based on a geographical location of the user.

6. The method of claim 5 , wherein the interactive game includes showing, via the AR device, a home, the home being selected based on the geographical location, the home including a style associated with the geographical location.

7. The method of claim 6 , wherein the geographical location is determined using a global positioning system of the AR device.

8. The method of claim 6 , wherein the geographical location is determined based on contextual images received from the camera of the AR device.

9. The method of claim 6 ,

wherein the interactive game includes offering another reward to the user using the AR device; and

wherein the another reward offered is selected based on the geographical location.

10. A system, comprising:

an augmented reality (AR) device including a headset having a wearable computer with a camera and an optical head-mounted display; and

a server computer, comprising:

a processing unit; and

system memory, the system memory including instructions which, when executed by the processing unit, cause the server computer to:

establish a communication session between the AR device and the server computer in response to a proximity of the AR device to another device at a physical location of a financial institution;

receive, in response to establishing the communication session, identification information from the AR device to the server computer causing the AR device to synchronize with the server computer;

while the AR device and the server computer are synchronized:

determine, based on the identification information, whether a user of the AR device has an account with the financial institution:

when the user of the AR device does not have an account with the financial institution, display, using the AR device, a link configured to download a financial software application:

when the user of the AR device has an account with the financial institution:

 select, based on the identification information, an interactive game of a plurality of interactive games;

 activate, at the physical location of the financial institution, the interactive game on the AR device in response to a viewing of an activating object by the camera of the AR device, to activate including to display the interactive game on the optical head-mounted display of the AR device;

 receive, using the interactive game, input from the user of the AR device;

 identify, based on the input, an identified employee of a plurality of employees of the financial institution;

 as part of the interactive game, generate on the optical head-mounted display of the AR device a directive for the user to meet the identified employee at the physical location;

 offer on the optical head-mounted display of the AR device a reward to the user for meeting the identified employee;

 initiate a scan of the physical location of the financial institution;

 in response to the scan, receive responses from devices positioned on each of the plurality of employees of the financial institution located at the physical location;

 based on the responses, determine a location of the identified employee; and

 display on the optical head-mounted display of the AR device the location of the identified employee.

11. The system of claim 10 , the system memory including further instructions which, when executed by the processing unit, cause the server computer to schedule one or more appointments for the user with the identified employee.

12. The system of claim 10 , wherein the activating object includes signage, a quick response (QR) code, an advertisement, or a document.

13. The system of claim 10 , wherein the identified employee is a teller or a loan officer.

14. The system of claim 10 , wherein the interactive game is selected based on a geographical location of the user.

15. The system of claim 14 , wherein the interactive game includes a showing, via the AR device, of a home, the home being selected based on the geographical location, the home including a style associated with the geographical location.

16. The system of claim 15 , wherein the geographical location is determined using a global positioning system of the AR device.

17. The system of claim 15 , wherein the geographical location is determined based on contextual images received from the camera of the AR device.

18. The system of claim 15 ,

wherein the interactive game includes offering another reward to the user using the AR device; and

wherein the another reward offered is selected based on the geographical location.

Assignments (2)
STATEMENT OF CHANGE OF ADDRESS OF ASSIGNEE Recorded Jun 17, 2025
From: WELLS FARGO BANK, N.A.
To: WELLS FARGO BANK, N.A.
Reel/Frame 071679/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2022
From: AQUILLA, CHRISTIN HOLT; EIDAM, KOURTNEY
To: WELLS FARGO BANK, N.A.
Reel/Frame 061345/0371 →
Continuity (2)
Continuation 17001233 · Aug 24, 2020
Continuation 14265604 · Apr 30, 2014
References Cited (72)
US 6641037B2 · Williams · 2003 [cited by applicant]
US 8282491B2 · Auterio et al. · 2012 [cited by applicant]
US 8407086B2 · Kusumoto et al. · 2013 [cited by applicant]
US 8438110B2 · Calman et al. · 2013 [cited by applicant]
US 8786399B2 · Skourup · 2014 [cited by applicant]
US 10395292B1 · Graham · 2019 [cited by applicant]
US 10726473B1 · Graham · 2020 [cited by applicant]
US 10839409B1 · Aquilla · 2020 [cited by applicant]
US 20030158796A1 · Balent · 2003 [cited by applicant]
US 20080189185A1 · Matsuo · 2008 [cited by examiner]
US 20080226119A1 · Candelore · 2008 [cited by applicant]
US 20080279481A1 · Ando · 2008 [cited by applicant]
US 20090063307A1 · Groenovelt · 2009 [cited by applicant]
US 20090128335A1 · Leung · 2009 [cited by applicant]
US 20100016080A1 · Garden et al. · 2010 [cited by applicant]
US 20100046842A1 · Conwell · 2010 [cited by applicant]
US 20100048290A1 · Baseley et al. · 2010 [cited by applicant]
US 20110029364A1 · Roeading · 2011 [cited by applicant]
US 20110124390A1 · Wilen · 2011 [cited by applicant]
US 20110213664A1 · Osterhout et al. · 2011 [cited by applicant]
US 20110221657A1 · Haddick · 2011 [cited by applicant]
US 20110258049A1 · Ramer · 2011 [cited by applicant]
US 20120122554A1 · Paquet et al. · 2012 [cited by applicant]
US 20120183172A1 · Stroila · 2012 [cited by applicant]
US 20120191518A1 · Nix et al. · 2012 [cited by applicant]
US 20120212400A1 · Border et al. · 2012 [cited by applicant]
US 20120229647A1 · Calman · 2012 [cited by examiner]
US 20120231424A1 · Calman et al. · 2012 [cited by applicant]
US 20120231814A1 · Calman et al. · 2012 [cited by applicant]
US 20120232937A1 · Calman et al. · 2012 [cited by applicant]
US 20120232954A1 · Calman · 2012 [cited by applicant]
US 20120232966A1 · Calman et al. · 2012 [cited by applicant]
US 20120232968A1 · Calman et al. · 2012 [cited by applicant]
US 20120232976A1 · Calman et al. · 2012 [cited by applicant]
US 20120232977A1 · Calman et al. · 2012 [cited by applicant]
US 20120233015A1 · Calman et al. · 2012 [cited by applicant]
US 20120233032A1 · Calman et al. · 2012 [cited by applicant]
US 20120233072A1 · Calman et al. · 2012 [cited by applicant]
US 20120256954A1 · Soon-Shiong · 2012 [cited by applicant]
US 20120290366A1 · Giles · 2012 [cited by applicant]
US 20130033522A1 · Calman et al. · 2013 [cited by applicant]
US 20130051548A1 · Chavez · 2013 [cited by applicant]
US 20130170697A1 · Zises · 2013 [cited by applicant]
US 20130179303A1 · Petrou · 2013 [cited by applicant]
US 20130191250A1 · Bradley et al. · 2013 [cited by applicant]
US 20130197992A1 · Bao · 2013 [cited by applicant]
US 20130210523A1 · Arumugam et al. · 2013 [cited by applicant]
US 20130218886A1 · Graham et al. · 2013 [cited by applicant]
US 20130238413A1 · Carlson et al. · 2013 [cited by applicant]
US 20130278631A1 · Border et al. · 2013 [cited by applicant]
US 20130281208A1 · Lyons et al. · 2013 [cited by applicant]
US 20130290106A1 · Bradley et al. · 2013 [cited by applicant]
US 20140028712A1 · Keating et al. · 2014 [cited by applicant]
US 20140032324A1 · Piccionielli · 2014 [cited by examiner]
US 20140100996A1 · Klein · 2014 [cited by applicant]
US 20140100997A1 · Mayerle et al. · 2014 [cited by applicant]
US 20140143105A1 · Shaw et al. · 2014 [cited by applicant]
US 20140152847A1 · Zomet · 2014 [cited by applicant]
US 20140229308A1 · Argue · 2014 [cited by examiner]
US 20140267770A1 · Gervautz · 2014 [cited by examiner]
US 20140357361A1 · Rajaraman · 2014 [cited by examiner]
US 20150120616A1 · Sullivan · 2015 [cited by examiner]
US 20150242943A1 · Abovitz · 2015 [cited by examiner]
US 20160295038A1 · Rao · 2016 [cited by examiner]
WO WO2012100082A2 · 2012 [cited by examiner]
Towards Augmented Reality-driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges, Lik-Hang Lee, p. 4 (Year: 2021). [cited by examiner]
Johnson, “Kellogg differentiates augmented reality efforts with entertainment,” http://www.mobilemarketer.com/cms/news/software-technology/16473.html, Mobile Marketer, Oct. 28, 2013, 4 pages. [cited by applicant]
Rohs, “Marker-Based Embodied Interaction for Handheld Augmented Reality Games,” http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.83.630, 2006, CiteSeerXB Journal of Virtual Reality and Broadcasting, 1 page. [cited by applicant]
Fiorletta, “IBM Unveils Augmented Reality Mobile Shopping App for In-Store Engagement,” http://www.retailtouchpoints.com/mobile/1737-ibm-unveils-augmented-reality-mobile-sho>, retail TouchPoints, Jul. 20, 2012, 7 pages. [cited by applicant]
Greengard, “Retail Turns to Tech to Transform the In-Store Experience,” <URL: http://eu.cmo.com/content/cmo-eu/home/articles/2013/9/23/retail_turns_to_tech.print.html>, CMO, Oct. 8, 2013, 5 pages. [cited by applicant]
Langley, “Food retail apps and innovative loyalty software platform launched in Australia,” http://ausfoodnews.com.au/2013/10/23/food-retail-apps-and-innovative-loyalty-software-platform-launched-in-australia.html, AFN … [cited by applicant]
Langlotz, Tobias, et al. “Next-generation augmented reality browsers: rich, seamless, and adaptive.” Proceedings of the IEEE 102.2 (2014), pp. 155-169 (Feb. 2014). [cited by applicant]