IP Library Granted Patent US 12,367,510
Granted Patent B2
US 12,367,510 · App. 18/598,265 · Granted Jul 22, 2025

Multi-factor authentication and post-authentication processing system

Inventors: Ron G. Faris (Brooklyn, NY); Jett House (New York City, NY); Aaron L. Uhrmacher (New York City, NY); Michael B. Hailey (Forest Grove, OR)
Assignee: NIKE, Inc.
G06Q30/0233G06Q30/018G06Q30/0185G06Q30/02G06Q30/0207G06Q30/0231G06Q30/0609G06Q30/0643H04L63/0853H04L63/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,510
App. No.
18/598,265
Granted
Jul 22, 2025
Kind
B2
Abstract

An end-user computing device may utilize an imaging device to capture input from an electronic tag of a physical asset. The end-user computing device may generate supplemental digital data associated with the input. The end-user computing device may transmit the input and the supplemental digital data to an authentication and digital assets server. The authentication and digital assets server may authenticate the physical asset and transmit the authentication results to the end-user computing device, which may display the authentication results. If the authentication of the physical asset is successful, the authentication and digital assets server may select one or more digital assets and transmit the one or more digital assets to the end-user computing device. The end-user computing device may display the one or more digital assets.

Claims (53)

1. A method comprising:

receiving, by an authentication and digital assets server, time data corresponding to a user performing a first activity during a first time period;

receiving, by the authentication and digital assets server and from an end-user computing device associated with the user, input from an electronic tag of a physical asset and supplemental digital data associated with the input, wherein the supplemental digital data comprises a timestamped image of the physical asset that was captured by an imaging device of the end-user computing device while the end-user computing device was in the physical presence of the physical asset;

authenticating, by the authentication and digital assets server based on the supplemental digital data associated with the input, the physical asset, wherein the authenticating the physical asset comprises determining the timestamped image was taken during the first time period and, using one or more image recognition algorithms, that the timestamped image data matches physical asset image data, stored in an authentication database, corresponding to the physical asset;

transmitting, by the authentication and digital assets server and to the end-user computing device, an authentication result;

selecting, by the authentication and digital assets server based on the supplemental digital data associated with the input and based on the authentication result indicating a successful authentication of the physical asset, a plurality of digital assets; and

transmitting, by the authentication and digital assets server and to the end-user computing device, the plurality of digital assets.

2. The method of claim 1 , wherein the input comprises a unique identification number associated with an electronic tag of the physical asset.

3. The method of claim 2 , further comprising:

referencing the unique identification number with a plurality of identification numbers stored in a master authentication database.

4. The method of claim 1 , further comprising:

receiving asset interaction event data associated with a first digital asset of the plurality of digital assets; and

updating an asset interaction record associated with end-user of the end-user computing device based on the asset interaction event data.

5. The method of claim 4 , wherein the asset interaction event data comprises an overlaid image, the method further comprising:

analyzing the overlaid image to detect whether the overlaid image comprises the physical asset.

6. The method of claim 4 , further comprising:

determining, based on the updated asset interaction record, whether the end-user is eligible for a physical asset; and

responsive to a determination the end-user is eligible for a physical asset, transmitting data associated with the physical asset to the end-user computing device.

7. The method of claim 1 , wherein the plurality of digital assets comprises a first set of digital assets configured to be utilized immediately by the user, and a second set of digital assets configured to be utilized by the user during a future event.

8. The method of claim 1 , wherein the supplemental digital data comprises a time of a capturing of the input.

9. The method of claim 1 , wherein the input supplemental digital data comprises a location of the end-user computing device during a capturing of the input.

10. The method of claim 1 , further comprising:

receiving asset interaction event data associated with the first digital asset of the plurality of digital assets, the asset interaction event data comprising an overlaid image;

updating an asset interaction record associated with the end-user based on the asset interaction event data;

analyzing the overlaid image to detect whether the overlaid image comprises the physical asset;

determining, based on the updated asset interaction record, whether the end-user is eligible for a physical asset; and

responsive to a determination the end-user is eligible for a physical asset, transmitting data associated with the physical asset to the end-user computing device.

11. The method of claim 1 , wherein a first digital asset of the plurality of digital assets comprises an overlay, and wherein the overlay is selected based on a location of the end-user computing device during a capturing of the input.

12. An apparatus comprising:

one or more processors;

memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

receive, by an authentication and digital assets server, time data corresponding to a user performing a first activity during a first time period

receive, by the authentication and digital assets server and from an end-user computing device, input from an electronic tag of a physical asset and supplemental digital data associated with the input, wherein the supplemental digital data comprises a timestamped image of the physical asset that was captured by an imaging device of the end-user computing device while the end-user computing device was in the physical presence of the physical asset;

authenticate, by the authentication and digital assets server based on the supplemental digital data associated with the input, the physical asset, wherein the authenticating the physical asset comprises determining that the timestamped image was taken during the first time period and, using, using one or more image recognition algorithms, that the timestamped image data matches physical asset image data, stored in an authentication database, corresponding to the physical asset;

select, by the authentication and digital assets server based on the supplemental digital data associated with the input and based on authenticating the physical asset, a plurality of digital assets; and

transmit, by the authentication and digital assets server and to the end-user computing device, the plurality of digital assets.

13. The apparatus of claim 12 , wherein the input comprises a unique identification number associated with an electronic tag of the physical asset.

14. The apparatus of claim 12 , wherein the supplemental digital data includes the location of the end-user computing device during the capturing of the input.

15. The apparatus of claim 12 , wherein the plurality of digital assets comprises a first set of digital assets configured to be utilized immediately and a second set of digital assets configured to be utilized during a future event.

16. The apparatus of claim 12 , wherein a first digital asset of the plurality of digital assets comprises an overlay selected based on a location of the end-user computing device during a capturing of the input, and wherein the instructions, when executed by the one or more processors, further cause the apparatus to:

receive asset interaction event data associated with the first digital asset of the plurality of digital assets, the asset interaction event data comprising an overlaid image;

update an asset interaction record associated with the end-user based on the asset interaction event data;

analyze the overlaid image to detect whether the overlaid image comprises the physical asset;

determine, based on the updated asset interaction record, whether the end-user is eligible for a physical asset; and

responsive to a determination the end-user is eligible for a physical asset, transmit data associated with the physical asset to the end-user computing device.

17. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive, from an end-user computing device, input from an electronic tag of a physical asset and supplemental digital data associated with the input, wherein the supplemental digital data comprises an image of the physical asset that was captured by an imaging device of the end-user computing device while the end-user computing device was in the physical presence of the physical asset;

authenticate, based on the supplemental digital data associated with the input, the physical asset, wherein authenticating the physical asset comprises determining the timestamped image was taken during the first time period and that the physical asset in the image matches image data, stored in an authentication database, corresponding to the physical asset;

select, based on the supplemental digital data associated with the input and based on the authenticating the physical asset, a digital asset; and

transmit, to the end-user computing device, the digital asset.

18. The one or more non-transitory computer-readable media of claim 17 , wherein the input comprises a unique identification number associated with an electronic tag of the physical asset.

19. The one or more non-transitory computer-readable media of claim 17 , wherein the supplemental digital data comprises one or more of a time of a capturing of the input and a location of the end-user computing device during the capturing of the input.

20. The one or more non-transitory computer-readable media of claim 17 , wherein the plurality of digital assets comprises a first set of digital assets configured to be utilized immediately and a second set of digital assets configured to be utilized during a future event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2024
From: FARIS, RON G.; HOUSE, JETT; UHRMACHER, AARON L.; HAILEY, MICHAEL B.
To: NIKE, INC.
Reel/Frame 066687/0980 →
Continuity (3)
Continuation 16129414 · Sep 12, 2018
Provisional Application 62557355 · Sep 12, 2017
Related Publication 20240289833A1 · Aug 29, 2024
References Cited (149)
US 6585622B1 · Shum et al. · 2003 [cited by applicant]
US 6932698B2 · Sprogis · 2005 [cited by applicant]
US 7171331B2 · Vock et al. · 2007 [cited by applicant]
US 8428614B2 · Wolfe · 2013 [cited by applicant]
US 8606645B1 · Applefeld · 2013 [cited by applicant]
US 9058764B1 · Persson et al. · 2015 [cited by applicant]
US 9131339B1 · Kulfan et al. · 2015 [cited by applicant]
US 9142038B2 · Lotto et al. · 2015 [cited by applicant]
US 9223902B1 · McHugh et al. · 2015 [cited by applicant]
US 10127725B2 · Kohler et al. · 2018 [cited by applicant]
US 10201939B1 · Pare et al. · 2019 [cited by applicant]
US 10706459B2 · Faris et al. · 2020 [cited by applicant]
US 10874947B2 · Benedetto et al. · 2020 [cited by applicant]
US 20020111201A1 · Lang · 2002 [cited by applicant]
US 20030107178A1 · Weston · 2003 [cited by applicant]
US 20040024850A1 · Miyake · 2004 [cited by applicant]
US 20040079797A1 · Wadley · 2004 [cited by applicant]
US 20050265345A1 · Chen et al. · 2005 [cited by applicant]
US 20060097847A1 · Bervoets et al. · 2006 [cited by applicant]
US 20060230640A1 · Chen · 2006 [cited by applicant]
US 20060293103A1 · Mendelsohn · 2006 [cited by applicant]
US 20070087797A1 · Van Luchene · 2007 [cited by applicant]
US 20070242066A1 · Levy Rosenthal · 2007 [cited by applicant]
US 20080009349A1 · Wolfe · 2008 [cited by applicant]
US 20080014964A1 · Sudit et al. · 2008 [cited by applicant]
US 20080167129A1 · Aaron et al. · 2008 [cited by applicant]
US 20090018911A1 · An Chang et al. · 2009 [cited by applicant]
US 20090089131A1 · Moukas et al. · 2009 [cited by applicant]
US 20090227374A1 · Tirpak et al. · 2009 [cited by applicant]
US 20100079338A1 · Wooden et al. · 2010 [cited by applicant]
US 20110029369A1 · Taylor et al. · 2011 [cited by applicant]
US 20110105092A1 · Felt et al. · 2011 [cited by applicant]
US 20110287834A1 · Lindmeir et al. · 2011 [cited by applicant]
US 20110313779A1 · Herzog et al. · 2011 [cited by applicant]
US 20120010995A1 · Skirpa et al. · 2012 [cited by applicant]
US 20120084571A1 · Weis et al. · 2012 [cited by applicant]
US 20120136998A1 · Hough et al. · 2012 [cited by applicant]
US 20120175412A1 · Grabiner et al. · 2012 [cited by applicant]
US 20120180084A1 · Huang et al. · 2012 [cited by applicant]
US 20120202600A1 · Jalili · 2012 [cited by applicant]
US 20120212505A1 · Burroughs et al. · 2012 [cited by applicant]
US 20120225705A1 · Rhodes, Jr. · 2012 [cited by applicant]
US 20120233076A1 · Sutcliffe et al. · 2012 [cited by applicant]
US 20120320216A1 · Mkrtchyan et al. · 2012 [cited by applicant]
US 20130178257A1 · Langseth · 2013 [cited by applicant]
US 20130211893A1 · Bryant · 2013 [cited by examiner]
US 20130260727A1 · Knudson et al. · 2013 [cited by applicant]
US 20130275217A1 · Ramchandani · 2013 [cited by examiner]
US 20130293584A1 · Anderson · 2013 [cited by applicant]
US 20140025481A1 · Kang et al. · 2014 [cited by applicant]
US 20140100997A1 · Mayerle et al. · 2014 [cited by applicant]
US 20140129949A1 · Singer · 2014 [cited by applicant]
US 20140131434A1 · Ozkan · 2014 [cited by applicant]
US 20140172640A1 · Argue et al. · 2014 [cited by applicant]
US 20140176565A1 · Adeyoola et al. · 2014 [cited by applicant]
US 20140237578A1 · Bryant et al. · 2014 [cited by applicant]
US 20140253743A1 · Loxam et al. · 2014 [cited by applicant]
US 20140279242A1 · Staicut et al. · 2014 [cited by applicant]
US 20140282974A1 · Maher et al. · 2014 [cited by applicant]
US 20140357352A1 · Van Luchene · 2014 [cited by applicant]
US 20150105153A1 · Xu · 2015 [cited by applicant]
US 20150106195A1 · Holman et al. · 2015 [cited by applicant]
US 20150109338A1 · McKinnon et al. · 2015 [cited by applicant]
US 20150140982A1 · Postrel · 2015 [cited by applicant]
US 20150205894A1 · Faris et al. · 2015 [cited by applicant]
US 20150206349A1 · Rosenthal et al. · 2015 [cited by applicant]
US 20150235267A1 · Steube et al. · 2015 [cited by applicant]
US 20150269593A1 · Le · 2015 [cited by applicant]
US 20150286897A1 · Spaith · 2015 [cited by applicant]
US 20150324850A1 · Rivera · 2015 [cited by applicant]
US 20150348329A1 · Carre et al. · 2015 [cited by applicant]
US 20160012498A1 · Prasad · 2016 [cited by applicant]
US 20160070809A1 · Rathus · 2016 [cited by applicant]
US 20160117061A1 · Hodgart et al. · 2016 [cited by applicant]
US 20160144280A1 · Pawlowski et al. · 2016 [cited by applicant]
US 20160292926A1 · Rosenthal et al. · 2016 [cited by applicant]
US 20160337580A1 · Kwon et al. · 2016 [cited by applicant]
US 20160367896A1 · Lee et al. · 2016 [cited by applicant]
US 20170021273A1 · Rios · 2017 [cited by applicant]
US 20170032382A1 · Shulman · 2017 [cited by examiner]
US 20170124434A1 · Goodwin et al. · 2017 [cited by applicant]
US 20170364925A1 · Wilkinson et al. · 2017 [cited by applicant]
US 20180021671A1 · Liesenfelt et al. · 2018 [cited by applicant]
US 20180041545A1 · Chakra et al. · 2018 [cited by applicant]
US 20180089709A1 · Rousseau-Villella · 2018 [cited by applicant]
US 20180190033A1 · Barnett et al. · 2018 [cited by applicant]
US 20180190324A1 · Paul et al. · 2018 [cited by applicant]
US 20180211342A1 · Hoareau · 2018 [cited by applicant]
US 20180350148A1 · George · 2018 [cited by applicant]
US 20190015747A1 · Thompson et al. · 2019 [cited by applicant]
US 20190311472A1 · Harrup · 2019 [cited by examiner]
US 20190342249A1 · Holmes · 2019 [cited by applicant]
US 20190362153A1 · Badalamenti et al. · 2019 [cited by applicant]
US 20200175140A1 · Steele · 2020 [cited by applicant]
US 20200372535A1 · Walz · 2020 [cited by examiner]
US 20210097761A1 · Rizvi et al. · 2021 [cited by applicant]
CN 101960482A · 2011 [cited by applicant]
CN 103597519A · 2014 [cited by applicant]
CN 103959325A · 2014 [cited by applicant]
CN 104115185A · 2014 [cited by applicant]
CN 106575455A · 2017 [cited by applicant]
CN 106796700A · 2017 [cited by applicant]
CN 106980847A · 2017 [cited by applicant]
JP 2006277124A · 2006 [cited by applicant]
JP 2008046806A · 2008 [cited by applicant]
JP 2010533326A · 2010 [cited by applicant]
JP 2012212225A · 2012 [cited by applicant]
JP 2013059573A · 2013 [cited by applicant]
JP 2013146804A · 2013 [cited by applicant]
JP 2013210783A · 2013 [cited by applicant]
JP 2014215929A · 2014 [cited by applicant]
JP 2015041126A · 2015 [cited by applicant]
JP 2015135672A · 2015 [cited by applicant]
JP 2016529581A · 2016 [cited by applicant]
JP 201723544A · 2017 [cited by applicant]
JP 2017073140A · 2017 [cited by applicant]
KR 1020130089853A · 2013 [cited by applicant]
WO 2008135764A1 · 2008 [cited by applicant]
WO 2012135796A1 · 2012 [cited by applicant]
WO 2013146804A1 · 2013 [cited by applicant]
WO 2013187130A1 · 2013 [cited by applicant]
WO 2014107681A1 · 2014 [cited by applicant]
WO 2014194419A1 · 2014 [cited by applicant]
WO 2016043663A1 · 2016 [cited by applicant]
WO 2016069986A1 · 2016 [cited by applicant]
Mar. 26, 2024 (CN)—Office Action—App 201880053813.3, 6 pages. [cited by applicant]
Mar. 30, 2024 (CN) Office Action—App 201880072458.4, 6 pages. [cited by applicant]
Jun. 3, 2024 (EP)—Supplemental Notice of Allowance—App 18786902.9, 86 pages. [cited by applicant]
Apr. 23, 2024 (JP) Office Action with English Translation—App JP 2023-085097, 7 pages. [cited by applicant]
Aug. 6, 2024 (JP)—Office Action—App JP2023-085097, 3 pages. [cited by applicant]
Aug. 28, 2018—(WO) ISR & WO—App. No. PCT/US18/038476. [cited by applicant]
TheHoiYiu: “Nike Augmented reality Case Study”, You Tube, May 6, 2011 (May 6, 2011), p. 1, CP054978581, Retrieved from the Internet: URL:https://www.youtube.com/watch?v=BoawN6hVB4c [retrieved on Aug. 14, 2018], the whol… [cited by applicant]
Adrianrdzv: Nike AR shoe demo:, You Tube, Mar. 5, 2012 (Mar. 5, 2012), p. 1, XP054978582, Retrieved from the Internet: URL:https://www.youtube.com/watch?v=WjN3CSXF9x0 [retrieved on Aug. 14, 2018], the whole document. [cited by applicant]
Nov. 30, 2018—(WO) ISR & WO—App. No. PCT/US18/050594. [cited by applicant]
Nov. 30, 2018—(WO) ISR & WO—App. No. PCT/US18/050599. [cited by applicant]
Nov. 30, 2018—(WO) ISR & WO—App. No. PCT/US18/050497. [cited by applicant]
Firefly1, “Amazon Firefly Hands-On—What is it?”, video accessible at https://www.youtube.com/watch?v=oVb_5YYXJgg, Dated Jul. 23, 2014. (Year: 2014). [cited by applicant]
Firefly2, “Firefly FAQ”, Amazon.com. Help, dated Jun. 9, 2014 (Year 2014). [cited by applicant]
Firefly3, Perez, “Amazon's Fire Phone Introduces Firefly, A Feature That Lets You Identify (And Buy) Things You See in The Real World”, Techcrunch.com, dated Jun. 18, 2014. (Year: 2014). [cited by applicant]
Targetinasnap1, Nguyen, Nicole, “Buy target items immediately by snapping a photo”, Popsugartech, dated: Jul. 23, 2014. (Year: 2014). [cited by applicant]
Targetinasnap2, Aheard, Brianna, Target's In a Snap App: Mobile Shopping Via Image Recognition, Innovative Retail Technologies, dated Jul. 25, 2014. (Year: 2014). [cited by applicant]
Targetinasnap3, Bourne, Leah, “Now You Can Shop Target Ads On Your iPhone!”, Stylecaster, Jul. 22, 2014. (Year: 2014). [cited by applicant]
Mahmood, Zahid; Ali, Tauseef; Muhammed, Nazeer; Bibi, Nargis; Shahzad, Imran; Azmat, Shoaib; EAR: Enhanced Augmented Reality System for Sports Entertainment Application, KSII Transaction on Internet and Informationan Sy… [cited by applicant]
Hugo, Martin, Cache Prizes; With a Receiver in Hand and lots of Containers Cleverly Hidden in the Outdoors, Geocachers go Wherever the Growing Sport's GPS Coordinates Take Them, Feb. 16, 2006, LA Times (Year: 2006). [cited by applicant]
BIT—A Framework and Architecture for Providing Digital Services for Physical Products; Christof Roduner ETH Zurich et al. IEEE 2010. (Year: 2010). [cited by applicant]
Oda, Ohan, Supporting Multi-Player Interaction in Co-Located and Remote Augmented Reality by Improving Reference Performance and Decreasing Physical Interference, 2016, Columbia University, (Year: 2016). [cited by applicant]
Jun. 9, 2023 (EP) Communication with European Search Report—App 23157187.8, 14 pages. [cited by applicant]
Schlatter, B.E., et al., Geocaching: 21st-Century Hide and Seek This High-Tech form of Orienteering Offers Physical Educators Abundant Opportunities for Multidisciplinary Lessons, 2005, Journal of Physical Education (Ye… [cited by applicant]
Ghosh, S., Pokemon Go shows potential of augmented reality for marketers, 6 Haymarket Business Publications Ltd., Jul. 15, 2016, 6 pages. [cited by applicant]