IP Library Granted Patent US 12,548,321
Granted Patent B2
US 12,548,321 · App. 17/689,923 · Granted Feb 10, 2026

Augmented, virtual and mixed-reality content selection and display for membership cards

Inventors: Stefan W. Herzberg (Nassau, BS); Megan Herzberg (Nassau, BS)
Assignee: TECHINVEST COMPANY LIMITED
G06V20/20G06Q30/0251G06V30/40G06T19/006G06T19/20G06V10/25G06V30/1448
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,548,321
App. No.
17/689,923
Filed
Mar 8, 2022
Granted
Feb 10, 2026
Kind
B2
Art Unit
2614
USPC
345/633
Abstract

A membership card information system recognizes a real world membership card object relating to or associated with an organization, association, entity or group and uses augmented, mixed and/or virtual reality to display information relating to the organization, association, entity or group on a smart device such as a smartphone or AR glasses.

Claims (68)

1 . A method of enabling interaction based on a physical membership credential evidencing membership in an enterprise, comprising:

receiving a capture by a portable handheld or wearable camera device of an image of the physical membership credential having indicia disposed thereon, the physical membership credential defining, on a visible surface thereof, at least one recognition area containing no visible code; and

configuring at least one processor to automatically perform operations comprising:

recognizing the physical membership credential from the at least one recognition area in the captured image;

determining whether a color and/or grey scale pattern in the at least one recognition area matches one of a number of patterns remotely stored in a database;

when the determining determines the color and/or grey scale pattern in the at least one recognition area matches a stored pattern in the database, associating the recognized physical membership credential with a record relating to the matching stored pattern in the database;

selecting a user-interactive media item in response to the determining matching;

superimposing the selected user-interactive media item onto a display of the portable handheld or wearable camera device that is displaying the captured image or a further image derived therefrom, including superimposing the selected user-interactive media item onto the captured image of the physical membership credential as if the superimposed selected user-interactive media item were anchored to the physical membership credential such that change in position of the handheld or wearable camera device does not detach the superimposed selected user-interactive media item from the captured image of the physical membership credential;

enabling user interaction with the superimposed anchored selected user-interactive media item;

presenting at least one further image on the display in response to a first user selection made through the enabled user interaction with the user-interactive media item; and

enabling selection, over an electronic network, of an item associated with the enterprise based on a subsequent user selection through the enabled user interaction with the user-interactive media item.

2 . The method of claim 1 wherein the superimposing comprises using at least one of augmented reality, mixed reality and virtual reality with no marker.

3 . The method of claim 1 wherein the physical membership credential comprises an imprinted two-dimensional or three-dimensional membership object.

4 . The method of claim 1 wherein the physical membership credential has indicia printed thereon, and the recognizing comprises recognizing at least some of the printed indicia that does not constitute a code.

5 . The method of claim 4 wherein the recognizing includes recognizing characters printed on the physical membership credential.

6 . The method of claim 5 wherein the physical membership credential comprises a patch of printed material attached to an associated item.

7 . The method of claim 6 wherein the selected user-interactive media item comprises a digital overlay that leads to specific action selected from the group consisting of providing specific information; presenting a video, presenting tutorial, or presenting any kind of displayable content.

8 . The method of claim 1 wherein the superimposing is performed on smart glasses.

9 . The method of claim 1 wherein the selected user-interactive media item comprises a call button.

10 . The method of claim 1 further including displaying any or all of the following action buttons in any combination or subcombination:

enterprise information,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shop link,

Explanation,

Intro,

Social Media links,

Discounts,

Special offers,

Locations,

Opening hours, and/or

Employee information.

11 . In a system for enabling interaction based on a physical membership credential evidencing membership in an enterprise, the system including a portable handheld or wearable camera device configured to capture an image of the physical membership credential having indicia disposed thereon, the physical membership credential defining, on a visible surface thereof, at least one recognition area containing no visible code, the portable handheld or wearable camera device comprising a display,

at least one non-transitory storage that stores instructions which configure at least one processor to automatically performing operations comprising:

cause the portable handheld or wearable camera device to display the captured image;

recognize the physical membership credential from the at least one recognition area in the captured image;

determine whether a color and/or grey scale pattern in the at least one recognition area matches one of a number of patterns remotely stored in a database, such that the recognized physical membership credential is associated with a record relating to the matching stored pattern in the database;

in response to a determined matching, superimpose a user-interactive media item onto the captured image of the physical membership credential to appear as if the superimposed user-interactive media item were anchored to the physical membership credential such that change in viewing angle of the handheld or wearable camera device does not detach the superimposed user-interactive media item from the captured image of the physical membership credential;

enable user interaction with the superimposed anchored user-interactive media item;

cause the portable handheld or wearable camera device to present at least one further image on the display in response to a first user selection made through the enabled user interaction with the user-interactive media item; and

enable selection, over an electronic network, of an item associated with the enterprise based on a subsequent user selection through the enabled user interaction with the user-interactive media item.

12 . The at least one non-transitory storage of claim 11 wherein the superimposing comprises using at least one of augmented reality, mixed reality and virtual reality with no marker.

13 . The at least one non-transitory storage of claim 11 wherein the physical membership credential comprises an imprinted two-dimensional or three-dimensional membership object.

14 . The at least one non-transitory storage of claim 11 wherein the physical membership credential has indicia printed thereon, and the recognizing comprises recognizing at least some of the printed indicia that does not constitute a code.

15 . The at least one non-transitory storage of claim 14 wherein the recognizing includes recognizing characters printed on the physical membership credential.

16 . The at least one non-transitory storage of claim 15 wherein the physical membership credential comprises a patch of printed material attached to an associated item.

17 . The at least one non-transitory storage of claim 16 wherein the selected user-interactive media item comprises a digital overlay that leads to specific action selected from the group consisting of providing specific information; presenting a video, presenting tutorial, or presenting any kind of displayable content.

18 . The at least one non-transitory storage of claim 11 wherein the portable handheld or wearable camera device comprises smart glasses.

19 . The at least one non-transitory storage of claim 11 wherein the user-interactive media item comprises a call button.

20 . The at least one non-transitory storage of claim 11 further including displaying any or all of the following action buttons in any combination or subcombination:

enterprise information,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shop link,

Explanation,

Intro,

Social Media links,

Discounts,

Special offers,

Locations,

Opening hours, and/or

Employee information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: AR, LLC
To: TECHINVEST COMPANY LIMITED
Reel/Frame 065957/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2022
From: HERZBERG, STEFAN W.; HERZBERG, MEGAN
To: AR, LLC
Reel/Frame 059977/0599 →
Continuity (11)
Continuation In Part 17228821 · Apr 13, 2021
Continuation 16895637 · Jun 8, 2020
Continuation 16565234 · Sep 9, 2019
Continuation In Part 17228814 · Apr 13, 2021
Continuation 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Continuation In Part 17641300
Continuation In Part 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Provisional Application 62966503 · Jan 27, 2020
Related Publication 20220189164A1 · Jun 16, 2022
References Cited (118)
US 7170391B2 · Lane · 2007 [cited by applicant]
US 9886845B2 · Rhoads · 2018 [cited by applicant]
US 10019136B1 · Ozog · 2018 [cited by applicant]
US 10055714B2 · Zhou · 2018 [cited by applicant]
US 10147076B2 · Zhou · 2018 [cited by applicant]
US 10521777B2 · Zhou · 2019 [cited by applicant]
US 10825004B1 · Walker · 2020 [cited by applicant]
US 11024065B1 · Baron · 2021 [cited by examiner]
US 11157739B1 · Iskandar · 2021 [cited by applicant]
US 11282323B2 · Van Horn · 2022 [cited by applicant]
US 11532051B1 · Braun · 2022 [cited by applicant]
US 20030009670A1 · Rhoads · 2003 [cited by applicant]
US 20030107639A1 · Field · 2003 [cited by examiner]
US 20050058318A1 · Rhoads · 2005 [cited by applicant]
US 20050196013A1 · Rhoads · 2005 [cited by applicant]
US 20080204361A1 · Scales · 2008 [cited by applicant]
US 20080260210A1 · Kobeli · 2008 [cited by applicant]
US 20090037275A1 · Pollio · 2009 [cited by examiner]
US 20090078756A1 · Oberan · 2009 [cited by applicant]
US 20120299961A1 · Ramkumar et al. · 2012 [cited by applicant]
US 20130206830A1 · Kugel · 2013 [cited by applicant]
US 20130210523A1 · Arumugam · 2013 [cited by applicant]
US 20130229452A1 · Roof · 2013 [cited by applicant]
US 20130278631A1 · Border · 2013 [cited by applicant]
US 20130335784A1 · Kurtz · 2013 [cited by applicant]
US 20140080428A1 · Rhoads · 2014 [cited by applicant]
US 20140100896A1 · Du · 2014 [cited by applicant]
US 20140340423A1 · Taylor · 2014 [cited by applicant]
US 20150117701A1 · Ross · 2015 [cited by applicant]
US 20150287290A1 · Van Horn · 2015 [cited by applicant]
US 20160085955A1 · Lerner · 2016 [cited by applicant]
US 20160100215A1 · Di Bernardo · 2016 [cited by examiner]
US 20160133054A1 · Honjo · 2016 [cited by applicant]
US 20160140427A1 · Keay · 2016 [cited by applicant]
US 20160209648A1 · Haddick · 2016 [cited by applicant]
US 20160225192A1 · Jones · 2016 [cited by applicant]
US 20160328607A1 · Krishnan · 2016 [cited by applicant]
US 20160357406A1 · Lee · 2016 [cited by applicant]
US 20160358383A1 · Gauglitz · 2016 [cited by applicant]
US 20170032285A1 · Sharma · 2017 [cited by applicant]
US 20170094196A1 · Adsumilli · 2017 [cited by applicant]
US 20170221272A1 · Li · 2017 [cited by applicant]
US 20170249491A1 · Macintosh · 2017 [cited by applicant]
US 20170270698A1 · Goslin · 2017 [cited by applicant]
US 20170344823A1 · Withrow · 2017 [cited by applicant]
US 20180018671A1 · Celia · 2018 [cited by applicant]
US 20180089899A1 · Piemonte et al. · 2018 [cited by applicant]
US 20180114364A1 · McPhee · 2018 [cited by applicant]
US 20180174366A1 · Nishibe · 2018 [cited by applicant]
US 20180208209A1 · Al-Dahle et al. · 2018 [cited by applicant]
US 20180240220A1 · Katori · 2018 [cited by applicant]
US 20180253876A1 · Lin · 2018 [cited by applicant]
US 20180276895A1 · Hodge · 2018 [cited by applicant]
US 20180330167A1 · Siggard · 2018 [cited by applicant]
US 20180345129A1 · Rathod · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20190124272A1 · O'Neill · 2019 [cited by applicant]
US 20190149725A1 · Adato · 2019 [cited by applicant]
US 20190188920A1 · McPhee · 2019 [cited by applicant]
US 20190205645A1 · Bates · 2019 [cited by applicant]
US 20190205962A1 · Piramuthu · 2019 [cited by applicant]
US 20190236594A1 · Ehrlich-Quinn · 2019 [cited by applicant]
US 20190244248A1 · Purves · 2019 [cited by examiner]
US 20190251303A1 · Fertakos · 2019 [cited by applicant]
US 20190258204A1 · Nelson · 2019 [cited by applicant]
US 20190318168A1 · Meier · 2019 [cited by applicant]
US 20190318186A1 · Sergott · 2019 [cited by applicant]
US 20190392088A1 · Duff · 2019 [cited by applicant]
US 20200019776A1 · Lewis · 2020 [cited by applicant]
US 20200045260A1 · Averhart · 2020 [cited by applicant]
US 20200082668A1 · Foley · 2020 [cited by applicant]
US 20200089014A1 · Peng et al. · 2020 [cited by applicant]
US 20200089313A1 · Himane · 2020 [cited by applicant]
US 20200160601A1 · Shreve · 2020 [cited by applicant]
US 20200225901A1 · Boissiere et al. · 2020 [cited by applicant]
US 20200233212A1 · Peimonte et al. · 2020 [cited by applicant]
US 20200233220A1 · Strongwater et al. · 2020 [cited by applicant]
US 20200233453A1 · Hatfield et al. · 2020 [cited by applicant]
US 20200233681A1 · Garstenauer et al. · 2020 [cited by applicant]
US 20200242439A1 · Micali · 2020 [cited by applicant]
US 20200394012A1 · Wright, Jr. · 2020 [cited by applicant]
US 20210004802A1 · Rule · 2021 [cited by applicant]
US 20220391867A1 · Glaser · 2022 [cited by applicant]
WO 2013138846A1 · 2013 [cited by applicant]
https://appleinsider.com/articles/20/07/23/apple-plans-to-dominate-all-aspects-of-ar-with-apple-glass-and-more. [cited by applicant]
International Search Report (PCT/ISA/220 & PCT/ISA/210) and Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/IB2020/058386 dated Feb. 1, 2021 (19 pages). [cited by applicant]
Jan. 4, 2024 Office Action in U.S. Appl. No. 18/095,866. [cited by applicant]
Aug. 23, 2023 Office Action in U.S. Appl. No. 17/641,300. [cited by applicant]
U.S. Appl. No. 17/641,300. [cited by applicant]
U.S. Appl. No. 17/689,900. [cited by applicant]
U.S. Appl. No. 17/689,903. [cited by applicant]
U.S. Appl. No. 17/689,904. [cited by applicant]
U.S. Appl. No. 17/689,906. [cited by applicant]
U.S. Appl. No. 17/689,911. [cited by applicant]
U.S. Appl. No. 17/689,912. [cited by applicant]
U.S. Appl. No. 17/689,913. [cited by applicant]
U.S. Appl. No. 17/689,917. [cited by applicant]
U.S. Appl. No. 17/689,920. [cited by applicant]
U.S. Appl. No. 17/689,926. [cited by applicant]
U.S. Appl. No. 17/689,933. [cited by applicant]
U.S. Appl. No. 17/689,900 Office Action, Nov. 14, 2024, Sergott et al., US 2019/0318186. [cited by applicant]
U.S. Appl. No. 17/689,903 Office Action, Apr. 8, 2025, Rhoads et al. US 20110098056 A1, Dialameh US 20140218493 A1, Chi et al. US 20180249083 A1, Bakman US 20180181378 A1, Paul U.S. Pat. No. 11,017,164 B1. [cited by applicant]
U.S. Appl. No. 17/689,904 Office Action, Apr. 15, 2025, Macauley et al. (US 20190197789 A1, Gammeter et al—Server-side object recognition and client-side object tracking for mobile augmented reality—2010—IEEE), Bonvolan… [cited by applicant]
U.S. Appl. No. 17/689,906 Office Action, Mar. 31, 2025, Bates US 20190205645, MacIntosh et al., US 20170249491 A1. [cited by applicant]
U.S. Appl. No. 17/689,911 Office Action, Sep. 19, 2024, Lin et al., US 2018/0253876 A1, Border et al., US 2013/0278631 A1. [cited by applicant]
U.S. Appl. No. 17/689,911 Office Action, Apr. 22, 2025, Lin et al., US 2018/0253876 A1, Border et al., US 2013/0278631 A1, Letellier et al. “Providing Additional Content to Print Media Using Augmented Reality”, IEEE, 20… [cited by applicant]
U.S. Appl. No. 17/689,912 Office Action, Sep. 19, 2024, Lin et al., US 2018/0253876 A1, Border et al., US 2013/0278631 A1. [cited by applicant]
U.S. Appl. No. 17/689,912 Office Action, Apr. 24, 2025, Lin et al., US 2018/0253876 A1, Border et al., US 2013/0278631 A1, Letellier et al. “Providing Additional Content to Print Media Using Augmented Reality”, IEEE, 20… [cited by applicant]
U.S. Appl. No. 17/689,913 Office Action, Oct. 21, 2024, Applefeld (U.S. Pat. No. 8,606,645 B1),, Carre et al. (US 20150348329. [cited by applicant]
U.S. Appl. No. 17/689,917 Office Action, Feb. 5, 2025, Davi et al. (US 20170148090 A1), DiBernardo et al. (US 20160100215 A1), Saur US20180308451, Loxam et al. (US 20140253743 A1). [cited by applicant]
U.S. Appl. No. 17/689,920 Office Action, Jan. 30, 2025, Rodriguez et al. (US 20120224743 A1, + DiBernardo et al. (US 20160100215). [cited by applicant]
U.S. Appl. No. 17/689,926 Office Action, Apr. 23, 2025, Wan US 20140111542 A1, Blusi et al. “Feasibility and Acceptability of Smart Augmented Reality Assisting Patients with Medication Pillbox Self-Management”, Bennett … [cited by applicant]
U.S. Appl. No. 17/689,929. [cited by applicant]
U.S. Appl. No. 17/689,931. [cited by applicant]
U.S. Appl. No. 17/689,933 Office Action, Apr. 10, 2025, Renaudie US 20150317569, Dialameh et al US20140218493, Chi et al. US 20180249083 A1, Bakman US 20180181378 A1. [cited by applicant]
U.S. Appl. No. 18/087,588 Office Action, Aug. 29, 2024, Wright Jr. et al. WO 2018222756 A1, Spivack et al. US 20190266404 A1, Miller US 11205304 B2, Fein et al. US 20140267409 A1, Hunt US 20120139847 A1. [cited by applicant]
U.S. Appl. No. 18/095,866 Office Action, Sep. 13, 2024, Adato et al. US 20190149725 A1, Shreve et al. US 20200160601 A1, Adsumilli et al. US 20170094196 A1, Hare et al. US 20200167995 A1. [cited by applicant]
U.S. Appl. No. 18/095,866 Office Action, Apr. 24, 2025, Haddick et al. US20130127980 A1, Shreve et al. US 20200160601 A1, Adsumilli et al. US 20170094196 A1, Hare et al. US 20200167995 A1. [cited by applicant]