IP Library Granted Patent US 12,579,805
Granted Patent B2
US 12,579,805 · App. 17/689,933 · Granted Mar 17, 2026

Augmented, virtual and mixed-reality content selection and display for travel

Inventors: Stefan W. Herzberg (Nassau, BS); Megan Herzberg (Nassau, BS)
Assignee: TECHINVEST COMPANY LIMITED
G06V20/20G06Q30/0251G06V30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,579,805
App. No.
17/689,933
Granted
Mar 17, 2026
Kind
B2
Abstract

A travel information system recognizes a real world object relating to a travel transaction and uses augmented, mixed and/or virtual reality to display information relating to the property and/or the transaction on a smart device such as a smartphone or AR glasses.

Claims (64)

1 . A method of presenting travel information to a single user comprising:

enabling capture by a camera or CMOS sensor disposed on wearable glasses, of an image of a printed item having travel indicia disposed thereon;

using a processor of the glasses, recognizing the printed item from the captured image;

matching the recognized printed item with a travel data record stored remotely to the glasses and accessed over a network in response to the recognizing;

selecting a media item in response to the matching without requiring the printed item to be or contain either an augmented reality marker or a bar code or otherwise be specially designed to be recognized by an augmented reality display device; and

superimposing, using augmented reality and/or mixed reality, a selected user-interactive media item onto an augmented reality display on the glasses, the selected user-interactive media item enabling booking of a trip or other travel accommodation, the superimposing being performed such that when the user moves the glasses to change the position or orientation of the printed item on the glasses' display, a picture or video of the user-interactive media item will move on the display with the image of the printed item as if the picture or video were glued or otherwise adhered to the printed item or were being displayed by the printed item itself from a magic display window on the printed item, wherein the superimposed image can change position, orientation and/or perspective as the underlying real world object viewed through the glasses changes position, orientation and/or viewing angle, in order to provide a photorealistic image in which the superimposed image appears to be part of the underlying real world image in the augmented reality display on the glasses.

2 . The method of claim 1 wherein the recognizing comprises recognizing a two-dimensional or three-dimensional object with print on it.

3 . The method of claim 1 wherein the printed item has indicia printed thereon, and the recognizing comprises recognizing at least some of the printed indicia.

4 . The method of claim 3 wherein the recognizing includes recognizing characters printed on the printed item.

5 . The method of claim 4 wherein the printed item comprises a printed travel advertisement.

6 . The method of claim 5 wherein the selected media item comprises an augmented reality digital overlay that further leads to specific action selected from the group consisting of providing specific information; a video, tutorial, or any kind of displayable content.

7 . The method of claim 1 wherein the superimposing is performed on a user's retina or smart glasses.

8 . The method of claim 1 wherein the selected media item comprises a call button.

9 . The method of claim 1 further including superimposing any or all of the following action buttons in any combination or subcombination:

Price Tag,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shop link,

Explanation,

Intro,

Social Media links,

Reviews,

Booking of tours,

Booking of upgrades,

Exchange rates,

Geo information,

Security updates, and/or

Healthcare updates.

10 . Wearable smart glasses for presenting travel information to a single user in an augmented reality display, the wearable smart glasses comprising:

a wearable glasses frame supporting an augmented reality display;

a camera or CMOS sensor disposed on the wearable glasses frame, the camera or CMOS sensor being configured to capture an image of a printed item having travel indicia disposed thereon;

at least one processor disposed on the wearable glasses frame and connected to the camera or CMOS sensor, the at least one processor being configured to perform operations comprising:

recognizing the printed item from the captured image;

matching the recognized printed item with a travel data record stored remotely to the glasses and accessed over a network in response to the recognizing;

selecting a media item in response to the matching without requiring the printed item to be or contain either an augmented reality marker or a bar code or otherwise be specially designed to be recognized by an augmented reality display device; and

superimposing, using augmented reality and/or mixed reality, a selected user-interactive media item onto the augmented reality display, the selected user-interactive media item enabling booking of a trip or other travel accommodation, the superimposing being performed such that when the user moves the glasses frame to change the position or orientation of the printed item on the glasses' display, a picture or video of the user-interactive media item will move on the display with the image of the printed item as if the picture or video were glued or otherwise adhered to the printed item or were being displayed by the printed item itself from a magic display window on the printed item, wherein the superimposed image can change position, orientation and/or perspective as the underlying real world object viewed through the glasses frame changes position, orientation and/or viewing angle, in order to provide a photorealistic image in which the superimposed image appears to be part of the underlying real world image in the augmented reality display on the glasses' augmented reality display.

11 . The wearable smart glasses of claim 10 wherein the recognizing comprises recognizing a two-dimensional or three-dimensional object with print on it.

12 . The wearable smart glasses of claim 10 wherein the printed item has indicia printed thereon, and the recognizing comprises recognizing at least some of the printed indicia.

13 . The wearable smart glasses of claim 12 wherein the recognizing includes recognizing characters printed on the printed item.

14 . The wearable smart glasses of claim 13 wherein the printed item comprises a printed travel advertisement.

15 . The wearable smart glasses of claim 14 wherein the selected media item comprises an augmented reality digital overlay that further leads to specific action selected from the group consisting of providing specific information; a video, tutorial, or any kind of displayable interactive content.

16 . The wearable smart glasses of claim 10 wherein the superimposing is performed on a user's retina.

17 . The wearable smart glasses of claim 10 wherein the selected interactive media item comprises a call indicator.

18 . The wearable smart glasses of claim 10 further including superimposing any or all of the following action indicators in any combination or subcombination:

Price Tag,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shop link,

Explanation,

Intro,

Social Media links,

Reviews,

Booking of tours,

Booking of upgrades,

Exchange rates,

Geo information,

Security updates, and/or

Healthcare updates.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: AR, LLC
To: TECHINVEST COMPANY LIMITED
Reel/Frame 065957/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2022
From: HERZBERG, STEFAN W.; HERZBERG, MEGAN
To: AR, LLC
Reel/Frame 059977/0611 →
Continuity (11)
Continuation In Part 17228821 · Apr 13, 2021
Continuation 16895637 · Jun 8, 2020
Continuation 16565234 · Sep 9, 2019
Continuation In Part 17228814 · Apr 13, 2021
Continuation 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Continuation In Part 17641300
Continuation In Part 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Provisional Application 62966503 · Jan 27, 2020
Related Publication 20220189168A1 · Jun 16, 2022
References Cited (130)
US 7170391B2 · Lane · 2007 [cited by applicant]
US 9451307B2 · McClanahan · 2016 [cited by applicant]
US 9886845B2 · Rhoads · 2018 [cited by applicant]
US 10019136B1 · Ozog · 2018 [cited by applicant]
US 10055714B2 · Zhou · 2018 [cited by applicant]
US 10142496B1 · Rao · 2018 [cited by applicant]
US 10147076B2 · Zhou · 2018 [cited by applicant]
US 10521777B2 · Zhou · 2019 [cited by applicant]
US 10778867B1 · Goyal · 2020 [cited by applicant]
US 10825004B1 · Walker · 2020 [cited by applicant]
US 11017164B1 · Paul · 2021 [cited by examiner]
US 11157739B1 · Iskandar · 2021 [cited by applicant]
US 11205304B2 · Miller · 2021 [cited by applicant]
US 11282323B2 · Van Horn · 2022 [cited by applicant]
US 11532051B1 · Braun · 2022 [cited by applicant]
US 20030009670A1 · Rhoads · 2003 [cited by applicant]
US 20050058318A1 · Rhoads · 2005 [cited by applicant]
US 20050132420A1 · Howard · 2005 [cited by applicant]
US 20050196013A1 · Rhoads · 2005 [cited by applicant]
US 20060038833A1 · Mallinson · 2006 [cited by examiner]
US 20080204361A1 · Scales · 2008 [cited by applicant]
US 20080260210A1 · Kobeli · 2008 [cited by applicant]
US 20090078756A1 · Oberan · 2009 [cited by applicant]
US 20110098056A1 · Rhoads · 2011 [cited by examiner]
US 20110145068A1 · King · 2011 [cited by applicant]
US 20120139847A1 · Hunt · 2012 [cited by applicant]
US 20120299961A1 · Ramkumar et al. · 2012 [cited by applicant]
US 20130206830A1 · Kugel · 2013 [cited by applicant]
US 20130210523A1 · Arumugam · 2013 [cited by applicant]
US 20130229452A1 · Roof · 2013 [cited by applicant]
US 20130278631A1 · Border · 2013 [cited by applicant]
US 20130335784A1 · Kurtz · 2013 [cited by applicant]
US 20140080428A1 · Rhoads · 2014 [cited by applicant]
US 20140100896A1 · Du · 2014 [cited by applicant]
US 20140218493A1 · Dialameh · 2014 [cited by examiner]
US 20140267409A1 · Fein · 2014 [cited by applicant]
US 20140340423A1 · Taylor · 2014 [cited by applicant]
US 20150117701A1 · Ross · 2015 [cited by applicant]
US 20150287290A1 · Van Horn · 2015 [cited by applicant]
US 20150317569A1 · Renaudie · 2015 [cited by examiner]
US 20160044383A1 · Bonvolanta · 2016 [cited by applicant]
US 20160085955A1 · Lerner · 2016 [cited by applicant]
US 20160133054A1 · Honjo · 2016 [cited by applicant]
US 20160140427A1 · Keay · 2016 [cited by applicant]
US 20160209648A1 · Haddick · 2016 [cited by applicant]
US 20160225192A1 · Jones · 2016 [cited by applicant]
US 20160328607A1 · Krishnan · 2016 [cited by applicant]
US 20160337505A1 · Bjontegard · 2016 [cited by applicant]
US 20160357406A1 · Lee · 2016 [cited by applicant]
US 20160358383A1 · Gauglitz · 2016 [cited by applicant]
US 20170032285A1 · Sharma · 2017 [cited by applicant]
US 20170094196A1 · Adsumilli · 2017 [cited by applicant]
US 20170221272A1 · Li · 2017 [cited by applicant]
US 20170249491A1 · Macintosh · 2017 [cited by applicant]
US 20170270698A1 · Goslin · 2017 [cited by applicant]
US 20170344823A1 · Withrow · 2017 [cited by applicant]
US 20180018671A1 · Celia · 2018 [cited by applicant]
US 20180089899A1 · Piemonte et al. · 2018 [cited by applicant]
US 20180114364A1 · McPhee · 2018 [cited by applicant]
US 20180157398A1 · Kaehler · 2018 [cited by examiner]
US 20180174366A1 · Nishibe · 2018 [cited by applicant]
US 20180181378A1 · Bakman · 2018 [cited by examiner]
US 20180208209A1 · Al-Dahle et al. · 2018 [cited by applicant]
US 20180225921A1 · Lyons · 2018 [cited by examiner]
US 20180240220A1 · Katori · 2018 [cited by applicant]
US 20180249083A1 · Chi · 2018 [cited by examiner]
US 20180253876A1 · Lin · 2018 [cited by applicant]
US 20180276895A1 · Hodge · 2018 [cited by applicant]
US 20180330167A1 · Siggard · 2018 [cited by applicant]
US 20180345129A1 · Rathod · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20190124272A1 · O'Neill · 2019 [cited by applicant]
US 20190149725A1 · Adato · 2019 [cited by applicant]
US 20190188920A1 · McPhee · 2019 [cited by applicant]
US 20190205645A1 · Bates · 2019 [cited by applicant]
US 20190205962A1 · Piramuthu · 2019 [cited by applicant]
US 20190220002A1 · Huang · 2019 [cited by applicant]
US 20190236594A1 · Ehrlich-Quinn · 2019 [cited by applicant]
US 20190251303A1 · Fertakos · 2019 [cited by applicant]
US 20190258204A1 · Nelson · 2019 [cited by applicant]
US 20190266404A1 · Spivack · 2019 [cited by applicant]
US 20190297186A1 · Karani · 2019 [cited by examiner]
US 20190318168A1 · Meier · 2019 [cited by applicant]
US 20190318186A1 · Sergott · 2019 [cited by applicant]
US 20190392088A1 · Duff · 2019 [cited by applicant]
US 20200019776A1 · Lewis · 2020 [cited by applicant]
US 20200034025A1 · Brady · 2020 [cited by examiner]
US 20200045260A1 · Averhart · 2020 [cited by applicant]
US 20200082668A1 · Foley · 2020 [cited by applicant]
US 20200089014A1 · Peng et al. · 2020 [cited by applicant]
US 20200089313A1 · Himane · 2020 [cited by applicant]
US 20200160601A1 · Shreve · 2020 [cited by applicant]
US 20200225901A1 · Boissiere et al. · 2020 [cited by applicant]
US 20200233212A1 · Peimonte et al. · 2020 [cited by applicant]
US 20200233220A1 · Strongwater et al. · 2020 [cited by applicant]
US 20200233453A1 · Hatfield et al. · 2020 [cited by applicant]
US 20200233681A1 · Garstenauer et al. · 2020 [cited by applicant]
US 20200242439A1 · Micali · 2020 [cited by applicant]
US 20200394012A1 · Wright, Jr. · 2020 [cited by applicant]
US 20210004802A1 · Rule · 2021 [cited by applicant]
US 20220391867A1 · Glaser · 2022 [cited by applicant]
US 20230300420A1 · Erskine · 2023 [cited by applicant]
WO 2013138846A1 · 2013 [cited by applicant]
WO 2018222756A1 · 2018 [cited by applicant]
Wright Jr et al, WO_2018222756_A1, 2018, PTC INC (Year: 2018). [cited by examiner]
https://appleinsider.com/articles/20/07/23/apple-plans-to-dominate-all-aspects-of-ar-with-apple-glass-and-more. [cited by applicant]
International Search Report (PCT/ISA/220 & PCT/ISA/210) and Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/IB2020/058386 dated Feb. 1, 2021 (19 pages). [cited by applicant]
Jan. 4, 2024 Office Action in U.S. Appl. No. 18/095,866. [cited by applicant]
Aug. 23, 2023 Office Action in U.S. Appl. No. 17/641,300. [cited by applicant]
U.S. Appl. No. 17/641,300. [cited by applicant]
U.S. Appl. No. 17/689,900. [cited by applicant]
U.S. Appl. No. 17/689,903. [cited by applicant]
U.S. Appl. No. 17/689,904. [cited by applicant]
U.S. Appl. No. 17/689,906. [cited by applicant]
U.S. Appl. No. 17/689,911. [cited by applicant]
U.S. Appl. No. 17/689,912. [cited by applicant]
U.S. Appl. No. 17/689,913. [cited by applicant]
U.S. Appl. No. 17/689,917. [cited by applicant]
U.S. Appl. No. 17/689,920. [cited by applicant]
U.S. Appl. No. 17/689,923. [cited by applicant]
U.S. Appl. No. 17/689,926. [cited by applicant]
U.S. Appl. No. 17/689,929. [cited by applicant]
U.S. Appl. No. 17/689,931. [cited by applicant]
U.S. Appl. No. 17/689,933. [cited by applicant]
U.S. Office Action issued in related U.S. Appl. No. 17/689,903 dated Mar. 7, 2024. [cited by applicant]
U.S. Office Action issued in related U.S. Appl. No. 17/689,903 dated Aug. 29, 2024. [cited by applicant]
U.S. Office Action issued in related U.S. Appl. No. 17/689,904 dated Jul. 10, 2. [cited by applicant]
U.S. Office Action issued in related U.S. Appl. No. 18/087,588 dated Aug. 29, 2024. [cited by applicant]
U.S. Office Action issued in related U.S. Appl. No. 18/095,866 dated Jan. 4, 2024. [cited by applicant]
Non-Final Office Action issued in U.S. Appl. No. 17/689,904 dated Jul. 10, 2024. [cited by applicant]