IP Library Granted Patent US 12,525,012
Granted Patent B2
US 12,525,012 · App. 17/689,900 · Granted Jan 13, 2026

Augmented, virtual and mixed-reality content selection and display for real estate

Inventors: Stefan W. Herzberg (Nassau, BS); Megan Herzberg (Nassau, BS)
Assignee: Techinvest Company Limited
G06V20/20G06Q30/0251G06V30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,525,012
App. No.
17/689,900
Filed
Mar 8, 2022
Granted
Jan 13, 2026
Kind
B2
Art Unit
2612
USPC
345/633
Abstract

A real estate information system recognizes a real world object relating to a real estate transaction and uses augmented, mixed and/or virtual reality to display information relating to the property and/or the transaction on a smart device such as a smartphone or AR glasses.

Claims (63)

1 . A method of presenting real estate information to a user comprising:

enabling capture by a portable camera of an image of an item having real estate indicia printed thereon, the printed real estate indicia relating to a real estate property for sale or rent; and

automatically performing operations with at least one processor operatively connected to the portable camera, the operations comprising:

translating a pattern of an image captured by the portable camera into shades of grey and/or color;

recognizing the pattern within-the printed item from the captured image, based on the shades of grey and/or color within a flexibly-definable area of recognition representing only part of the item;

based at least in part on machine learning, pattern-matching the recognized pattern with a real estate data record stored in a multiple listing service (MLS) database and accessed over a digital network;

selecting an interactive media item in response to the matching, the selected interactive media item providing additional audible and/or visual information concerning the real estate property for sale or rent; and

anchoring and superimposing the selected interactive media item onto a display of the captured image or an image derived therefrom.

2 . The method of claim 1 wherein the superimposing comprises using at least one of augmented reality, mixed reality and virtual reality.

3 . The method of claim 1 wherein recognizing comprises recognizing a two-dimensional or three-dimensional object with print on it.

4 . The method of claim 1 wherein the item has indicia printed thereon, and the recognizing comprises recognizing the pattern defined by at least some of the printed indicia.

5 . The method of claim 4 wherein the recognizing further includes recognizing characters printed on the item.

6 . The method of claim 5 wherein the item comprises a printed real estate advertisement.

7 . The method of claim 6 wherein the selected media item comprises a digital overlay that leads to specific action selected from the group consisting of providing specific information; a video, tutorial, or any kind of displayable content.

8 . The method of claim 1 wherein the superimposing is performed on a handheld display device, a user's retina or smart glasses.

9 . The method of claim 1 wherein the selected media item comprises a call button.

10 . The method of claim 1 further including displaying any or all of the following action buttons in any combination or subcombination:

Price Tag,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shoplink,

Explanation,

Intro,

Social Media links,

Floor plan,

MLS number,

Neighborhood, ‘Pricing history, and/or

Map.

11 . A system for presenting real estate information to a user comprising:

a portable camera configured to capture an image of an item having real estate indicia printed thereon, the printed real estate indicia relating to a real estate property for sale or rent; and

at least one processor operatively connected to the portable camera and configured to automatically perform operations comprising;

translating a pattern within an area of recognition defined by the item into grey scale and/or color values., the area of recognition being smaller than a visible surface of the item;

recognizing the printed item from the grey scale and/or color values within the area of recognition in the captured image, including enabling wide variation in a definition of an area of recognition;

based at least in part on machine learning, pattern-matching the recognized printed item with a real estate data record stored in a multiple listing service (MLS) database and accessed over a digital network;

selecting an interactive media item in response to the matching, the selected interactive media item providing additional information concerning the real estate property for sale or rent; and

superimposing a the selected interative media item onto a display of the captured image or an image derived therefrom.

12 . The system of claim 11 wherein the superimposing comprises using at least one of augmented reality, mixed reality and virtual reality.

13 . The system of claim 11 wherein recognizing comprises recognizing a two-dimensional or three-dimensional object with print on it.

14 . The system of claim 11 wherein the item has indicia printed thereon, and the recognizing further comprises recognizing at least some of the printed indicia.

15 . The system of claim 14 wherein the recognizing further includes recognizing characters printed on the item.

16 . The system of claim 15 wherein the item comprises a printed real estate advertisement.

17 . The system of claim 16 wherein the selected media item comprises a digital overlay that leads to specific action selected from the group consisting of providing specific information; a video, tutorial, or any kind of displayable content.

18 . The system of claim 11 wherein the superimposing is performed on a handheld display device, a user's retina or smart glasses.

19 . The system of claim 11 wherein the selected media item comprises a call button.

20 . The system of claim 11 wherein the operations further comprise displaying any or all of the following action buttons in any combination or subcombination:

Price Tag,

Photo Gallery,

Videos,

Description,

Call,

Mail,

Shoplink,

Explanation,

Intro,

Social Media links,

Floor plan,

MLS number,

Neighborhood,

Pricing history, and/or

Map.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: AR, LLC
To: TECHINVEST COMPANY LIMITED
Reel/Frame 065957/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2022
From: HERZBERG, STEFAN W.; HERZBERG, MEGAN
To: AR, LLC
Reel/Frame 059977/0542 →
Continuity (11)
Continuation In Part 17228821 · Apr 13, 2021
Continuation 16895637 · Jun 8, 2020
Continuation 16565234 · Sep 9, 2019
Continuation In Part 17228814 · Apr 13, 2021
Continuation 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Continuation In Part 17641300
Continuation In Part 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Provisional Application 62966503 · Jan 27, 2020
Related Publication 20220189160A1 · Jun 16, 2022
References Cited (94)
US 7170391B2 · Lane · 2007 [cited by applicant]
US 9886845B2 · Rhoads · 2018 [cited by applicant]
US 10019136B1 · Ozog · 2018 [cited by applicant]
US 10055714B2 · Zhou · 2018 [cited by applicant]
US 10147076B2 · Zhou · 2018 [cited by applicant]
US 10521777B2 · Zhou · 2019 [cited by applicant]
US 10628674B1 · Godse · 2020 [cited by examiner]
US 10825004B1 · Walker · 2020 [cited by applicant]
US 10997418B2 · Herzberg · 2021 [cited by examiner]
US 10997419B2 · Herzberg · 2021 [cited by examiner]
US 11157739B1 · Iskandar · 2021 [cited by applicant]
US 11282323B2 · Van Horn · 2022 [cited by applicant]
US 11532051B1 · Braun · 2022 [cited by applicant]
US 20030009670A1 · Rhoads · 2003 [cited by applicant]
US 20050058318A1 · Rhoads · 2005 [cited by applicant]
US 20050196013A1 · Rhoads · 2005 [cited by applicant]
US 20080204361A1 · Scales · 2008 [cited by applicant]
US 20080260210A1 · Kobeli · 2008 [cited by applicant]
US 20090078756A1 · Oberan · 2009 [cited by applicant]
US 20120299961A1 · Ramkumar · 2012 [cited by examiner]
US 20130206830A1 · Kugel · 2013 [cited by applicant]
US 20130210523A1 · Arumugam · 2013 [cited by examiner]
US 20130229452A1 · Roof · 2013 [cited by applicant]
US 20130278631A1 · Border · 2013 [cited by applicant]
US 20130335784A1 · Kurtz · 2013 [cited by applicant]
US 20140080428A1 · Rhoads · 2014 [cited by applicant]
US 20140100896A1 · Du · 2014 [cited by applicant]
US 20140340423A1 · Taylor · 2014 [cited by applicant]
US 20150117701A1 · Ross · 2015 [cited by applicant]
US 20150161171A1 · Thankavel · 2015 [cited by examiner]
US 20150287290A1 · Van Horn · 2015 [cited by applicant]
US 20160085955A1 · Lerner · 2016 [cited by applicant]
US 20160133054A1 · Honjo · 2016 [cited by applicant]
US 20160140427A1 · Keay · 2016 [cited by applicant]
US 20160209648A1 · Haddick · 2016 [cited by examiner]
US 20160225192A1 · Jones · 2016 [cited by applicant]
US 20160328607A1 · Krishnan · 2016 [cited by applicant]
US 20160357406A1 · Lee · 2016 [cited by applicant]
US 20160358383A1 · Gauglitz · 2016 [cited by applicant]
US 20170032285A1 · Sharma · 2017 [cited by applicant]
US 20170094196A1 · Adsumilli · 2017 [cited by applicant]
US 20170221272A1 · Li · 2017 [cited by applicant]
US 20170249491A1 · Macintosh · 2017 [cited by examiner]
US 20170270698A1 · Goslin · 2017 [cited by applicant]
US 20170344823A1 · Withrow · 2017 [cited by applicant]
US 20180018671A1 · Celia · 2018 [cited by applicant]
US 20180089899A1 · Piemonte et al. · 2018 [cited by applicant]
US 20180114364A1 · McPhee · 2018 [cited by applicant]
US 20180174366A1 · Nishibe · 2018 [cited by applicant]
US 20180208209A1 · Al-Dahle et al. · 2018 [cited by applicant]
US 20180240220A1 · Katori · 2018 [cited by applicant]
US 20180253876A1 · Lin · 2018 [cited by applicant]
US 20180276895A1 · Hodge · 2018 [cited by applicant]
US 20180330167A1 · Siggard · 2018 [cited by applicant]
US 20180345129A1 · Rathod · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20190124272A1 · O'Neill · 2019 [cited by applicant]
US 20190149725A1 · Adato · 2019 [cited by applicant]
US 20190188920A1 · McPhee · 2019 [cited by applicant]
US 20190205645A1 · Bates · 2019 [cited by applicant]
US 20190205962A1 · Piramuthu · 2019 [cited by applicant]
US 20190236594A1 · Ehrlich-Quinn · 2019 [cited by applicant]
US 20190251303A1 · Fertakos · 2019 [cited by applicant]
US 20190258204A1 · Nelson · 2019 [cited by applicant]
US 20190318168A1 · Meier · 2019 [cited by applicant]
US 20190318186A1 · Sergott · 2019 [cited by examiner]
US 20190392088A1 · Duff · 2019 [cited by applicant]
US 20200019776A1 · Lewis · 2020 [cited by applicant]
US 20200045260A1 · Averhart · 2020 [cited by applicant]
US 20200082668A1 · Foley · 2020 [cited by applicant]
US 20200089014A1 · Peng et al. · 2020 [cited by applicant]
US 20200089313A1 · Himane · 2020 [cited by applicant]
US 20200160601A1 · Shreve · 2020 [cited by applicant]
US 20200225901A1 · Boissiere et al. · 2020 [cited by applicant]
US 20200233212A1 · Peimonte et al. · 2020 [cited by applicant]
US 20200233220A1 · Strongwater et al. · 2020 [cited by applicant]
US 20200233453A1 · Hatfield et al. · 2020 [cited by applicant]
US 20200233681A1 · Garstenauer et al. · 2020 [cited by applicant]
US 20200242439A1 · Micali · 2020 [cited by applicant]
US 20200394012A1 · Wright, Jr. · 2020 [cited by applicant]
US 20210004802A1 · Rule · 2021 [cited by applicant]
US 20220189161A1 · Herzberg · 2022 [cited by examiner]
US 20220189162A1 · Herzberg · 2022 [cited by examiner]
US 20220189164A1 · Herzberg · 2022 [cited by examiner]
US 20220189166A1 · Herzberg · 2022 [cited by examiner]
US 20220189167A1 · Herzberg · 2022 [cited by examiner]
US 20220189168A1 · Herzberg · 2022 [cited by examiner]
US 20220198795A1 · Herzberg · 2022 [cited by examiner]
US 20220198797A1 · Herzberg · 2022 [cited by examiner]
US 20220262114A1 · Herzberg · 2022 [cited by examiner]
US 20220391867A1 · Glaser · 2022 [cited by applicant]
WO 2013138846A1 · 2013 [cited by applicant]
Jan. 4, 2024 Office Action in U.S. Appl. No. 18/095,866. [cited by applicant]
Aug. 23, 2023 Office Action in U.S. Appl. No. 17/641,300. [cited by applicant]