IP Library Granted Patent US 11,961,294
Granted Patent B2
US 11,961,294 · App. 17/641,300 · Granted Apr 16, 2024

Augmented, virtual and mixed-reality content selection and display

Inventors: Stefan W. Herzberg (Nassau, BS); Megan Herzberg (Nassau, BS)
Assignee: Techinvest Company Limited
G06V20/20G06T11/00G06V30/42G06Q30/0276
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,961,294
App. No.
17/641,300
Filed
Mar 8, 2022
Granted
Apr 16, 2024
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

Systems, methods and techniques for automatically recognizing two or 3-dimensional real world objects with an augmented reality display device (smartphone or glasses etc.), and augmenting or enhancing the display of such real world objects by superimposing virtual images such as a still or video advertisement, an opportunity to buy, a story or other virtual image presentation. In non-limiting embodiments, the real world object includes visible features including visible security features and a recognition process takes the visible security features into account when recognizing the object and/or displaying superimposed virtual images.

Claims (23)

1. A method of presenting image information to a user comprising:

enabling optical capture of an image of a printed item bearing at least one visible security feature encoding a value;

displaying the captured image;

recognizing the printed item within the optically captured image by pattern matching at least one of color and grey scale information within a predefined recognition area of the captured image, wherein the recognizing does not require decoding the value encoded by the at least one visible security feature;

selecting a media item based at least in part on the pattern matching; and

using augmented reality to superimpose the selected media item onto the displayed captured image to appear as if it were part of the printed item,

wherein the enabling capture comprises downloading the image over a digital network.

2. The method of claim 1 wherein the recognizing comprises recognizing the image within the predefined recognition area that excludes the at least one visible security feature.

3. The method of claim 1 wherein the recognizing comprises recognizing the image within the predefined recognition area that includes the at least one visible security feature.

4. The method of claim 1 wherein the recognizing takes the at least one visible security feature into account but not the value the at least one visible security feature encodes.

5. A method of presenting image information to a user comprising:

enabling optical capture of an image of a printed item bearing at least one visible security feature encoding a value;

displaying the captured image;

recognizing the printed item within the optically captured image by using at least one of color and grey scale information within a predefined recognition area of the captured image, wherein the recognizing does not require recognizing and decoding the value encoded by the at least one visible security feature;

selecting a media item based at least in part on the recognition; and

using augmented reality to superimpose the selected media item onto the displayed captured image to appear as if it were part of the printed item,

wherein the printed item comprises a banknote or other government issued document, and the at least one visible security feature includes at least three items selected from the group consisting of holograms, woven three-dimensional security ribbon(s), distinctive image pattern(s) such as the EURion constellation, glossy stripe(s) that reveal additional information when viewed on an angle, watermark(s), raised printing, ultraviolet ink which reveals additional image information when viewed under ultraviolet light, thermochromatic ink the color of which is dependent on temperature, color changing or color shifting ink, see through indicia with complementary front and obverse portions, microprinting, unique printing fonts, embedded security threads, perforations, plastic, cotton fiber or other material matted or other textured surface(s), foil stamps, photographs including clear window photographs, serial numbers and barcodes and the recognizing does not require recognizing any of these items.

6. A system for presenting image information to a user comprising:

enabling a smart device to optically capture an image of a printed item bearing at least one visible security feature encoding a value and to display the captured image;

at least one processor configured to recognize the printed item within the optically captured image based on at least one of color and grey scale information wherein the recognition does not require recognizing or decoding the encoded value; and

in response to the recognized captured image, enabling the smart device to use augmented reality to superimpose a media item selected based at least in part on the recognized printed item onto the displayed image to appear as if it were part of the printed item,

wherein the smart device comprises a wearable device,

wherein the wearable device comprises wirelessly-connected augmented reality enabled glasses.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: AR, LLC
To: TECHINVEST COMPANY LIMITED
Reel/Frame 065957/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2022
From: HERZBERG, STEFAN W.; HERZBERG, MEGAN
To: AR, LLC
Reel/Frame 059198/0266 →
Continuity (4)
Continuation In Part 16893236 · Jun 4, 2020
Continuation In Part 16565234 · Sep 9, 2019
Provisional Application 62966503 · Jan 27, 2020
Related Publication 20220398842A1 · Dec 15, 2022