IP Library › Granted Patent US 12,366,743
Granted Patent B2
US 12,366,743 · App. 17/467,731 · Granted Jul 22, 2025

Method for producing a digital image, associated computer program product and optical system

Inventors: Arnaud Malvache (Fuveau, FR); Antonin Borot (Marseilles, FR); Benjamin Lefaudeux (Menlo Park, CA); Laurent Marfisi (Marseilles, FR)
Assignee: UNISTELLAR
G02B23/10G01C21/02G02B27/0093G02B27/026G09B27/00G09B27/04G02B2027/0138G02B2027/014G02B2027/0141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,366,743
App. No.
17/467,731
Granted
Jul 22, 2025
Kind
B2
Abstract

The invention relates to an optical system for restoring a natural image combined with a digital image, in order to characterise and highlight the objects represented on the natural image. The optical system includes an objective lens, an eyepiece, a semi-reflective plate, a processing unit, capturing means and restoring means. The invention also relates to a method for producing such a digital image.

Claims (67)

1. An optical system, comprising,

a processing unit, a non-transitory computer-readable medium and a program memory coupled to the processing unit and having program instructions stored thereon which, when executed by the processing unit, cause the processing unit to produce a digital image;

a hollow body, comprising,

an objective lens to collect a set of incoming light beams from a study scene corresponding to a portion of a ceiling structure;

a matrix sensor cooperating with the processing unit and having an active face, to capture all or some of said incoming light beams, said matrix sensor producing a digital representation of the study scene,

a data memory for recording information associated with a determined pattern comprising an item of metainformation characterizing said pattern; and

wherein the processing unit is arranged to produce the digital image from an electronic transformation of the digital representation, and

the processing unit further cooperates with the program memory comprising program instructions which, when executed by the processing unit,

analyze said digital representation and detect the presence of a characteristic pattern;

search in the data memory for a recording associated with a determined pattern close to said detected characteristic pattern;

extract the value of the associated metainformation from such a recording; and

trigger the acquisition of several successive digital representations by the matrix sensor;

produce one single digital representation from said successive digital representations,

and

wherein the processing unit cooperates with a program memory comprising program instructions, which, when executed by the processing unit, reduce noise and/or improve intensity and contrast of the digital representation in order to improve quality of the digital image.

2. The optical system according to claim 1 , comprising:

an eyepiece;

a screen cooperating with the processing unit and comprising an active face to project, into the hollow body, to the eyepiece, the digital image in the form of a set of projected light beams;

a semi-reflective plate positioned within the hollow body to reflect a first subset of incoming light beams towards the active face of said matrix sensor and transmit a second subset of incoming light beams towards the eyepiece, the semi-reflective plate being furthermore arranged to transmit and reflect the first and second subsets of said projected light beams respectively towards the active face of the matrix sensor and the eyepiece;

wherein the respective active faces of the matrix sensor and the screen face one another and are arranged on either side of the semi-reflective plate, said active faces being passed through by a virtual transversal axis of the hollow body perpendicular to a virtual longitudinal axis of said hollow body and passing through a center of the semi-reflective plate.

3. The optical system according to claim 2 , wherein the hollow body comprises a polarizer to absorb the light beams projected and transmitted by the semi-reflective plate, arranged between the matrix sensor and the screen, said polarizer being passed through by the virtual transversal axis.

4. The optical system according to claim 2 , wherein the hollow body comprises an imaging lens to constitute an image from projected light beams, arranged between the screen and the semi-reflective plate, said lens being passed through by the virtual transversal axis.

5. The optical system according to claim 1 , further comprising communication means cooperating with the processing unit, arranged to receive a transmission message emitted from a third-party entity, the processing unit being arranged to:

decode such a transmission message emitted by said third-party entity, said transmission message encoding characteristic data of a determined pattern, localization data and an item of metainformation associated with said pattern; and

record in the data memory, said characteristic data of a determined pattern, said localization data and said metainformation associated with said pattern and deduced from said transmission message;

wherein the communication means is a modulator/demodulator.

6. The optical system according to claim 5 , wherein the communication means are arranged to emit a discovery message and the processing unit is furthermore arranged to:

produce said discovery message, such that it encodes the positioning data of the study scene in the ceiling structure; and

trigger the emission of said discovery message by the communication means to request from a third-party entity of the characteristic data of a pattern determined by said positioning data of the study scene and an item of metainformation in line with said determined pattern.

7. The optical system according to claim 1 , further comprising communication means cooperating with the processing unit and arranged to emit a transmission message, the processing unit being arranged to:

search in a data memory for characteristic data of a pattern determined by positioning data of the study scene and characteristic data of a determined pattern, localization data and an item of metainformation associated with said pattern;

produce a transmission message to encode said characteristic data of a determined pattern, said localization data and said item of metainformation associated with said pattern; and

trigger the emission of said transmission message by said communication means;

wherein the communication means is a modulator/demodulator.

8. The optical system according to claim 1 , further comprising communication means cooperating with the processing unit and arranged to emit a transmission message and receive a discovery message, the processing unit being arranged to:

decode said discovery message, said discovery message comprising positioning data of a study scene in the ceiling structure;

search in a data memory for characteristic data of a pattern determined by said positioning data of the study scene deduced from said discovery message and characteristic data of a determined pattern, localization data and an item of metainformation associated with said pattern;

produce a transmission message to encode said characteristic data of a determined pattern, said localization data and said item of metainformation associated with said pattern; and

trigger the emission of said transmission message by said communication means;

wherein the communication means is a modulator/demodulator.

9. A method for producing a digital image implemented by the processing unit of an optical system according to claim 1 and observing a study scene, said processing unit cooperating with the matrix sensor, and a data memory of said optical system, said method comprising:

a step for recording, in the data memory, information associated with a determined pattern comprising an item of metainformation characterizing said pattern;

a step for triggering the capture of incoming light beams from said study scene by the matrix sensor and producing a digital representation of said study scene;

a step for analyzing said digital representation and detecting the presence of a characteristic pattern;

a step for searching in the data memory for a recording associated with a determined pattern close to said detected characteristic pattern;

a step for extracting the value of the associated metainformation from such a recording;

a step for producing a digital image from the digital representation and from said extracted metainformation, and

wherein prior to the step for analyzing said digital representation produced by the matrix sensor, a step for improving the contrast and/or reducing noise of the digital representation.

10. The method according to claim 9 , further comprising:

a step for the associating in the data memory the recording with a localization data of the determined pattern in the ceiling structure;

wherein the method further comprises, prior to the step of searching in the data memory for a recording associated with a pattern close to the detected characteristic pattern:

a step for determining the positioning data of the study scene in the ceiling structure;

a step for extracting from a first recording of the data memory, localization data and calculating a distance between said localization data extracted and the positioning data of said study scene in the ceiling structure; and

a step for certifying the proximity of a pattern associated with the localization data extracted if said calculated distance is less than a predetermined threshold;

wherein said step for searching in the data memory for a recording associated with a pattern close to the detected characteristic pattern is implemented if and only if the step for certifying the proximity of the pattern associated with the localization data extracted from the study scene certifies such a proximity.

11. The method according to claim 9 , comprising, prior to the step for analyzing said digital representation:

a step for triggering the acquisition of several successive digital representations by the matrix sensor; and

a step for producing one single digital representation from said successive digital representations.

12. The method according to claim 9 , comprising:

a step for recording said digital image in the data memory; and

a step, prior to the step for analyzing the digital representation, for extracting from said data memory the digital image from the preceding restoration and subtracting said digital image from the digital representation of the current study scene.

13. The method according to claim 9 , comprising:

a step for establishing communication between the processing unit and a third-party entity;

wherein said method comprises a step for producing a discovery message comprising the positioning data of the study scene in the ceiling structure and triggering the emission of said discovery message, if the step for searching in the data memory for a recording associated with a pattern close to the characteristic pattern has not succeeded.

14. The method according to claim 9 , wherein the step for triggering the capture of incoming light beams from said study scene by the matrix sensor and producing a digital representation of said study scene is implemented so as to capture a study scene named by positioning data of said study scene in the ceiling structure.

15. The optical system according to claim 9 , wherein the program memory comprises program instructions which when there are executed by the processing unit, average the gray level of light intensity value or color of each pixel from said successive digital representations.

16. The optical system according to claim 9 , wherein the processing unit is arranged to produce the digital image from an electronic transformation of the digital representation and an item of metainformation recorded in a data memory cooperating with said processing unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2021
From: MALVACHE, ARNAUD; BOROT, ANTONIN; LEFAUDEUX, BENJAMIN; MARFISI, LAURENT
To: UNISTELLAR
Reel/Frame 057399/0032 →
Priority Claims (1)
FR 1657596 · Aug 5, 2016 · national
Continuity (2)
Continuation 16322226
Related Publication 20210405341A1 · Dec 30, 2021
References Cited (12)
US 20010000677A1 · Takagi et al. · 2001 [cited by applicant]
US 20160109695A1 · Hillis et al. · 2016 [cited by applicant]
US 20180227503A1 · Ando et al. · 2018 [cited by applicant]
US 20190109695A1 · Kim · 2019 [cited by examiner]
DE 102005025048A1 · 2006 [cited by applicant]
EP 2472472A1 · 2012 [cited by applicant]
JP H0572486A · 1993 [cited by applicant]
JP 2009258212A · 2009 [cited by applicant]
JP 2009288269A · 2009 [cited by applicant]
Lintu et al., “An Augmented Reality System for Astronomical Observations”, Virtual Reality, 2006. IEEE Alexandria, VA, USA Mar. 25-29, 2006, Piscataway, NJ, USA, IEEE, Mar. 25, 2006, p. 6-16; 10 pages. [cited by applicant]
Filippenko et al., “Abstract”, International Astronomical Union Colloquium, vol. 183, Jan. 1, 2001, p. 121-130; 10 pages. [cited by applicant]
International Search Report issued on Dec. 11, 2017 in corresponding International application No. PCT/FR2017/052203; 7 pages. [cited by applicant]