IP Library › Granted Patent US 12,324,626
Granted Patent B2
US 12,324,626 · App. 17/618,085 · Granted Jun 10, 2025

Process for determining ophthalmic parameters by 3D mapping

Inventors: Jean-Philippe Sayag (Paris, FR); Alexander Shelymagin (Vilnius, LT)
Assignee: ACEP FRANCE
A61B3/111A61B3/0025A61B3/10A61B3/112A61B3/14G02C13/003G02C13/005A61B2560/0406
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,324,626
App. No.
17/618,085
Granted
Jun 10, 2025
Kind
B2
Abstract

A method for determining ophthalmic parameters for a given frame and a given wearer, including: a) the given wearer is fitted with said given frame; b) providing a device including a first projecting mean able to project a pattern of optical radiation onto the face of the wearer, a first camera able to record said pattern of optical radiation, a processing device able to processes the image of the pattern in order to generate a depth map of the face of the wearer, a screen able to display the images recorded by said first camera and a light source able to illuminate the pupils of the wearer, c) recording simultaneously a depth map of the face of the wearer and a picture of the face of the wearer while said light source is illuminating the pupils of the wearer.

Claims (21)

1. A method for determining ophthalmic parameters for a given frame and a given wearer, said method comprising the following steps:

a) fitting said given wearer with said given frame;

b) providing a mobile device comprising a first projecting mean able to project a pattern of optical radiation onto the face of the wearer, a first camera able to record said pattern of optical radiation, a processing device able to processes the image of the pattern in order to generate a depth map of the face of the wearer, a screen able to display the images recorded by said first camera and a light source able to illuminate the pupils of the wearer,

c) recording simultaneously a depth map of the face of the wearer and a picture of the face of the wearer while said light source is obtained by displaying a white form on said screen and is illuminating the pupils of the wearer while said screen displays a focusing point,

d) determining automatically the position of the pupils of the wearer,

e) associating the position of the pupils of the wearer to their respective coordinates in the depth map,

f) determining from the respective coordinates of the pupils of the wearer said ophthalmic parameters, and

further comprising a step wherein the position of the pupils obtained at step d) is displayed on the screen with said recorded image of the face of the wearer and wherein said position can be corrected.

2. The method according to claim 1 further comprising a step wherein the position of said frame is calculated form the recorded image of the face of the wearer and said position is associated to its respective coordinate in the depth map.

3. The method according to claim 1 further comprising a step where the position of said frame is displayed on the screen with said recorded image of the face of the wearer and wherein said position can be corrected.

4. The method according to claim 1 wherein said optical parameters are chosen from the group comprising far vision pupillary distance, near vision pupillary distance, vertex pantoscopic tilt, frame wrap, near vision fitting height and far vision fitting height.

5. The method according to claim 1 , wherein the wearer is holding said mobile device at an arm length and at eye level.

6. The method according to claim 1 , wherein the wearer is holding said mobile device at a reading distance.

7. The method according to claim 1 , further comprising, before step c), determining the direction of gaze of the wearer from a depth map obtained by illuminating the face of the wearer by the first projecting mean with a pattern of optical radiation and by recording a second picture comprising said pattern.

8. The method according to claim 1 , further comprising, before step c), determining the head inclination of the wearer from a depth map obtained by illuminating the face of the wearer by the first projecting mean with a pattern of optical radiation and by recording a second picture comprising said pattern.

9. The method according to claim 1 , wherein said focusing point is a red circle.

10. The method according to claim 1 , wherein said focusing point is near said camera.

11. The method according to claim 1 , wherein said focusing point is shifted to the right, to the left, above or below said camera.

12. The method according to claim 1 , wherein said screen displays a transversal line while step c).

13. The method according to the screen to claim 1 , wherein said screen displays the image recorded by said camera.

14. A mobile device, comprising a first projecting mean able to project a pattern of optical radiation onto the face of an individual wearing a frame, a first camera able to record said pattern of optical radiation, a processing device able to process the image of the pattern in order to generate a depth map of the face of said individual, a screen able to display the images recorded by said first camera, a light source able to illuminate the pupils of the wearer wherein said mobile device further comprises a software able to implement a process according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2022
From: SAYAG, JEAN-PHILIPPE; SHELYMAGIN, ALEXANDER
To: ACEP FRANCE
Reel/Frame 058675/0380 →
Priority Claims (1)
FR 1906179 · Jun 11, 2019 · national
Continuity (1)
Related Publication 20220296096A1 · Sep 22, 2022
References Cited (45)
US 9395562B1 · Nguyen et al. · 2016 [cited by applicant]
US 9618620B2 · Zweigle et al. · 2017 [cited by applicant]
US 10107914B2 · Kalscheur et al. · 2018 [cited by applicant]
US 11126016B2 · Breuninger et al. · 2021 [cited by applicant]
US 11195318B2 · Suma et al. · 2021 [cited by applicant]
US 20090021693A1 · Sessner et al. · 2009 [cited by applicant]
US 20140152956A1 · Silva · 2014 [cited by examiner]
US 20150146168A1 · Divo et al. · 2015 [cited by applicant]
US 20160299360A1 · Sone et al. · 2016 [cited by applicant]
US 20170336654A1 · Seitz · 2017 [cited by examiner]
US 20180321517A1 · El-Hajal et al. · 2018 [cited by applicant]
US 20190033624A1 · Breuninger · 2019 [cited by examiner]
US 20200292307A1 · Seitz · 2020 [cited by examiner]
US 20220218198A1 · Devani · 2022 [cited by examiner]
DE 102005003699A1 · 2006 [cited by applicant]
DE 102011009646A1 · 2012 [cited by applicant]
DE 102014015671A1 · 2016 [cited by applicant]
DE 102015001874A1 · 2016 [cited by applicant]
DE 102016106121A1 · 2017 [cited by applicant]
EP 2772795A1 · 2014 [cited by applicant]
EP 3413122A1 · 2017 [cited by applicant]
EP 3270099A1 · 2018 [cited by applicant]
International Search Report and Written Opinion issued on Sep. 8, 2020 in corresponding International Application No. PCT/EP2020/066140; 12 pages. [cited by applicant]
International Preliminary Report on Patentability issued on Aug. 5, 2021, in corresponding International Application No. PCT/EP2020/066140; 12 pages. [cited by applicant]
In the United States District Court for the Southern District of Florida Miami Division; [cited by applicant]
Feng, et al., “Rapid Avatar Capture and Simulation Using Commodity Depth Sensors”, USC Institute for Creative Technologies, University of Southern California, May 23, 2014, 1 page. [cited by applicant]
Chmiel, “How to Create a Measuring App With ARKit In IOS 11” by Pawel Chmiel, Droids on Roids, Jul. 13, 2017, 11 pages URL: https://www.thedroidsonroids.com/blog/how-to-create-a-measuring-app-with-arkit-in-ios-11 Archiv… [cited by applicant]
Pereira, “ARKit introduction” by Ricardo Pereira, Whitesmith, Jul. 19, 2017, 12 pages URL: https://www.whitesmith.co/blog/arkit-introduction/ Archive: https://web.archive.org/web/20200415023503/https://www.whitesmith.co… [cited by applicant]
Apple Developer, Apple developer documentation entry for the VNFaceLandmarks2D class,“VNFaceLandmarks2D”, Jun. 18, 2019, 4 pages URL: https://developer.apple.com/documentation/vision/vnfacelandmarks2d Archive: https://w… [cited by applicant]
Quora, “How can Apple's ARKit (Augmented Reality) do precise measurement with just one camera?”, Quora, Inc. Jan. 10, 2025, 14 pages URL: https://www.quora.com/How-can-Apple%E2%80%99s-ARKit-Augmented-Reality-do-precise-… [cited by applicant]
Intel Realsense, “Room Scanning using LiDAR Camera L515 Demo”, Youtube, Jan. 27, 2020, 1 page URL: https://youtu.be/41Yu2H9_z3w?si=dalDOXg5R1Q-qWRk Archive: https://web.archive.org/web/20200720225936/https://www.youtube… [cited by applicant]
Intel Realsense, “Body Scanning using LiDAR Camera L515”, Youtube, Jan. 27, 2020, 1 page URL: https://www.youtube.com/watch?v=Uzlfn667abE Archive: https://web.archive.org/web/20201104074949/https://www.youtube.com/watch… [cited by applicant]
Intel Realsense, “Intel RealSense LiDAR Camera L515—the worlds' smallest high-resolution LiDAR depth camera”, Youtube, Dec. 11, 2019, 1 page URL: https://www.youtube.com/watch?v=Rx-75ZEAMeg Archive: https://web.archive.… [cited by applicant]
Intel Realsense, Intel RealSense Depth and Tracking Cameras, store, “Intel Realsense LiDAR Camera L515”, Jan. 7, 2020, 5 pages Archive: http://web.archive.org/web/20200107220737/https://www.intelrealsense.com/lidar-came… [cited by applicant]
Optikam Tech, “Optikam Pad Product Demo”, Vimeo, Uploaded Jan. 3, 2015, 1 page URL: https://vimeo.com/115857055. [cited by applicant]
Optikam Tech, “Spectangle Pro Product Demo”, Vimeo, Uploaded Mar. 6, 2015, 1 page URL: https://vimeo.com/121471286. [cited by applicant]
Optikam Tech, “OptikamPad Training Video”, Vimeo, Uploaded Feb. 6, 2013, 1 page URL: https://vimeo.com/59100367. [cited by applicant]
Optikam Tech, “The OptikamPad Experience”, Vimeo, Uploaded Mar. 15, 2015, 1 page URL: https://vimeo.com/122272236. [cited by applicant]
Goldberg, “Putting virtual glasses on a real face: Warby Parker's Virtual Try-On placement algorithm”, Medium, Apr. 2, 2019, 12 pages URL: https://medium.com/@davidhgoldberg/putting-virtual-glasses-on-a-real-face-warby-… [cited by applicant]
Optikam Tech, “The Spectangle Pro Experience Video”, Vimeo, Uploaded Nov. 5, 2015, 1 page URL: https://vimeo.com/1447949. [cited by applicant]
Optikam Tech, Spectangle Pro Training Video, VImeo, Feb. 6, 2015, 1 page URL: https://vimeo.com/118945207. [cited by applicant]
Optikam Tech, Optikam Tech Vimeo Channel (Various), Vimeo, 1 page URL: https://vimeo.com/user16311401. [cited by applicant]
[cited by applicant]
Technology for Opticians, “SmartMIRROR V1 Measurements”, Youtube, Uploaded Aug. 12, 2017, 1 page URL: https://www.youtube.com/watch?v=fWttBLfAZzc. [cited by applicant]
ACEPdirect, “SmartMirror for Ipad”, Facebook, Uploaded Jul. 20, 2015, 1 page URL: https://www.facebook.com/photo/?fbid=492989864186693&set=smart-mirror-for-ipadsmart-mirror-works-on-the-ipad-mini-ipad-mini-2-ipad2-ipad4. [cited by applicant]