IP Library Granted Patent US 12,425,559
Granted Patent B2
US 12,425,559 · App. 18/636,707 · Granted Sep 23, 2025

Online compensation of thermal distortions in a stereo depth camera

Inventors: Aviad Zabatani (Even Yehuda, IL); Sagy Bareket (Haifa, IL); Ohad Menashe (Haifa, IL); Erez Sperling (D.N. Menashe, IL); Alex Bronstein (Haifa, IL); Michael Bronstein (Lugano, CH); Ron Kimmel (Haifa, IL); Vitaly Surazhsky (Yokneam Illit, IL)
Assignee: Intel Corporation
H04N13/246G06F3/012G06F3/017G06F3/0488G06T5/80G06T7/85H04N13/243H04N13/25H04N13/254H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,425,559
App. No.
18/636,707
Granted
Sep 23, 2025
Kind
B2
Abstract

An example apparatus includes: a camera to record an image; memory to store instructions; and a processor in circuit with the memory, the processor to execute the instructions to: determine a depth based on: (a) the image and (b) a calibration parameter of the camera; and adjust the calibration parameter based on a temperature of the camera and the depth.

Claims (57)

1. An apparatus comprising:

interface circuitry;

machine-readable instructions; and

at least one processor circuit to be programmed by the machine-readable instructions to:

control a light source to cast an infrared light pattern;

obtain data generated by an infrared camera, the data based on the infrared light pattern;

determine, based on a deformation of the infrared light pattern, depth data including physical distances between the infrared camera and different locations on a face; and

control an application based on the depth data.

2. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is in a smartphone.

3. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to:

perform facial tracking based on the data;

create a virtual screen based on the facial tracking; and

adapt a user interface of the application based on the facial tracking.

4. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to:

cause a virtual object to be rendered in a user interface of the application;

determine a body part gesture based on second data generated by the infrared camera;

determine dynamics of the virtual object based on the body part gesture; and

apply the dynamics to the virtual object in the user interface of the application.

5. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to:

obtain the data based on multiple scans of the infrared light pattern by the infrared camera;

reconstruct a shape of the face based on the multiple scans of the infrared light pattern and based on second data from a second camera;

determine image distortions in the reconstructed shape of the face; and

perform a calibration routine to compensate for the image distortions.

6. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to determine the physical distances based on the data generated by the infrared camera and based on second data generated by a red-green-blue camera.

7. At least one non-transitory machine-readable medium comprising machine-readable instructions to cause at least one processor circuit to at least:

generate a virtual object for a user interface of an application;

control a light source to cast an infrared light pattern;

determine a body-part gesture based on data generated by an infrared camera, the data based on the infrared light pattern;

determine dynamics of the virtual object based on the body part gesture; and

apply the dynamics to the virtual object in the user interface of the application.

8. The at least one non-transitory machine-readable medium of claim 7 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to:

perform facial tracking based on second data generated by an infrared camera;

create a virtual screen based on the facial tracking; and

adapt the user interface of the application based on the facial tracking.

9. The at least one non-transitory machine-readable medium of claim 7 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to:

obtain second data based on multiple scans of the infrared light pattern by the infrared camera;

reconstruct a shape of a face based on the multiple scans of the infrared light pattern and based on third data from a second camera;

determine image distortions in the reconstructed shape of the face; and

perform a calibration routine to compensate for the image distortions.

10. The at least one non-transitory machine-readable medium of claim 8 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to determine physical distances between the infrared camera and different locations on a face based on a deformation of a second infrared light pattern on the face.

11. The at least one non-transitory machine-readable medium of claim 10 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to determine the physical distances based on the second data generated by the infrared camera and based on third data generated by a red-green-blue camera.

12. A method comprising:

controlling a light source to cast an infrared light pattern;

obtaining first data generated by an infrared camera, the first data based on multiple scans of the infrared light pattern by the infrared camera;

reconstructing, by at least one processor circuit programmed by at least one instruction, a shape of a face based on the multiple scans of the infrared light pattern and based on second data from a second camera;

determining, by one or more of the at least one processor circuit, one or more image distortions in the reconstructed shape of the face based on third data from a third camera; and

performing, by one or more of the at least one processor circuit, a calibration routine to compensate for the one or more image distortions.

13. The method of claim 12 , including controlling an application in a smartphone.

14. The method of claim 13 , including:

creating a virtual screen based on facial tracking; and

adapting a user interface of the application based on the facial tracking.

15. The method of claim 13 , including:

rendering a virtual object on a user interface of the application;

determining a body part gesture based on fourth data generated by the infrared camera;

determining dynamics of the virtual object based on the body part gesture; and

applying the dynamics to the virtual object on the user interface of the application.

16. The method of claim 12 , including determining physical distances between the infrared camera and different locations on a face, the physical distances based on a deformation of a second infrared light pattern on the face.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2026
From: INTEL CORPORATION
To: REALSENSE, INC.
Reel/Frame 074071/0151 →
Continuity (6)
Continuation 17902565 · Sep 2, 2022
Continuation 16983640 · Aug 3, 2020
Continuation 16450524 · Jun 24, 2019
Continuation 15805598 · Nov 7, 2017
Continuation 14865196 · Sep 25, 2015
Related Publication 20240283902A1 · Aug 22, 2024
References Cited (21)
US 9813692B2 · Zabatani et al. · 2017 [cited by applicant]
US 10390002B2 · Zabatani et al. · 2019 [cited by applicant]
US 10735713B2 · Zabatani et al. · 2020 [cited by applicant]
US 11438569B2 · Zabatani et al. · 2022 [cited by applicant]
US 11973923B2 · Zabatani et al. · 2024 [cited by applicant]
US 20040101212A1 · Fedorovskaya · 2004 [cited by examiner]
US 20150002628A1 · Reif · 2015 [cited by applicant]
US 20150363934A1 · Ko · 2015 [cited by examiner]
US 20160011657A1 · Estacio · 2016 [cited by examiner]
US 20170034502A1 · Aurongzeb et al. · 2017 [cited by applicant]
US 20170094255A1 · Zabatani et al. · 2017 [cited by applicant]
US 20180234673A1 · Zabatani et al. · 2018 [cited by applicant]
Carmody, “How Facial Recognition Works in Xbox Kinect,” Wired, retrieved from https://www.wired.com/2010/11/how-facial-recognition-works-in-xbox-kinect/, Nov. 5, 2010, 5 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 14/865,196, Jun. 30, 2017, 11 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 15/805,598, filed Jan. 24, 2019, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 15/805,598, filed Jun. 19, 2019, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 16/450,524, filed Mar. 24, 2020, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action”, issued in connection with U.S. Appl. No. 16/983,640, filed Sep. 9, 2021, 5 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in U.S. Appl. No. 16/983,640 on Jan. 5, 2022, 5 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 16/983,640, filed Apr. 27, 2022, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/902,565, dated Jan. 30, 2024, 7 pages. [cited by applicant]
Cited By (1)
US 12,579,690