IP Library Granted Patent US 11,146,735
Granted Patent B2
US 11,146,735 · App. 16/666,112 · Granted Oct 12, 2021

Image processing methods and apparatuses, computer readable storage media, and electronic devices

Inventors: Ziqing Guo (Guangdong, CN); Haitao Zhou (Guangdong, CN); Kamwing Au (Guangdong, CN); Xiao Tan (Guangdong, CN); Guohui Tan (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N5/2352G01K13/00G06T7/514G06T7/521H04N5/23229G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,146,735
App. No.
16/666,112
Granted
Oct 12, 2021
Kind
B2
Abstract

The present disclosure provides an image processing method, an image processing apparatus, a computer readable storage medium, and an electronic device. The method includes: in response to detecting that a camera component is turned on, controlling the camera component to collect a speckle image, the speckle image being an image formed by illuminating an object with laser speckles; detecting a target temperature of the camera component, and acquiring a corresponding reference image based on the target temperature, the reference image being an image with reference depth information and collected when calibrating the camera component; and calculating based on the speckle image and the reference image to acquire a depth image.

Claims (73)

1. A method for image processing, comprising:

in response to detecting that a camera component is turned on, controlling the camera component to collect a speckle image of an object that is illuminated with laser speckles;

detecting a current temperature of the camera component;

acquiring a reference image with reference depth information based on the current temperature and a preset correspondence between reference images and specified temperatures, comprising:

acquiring differences between the current temperature and each specified temperature; and

acquiring the reference image corresponding to the specified temperature with the smallest difference;

calculating based on the speckle image and the acquired reference image to acquire a depth image; and

establishing the preset correspondence between reference images and specified temperatures, comprising:

controlling a temperature of the camera component to reach each specified temperature;

controlling the camera component to collect a reference image under each specified temperature; and

establishing the correspondence between the specified temperatures and the reference images.

2. The method of claim 1 , wherein controlling the camera component comprises:

controlling the camera component by a first processing unit that is an external processing unit with respect to a central processing unit.

3. The method of claim 2 , wherein detecting the current temperature of the camera component comprises:

detecting, by a temperature sensor, the current temperature of the camera component;

acquiring, by a second processing unit, the detected current temperature of the camera component from the temperature sensor, the second processing unit is a processing unit located in a trusted execution environment of the central processing unit; and

transmitting, by the second processing unit, the detected current temperature of the camera component to the first processing unit.

4. The method of claim 3 , wherein acquiring the reference image with reference depth information based on the current temperature and the preset correspondence comprising:

acquiring, by the first processing unit, the reference image with reference depth information based on the current temperature and the preset correspondence.

5. The method of claim 4 , wherein calculating based on the speckle image and the acquired reference image to acquire the depth image comprises:

calculating, by the first processing unit, based on the speckle image and the acquired reference image to acquire the depth image; and

transmitting, by the first processing unit, the depth image to the second processing unit.

6. The method of claim 1 , further comprising:

in response to detecting an image acquisition instruction, acquiring a timestamp carried in the image acquisition instruction, the timestamp being configured to indicate a time when the image acquisition instruction is initiated; and

controlling the camera component to turn on in response to that a duration from the timestamp to a target time is less than a duration threshold, the target time being configured to indicate a time when the image acquisition instruction is detected.

7. The method of claim 1 , further comprising:

acquiring an identifier of the camera component; and

acquiring the preset correspondence corresponding to the identifier.

8. The method of claim 1 , wherein calculating based on the speckle image and the acquired reference image to acquire the depth image comprises:

comparing the acquired reference image with the speckle image to acquire offset information for indicating a horizontal offset of a speckle in the speckle image relative to a corresponding speckle in the reference image; and

calculating based on the offset information and the reference depth information to acquire the depth image.

9. The method of claim 6 , further comprising:

acquiring an application level corresponding to a target application that initiates the image acquisition instruction;

adjusting an accuracy of the depth image based on the application level to acquire an adjusted depth image; and

transmitting the adjusted depth image to the target application.

10. The method of claim 1 , further comprising:

storing the preset correspondence between reference images and specified temperatures into a first processing unit that is an external processing unit with respect to a central processing unit.

11. The method of claim 1 , further comprising:

storing the preset correspondence between reference images and specified temperatures into a first processing unit that is an external processing unit with respect to a central processing unit; and

in response to detecting that a terminal is powered on, loading the preset correspondence between reference images and specified temperatures from the first processing unit into a second processing unit, the second processing unit is a processing unit located in a trusted execution environment of the central processing unit.

12. The method of claim 1 , wherein the camera component comprises a laser lamp and a camera, and controlling the temperature of the camera component to reach each specified temperature comprises:

controlling the laser lamp to operate at a specified frequency to control the temperature of the camera component to each the specified temperature.

13. The method of claim 1 , further comprising:

acquiring an identifier of the camera component; and

associating the identifier of the camera component to the preset correspondence.

14. The method of claim 1 , further comprising:

acquiring an identifier of the camera component;

associating the identifier of the camera component to the preset correspondence; and storing the identifier, and the preset correspondence into a server.

15. The method of claim 14 , further comprising:

transmitting a request for acquiring the preset correspondence to server, the request carrying the identifier of the camera component; and

receiving the preset correspondence from the server based on the identifier of the camera component carried in the request.

16. A non-transitory computer readable storage medium having stored thereon computer programs executed by a processor to carry out:

in response to detecting that a camera component is turned on, controlling the camera component to collect a speckle image of an object that is illuminated with laser speckles;

detecting a current temperature of the camera component;

acquiring a reference image with reference depth information based on the current temperature and a preset correspondence between reference images and specified temperatures, comprising:

acquiring differences between the current temperature and each specified temperature; and

acquiring the reference image corresponding to the specified temperature with the smallest difference;

calculating based on the speckle image and the acquired reference image to acquire a depth image; and

establishing the preset correspondence between reference images and specified temperatures, comprising:

controlling a temperature of the camera component to reach each specified temperature;

controlling the camera component to collect a reference image under each specified temperature; and

establishing the correspondence between the specified temperatures and the reference images.

17. An electronic device comprising a memory and a processor, the memory storing computer readable instructions, the computer readable instructions being executed by the processor, causing the processor to:

in response to detecting that a camera component is turned on, control the camera component to collect a speckle image of an object that is illuminated with laser speckles;

detect a current temperature of the camera component;

acquire a reference image with reference depth information based on the current temperature and a preset correspondence between reference images and specified temperatures, comprising:

acquire differences between the current temperature and each specified temperature; and

acquire the reference image corresponding to the specified temperature with the smallest difference;

calculate based on the speckle image and the acquired reference image to acquire a depth image; and

establish the preset correspondence between reference images and specified temperatures, by actions of:

controlling a temperature of the camera component to reach each specified temperature;

controlling the camera component to collect a reference image under each specified temperature; and

establishing the correspondence between the specified temperatures and the reference images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2019
From: GUO, ZIQING; ZHOU, HAITAO; AU, KAMWING; TAN, XIAO; TAN, GUOHUI
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 050846/0382 →
Priority Claims (2)
CN 201810404831.3 · Apr 28, 2018 · national
CN 201810690949.7 · Jun 28, 2018 · national
Continuity (2)
Continuation PCTCN2019080601 · Mar 29, 2019
Related Publication 20200068110A1 · Feb 27, 2020