IP Library Granted Patent US 12,443,283
Granted Patent B2
US 12,443,283 · App. 17/684,890 · Granted Oct 14, 2025

Projection control method and electronic device

Inventor: Yong Duan (Beijing, CN)
Assignee: LENOVO (BEIJING) LIMITED
G06F3/017G03H1/0005G06T7/50G06T7/70G09G3/002G03H2001/0061G09G2340/0407G09G2340/0464
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,443,283
App. No.
17/684,890
Granted
Oct 14, 2025
Kind
B2
Abstract

Projection control method, electronic device, and storage medium are provided. The projection control method includes obtaining a first depth data corresponding to a reference object; obtaining a second depth data corresponding to a remote object; determining a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data; and performing a holographic projection on the remote object according to the first scaling ratio and the second depth data, to obtain a first projection image.

Claims (81)

1. A projection control method, comprising:

obtaining a first depth data corresponding to a reference object;

obtaining a second depth data corresponding to a remote object;

determining a second scaling ratio associated with a ratio of a height of a projection of the reference object to a height of the reference object;

determining a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data, the first scaling ratio being associated with a ratio of a height of a first projection image of the remote object to a height of the remote object; and

performing a holographic projection of the remote object according to the first scaling ratio and the second depth data, to obtain the first projection image, such that the height of the first projection image is based at least in part on the height of the remote object and a ratio of the first scaling ratio to the second scaling ratio is a predetermined ratio, wherein the projection control method further comprises:

performing a gesture collection on a gesture of the reference object to obtain second gesture information;

determining a first virtual object according to the second gesture information, the first virtual object is different from the reference object and the remote object;

performing the holographical projection of the first virtual object according to the first scaling ratio, to obtain a first interactive image of the first virtual object for interaction between the reference object and the remote object;

performing an interactive gesture collection on the reference object and the remote object, to obtain third gesture information; and

performing a projection adjustment on the first interactive image according to the third gesture information, to obtain a second interactive image of the first virtual object.

2. The method according to claim 1 , wherein determining the first scaling ratio corresponding to the remote object according to the first depth data and the second depth data includes:

determining a first projection contour and a first original height of the reference object according to the first depth data,

wherein the second scaling ratio is determined according to the first projection contour and the first original height of the reference object; and

determining a second projection contour and a second original height of the remote object according to the second depth data,

wherein the first scaling ratio corresponding to the second projection contour is determined according to the second original height of the remote object and the second scaling ratio.

3. The method according to claim 1 , further including:

adjusting the first projection image to obtain a second projection image.

4. The method according to claim 3 , wherein adjusting the first projection image to obtain the second projection image includes:

performing a scale adjustment on the first depth data to obtain third depth data;

adjusting the first scaling ratio based on the third depth data to obtain a third scaling ratio; and

performing a projection adjustment on the first projection image according to the third scaling ratio to obtain the second projection image.

5. The method according to claim 3 , wherein adjusting the first projection image to obtain the second projection image includes:

performing a scale adjustment on the second depth data to obtain fourth depth data;

adjusting the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; and

performing a projection adjustment on the first projection image according to the fourth scaling ratio to obtain the second projection image.

6. The method according to claim 3 , wherein adjusting the first projection image to obtain the second projection image includes:

collecting a gesture of the reference object to obtain first gesture information; and

adjusting the first projection image according to the first gesture information, to obtain the second projection image, wherein the adjusting includes at least one of a projection position adjustment and a projection scale adjustment.

7. The method according to claim 3 , wherein adjusting the first projection image to obtain the second projection image includes:

determining first position information corresponding to the reference object;

determining second position information corresponding to the remote object;

determining overlapped position information according to the first position information and the second position information; and

performing a mask processing on the first projection image according to the overlapped position information, to obtain the second projection image.

8. An electronic device, comprising:

a memory storing program instructions for a projection control method; and

a processor coupled with the memory and, when the program instructions being executed, configured to:

obtain first depth data corresponding to a reference object;

obtain second depth data corresponding to a remote object;

determine a second scaling ratio associated with a ratio of a height of a projection of the reference object to a height of the reference object;

determine a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data, the first scaling ratio being associated with a ratio of a height of a first projection image of the remote object to a height of the remote object; and

perform a holographic projection of the remote object according to the first scaling ratio and the second depth data, to obtain the first projection image, such that the height of the first projection image is based at least in part on the height of the remote object and a ratio of the first scaling ratio to the second scaling ratio is a predetermined ratio, wherein:

the projection control method further comprises:

performing a gesture collection on a gesture of the reference object to obtain second gesture information;

determining a first virtual object according to the second gesture information, the first virtual object is different from the reference object and the remote object;

performing the holographical projection of the first virtual object according to the first scaling ratio, to obtain a first interactive image of the first virtual object for interaction between the reference object and the remote object;

performing an interactive gesture collection on the reference object and the remote object, to obtain third gesture information; and

performing a projection adjustment on the first interactive image according to the third gesture information, to obtain a second interactive image of the first virtual object.

9. The electronic device according to claim 8 , wherein the processor is further configured to:

determine a first projection contour and a first original height of the reference object according to the first depth data,

wherein the second scaling ratio is determined according to the first projection contour and the first original height of the reference object; and

determine a second projection contour and a second original height of the remote object according to the second depth data,

wherein the first scaling ratio corresponding to the second projection contour is determined according to the second original height of the remote object and the second scaling ratio.

10. The electronic device according to claim 8 , wherein the processor is further configured to:

adjust the first projection image to obtain a second projection image.

11. The electronic device according to claim 10 , wherein the processor is further configured to:

perform a scale adjustment on the first depth data to obtain third depth data, and adjust the first scaling ratio based on the third depth data to obtain a third scaling ratio; and

perform a projection adjustment on the first projection image according to the third scaling ratio to obtain the second projection image.

12. The electronic device according to claim 11 , wherein the processor is further configured to:

perform the scale adjustment on the second depth data to obtain fourth depth data, and adjust the first scaling ratio based on the fourth depth data to obtain a fourth scaling ratio; and

perform the projection adjustment on the first projection image according to the fourth scaling ratio to obtain the second projection image.

13. The electronic device according to claim 11 , wherein the processor is further configured to:

obtain first gesture information by collecting a gesture of the reference object; and

adjust the first projection image according to the first gesture information, to obtain the second projection image, wherein the adjustment includes at least one of a projection position adjustment and a projection scale adjustment.

14. The electronic device according to claim 13 , wherein the processor is further configured to:

determine first position information corresponding to the reference object;

determine second position information corresponding to the remote object; and

determine overlapped position information according to the first position information and the second position information.

15. The electronic device according to claim 14 , wherein the processor is further configured to:

perform a mask processing on the first projection image according to the overlapped position information, to obtain the second projection image.

16. A non-transitory computer-readable storage medium containing computer-executable instructions stored thereon, wherein, when being executed, the computer-executable instructions cause a processor to perform a projection control method, the method comprising:

obtaining a first depth data corresponding to a reference object;

obtaining a second depth data corresponding to a remote object;

determining a second scaling ratio associated with a ratio of a height of a projection of the reference object to a height of the reference object;

determining a first scaling ratio corresponding to the remote object according to the first depth data and the second depth data, the first scaling ratio being associated with a ratio of a height of a first projection image of the remote object to a height of the remote object; and

performing a holographic projection of the remote object according to the first scaling ratio and the second depth data, to obtain the first projection image, such that the height of the first projection image is based at least in part on the height of the remote object and a ratio of the first scaling ratio to the second scaling ratio is a predetermined ratio, wherein the projection control method further comprises:

performing a gesture collection on a gesture of the reference object to obtain second gesture information;

determining a first virtual object according to the second gesture information, the first virtual object is different from the reference object and the remote object;

performing the holographical projection of the first virtual object according to the first scaling ratio, to obtain a first interactive image of the first virtual object for interaction between the reference object and the remote object;

performing an interactive gesture collection on the reference object and the remote object, to obtain third gesture information; and

performing a projection adjustment on the first interactive image according to the third gesture information, to obtain a second interactive image of the first virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2022
From: DUAN, YONG
To: LENOVO (BEIJING) LIMITED
Reel/Frame 059164/0565 →
Priority Claims (1)
CN 202111163802.0 · Sep 30, 2021 · national
Continuity (1)
Related Publication 20230096088A1 · Mar 30, 2023
References Cited (3)
US 11907412B2 · Silverstein · 2024 [cited by examiner]
US 20160189364A1 · Aruga · 2016 [cited by examiner]
US 20190188895A1 · Miller, IV · 2019 [cited by examiner]