IP Library Granted Patent US 10,936,124
Granted Patent B2
US 10,936,124 · App. 16/417,655 · Granted Mar 2, 2021

Interactive projection system and interactive projection method

Inventors: Xiu-Yu Lin (Taipei, TW); Ting-Hsiang Lan (Taipei, TW); Chiao-Tsu Chiang (Taipei, TW); Ya-Fang Hsu (Taipei, TW)
Assignee: COMPAL ELECTRONICS, INC.
G06F3/0425G06T11/203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,936,124
App. No.
16/417,655
Granted
Mar 2, 2021
Kind
B2
Abstract

An interactive projection system and an interactive projection method are provided. The interactive projection method includes: generating a virtual image by using a projector; detecting an object on the virtual image by using a depth camera, wherein the object corresponds to a virtual scene; detecting a drawing operation corresponding to the virtual image by using the depth camera; and projecting the virtual scene on the virtual image in response to the object being placed on the virtual image, and generating a block on the virtual image according to the drawing operation.

Claims (74)

1. An interactive projection system, comprising:

an object, corresponding to a virtual scene; and

a projector, comprising:

a light source module, providing an illumination beam;

a projection lens module, converting the illumination beam into an image beam and projecting the image beam to generate a virtual image;

a depth camera, detecting the object on the virtual image and a drawing operation corresponding to the virtual image;

a storage medium, storing a database associated with the virtual scene; and

a processing module, coupled to the light source module, the projection lens module, the depth camera, and the storage medium, wherein the processing module accesses the database in response to the object being placed on the virtual image and projects the virtual scene on the virtual image through the projection lens module, and the processing module generates a block on the virtual image according to the drawing operation,

wherein the block comprises a first region and a second region, the processing module selects a first position from the first region, and the processing module determines whether a first virtual facility can be placed at the first position.

2. The interactive projection system according to claim 1 , wherein the processing module determines a line segment drawn by the drawing operation as a path in response to formation of an enclosed block by the line segment and an existing line segment on the virtual image, and the processing module generates the block according to the path.

3. The interactive projection system according to claim 2 , wherein the processing module determines the enclosed block as the block based on an area of the enclosed block being larger than an area threshold value.

4. The interactive projection system according to claim 1 , wherein the processing module selects a second position different from the first position from the first region in response to the first virtual facility not being placeable at the first position, and the processing module determines whether the first virtual facility can be placed at the second position.

5. The interactive projection system according to claim 4 , wherein the processing module places the first virtual facility in the second region in response to the first virtual facility not being placeable at the second position.

6. The interactive projection system according to claim 4 , wherein the processing module selects a third position from the first region in response to the first virtual facility not being placeable at the second position, and the processing module determines whether a second virtual facility different from the first virtual facility can be placed at the third position.

7. The interactive projection system according to claim 1 , wherein the processing module is configured to:

obtain a circumscribed circle corresponding to the object on the virtual image;

connect a center of the circumscribed circle to a plurality of vertices of the block to generate a plurality of tangent points of the circumscribed circle;

obtain a plurality of tangent lines of the circumscribed circle respectively corresponding to the plurality of tangent points; and

generate a plurality of enclosed regions comprising the first region by using the plurality of tangent lines and a plurality of edges of the block.

8. The interactive projection system according to claim 1 , wherein the processing module is configured to:

obtain a circumscribed circle corresponding to the object on the virtual image;

connect a center of the circumscribed circle to a plurality of vertices of the block to generate a plurality of tangent points of the circumscribed circle;

obtain a plurality of tangent lines of the circumscribed circle respectively corresponding to the plurality of tangent points;

generate a plurality of enclosed regions comprising a first enclosed region by using the plurality of tangent lines and a plurality of edges of the block; and

obtain a maximum circle in the first enclosed region as the first region.

9. The interactive projection system according to claim 1 , wherein the processing module is configured to:

obtain a circumscribed circle corresponding to the object on the virtual image; and

obtain a circle as the first region, wherein the first region is respectively tangent to the circumscribed circle, a first edge of the block, and a second edge of the block adjacent to the first edge.

10. The interactive projection system according to claim 1 , wherein the processing module determines that the first virtual facility cannot be placed at the first position in the first region in response to presence of another virtual facility in the first region.

11. The interactive projection system according to claim 1 , wherein the processing module determines that the first virtual facility cannot be placed at the first position in response to a projection image of the first virtual facility on the virtual image exceeding the first region when the first virtual facility is placed at the first position.

12. The interactive projection system according to claim 1 , wherein the processing module randomly selects the first position from the first region.

13. The interactive projection system according to claim 1 , wherein the processing module selects a geometric center of the first region as the first position.

14. An interactive projection method, comprising:

generating a virtual image by using a projector;

detecting an object on the virtual image by using a depth camera, wherein the object corresponds to a virtual scene;

detecting a drawing operation corresponding to the virtual image by using the depth camera;

projecting the virtual scene on the virtual image in response to the object being placed on the virtual image, and generating a block on the virtual image according to the drawing operation, wherein the block comprises a first region and a second region;

selecting a first position from the first region; and

determining whether a first virtual facility can be placed at the first position.

15. The interactive projection method according to claim 14 , further comprising:

determining a line segment drawn by the drawing operation as a path in response to formation of an enclosed block by the line segment and an existing line segment on the virtual image; and

generating the block according to the path.

16. The interactive projection method according to claim 15 , further comprising:

determining the enclosed block as the block based on an area of the enclosed block being larger than an area threshold value.

17. The interactive projection method according to claim 14 , further comprising:

selecting a second position different from the first position from the first region in response to the first virtual facility not being placeable at the first position; and

determining whether the first virtual facility can be placed at the second position.

18. The interactive projection method according to claim 17 , further comprising:

placing the first virtual facility in the second region in response to the first virtual facility not being placeable at the second position.

19. The interactive projection method according to claim 17 , further comprising:

selecting a third position from the first region in response to the first virtual facility not being placeable at the second position; and

determining whether a second virtual facility different from the first virtual facility can be placed at the third position.

20. The interactive projection method according to claim 14 , further comprising:

obtaining a circumscribed circle corresponding to the object on the virtual image;

connecting a center of the circumscribed circle to a plurality of vertices of the block to generate a plurality of tangent points of the circumscribed circle;

obtaining a plurality of tangent lines of the circumscribed circle respectively corresponding to the plurality of tangent points; and

generating a plurality of enclosed regions comprising the first region by using the plurality of tangent lines and a plurality of edges of the block.

21. The interactive projection method according to claim 14 , further comprising:

obtaining a circumscribed circle corresponding to the object on the virtual image;

connecting a center of the circumscribed circle to a plurality of vertices of the block to generate a plurality of tangent points of the circumscribed circle;

obtaining a plurality of tangent lines of the circumscribed circle respectively corresponding to the plurality of tangent points;

generating a plurality of enclosed regions comprising a first enclosed region by using the plurality of tangent lines and a plurality of edges of the block; and

obtaining a maximum circle in the first enclosed region as the first region.

22. The interactive projection method according to claim 14 , further comprising:

obtaining a circumscribed circle corresponding to the object on the virtual image; and

obtaining a circle as the first region, wherein the first region is respectively tangent to the circumscribed circle, a first edge of the block, and a second edge of the block adjacent to the first edge.

23. The interactive projection method according to claim 14 , further comprising:

determining that the first virtual facility cannot be placed at the first position in the first region in response to presence of another virtual facility in the first region.

24. The interactive projection method according to claim 14 , further comprising:

determining that the first virtual facility cannot be placed at the first position in response to a projection image of the first virtual facility on the virtual image exceeding the first region when the first virtual facility is placed at the first position.

25. The interactive projection method according to claim 14 , further comprising:

randomly selecting the first position from the first region.

26. The interactive projection method according to claim 14 , further comprising:

selecting a geometric center of the first region as the first position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2019
From: LIN, XIU-YU; LAN, TING-HSIANG; CHIANG, CHIAO-TSU; HSU, YA-FANG
To: COMPAL ELECTRONICS, INC.
Reel/Frame 049235/0949 →
Continuity (2)
Provisional Application 62674580 · May 21, 2018
Related Publication 20190369806A1 · Dec 5, 2019