IP Library Granted Patent US 10,521,052
Granted Patent B2
US 10,521,052 · App. 15/665,015 · Granted Dec 31, 2019

3D interactive system

Inventors: Yi-Pai Huang (Taipei, TW); Xuan Li (Taipei, TW); Yi-Chun Hsu (Taipei, TW); Chun-Ho Chen (Taipei, TW)
Assignee: Synaptics Incorporated
G06F3/0418G06F3/017G06F3/0304G06F3/0421G06F3/0425G06F3/0428G06T7/593G06T7/74G06F3/044G06F2203/04101G06F2203/04106G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,521,052
App. No.
15/665,015
Granted
Dec 31, 2019
Kind
B2
Abstract

A processing system is provided. The processing system includes: a sensor module configured to obtain a first image including a first reflected view of an input object within a sensing region associated with an input surface; and a determination module configured to: determine a first position of the input object within the first image; and determine a distance of the input object from the input surface using the first position.

Claims (74)

1. A processing system, comprising:

a sensor module configured to obtain a first image comprising a first reflected view of an input object within a sensing region associated with an input surface,

wherein the first image is obtained from a first camera comprising a first field of view,

wherein the first reflected view is obtained from a first reflective surface within the first field of view of the first camera,

wherein the first reflective surface is separate from the input surface and separate from the input object, and

wherein the first reflective surface partially covers a lens of the first camera and is at least partially facing the first camera; and

a determination module configured to:

determine a first position of the input object within the first image; and

determine a distance of the input object from the input surface using the first position.

2. The processing system of claim 1 , wherein:

the sensor module is further configured to obtain, from a second camera comprising a second field of view, a second image comprising a second reflected view of the input object;

the second reflected view is obtained from a second reflective surface within the second field of view of the second camera;

the second reflective surface is separate from the input surface and separate from the input object;

the determination module is further configured to determine, within the second image, a second position of the input object corresponding to the second reflected view; and

the distance is further determined using the second position.

3. The processing system of claim 1 , wherein:

the sensor module is further configured to obtain, from a second camera comprising a second field of view, a second image comprising a direct view of the input object;

the determination module is further configured to determine, within the second image, a second position of the input object corresponding to the direct view; and

the distance is further determined using the second position.

4. The processing system of claim 1 , wherein the first camera captures infrared (IR) radiation emitted from a backlight passing through a display screen, the display screen capable of displaying a visual interface, and wherein the input surface is the display screen.

5. The processing system of claim 1 , wherein:

the sensor module is further configured to:

obtain, from the first camera, a second image comprising a direct view of the input object; and

the determination module is further configured to:

determine, within the second image, a second position of the input object corresponding to the direct view; and

determine a displacement of the input object in the sensing region using the first position and the second position.

6. A method for operating a processing system associated with an input surface, comprising:

obtaining a first image comprising a first reflected view of an input object within a sensing region associated with the input surface,

wherein the first image is obtained by a first camera comprising a first field of view,

wherein the first reflected view is obtained from a first reflective surface within the first field of view of the first camera,

wherein the first reflective surface is separate from the input surface and separate from the input object, and

wherein the first reflective surface partially covers a lens of the first camera and is at least partially facing the first camera;

determining a first position of the input object within the first image; and

determining a distance of the input object from the input surface using the first position.

7. The method of claim 6 , further comprising:

obtaining, from a second camera comprising a second field of view, a second image comprising a second reflected view of the input object,

wherein the second reflected view is obtained from a second reflective surface within the second field of view of the second camera, and

wherein the second reflective surface is separate from the input surface and separate from the input object; and

determining, within the second image, a second position of the input object corresponding to the second reflected view,

wherein the distance is determined using the second position.

8. The method of claim 6 , further comprising:

obtaining, from a second camera comprising a second field of view, a second image comprising a direct view of the input object; and

determining, within the second image, a second position of the input object corresponding to the direct view,

wherein the distance is determined using the second position.

9. The method of claim 8 , wherein determining the distance comprises executing a triangulation using the first position and the second position.

10. The method of claim 6 , wherein the first camera captures infrared (IR) radiation emitted from a backlight passing through a display screen, the display screen capable of displaying a visual interface, and wherein the input surface is the display screen.

11. The method of claim 6 , further comprising:

obtaining, from the first camera, a second image comprising a direct view of the input object;

determining, within the second image, a second position of the input object corresponding to the direct view; and

determining a displacement of the input object in the sensing region using the first position and the second position.

12. The method of claim 11 , further comprising:

determining, using the displacement, a gesture performed by a user, wherein the input object is a finger of the user.

13. An input device, comprising:

an input surface;

a first reflective surface emitting a first reflected view of an input object proximate to the input surface,

wherein the first reflective surface is separate from the input surface and separate from the input object;

a first camera comprising a first field of view and configured to generate a first image comprising the first reflected view, wherein the first reflective surface is within the first field of view, and wherein the first reflective surface partially covers a lens of the first camera and is at least partially facing the first camera; and

a processing system configured to:

determine a first position of the input object within the first image; and

determine a distance of the input object from the input surface using the first position.

14. The input device of claim 13 , further comprising:

a second reflective surface emitting a second reflected view of the input object; and

a second camera comprising a second field of view and configured to generate a second image comprising the second reflected view, wherein the second reflective surface is within the second field of view,

wherein the processing system is further configured to determine, within the second image, a second position of the input object corresponding to the second reflected view, and

wherein the distance is further determined using the second position.

15. The input device of claim 13 , further comprising:

a second camera configured to generate a second image comprising a direct view of the input object,

wherein the processing system is further configured to determine, within the second image, a second position of the input object corresponding to the direct view, and

wherein the distance is further determined using the second position.

16. The input device of claim 13 , wherein the first camera captures infrared (IR) radiation emitted from a backlight passing through a display screen, the display screen capable of displaying a visual interface, and wherein the input surface is the display screen.

17. The input device of claim 13 , wherein the processing system is further configured to:

obtain, from the first camera, a second image comprising a direct view of the input object;

determine, within the second image, a second position of the input object corresponding to the direct view; and

determine a displacement of the input object within the sensing region using the first position and the second position.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE SPELLING OF THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 051316 FRAME: 0777. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 18, 2020
From: SYNAPTICS INCORPORATED
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 052186/0756 →
SECURITY INTEREST Recorded Dec 16, 2019
From: SYNAPTICS INCORPROATED
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 051316/0777 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2017
From: HUANG, YI-PAI; LI, XUAN; HSU, YI-CHUN; CHEN, CHUN-HO
To: SYNAPTICS INCORPORATED
Reel/Frame 043167/0284 →