IP Library › Granted Patent US 9,965,028
Granted Patent B2
US 9,965,028 · App. 13/081,126 · Granted May 8, 2018

Method for suspension sensing in interactive display, method for processing suspension sensing image, and proximity sensing apparatus

Inventors: Byung In Yoo (Seoul, KR); Du Sik Park (Suwon-si, KR); Chang Kyu Choi (Seongnam-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/011G06F3/017G06F3/04815
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,965,028
App. No.
13/081,126
Granted
May 8, 2018
Kind
B2
Abstract

Provided is a method for proximity sensing in an interactive display and a method of processing a proximity sensing image. The method for proximity-sensing may include suspending, in a three-dimensional (3D) space, at least one hand of a user to manipulate at least one of a viewpoint of the user and a position of a virtual object displayed on a screen, and changing the virtual object by manipulating at least one of the position of the virtual object and the viewpoint of the user based on the suspending.

Claims (36)

1. A method for proximity-sensing in an interactive display, the method comprising:

sensing coordinates (x1, y1) of a position touched by a hand of a user, while the other hand of the user is suspended;

sensing coordinates (x2, y2, z2) of a position where the other hand is suspended, while the position is touched by the hand of the user;

sensing a rotation direction (rx, ry, rz) by a suspension of the other hand, while the position is touched by the hand of the user;

determining a virtual object to be manipulated in a UI displayed on a screen, based on the coordinates (x1, y1);

calculating a movement speed and a movement acceleration speed of the other hand, based on the coordinates (x2, y2, z2);

calculating a movement speed of the virtual object, based on the movement speed and the movement acceleration speed;

calculating a rotation speed and a rotation acceleration speed of the other hand using the rotation direction (rx, ry, rz);

calculating a rotation speed of the virtual object based on the rotation speed and the rotation acceleration speed;

applying the movement speed of the virtual object to create a movement effect of the virtual object; and

applying the rotation speed of the virtual object to create a rotation effect of the virtual object.

2. The method of claim 1 , wherein the suspension comprises a two dimensional (2D) slap gesture to suspend the other hand of the user in a desired direction of a vertical direction and a horizontal direction to change the virtual object in the desired direction of the vertical direction and the horizontal direction.

3. The method of claim 1 , wherein the virtual object is a surface of a hexahedron User Interface (UI), and is transformed to another surface of the hexahedron UI in a suspension direction.

4. The method of claim 1 , wherein the suspension comprises a 3D suspension gesture of moving the other hand of the user from a position in a 3D space to another position in a 3D space or to rotate the other hand of the user in the 3D position to thereby change the at least one of the position of the virtual object and the viewpoint of the user.

5. The method of claim 4 , wherein the 3D suspension gesture comprises a 3D movement gesture to move the virtual object from the other 3D position to a corresponding position.

6. The method of claim 4 , wherein, when the virtual object is a 3D passage, the 3D suspension gesture includes a forward movement gesture of moving the other hand of the user towards the screen and a backward movement gesture to move the other hand of the user away from the screen.

7. The method of claim 1 , wherein the suspension comprises a 3D six degrees of freedom (DOF) suspension gesture of moving the other hand of the user from a current position in a 3D space to another position in the 3D position, and to rotate the other hand of the user.

8. A non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform the method of claim 1 .

9. The method of claim 1 , further comprising:

calculating a scene change speed of the UI based on the movement speed and the movement acceleration speed; and

applying the scene change speed to a special effect for scene change.

10. The method of claim 9 , wherein the special effect comprises a motion blur effect for scene change.

11. A proximity-sensing apparatus used with an interactive display, the proximity-sensing apparatus comprising:

a suspension sensor configured to:

sense coordinates (x1, y1) of a position touched by a hand of a user, while the other hand of the user is suspended,

sense coordinates (x2, y2, z2) of a position where the other hand is suspended, while the position is touched by the hand of the user, and

sense a rotation direction (rx, ry, rz) by a suspension of the other hand, while the position is touched by the hand of the user;

a suspension image processing unit configured to:

determine a virtual object to be manipulated in a UI displayed on a screen, based on the coordinates (x1, y1),

calculate a movement speed and a movement acceleration speed of the other hand, based on the coordinates (x2, y2, z2),

calculate a movement speed of the virtual object, based on the movement speed and the movement acceleration speed,

calculate a rotation speed and a rotation acceleration speed of the other hand using the rotation direction (rx, ry, rz), and

calculate a rotation speed of the virtual object based on the rotation speed and the rotation acceleration speed; and

a user interface processing unit configured to:

apply the movement speed of the virtual object to create a movement effect of the virtual object, and

apply the rotation speed of the virtual object to create a rotation effect of the virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2011
From: YOO, BYUNG IN; PARK, DU SIK; CHOI, CHANG KYU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 026234/0776 →
Priority Claims (1)
KR 10-2010-0031798 · Apr 7, 2010 · national
Continuity (1)
Related Publication 20110248918A1 · Oct 13, 2011