IP Library › Granted Patent US 11,874,969
Granted Patent B2
US 11,874,969 · App. 17/683,360 · Granted Jan 16, 2024

Method for determining two-handed gesture, host, and computer readable medium

Inventors: Chun-Li Wang (Taoyuan, TW); Caesar Tan (Taoyuan, TW); Yi-Cheng Lai (Taoyuan, TW)
Assignee: HTC Corporation
G06F3/017G02B27/0101G02B27/017G06F3/011G06T1/0007G06V20/20G06V40/28G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,874,969
App. No.
17/683,360
Granted
Jan 16, 2024
Kind
B2
Abstract

The disclosure provides a method for determining a two-handed gesture, a host, and a computer readable medium. The method includes: providing a visual content of a reality system; tracking a first hand gesture and a second hand gesture perform by two hands; in response to determining that the first hand gesture and the second hand gesture form a two-handed gesture, activating a system function of the reality system, wherein the system function of the reality system is independent to the visual content.

Claims (51)

1. A method for determining a two-handed gesture, adapted to a host, wherein the host is a virtual reality head-mounted display (VR HMD), comprising:

providing a visual virtual reality content;

tracking a first hand gesture and a second hand gesture perform by two hands;

in response to determining that the first hand gesture and the second hand gesture form a two-handed gesture, activating a system function of the reality system, wherein the system function of the reality system comprises showing a see-through window in a field of view (FOV) of a user of the host, wherein the see-through window shows a real-world scene captured by a front camera of the HMD of the reality system and the see-through window is surrounded by the virtual reality content.

2. The method according to claim 1 , wherein the system function of the reality system further comprises at least one of taking a screenshot related to the visual content, activating a main menu page of the reality system, triggering a voice assistant of the reality system, and summoning an iconic virtual assistant.

3. The method according to claim 1 , wherein the real-world scene shown in the see-through window varies in response to a movement of the two-handed gesture.

4. The method according to claim 2 , wherein the screenshot related to the visual content comprises at least one of a 360-degree screenshot of the visual content, a first screenshot of a field of view in the visual content, and a second screenshot of an enclosed region formed by the two-handed gesture.

5. The method according to claim 1 , comprising:

obtaining a first finger and a second finger in the first hand gesture and obtaining a third finger and a fourth finger in the second hand gesture;

in response to determining that the first finger, the second finger, the third finger and the fourth finger form an enclosed region, determining that the first hand gesture and the second hand gesture form the two-handed gesture.

6. The method according to claim 5 , further comprising:

obtaining a first distance between a tip of the first finger and a tip of the fourth finger;

obtaining a second distance between a tip of the second finger and a tip of the third finger;

in response to determining that the first distance and the second distance are lower than a distance threshold, determining that the first finger, the second finger, the third finger and the fourth finger form the enclosed region, wherein the enclosed region is a region surrounded by the first finger, the second finger, the third finger and the fourth finger.

7. The method according to claim 5 , further comprising:

obtaining a first distance between a tip of the first finger and a tip of the fourth finger;

obtaining a second distance between a tip of the second finger and a tip of the third finger;

in response to determining that the first distance and the second distance are gradually decreased to be lower than a distance threshold, determining that the first finger, the second finger, the third finger and the fourth finger form the enclosed region and determining that the first hand gesture and the second hand gesture form the two-handed gesture, wherein the enclosed region is a region surrounded by the first finger, the second finger, the third finger and the fourth finger.

8. The method according to claim 5 , wherein before the step of determining that the first hand gesture and the second hand gesture form the two-handed gesture, the method further comprises:

in response to determining that at least one of the first finger, the second finger, the third finger and the fourth finger performs a trigger movement, determining that the first hand gesture and the second hand gesture form the two-handed gesture.

9. The method according to claim 5 , wherein before the step of determining that the first hand gesture and the second hand gesture form the two-handed gesture, the method further comprises:

in response to determining that the enclosed region has been maintained for a predetermined time length, determining that the first hand gesture and the second hand gesture form the two-handed gesture.

10. The method according to claim 5 , wherein the enclosed region comprises a circular region or a polygonal region.

11. The method according to claim 1 , wherein the two-handed gesture forms an enclosed region, and the method further comprises:

showing a virtual object in the visual content, wherein the virtual object has a shape corresponding to a shape of the enclosed region, and the see-through window locates within the virtual object.

12. The method according to claim 1 , wherein after the step of activating the system function of the reality system, the method further comprises:

in response to determining that the two-handed gesture disappears, deactivating the system function of the reality system.

13. A host, wherein the host is a virtual reality head-mounted display (VR HMD), comprising:

a non-transitory storage circuit, storing a program code;

a processor, coupled to the storage circuit and accessing the program code to perform:

providing a virtual reality content;

tracking a first hand gesture and a second hand gesture perform by two hands;

in response to determining that the first hand gesture and the second hand gesture form a two-handed gesture, activating a system function of the reality system, wherein the system function of the reality system comprises showing a see-through window in a filed of view (FOV) of a user of the host, wherein the see-through window shows a real-world scene captured by a front camera of the HMD of the reality system and the see-through window is surrounded by the virtual reality content.

14. The host according to claim 13 , wherein the system function of the reality system further comprises at least one of taking a screenshot related to the visual content, activating a main menu page of the reality system, triggering a voice assistant of the reality system, and summoning an iconic virtual assistant.

15. The host according to claim 13 , comprising:

obtaining a first finger and a second finger in the first hand gesture and obtaining a third finger and a fourth finger in the second hand gesture;

in response to determining that the first finger, the second finger, the third finger and the fourth finger form an enclosed region, determining that the first hand gesture and the second hand gesture form the two-handed gesture.

16. The host according to claim 15 , further comprising:

obtaining a first distance between a tip of the first finger and a tip of the fourth finger;

obtaining a second distance between a tip of the second finger and a tip of the third finger;

in response to determining that the first distance and the second distance are lower than a distance threshold, determining that the first finger, the second finger, the third finger and the fourth finger form the enclosed region, wherein the enclosed region is a region surrounded by the first finger, the second finger, the third finger and the fourth finger.

17. The host according to claim 15 , further comprising:

obtaining a first distance between a tip of the first finger and a tip of the fourth finger;

obtaining a second distance between a tip of the second finger and a tip of the third finger;

in response to determining that the first distance and the second distance are gradually decreased to be lower than a distance threshold, determining that the first finger, the second finger, the third finger and the fourth finger form the enclosed region and determining that the first hand gesture and the second hand gesture form the two-handed gesture, wherein the enclosed region is a region surrounded by the first finger, the second finger, the third finger and the fourth finger.

18. The host according to claim 15 , wherein before the step of determining that the first hand gesture and the second hand gesture form the two-handed gesture, the method further comprises:

in response to determining that at least one of the first finger, the second finger, the third finger and the fourth finger performs a trigger movement, determining that the first hand gesture and the second hand gesture form the two-handed gesture.

19. A non-transitory computer readable medium, the computer readable medium recording an executable computer program, the executable computer program being loaded by a host to perform steps of:

providing a virtual reality content, wherein the host is a virtual reality head-mounted display (VR HMD);

tracking a first hand gesture and a second hand gesture perform by two hands;

in response to determining that the first hand gesture and the second hand gesture form a two-handed gesture, activating a system function of the reality system, wherein the system function of the reality system comprises showing a see-through window in a filed of view (FOV) of a user of the host, wherein the see-through window shows a real-world scene captured by a front camera of the HMD of the reality system and the see-through window is surrounded by the virtual reality content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2022
From: WANG, CHUN-LI; TAN, CAESAR; LAI, YI-CHENG
To: HTC CORPORATION
Reel/Frame 059179/0928 →
Continuity (2)
Provisional Application 63244268 · Sep 15, 2021
Related Publication 20230078183A1 · Mar 16, 2023