IP Library Patent Application 15452867
Patent Application
App. No. 15/452,867

METHOD FOR CONTROLLING DISTRIBUTION OF MULTIPLE SUB-SCREENS AND DEVICE USING THE SAME

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/452,867
Abstract

A method for controlling distribution of multiple dub-screens on a single display, applied on an electronic device. The sub-screen at least comprises a first sub-screen and a second sub-screen. The first sub-screen at least comprises a first operator. The second sub-screen comprises a second operator. The method comprises certain steps. Tracking a first head position of the first operator relative to the first sub-screen, and calculating a first face center point of the first head position. Tracking a second head position of the second operator relative to the second sub-screen, and calculating a second face center point of the second head position. Adjusting distributions of the first sub-screen and the second sub-screen according to the first face center point and the second face center point. A device of controlling distribution of multiple sub-screens is provided.

Claims (75)

1 . A method of controlling distribution of multiple sub-screens, applied on an electronic device, the multiple sub-screens comprising at least a first sub-screen associated with at least a first operator and at least a second sub-screen associated with at least a second operator, the method comprising:

tracking a first head position of the first operator relative to the first sub-screen, and calculating a first face center point of the first head position, and tracking a second head position of the second operator relative to the second sub-screen, and calculating a second face center point of the second head position; and

adjusting distributions of the first sub-screen and the second sub-screen according to the first face center point and the second face center point.

2 . The method of claim 1 , wherein adjusting distributions of the first sub-screen and the second sub-screen according to the first face center point and the second face center point comprises:

calculating a sum of distances, a distance between a first distribution center and a first face center point or a second face center point and a distance between a second distribution center and a second face center point or a first face center point of each distribution manner; selecting the distribution manner having a minimum sum; and

adjusting the distributions of the first sub-screen and the second sub-screen according to the distribution manner having the minimum sum.

3 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen; wherein the sub-screen operating gesture comprises a mouse simulating gesture, the mouse simulating gesture comprises a mouse moving gesture, a mouse clicking gesture, and a mouse dragging gesture, the mouse moving gesture is movement of an open palm, the mouse clicking gesture is clenching of a fist, and the mouse dragging gesture is movement of the clenched fist;

transmitting a mouse controlling command selected from a group consisting of a mouse moving command, a mouse clicking command and a mouse dragging command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mouse simulating gesture; and

controlling a cursor to act on the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mouse simulating gesture according to the mouse controlling command.

4 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a scroll-up gesture, and the scroll-up gesture is a hand waving towards left;

transmitting a scroll-up command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-up gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-up gesture to page up according to the scroll-up command.

5 . The method of claim 4 , wherein the sub-screen operating gesture further comprises a scroll-down gesture, the scroll-down gesture is the hand waving towards right, the method further comprises:

transmitting a scroll-down command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-down gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-down gesture to page down according to the scroll-down command.

6 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen; wherein the sub-screen operating gesture comprises a zoom-in gesture, the zoom-in gesture is two hands moving away from each other;

transmitting a zoom in command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-in gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-in gesture to zoom in according to the zoom-in command.

7 . The method of claim 6 , wherein the sub-screen operating gesture further comprises a zoom-out gesture, the zoom-out gesture is the two hands moving close to each other, the method further comprises:

transmitting a zoom-out command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-out gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-out gesture to zoom out according to the zoom-out command.

8 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen; wherein the sub-screen operating gesture comprises a mute gesture, the mute gesture is having an index finger in front of a mouth;

transmitting a mute command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mute gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mute gesture to be muted according to the mute command.

9 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen; wherein the sub-screen operating gesture comprises a return gesture, the return gesture is an open palm turning anticlockwise;

transmitting a returning command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the return gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the return gesture to return to a previous page according to the returning command.

10 . The method of claim 1 , wherein the method further comprises:

capturing a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen; wherein the sub-screen operating gesture comprises a homepage gesture, and the homepage gesture is a thumb pointing up;

transmitting a homepage command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the homepage gesture; and

controlling the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the homepage gesture to return to homepage according to the homepage command.

11 . A device of controlling distribution of multiple sub-screens, the multiple sub-screens comprising at least a first sub-screen associated with at least a first operator and at least a second sub-screen associated with at least a second operator, the device comprising:

a plurality of processors; and

a plurality of non-transitory computer storage mediums, coupled to the plurality of processors and configured to store instructions for execution by the plurality of processors, the instructions causing the plurality of processors to:

track a first head position of the first operator relative to the first sub-screen, and calculating a first face center point of the first head position, and track a second head position of the second operator relative to the second sub-screen, and calculating a second face center point of the second head position; and

adjust distributions of the first sub-screen and the second sub-screen according to the first face center point and the second face center point.

12 . The device of claim 11 , wherein the instructions cause the plurality of processors to

calculate a sum of distances, a distance between a first distribution center and a first face center point or a second face center point and a distance between a second distribution and a second face center point or a first face center point of each distribution manner,

select the distribution manner having a minimum sum; and

adjust the distributions of the first sub-screen and the second sub-screen according to the distribution manner having the minimum sum.

13 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a mouse simulating gesture, the mouse simulating gesture comprises a mouse moving gesture, a mouse clicking gesture, and a mouse dragging gesture, the mouse moving gesture is movement of an open palm, the mouse clicking gesture is clenching of a fist, and the mouse dragging gesture is movement of the clenched fist;

transmit a mouse controlling command selected from a group consisting of a mouse moving command, a mouse clicking command and a mouse dragging command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mouse simulating gesture; and

control a cursor to act on the first sub-screen related to the first operator and the second sub-screen related to the second operator posing the mouse simulating gesture according to the mouse controlling command.

14 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a scroll-up gesture, the scroll-up gesture is hand waving towards left;

transmit a scroll-up command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-up gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-up gesture to page up according to the scroll-up command.

15 . The device of claim 14 , wherein the sub-screen operating gesture further comprises a scroll-down gesture, the scroll-down gesture is the hand waving towards right, the instructions cause the plurality of processors to:

transmit a scroll-down command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-down gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the scroll-down gesture to page down according to the scroll-down command.

16 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a zoom-in gesture, the zoom-in gesture is two hands moving away from each other;

transmit a zoom in command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-in gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-in gesture to zoom in according to the zoom-in command.

17 . The device of claim 16 , wherein the sub-screen operating gesture further comprises a zoom-out gesture, the zoom-out gesture is the two hands moving close to each other, the instructions cause the plurality of processors to:

transmit a zoom-out command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-out gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the zoom-out gesture to zoom out according to the zoom-out command.

18 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a mute gesture, the mute gesture is having an index finger in front of a mouth;

transmit a mute command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the mute gesture; and

control the first sub-screen related to the first operator and the second sub-screen related to the second operator posing the mute gesture to be muted according to the mute command.

19 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a return gesture, the return gesture is an open palm turning anticlockwise;

transmit a returning command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the return gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the return gesture to return to a previous page according to the returning command.

20 . The device of claim 11 , wherein the instructions cause the plurality of processors to:

capture a sub-screen operating gesture posed by the first operator relative to the first sub-screen or the second operator relative to the second sub-screen, wherein the sub-screen operating gesture comprises a homepage gesture, the homepage gesture is thumb pointing up;

transmit a homepage command to the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the homepage gesture; and

control the first sub-screen related to the first operator or the second sub-screen related to the second operator posing the homepage gesture to return to homepage according to the homepage command.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2018
From: NANNING FUGUI PRECISION INDUSTRIAL CO., LTD.; HON HAI PRECISION INDUSTRY CO., LTD.
To: NANNING FUGUI PRECISION INDUSTRIAL CO., LTD.
Reel/Frame 045171/0347 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2017
From: LIN, PO-YU
To: NANNING FUGUI PRECISION INDUSTRIAL CO., LTD.; HON HAI PRECISION INDUSTRY CO., LTD.
Reel/Frame 041500/0504 →