IP Library Granted Patent US 9,525,906
Granted Patent B2
US 9,525,906 · App. 14/225,453 · Granted Dec 20, 2016

Display device and method of controlling the display device

Inventor: Yung-Long Lai (New Taipei, TW)
Assignee: HON HAI PRECISION INDUSTRY CO., LTD.
H04N21/4223H04N21/4126H04N21/42224H04N21/4221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,525,906
App. No.
14/225,453
Granted
Dec 20, 2016
Kind
B2
Abstract

A display device is connected in communication with a mobile electronic device. The display control device detects a movement information of a control object in a first two-dimensional space, and the mobile electronic device detects a movement information of the control object in a second two-dimensional space. The display control device works out at a current three-dimensional coordinates of the control object according to the movement information of the control object in the first two-dimensional space, and a movement information of the control object in the second two-dimensional space and the initial three-dimensional coordinates of the control object.

Claims (32)

1. A system of controlling a display device comprising:

a first shooting module and a second shooting module, the modules shooting images located at different positions;

a touch screen;

a processor; and

a storage system storing one or more software programs in the form of computerized codes operable to be executed by the processor, the one or more software programs comprising:

an initializing module detecting an initialization operation on the touch screen to obtain a coordinate of a touch point of a control object on the touch screen as an initial coordinate in a first two-dimensional space, wherein the initialization operation is a multi-touch operation, or a touch operation exceeding a predetermined time duration;

a setting module setting an initial three-dimensional coordinate of the control object in a three-dimensional space based on the initial coordinate, wherein the three-dimensional space is cooperatively formed by the first two-dimensional space and a second two-dimensional space;

a first detection module detecting movement information of the control object in the first two-dimensional space according to an image obtained by the first shooting module, wherein the movement information of the control object in the first two-dimensional space comprises a movement direction and a movement distance of the control object in the first two-dimensional space;

a second detection module detecting movement information of the control object in the second two-dimensional space according to an image obtained by the second shooting module, wherein the movement information of the control object in the second two-dimensional space comprises a movement direction and a movement distance of the control object in the second two-dimensional space;

a control module calculating a current three-dimensional coordinate of the control object according to the movement information of the control object in the first two-dimensional space, the movement information of the control object in the second two-dimensional space and the initial three-dimensional coordinate of the control object, and controlling the display device to perform an action corresponding to the current three-dimensional coordinate of the control object; and

the setting module further updating the initial three-dimensional coordinate of the control object to the current three-dimensional coordinate of the control object.

2. The system of controlling the display device of claim 1 , wherein the setting module sets an initial three-dimensional coordinate of the control object according to the initial coordinate obtained by the initializing module and the control module further controls the display device to show a cursor at an initial location of the cursor according to the initial three-dimensional coordinate of the control object.

3. The system of controlling the display device of claim 2 , wherein the control module further controls the display device to move the cursor according to the current three-dimensional coordinate of the control object.

4. The system of controlling the display device of claim 1 , wherein the control module further controls the display device to perform a preset operation when the movement distance of the control object exceeds a threshold in a preset movement direction.

5. A method of controlling a display device, the display device connected to a mobile electronic device, the display device comprising a first shooting module and the mobile electronic device comprising a second shooting module and a touch screen, wherein the method comprises:

the mobile electronic device detecting an initialization operation on the touch screen of a control object to obtain a coordinate of a touch point of the control object on the touch screen as an initial coordinate in a first two-dimensional space, wherein the initialization operation is a multi-touch operation, or a touch operation exceeding a predetermined time duration;

the display device setting an initial three-dimensional coordinate of the control object in a three-dimensional space based on the initial coordinate, the three-dimensional space is cooperatively formed by the first two-dimensional space and a second two-dimensional space;

the display device determining movement information of the control object in the first two-dimensional space according to an image obtained by the first shooting module, wherein the movement information of the control object in the first two-dimensional space comprises a movement direction and a movement distance of the control object in the first two-dimensional space;

the mobile electronic device determining movement information of the control object in the second two-dimensional space according to an image obtained by the second shooting module, wherein the movement information of the control object in the second two-dimensional space comprises movement direction and movement distance of the control object in the second two-dimensional space;

the display device calculating a current three-dimensional coordinate of the control object according to the movement information of the control object in the first two-dimensional space, the movement information of the control object in the second two-dimensional space and the initial three-dimensional coordinate of the control object, and perform an action corresponding to the current three-dimensional coordinate of the control object; and

the display device updating the initial three-dimensional coordinate of the control object to the current three-dimensional coordinate of the control object.

6. The method of controlling the display device of claim 5 , further comprising:

the display device setting an initial three-dimensional coordinate of the control object according to the initial coordinate transmitted by the mobile electronic device, and the control module controlling the display device to show a cursor at an initial location of the cursor according to the initial three-dimensional coordinates of the control object.

7. The method of controlling the display device of claim 6 , wherein the method further comprises:

the display device moving the cursor according to the current three-dimensional coordinate of the control object.

8. The method of controlling the display device of claim 5 , further comprising:

the display device performing a preset operation when the movement distance of the control object exceeds a threshold in a preset movement direction.

9. A display device, connected to a mobile electronic device, the display device comprises a first shooting module, the mobile electronic device comprising a second shooting module and a touch screen, the display device further comprising:

a setting module, setting an initial three-dimensional coordinate of a control object in a three-dimensional space, the three-dimensional space is cooperatively formed by the first two-dimensional space and a second two-dimensional space, and in the event that the mobile electronic device detects an initialization operation on the touch screen of the control object obtaining a coordinate of a touch point of the control object on the touch screen as an initial coordinate, wherein the initialization operation is a multi-touch operation, or a touch operation exceeding a predetermined time duration;

a first detection module detecting movement information of the control object in the first two-dimensional space according to an image obtained by the first shooting module, wherein the movement information of the control object in the first two-dimensional space comprises a movement direction and a movement distance of the control object in the first two-dimensional space;

a control module calculating a current three-dimensional coordinate of the control object according to the movement information of the control object in the first two-dimensional space, a movement information of the control object in the second two-dimensional space and the initial three-dimensional coordinates of the control object, and controlling a display device to perform an action corresponding to the current three-dimensional coordinate of the control object, wherein the mobile electronic device determines the movement information of the control object in the second two-dimensional space according to an image obtained by the second shooting module and transmits the movement information of the control object in the second two-dimensional space to the control module; and

the setting module further updating the initial three-dimensional coordinate of the control object to the current three-dimensional coordinate of the control object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2018
From: HON HAI PRECISION INDUSTRY CO., LTD.
To: CLOUD NETWORK TECHNOLOGY SINGAPORE PTE. LTD.
Reel/Frame 045171/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2014
From: LAI, YUNG-LONG
To: HON HAI PRECISION INDUSTRY CO., LTD.
Reel/Frame 032621/0537 →
Priority Claims (1)
TW 102112267 · Apr 8, 2013 · national
Continuity (1)
Related Publication 20140304736A1 · Oct 9, 2014