IP Library Granted Patent US 10,437,415
Granted Patent B2
US 10,437,415 · App. 14/828,734 · Granted Oct 8, 2019

System, method, and device for controlling a display

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,437,415
App. No.
14/828,734
Granted
Oct 8, 2019
Kind
B2
Abstract

A device includes circuitry configured to acquire detection data from at least one sensor corresponding to a motion of a finger of a user. The circuitry is also configured to set a window based on the acquired data. The circuitry is also configured to identify a gesture based on a second motion performed by the user and to control a display based on the gesture.

Claims (54)

1. A system comprising:

a wearable device including circuitry, the circuitry of the wearable device configured to

detect a first input indicating a start of creation of a window,

acquire detection data from at least one sensor associated with the wearable device corresponding to a first motion of a finger of a user,

transmit the detection data to an electronic device, and

detect a second input indicating an end of the creation of the window; and

the electronic device including circuitry, the circuitry of the electronic device configured to

create the window to correspond to a portion of a display of the electronic device based on the detection data acquired between the first input and the second input, the window having a size determined by the detection data acquired between the first input and the second input, the portion of the display including a displayed icon,

identify a gesture based on sensed data outputted by the wearable device in response to a second motion of the finger of the user, and

control a display content of the display of the electronic device when the gesture is detected to be within a region of the window associated with the displayed icon, a size of the region of the window being a function of the size of the window.

2. The system of claim 1 , wherein the circuitry of the electronic device is further configured to:

match the gesture with a corresponding touch panel gesture; and

update the display content to predefined contents of the corresponding touch panel gesture.

3. The system of claim 1 , wherein the display includes a plurality of areas and the display content of each of the plurality of areas is set based on detected data in a corresponding window in space.

4. The system of claim 1 , wherein the window is set based on a single detected motion in the detection data.

5. The system of claim 4 , wherein the window is set based on the single motion and a predetermined aspect ratio.

6. The system of claim 1 , wherein the window is set based on a first motion in a horizontal direction and a second motion in a vertical direction.

7. The system of claim 1 , wherein a shape of the window is set based on a shape formed by fingers of the user.

8. The system of claim 1 , wherein the first motion is detected from an image acquired by a camera.

9. The system of claim 1 , wherein the circuitry of the electronic device is further configured to set a plurality of windows based on a plurality of motions received from a plurality of users.

10. The system of claim 1 , wherein the circuitry of the electronic device is further configured to:

detect a first view direction;

set a first window based on the first motion of the finger in the first view direction;

detect a second view direction; and

set a second window based on the first motion of the finger in the second view direction.

11. The system of claim 10 , wherein the circuitry of the electronic device is further configured to:

detect a head movement; and

switch from the first window to the second window based on the head movement.

12. The system of claim 1 , wherein a size of an icon is a function of a size of the window.

13. The system of claim 1 , wherein the first input is a press of a button of the wearable device.

14. The system of claim 1 , wherein the circuitry of the wearable device is further configured to detect an acceleration to the wearable device;

the circuitry of the electronic device is further configured to

determine a distance corresponding to the motion of the finger of the user based on the acceleration data; and

wherein dimensions of the window are a function of the distance.

15. The system of claim 1 , wherein a number of icons displayed on the display is a function of dimensions of the window.

16. The system of claim 1 , wherein the circuitry of the electronic device is further configured to:

create a second window in a second portion of the display based on data received from a second wearable device; and

control the second portion of the display based on data detected in the second window, the data being associated with a second gesture detected by the second wearable device.

17. A method for controlling a display, the method comprising:

detecting, using processing circuitry of a wearable device, a first input indicating a start of creation of a window;

acquiring, using the processing circuitry of the wearable device, detection data from at least one sensor associated with the wearable device corresponding to a first motion of a finger of a user;

transmitting, using the processing circuitry of the wearable device, the detection data to an electronic device;

detecting, using the processing circuitry of the wearable device, a second input indicating an end of the creation of the window;

creating, using processing circuitry of the electronic device, the window to correspond to a portion of a display of the electronic device based on the detection data acquired between the first input and the second input, the window having a size determined by the detection data acquired between the first input and the second input, the portion of the display including a displayed icon;

identifying, using the processing circuitry of the electronic device, a gesture based on sensed data outputted by the wearable device in response to a second motion of the finger of the user; and

controlling a display content of the display of the electronic device when the gesture is detected to be within a region of the window associated with the displayed icon, a size of the region of the window being a function of the size of the window.

18. A non-transitory computer readable medium storing computer-readable instructions therein which when executed by a computer causes the computer to perform a method for controlling a display, the method comprising:

detecting a first input from a wearable device indicating a start of creation of a window;

acquiring detection data from at least one sensor associated with the wearable device corresponding to a first motion of a finger of a user in space;

transmitting the detection data to an electronic device;

detecting a second input from the wearable device indicating an end of the creation of the window;

creating the window to correspond to a portion of a display of the electronic device based on the detection data acquired between the first input and the second input, the window having a size determined by the detection data acquired between the first input and the second input, the portion of the display including a displayed icon;

identifying a gesture of the user based on sensed data outputted by the wearable device in response to a second motion of the finger of the user; and

controlling a display content of the display of the electronic device when the gesture is detected to be within a region of the window associated with the displayed icon, a size of the region of the window being a function of the size of the window.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2015
From: TOKUTAKE, KENJI
To: SONY MOBILE COMMUNICATIONS, INC.
Reel/Frame 036407/0340 →