IP Library Granted Patent US 9,372,591
Granted Patent B2
US 9,372,591 · App. 12/420,480 · Granted Jun 21, 2016

Methods of interfacing with multi-input devices and multi-input display systems employing interfacing techniques

Inventors: Philip L. Davidson (Bronx, NY); Jefferson Y. Han (Holliswood, NY)
Assignee: PERCEPTIVE PIXEL, INC.
G06F3/0481G06F3/0485G06F3/04883G06F3/0488G06F2203/04806G06F2203/04808G09G5/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,372,591
App. No.
12/420,480
Granted
Jun 21, 2016
Kind
B2
Abstract

Methods and systems for interfacing with multi-input devices employ various techniques for controlling the window framing of images. Such techniques provide control, including moving, sizing, and orientating, of one or more displayed window frames in which one or more images are displayed.

Claims (68)

1. A method of interfacing with a multi-input display device, comprising the steps of:

displaying on a multi-input display device a graphical window and at least a first portion of an image not displayed in its entirety within the graphical window;

accessing data that identifies a position and movement of three or more input elements that are simultaneously in contact with three or more different edges of the displayed graphical window;

selecting, based on the accessed data,

a modification implemented when the three or more input elements are simultaneously in contact with the three or more different edges of the displayed graphical window, the modification simultaneously moving each of the three or more edges of the displayed graphical window contacted by the three or more input elements in a respective direction of identified movement of the respective input element normal to an axis of the respective edge while the position of the displayed first portion of the image remains unchanged relative to the display device;

manipulating the displayed graphical window in accordance with the selected modification to reveal new content of the image not displayed in its entirety; and

based on the manipulation of the displayed graphical window, displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and second portions of the image not displayed in its entirety are substantially the same.

2. The method of claim 1 , wherein:

the modification corresponds to simultaneously moving each of the edges of the displayed graphical window contacted by a respective one of the input elements in a direction of identified movement of the respective input element normal to an axis parallel to the respective edge.

3. The method of claim 1 ,

wherein displaying the graphical window comprises displaying the graphical window over a background display,

wherein the modification simultaneously moving each of the edges of the displayed graphical window comprises the modification simultaneously moving each of the edges of the displayed graphical window relative to the background display.

4. The method of claim 1 , wherein displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window comprises displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and second portions of the image not displayed in its entirety are the same.

5. A multi-input display system, comprising:

a display device configured to display on a display surface a graphical window and at least a first portion of an image not displayed in its entirety within the graphical window and detect one or more input elements contacting the display surface; and

a controller configured to access data that identifies a position and movement of three or more input elements that are simultaneously in contact with three or more different edges of the displayed graphical window, the controller being adapted to select, based on the accessed data, a modification from among multiple modifications and manipulate the displayed graphical window in accordance with the selected modification,

wherein the selected modification is implemented when the three or more input elements are simultaneously in contact with the three or more different edges of the graphical window, the modification simultaneously moving each of the three or more edges of the graphical window contacted by the three or more input elements in a respective direction of identified movement of the respective input element normal to an axis of the respective edge while the position of the displayed first portion of the image remains unchanged relative to the display surface,

wherein the controller is configured to manipulate the displayed graphical window to reveal new content of the image not displayed in its entirety based on the selected modification to display on the display surface at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display surface of common portions of the first and the second portions of the image not displayed in its entirety are substantially the same.

6. The system of claim 5 , wherein:

the modification corresponds to simultaneously moving each of the edges of the displayed graphical window contacted by a respective one of the input elements in a direction of identified movement of the respective input element normal to an axis parallel to the respective edge.

7. The system of claim 5 ,

wherein the display device being configured to display on the display surface the graphical window comprises the display device being configured to display on the display surface the graphical window over a background display,

wherein the selected modification simultaneously moving each of the edges of the displayed graphical window comprises the selected modification simultaneously moving each of the edges of the displayed graphical window relative to the background display.

8. The system of claim 5 , wherein the controller being configured to control the display device comprises the controller being configured to control the display device to display on the display surface at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display surface of common portions of the first and the second portions of the image not displayed in its entirety are the same.

9. A method of interfacing with a multi-input display device, comprising the steps of:

displaying on a multi-input display device a graphical window and at least a first portion of an image not displayed in its entirety within the graphical window;

accessing data that identifies positions and movement of a plurality of input elements that are simultaneously in contact with one or more edges of the displayed graphical window;

selecting, based on the accessed data, either:

a first modification implemented when two of the plurality of input elements are simultaneously in contact with adjacent edges of the displayed graphical window, the first modification changing at least one of a shape and a size of the displayed graphical window in accordance with the identified positions and movement of the two input elements contacting the adjacent edges while the position of the displayed first portion of the image remains unchanged relative to the display device, or

a second modification implemented when two of the plurality of input elements are simultaneously in contact with a same edge of the displayed graphical window, the second modification changing at least one of a position and a shape of the displayed graphical window in accordance with the identified positions and movement of the two input elements contacting the same edge while the position of the displayed first portion of the image remains unchanged relative to the display device;

manipulating the displayed graphical window in accordance with the selected modification to reveal new content of the image not displayed in its entirety; and

based on the manipulation of the displayed graphical window, displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and the second portions of the image not displayed in its entirety are substantially the same.

10. The method of claim 9 , wherein the first modification comprises uniformly scaling the size of the displayed graphical window in accordance with the identified movement of the two input elements contacting the adjacent edges.

11. The method of claim 9 , wherein the second modification comprises changing the shape of the displayed graphical window by changing a length of said same edge in accordance with a change in distance between the positions of the two input elements contacting said same edge.

12. The method of claim 9 ,

wherein displaying the graphical window comprises displaying the graphical window over a background display,

wherein the first modification changing at least one of a shape and a size of the displayed graphical window comprises the first modification changing at least one of the shape and the size of the displayed graphical window relative to the background display, and

wherein the second modification changing at least one of a position and a shape of the displayed graphical window comprises the second modification changing at least one of the position and the shape of the displayed graphical window relative to the background display.

13. The method of claim 9 , wherein selecting either the first modification or the second modification comprises selecting the first modification for manipulating the displayed graphical window, and

wherein manipulating the displayed graphical window in accordance with the selected modification comprises manipulating the displayed graphical window in accordance with the selected first modification.

14. The method of claim 9 , wherein selecting either the first modification or the second modification comprises selecting the second modification for manipulating the displayed graphical window, and

wherein manipulating the displayed graphical window in accordance with the selected modification comprises manipulating the displayed graphical window in accordance with the selected second modification.

15. The method of claim 9 , wherein displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window comprises displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and the second portions of the image not displayed in its entirety are the same.

16. A multi-input display system, comprising:

a display device configured to display on a display surface a graphical window and at least a first portion of an image not displayed in its entirety within the graphical window and detect input elements simultaneously in contact with the display surface; and

a controller configured to access data that identifies positions and movement of a plurality of input elements that are simultaneously in contact with one or more edges of the displayed graphical window, select, based on the accessed data, a modification from among multiple modifications, and manipulate the displayed graphical window in accordance with the selected modification, the multiple modifications either:

a first modification implemented when two of the plurality of input elements are simultaneously in contact with adjacent edges of the displayed graphical window, the first modification changing at least one of a shape and a size of the displayed graphical window in accordance with the identified positions and movement of the two input elements contacting the adjacent edges while the position of the displayed first portion of the image remains unchanged relative to the display device, or

a second modification implemented when two of the plurality of input elements are simultaneously in contact with a same edge of the displayed graphical window, the second modification changing at least one of a position and a shape of the displayed graphical window in accordance with the identified positions and movement of the two input elements contacting the same edge while the position of the displayed first portion of the image remains unchanged relative to the display device,

wherein the controller is configured to manipulate the displayed graphical window to reveal new content of the image not displayed in its entirety based on the selected modification to display on the display surface at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display surface of common portions of the first and the second portions of the image not displayed in its entirety are substantially the same.

17. The system of claim 16 , wherein the first modification comprises uniformly scaling the size of the displayed graphical window in accordance with the identified movement of the two input elements contacting the adjacent edges.

18. The system of claim 16 , wherein the second modification comprises changing the shape of the displayed graphical window by changing a length of said same edge in accordance with a change in distance between the positions of the two input elements contacting said same edge.

19. The system of claim 16 ,

wherein the display device being configured to display on the display surface the graphical window comprises the display device being configured to display on the display surface the graphical window over a background display,

wherein the first modification changing at least one of a shape and a size of the displayed graphical window comprises the first modification changing at least one of the shape and the size of the displayed graphical window relative to the background display, and

wherein the second modification changing at least one of a position and a shape of the displayed graphical window comprises the second modification changing at least one of the position and the shape of the displayed graphical window relative to the background display.

20. The system of claim 16 , wherein the controller being configured to select either the first modification or the second modification comprises the controller being configured to select the first modification for manipulating the displayed graphical window, and

wherein the controller being configured to manipulate the displayed graphical window in accordance with the selected modification comprises the controller being configured to manipulate the displayed graphical window in accordance with the selected first modification.

21. The system of claim 16 , wherein the controller being configured to select either the first modification or the second modification comprises the controller being configured to select the second modification for manipulating the displayed graphical window, and

wherein the controller being configured to manipulate the displayed graphical window in accordance with the selected modification comprises the controller being configured to manipulate the displayed graphical window in accordance with the selected second modification.

22. The system of claim 16 , wherein the controller being configured to control the display device comprises the controller being configured to control the display device to display on the display surface at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display surface of common portions of the first and the second portions of the image not displayed in its entirety are the same.

23. A method of interfacing with a multi-input display device, comprising the steps of:

displaying on a multi-input display device a graphical window and at least a first portion of an image not displayed in its entirety within the graphical window, the graphical window including a frame;

identifying a position and movement of three or more input elements that have been determined to have simultaneously contacted respectively three or more different edges of the displayed frame of the graphical window;

manipulating the displayed graphical window in accordance with

a modification implemented when the three or more input elements have been determined to have simultaneously contacted respectively the three or more different edges of the displayed frame of the graphical window, the modification simultaneously moving each of the three or more edges of the displayed frame contacted by a respective one of the three or more input elements in a direction of identified movement of the respective input element normal to an axis of the respective edge while the position of the displayed first portion of the image remains unchanged relative to the display device; and

based on the manipulation of the graphical window, displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and second portions of the image not displayed in its entirety are substantially the same.

24. The method of claim 23 , wherein the multi-input display device comprises a multi-touch display device.

25. The method of claim 23 , wherein displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window comprises displaying on the display device at least a second portion of the image not displayed in its entirety within the manipulated graphical window that is different from the first portion, but that includes the newly revealed content, wherein positions on the display device of common portions of the first and second portions of the image not displayed in its entirety are the same.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2017
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 044823/0905 →
MERGER Recorded Nov 27, 2017
From: PERCEPTIVE PIXEL INC.
To: MICROSOFT CORPORATION
Reel/Frame 044511/0872 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2009
From: DAVIDSON, PHILIP L.; HAN, JEFFERSON Y.
To: PERCEPTIVE PIXEL, INC.
Reel/Frame 022894/0592 →
Continuity (2)
Provisional Application 61043863 · Apr 10, 2008
Related Publication 20090256857A1 · Oct 15, 2009