IP Library Granted Patent US 10,754,490
Granted Patent B2
US 10,754,490 · App. 15/615,169 · Granted Aug 25, 2020

User interface for collaborative efforts

Inventors: Desney S. Tan (Kirkland, WA); Kenneth P. Hinckley (Redmond, WA); Steven N. Bathiche (Kirkland, WA); Ronald O. Pessner (Seattle, WA); Bongshin Lee (Issaquah, WA); Anoop Gupta (Woodinville, WA); Amir Netz (Bellevue, WA); Brett D. Brewer (Sammamish, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/0481G06F3/0484G06F3/04883G06F3/04886G06F21/31G06F21/316G06F21/32G06F21/34G06F21/84H04L65/40G06F2203/04808G06F2221/032G06F2221/2149
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,754,490
App. No.
15/615,169
Granted
Aug 25, 2020
Kind
B2
Abstract

The description relates to a shared digital workspace. One example includes a display device and sensors. The sensors are configured to detect users proximate the display device and to detect that an individual user is performing an individual user command relative to the display device. The system also includes a graphical user interface configured to be presented on the display device that allows multiple detected users to simultaneously interact with the graphical user interface via user commands.

Claims (81)

1. A system, comprising:

a display device;

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to:

in a first instance:

present a shared canvas on the display device;

modify the shared canvas responsive to user inputs directed to the shared canvas received from different users;

responsive to user commands received from the different users, retrieve different personal data items of the different users;

concurrently display the different personal data items on the shared canvas; and

save a copy of the shared canvas to personal data associated with an individual user; and

in a subsequent instance, retrieve the shared canvas from the personal data associated with the individual user and present the shared canvas on the display device with the different personal data items of the different users that were retrieved and concurrently displayed in the first instance.

2. The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance:

receive different free-form ink inputs for different free-form ink drawings entered by the different users; and

modify the shared canvas to include the different free-form ink drawings on the shared canvas responsive to the different free-form ink inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the different free-form ink drawings received from the different users in the first instance.

3. The system of claim 2 , the display device comprising a touch sensor configured to detect the different free-form ink inputs.

4. The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance:

receive different free-form ink inputs from the different users;

perform ink-to-text processing on the different free-form ink inputs; and

modify the shared canvas to include different text representations, produced by the ink-to-text processing, of the different free-form ink inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the different text representations of the different free-form ink inputs received from the different users in the first instance.

5. The system of claim 4 , wherein the instructions, when executed by the processor, cause the processor to:

provide the shared canvas to a remote user of a remote device.

6. The system of claim 5 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance:

receive further inputs from the remote device, the further inputs identifying one or more words;

further modify the shared canvas to provide a further modified shared canvas that reflects the one or more words identified by the further inputs received from the remote device; and

display the further modified shared canvas on the display device; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the one or more words identified by the further inputs received from the remote user in the first instance.

7. The system of claim 6 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, obtain the different personal data items of the different users from a cloud service.

8. The system of claim 6 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, obtain the different personal data items from different mobile devices of the different users.

9. A method comprising:

in a first instance:

presenting a shared display area on a display device;

modifying the shared display area with different free-form ink drawings responsive to different free-form inputs directed to the shared display area, the different free-form inputs being received from different users;

responsive to user commands received from the different users, retrieving different data items of the different users;

concurrently displaying the different data items on the shared display area with the different free-form ink drawings; and

saving a representation of the shared display area; and

in a subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the different free-form ink drawings and the different data items of the different users that were retrieved and concurrently displayed in the first instance.

10. The method of claim 9 , further comprising:

in the first instance, receiving the different free-form inputs from a stylus that contacts the display device.

11. The method of claim 9 , further comprising:

in the first instance, receiving the different free-form inputs from fingers of the different users when the fingers contact the display device.

12. The method of claim 9 , further comprising:

in the first instance:

converting other free-form ink received from the different users to obtain text; and

displaying the text on the shared display area; and

in the subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the text obtained by converting the other free-form ink received from the different users.

13. The method of claim 9 , further comprising:

sending the representation of the shared display area to a remote user of a remote device.

14. The method of claim 9 , further comprising:

providing the representation of the shared display area to a cloud service that sends the representation to a remote device of a remote user.

15. The method of claim 9 , further comprising:

in the first instance:

receiving further inputs from a remote device, the further inputs specifying text input to the remote device by a remote user; and

modifying the shared display area to include the text input to the remote device by the remote user; and

in the subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the text specified by the further inputs received from the remote device in the first instance.

16. A system, comprising:

a touch screen;

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to:

in a first instance:

present a shared canvas on the touch screen;

modify the shared canvas responsive to touch inputs received from different users, the touch inputs being directed to the shared canvas;

responsive to the touch inputs received from the different users, retrieve different data items specified by the different users from a cloud service;

concurrently display the different data items retrieved from the cloud service on the shared canvas; and

save a copy of the shared canvas; and

in a subsequent instance, retrieve the shared canvas and present the shared canvas on the touch screen with the different data items of the different users that were retrieved and concurrently displayed in the first instance.

17. The system of claim 16 , wherein the instructions, when executed by the processor, cause the processor to:

scroll the shared canvas in a horizontal or vertical direction.

18. The system of claim 16 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, authenticate the different users before retrieving the different data items from the cloud service.

19. The system of claim 16 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, receive free-form ink from an individual user and modify the shared canvas to include the free-form ink responsive to the touch inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the touch screen with the different data items of the different users that were retrieved and concurrently displayed in the first instance and the free-form ink received from the individual user in the first instance.

20. The system of claim 16 , wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, send the shared canvas to a remote device of a remote user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2018
From: TAN, DESNEY S.; HINCKLEY, KENNETH P.; BATHICHE, STEVEN N.; PESSNER, RONALD O.; LEE, BONGSHIN; GUPTA, ANOOP; NETZ, AMIR; BREWER, BRETT D.
To: MICROSOFT CORPORATION
Reel/Frame 045258/0040 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2018
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 045258/0107 →