IP Library Granted Patent US 8,514,264
Granted Patent B2
US 8,514,264 · App. 13/406,235 · Granted Aug 20, 2013

Remote workspace sharing

Inventors: Ankur Agarwal (Cambridge, GB); Antonio Criminisi (Hardwick, GB); William A. S. Buxton (Toronto, GB); Andrew Blake (Cambridge, GB); Andrew William Fitzgibbon (Cambridge, GB)
Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,514,264
App. No.
13/406,235
Granted
Aug 20, 2013
Kind
B2
Abstract

Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

Claims (34)

1. A method comprising:

displaying an image of a shared work product at a first display;

receiving at least one image of the first display and a region around that first display;

segmenting the received image to obtain a foreground image; and

composing an output image from an image of the shared work product and the foreground image.

2. A method as claimed in claim 1 which further comprises estimating a relative depth of the foreground image from the first display.

3. A method as claimed in claim 1 which further comprises displaying an image of a remote user at a second display positioned near the first display and arranged to display an image of the remote user during use of a collaborative work application with that remote user.

4. A method as claimed in claim 1 wherein the segmenting is achieved using knowledge of the image of the shared work product and comparing the knowledge of the image of the shared work product with the received image.

5. A method as claimed in claim 1 wherein the segmenting is achieved using an image processing segmentation algorithm.

6. A method as claimed in claim 5 wherein the image processing segmentation algorithm is based on a contrast analysis technique.

7. A method as claimed in claim 5 wherein the image processing segmentation algorithm is based on an edge detection technique.

8. A method as claimed in claim 5 wherein the image processing segmentation algorithm is based on an object recognition technique.

9. A method comprising:

displaying an image of a shared work product at a first display;

receiving at least one video image of the first display and a region around that first display;

segmenting the at least one video image to obtain a foreground image;

estimating a relative depth of the foreground image from the first display; and

composing an output image from an image of the shared work product and the foreground image based at least in part on the estimated relative depth.

10. A method as claimed in claim 9 wherein the segmenting is achieved using an image processing segmentation algorithm based at least in part on a contrast analysis technique, an edge detection technique, or an object recognition technique.

11. A method as claimed in claim 9 wherein the segmenting is achieved using knowledge of the image of the shared work product and comparing the knowledge of the image of the shared work product with the at least one video image.

12. A method as claimed in claim 9 which further comprises displaying an image of a remote user at a second display positioned near the first display and arranged to display an image of the remote user during use of a collaborative work application with that remote user.

13. An apparatus comprising:

a display to render an image of a shared work product;

an input arranged to receive at least one image of the display and a region around the display; and

a processor arranged to:

segment the received image to obtain a foreground image; and

compose an output image from an image of the shared work product and the foreground image.

14. An apparatus as claimed in claim 13 wherein the input comprises a video camera.

15. An apparatus as claimed in claim 13 wherein the input comprises a mono camera.

16. An apparatus as claimed in claim 13 wherein the processor is arranged to estimate a relative depth of the foreground image from the display.

17. An apparatus as claimed in claim 16 wherein the processor is arranged to compose the output image from the image of the shared work product and the foreground image based at least in part on the estimated relative depth.

18. An apparatus as claimed in claim 13 wherein the processor is arranged to segment the received image to obtain the foreground image by using an image processing segmentation algorithm.

19. An apparatus as claimed in claim 18 wherein the processor is arranged to use the image processing segmentation algorithm based at least in part on a contrast analysis technique, an edge detection technique, or an object recognition technique.

20. An apparatus as claimed in claim 13 wherein the processor is arranged to segment the received image to obtain the foreground image by using knowledge of the image of the shared work product and comparing the knowledge of the image of the shared work product with the received image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2016
From: MICROSOFT TECHNOLOGY LICENSING, LLC
To: ZHIGU HOLDINGS LIMITED
Reel/Frame 040354/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
Continuity (2)
Continuation 11669107 · Jan 30, 2007
Related Publication 20120162354A1 · Jun 28, 2012