IP Library Granted Patent US 11,526,322
Granted Patent B2
US 11,526,322 · App. 16/112,687 · Granted Dec 13, 2022

Enhanced techniques for merging content from separate computing devices

Inventor: Hannah Rebecca Lewbel (Kirkland, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06F3/1454G06F3/017G06F3/04845G06F3/04883G06F3/167G09G5/373G09G5/38G09G2340/10G09G2354/00G09G2356/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,526,322
App. No.
16/112,687
Granted
Dec 13, 2022
Kind
B2
Abstract

The present disclosure provides technologies that enable users to graphically merge content displayed on a first computing device with content displayed on a second computing device by the use of a simplified gesture. For example, a user can hold a portable computer displaying content up to a screen of another computer displaying other content. The user can position the portable computer to align the rendering of the content with a rendering of the other content. Measurements of the alignment are processed to determine a location that is used to graphically merge the content of the portable computer at a specific location within the other content. A scaling factor can be used to control the size of the content that is placed within the other content. The scaling factor can be based on a user gesture, preference data, or knowledge of a computing device.

Claims (57)

1. A method for merging content on a first computer from a second computer comprising:

displaying a first content of a first file on a display screen of the first computer executing a first environment for editing the first content;

displaying a second content of a second the on a display screen of the second computer executing a second environment for editing the second content;

receiving a signal from at least one sensor, the signal indicating a position of a display of the second content relative to a display of the first content;

determining an anchor point within the first content based on the position of the display of the second content relative to the display of the first content;

determining a scaling factor based on one or more user preferences associated with a user identity;

communicating the second content from the second computer to the first computer; and

displaying a rendering of the second content concurrently with a rendering of the first content on the display screen of the first computer, wherein a position of the second content on the display screen of the first computer is based on the anchor point, wherein the rendering of the second content that is displayed concurrently with the first content on the display screen of the first computer is communicated from the second computer in response to a request to merge the second content with the first content at the anchor point, wherein the rendering of the second content is displayed based on the scaling factor that is determined based on the one or more user preferences associated with the second computer and adjusted based on data received from the at least one sensor indicating a distance between the second computer and the display screen of the first computer.

2. The method of claim 1 , further comprising:

communicating the first content from the first computer to the second computer; and

displaying a portion of the first content on the display of the second computer to show an alignment between the first content and the second content, wherein a position of the first content on the display of the second computer is based on the anchor point.

3. The method of claim 1 , further comprising:

receiving image data from a camera of the second computer, the camera for capturing images of the rendering of the first content on the display screen of the first computer; and

rendering at least a portion of the image data on the display screen of the second computer to show an alignment between the first content and the second content.

4. The method of claim 1 , wherein the rendering of the second content on the display screen of the first computer is based on a scaling factor, and wherein the scaling factor is based on at least one of a resolution of a screen of the second computer, a model of the second computer, or a user identifier.

5. The method of claim 1 , further comprising:

receiving a voice command at a sensor in communication with the first computer, the voice command describing a location for the second content to be placed within the first content; and

interpreting the voice command to generate coordinates for the second content to be placed within the first content, wherein the rendering of at least one graphical element of the second content is based on the coordinates.

6. The method of claim 1 , further comprising storing at least a portion of the second content within the first file, wherein the second content is stored with metadata defining the anchor point and at least one scaling factor applied to the second content.

7. The method of claim 1 , further comprising:

determining a blank area within the first content, the blank area created by an insertion of the second content; and

generating additional content to accommodate any blank areas, wherein the additional content includes at least one graphical element that is an extension or a projection of at least one graphical element of the first content, wherein the rendering of the first content includes the at least one graphical element.

8. The method of claim 1 , wherein the first content originally stored on the first computer is not scaled while the second content communicated from the second computer content displayed on the display screen of the first computer is scaled according to the distance between the second computer and the display screen of the first computer.

9. The method of claim 1 , wherein the scaling factor is further adjusted in response to a user input comprising at least one of a stored user preference, a gesture, a voice command, and an input via a user interface.

10. The method of claim 1 , wherein the scaling factor is further determined based on a model number of the second computer.

11. A system for merging content on a first computer from a second computer comprising:

one or more processing units; and

a computer-readable medium having encoded thereon computer-executable instructions to cause the one or more processing units to

display a first content of a first the on a display screen of the first computer executing a first environment for editing the first content;

display a second content of a second the on a display screen of the second computer executing a second environment for editing the second content;

receive a signal from at least one sensor, the signal indicating a position of a display of the second content relative to a display of the first content;

determine an anchor point within the first content based on the position of the display of the second content relative to the display of the first content;

determine a scaling factor based on one or more user preferences associated with a user identity;

communicate the second content from the second computer to the first computer;

receive an input confirming the anchor point; and

in response to the input confirming the anchor point, display a rendering of the second content concurrently with a rendering of the first content on the display screen of the first computer, wherein a position of the second content on the display screen of the first computer is based on the anchor point, wherein the rendering of the second content that is displayed concurrently with the first content on the display screen of the first computer is communicated from the second computer in response to a request to merge the second content with the first content at the anchor point, wherein the rendering of the second content is displayed based on the scaling factor that is determined based on the one or more user preferences associated with the second computer and adjusted based on data received from the at least one sensor indicating a distance between the second computer and the display screen of the first computer.

12. The system of claim 11 , wherein the input confirming the anchor point includes at least one of, receiving an input at a user interface element, receiving a signal indicating that the second computer contacted the first computer, a voice command confirming the location, or a voice command indicating the anchor point.

13. The system of claim 11 , where the computer-executable instructions further cause the one or more processing units to:

communicate text properties or drawing properties from the second computer to the first computer; and

apply the text properties or the drawing properties to the second content displayed on the display screen.

14. The system of claim 11 , where the computer-executable instructions further cause the one or more processing units to:

determine that a blank area within the first content is created by an insertion of the second content; and

generate additional content to fill the blank area, wherein the additional content includes at least one graphical element that is an extension or a projection of at least one graphical element of the first content, wherein the rendering of the first content includes the at least one graphical element, and wherein the extension or the projection of the at least one graphical element is generated by a machine learning module employing one or more machine learning mechanisms.

15. A method for merging content on a first computer from a second computer comprising,

displaying a first content of a first file on a display screen of the first computer executing a first environment for editing the first content;

displaying a second content of a second file on a display screen of the second computer executing a second environment for editing the second content;

receiving an input gesture defining a region within the first content, wherein data defining the region allows an insertion of the second content within the region, wherein the data defining the region restricts the insertion of the second content outside of the region;

determining a scaling factor based on one or more user preferences associated with a user identity;

analyzing an input signal to determine a position of the second content; and

in response to determining that the position of the second content is within the region, communicating the second content from the second computer to the first computer and displaying the second content on the display screen of the first computer within the region, wherein the rendering of the second content that is displayed concurrently with the first content on the display screen of the first computer is communicated from the second computer in response to a request to merge the second content with the first content at the anchor point, wherein the rendering of the second content is displayed based on the scaling factor that is determined based on the one or more user preferences associated with the second computer and adjusted based on data received from the at least one sensor indicating a distance between the second computer and the display screen of the first computer.

16. The method of claim 15 , further comprising in response to determining that the position of the second content is outside of the region, preventing the communication of the second content from the second computer to the first computer and preventing the display of the second content on the display screen of the first computer.

17. The method of claim 15 , wherein the input signal includes at least one of a voice input indicating the position of the second content or a signal from a sensor indicating a location of the second computer relative to the first computer, the location indicating the position of the second content.

18. The method of claim 15 , wherein the input gesture defining the region comprises an ink gesture, and wherein the method further comprises analyzing the ink gesture to determine the region.

19. The method of claim 15 , wherein the input gesture indicates an identifier, wherein the method further comprises:

determining that the identifier is associated with the second content; and

in response to determining that the identifier is associated with the second content, allowing communication of the second content from the second computer to the first computer and allowing the display of the second content on the display screen of the first computer within the region.

20. The method of claim 19 , in response to determining that the identifier is not associated with the second content, preventing the communication of the second content from the second computer to the first computer and preventing the display of the second content on the display screen of the first computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2018
From: LEWBEL, HANNAH REBECCA
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 046705/0041 →
Continuity (1)
Related Publication 20200065052A1 · Feb 27, 2020