IP Library Granted Patent US 10,817,079
Granted Patent B2
US 10,817,079 · App. 15/882,623 · Granted Oct 27, 2020

Displaying a shadow of a stylus or of content on a display device

Inventors: Mark R. Ligameri (Santa Rosa, FL); Michiel S. Knoppert (Amsterdam, NL); Jace W. Files (Round Rock, TX)
Assignee: Dell Products L.P.
G06F3/03545G06F3/02G06F3/0346G06F3/04815G06F3/04842G06F3/04847G06T15/506G06T15/60G06F3/0488G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,817,079
App. No.
15/882,623
Granted
Oct 27, 2020
Kind
B2
Abstract

In some examples, a computing device may receive stylus sensor data from one or more sensors in a stylus that is used to interact with the computing device. The computing device may determine, based on the stylus sensor data, (i) a stylus height of a tip of the stylus from a display device and (ii) one or more stylus angles of the stylus relative to the display device. The computing device may display, on the display device, a virtual shadow of the stylus at a location based at least in part on the stylus height, the stylus angles, and a location of a virtual light source. The computing device may display, on the display device, one or more virtual shadows of content items corresponding to the stylus acting as a virtual light source.

Claims (114)

1. A computing device comprising:

a display device;

one or more processors, and one or more non-transitory computer storage media to store instructions that are executable by the one or more processors to perform operations comprising:

receiving stylus sensor data from one or more sensors in a stylus;

determining, based on the stylus sensor data, a stylus height of a tip of the stylus from the display device;

determining, based on the stylus sensor data, a stylus angle of the stylus relative to the display device;

displaying, on the display device, a virtual shadow of the stylus at a first location based at least in part on:

the stylus height of the tip of the stylus;

the stylus angle; and

a location of a virtual light source;

determining a location of a shadow tip of the virtual shadow corresponding to the tip of the stylus; and

based at least in part on determining that the location of the shadow tip of the virtual shadow is within a predetermined distance from an element in a user interface, indicating a selection of the element;

wherein a light source interface associated with the virtual light source enables specification of:

the location, in three dimensions, of the virtual light source relative to a center of the display device; and

a size of the virtual light source.

2. The computing device of claim 1 , wherein the operations further comprise:

determining a change to the stylus angle of the stylus; and

moving the virtual shadow based at least in part on the change to the stylus angle of the stylus.

3. The computing device of claim 1 , wherein the operations further comprise:

receiving, from the one or more sensors in the stylus, button press data indicating a confirmation of the selection of the element; and

confirming the selection of the element in the user interface.

4. The computing device of claim 1 , wherein:

the stylus comprises one or more buttons; and

button press data is sent from the stylus to the computing device based at least in part on detecting a button selection of a particular button of the one or more buttons.

5. The computing device of claim 1 , wherein the operations further comprise:

determining that the tip of the stylus is not touching a surface of the display device; and

based at least in part on determining that the shadow tip of the virtual shadow is selecting a first element in the user interface:

indicating that the first element is selected; and

receiving, from the stylus, a confirmation that the first element is selected.

6. The computing device of claim 5 , wherein the operations further comprise:

determining that the tip of the stylus is touching the surface of the display device; and

based at least in part on determining that the tip of the stylus is selecting a second element in the user interface confirming that the second element in the user interface is selected.

7. The computing device of claim 1 , wherein the operations further comprise:

receiving second stylus sensor data from the one or more sensors of a stylus;

determining, based at least in part on the second stylus sensor data, a second stylus height of the tip of the stylus from the display device;

determining, based at least in part on the second stylus sensor data, a second stylus angle of the stylus relative to the display device; and

displaying, on the display device, the virtual shadow of the stylus at a second location based at least in part on:

the second stylus height of the tip of the stylus;

the second stylus angle; and

the virtual light source.

8. A method comprising:

receiving, by a computing device, stylus sensor data from one or more sensors in a stylus;

determining, based on the stylus sensor data, a stylus height of a tip of the stylus from a display device that is associated with the computing device;

determining, based on the stylus sensor data, a stylus angle of the stylus relative to the display device; and

displaying, on the display device, a virtual shadow of the stylus at a first location based at least in part on:

the stylus height of the tip of the stylus;

the stylus angle; and

a location of a virtual light source;

determining, by the computing device, that the tip of the stylus is not touching a surface of the display device; and

based at least in part on determining, by the computing device, that a shadow tip of the virtual shadow is selecting a first element in a user interface:

indicating, by the computing device, that the first element is selected; and

receiving, from the stylus, a confirmation that the first element is selected;

wherein a light source interface associated with the virtual light source enables specification of:

the location, in three dimensions, of the virtual light source relative to a center of the display device; and

a size of the virtual light source.

9. The method of claim 8 , further comprising:

determining a location of the shadow tip of the virtual shadow corresponding to the tip of the stylus;

determining that the location of the shadow tip of the virtual shadow is within a predetermined distance from the first element in the user interface; and

indicating a selection of the first element.

10. The method of claim 9 , further comprising:

receiving, from the one or more sensors in the stylus, button press data indicating a confirmation of the selection of the first element; and

confirming the selection of the first element in the user interface.

11. The method of claim 8 , wherein:

the stylus comprises one or more buttons; and

based at least in part on detecting a button selection of a particular button of the one or more buttons, the stylus sends button press data from the stylus to the computing device.

12. The method of claim 8 , further comprising:

determining that the tip of the stylus is touching the surface of the display device;

determining that the tip of the stylus is selecting a second element in the user interface; and

confirming that the second element in the user interface is selected.

13. The method of claim 8 , further comprising:

receiving second stylus sensor data from the one or more sensors in the stylus;

determining, based at least in part on the second stylus sensor data, a second stylus height of the tip of the stylus from the display device;

determining, based at least in part on the second stylus sensor data, a second stylus angle of the stylus relative to the display device; and

displaying, on the display device, the virtual shadow of the stylus at a second location based at least in part on:

the second stylus height of the tip of the stylus;

the second stylus angle; and

the virtual light source.

14. One or more non-transitory computer storage media to store instructions that are executable by one or more processors to perform operations comprising:

receiving stylus sensor data from one or more sensors in a stylus;

determining, based on the stylus sensor data, a stylus height of a tip of the stylus from a display device that is associated with a computing device;

determining, based on the stylus sensor data, a stylus angle of the stylus relative to the display device; and

displaying, on the display device, a virtual shadow of the stylus at a first location based at least in part on:

the stylus height of the tip of the stylus;

the stylus angle; and

a location of a virtual light source;

determining that the tip of the stylus is not touching a surface of the display device;

and based at least in part on determining that a shadow tip of the virtual shadow is selecting a first element in a user interface:

indicating that the first element is selected; and

receiving, from the stylus, a confirmation that the first element is selected;

wherein a light source interface enables specification of:

the location, in three dimensions, of the virtual light source relative to a center of the display device; and

a size of the virtual light source.

15. The one or more non-transitory computer storage media of claim 14 , wherein the operations further comprise:

determining a location of the shadow tip of the virtual shadow corresponding to the tip of the stylus;

determining that the location of the shadow tip of the virtual shadow is within a predetermined distance from the first element in the user interface; and

indicating a selection of the first element.

16. The one or more non-transitory computer storage media of claim 15 , wherein the operations further comprise:

receiving, from the one or more sensors in the stylus, button press data indicating a confirmation of the selection of the first element; and

confirming the selection of the first element in the user interface.

17. The one or more non-transitory computer storage media of claim 14 , wherein:

the stylus comprises one or more buttons; and

button press data is sent from the stylus to the computing device based at least in part on detecting a button selection of a particular button of the one or more buttons.

18. The one or more non-transitory computer storage media of claim 15 , wherein the light source interface enables specification of the location of the virtual light source per application.

19. The one or more non-transitory computer storage media of claim 18 , wherein the operations further comprise:

determining that the tip of the stylus is touching the surface of the display device; and

based at least in part on determining that the tip of the stylus is selecting a second element in the user interface confirming that the second element in the user interface is selected.

20. The one or more non-transitory computer storage media of claim 14 , wherein the operations further comprise:

receiving second stylus sensor data from the one or more sensors of a stylus;

determining, based at least in part on the second stylus sensor data, a second stylus height of the tip of the stylus from the display device;

determining, based at least in part on the second stylus sensor data, a second stylus angle of the stylus relative to the display device; and

displaying, on the display device, the virtual shadow of the stylus at a second location based at least in part on:

the second stylus height of the tip of the stylus;

the second stylus angle; and

the virtual light source.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045482/0131) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 061749/0924 →
RELEASE OF SECURITY INTEREST AT REEL 045482 FRAME 0395 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0314 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 045482/0131 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Mar 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 045482/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: LIGAMERI, MARK R.; KNOPPERT, MICHIEL S.; FILES, JACE W.
To: DELL PRODUCTS L. P.
Reel/Frame 044767/0858 →
Continuity (1)
Related Publication 20190235648A1 · Aug 1, 2019