IP Library Granted Patent US 11,366,958
Granted Patent B1
US 11,366,958 · App. 17/175,402 · Granted Jun 21, 2022

Intelligent automated note annotation

Inventors: Benedict Tiong Chee Tay (Singapore, SG); Mark John Law (Singapore, SG); Jonathan Sebastian Yarborough Wood (Singapore, SG); Chin Leong Ong (Singapore, SG); Michiel Sebastiaan Emanuel Petrus Knoppert (Amsterdam, NL); Ye Chang Ron Tan (Singapore, SG)
Assignee: DELL PRODUCTS L.P.
G06F40/169G06F3/04883G06F9/54G06F16/31G06F16/338G06F16/3344G06F16/9558G06F40/117G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,366,958
App. No.
17/175,402
Granted
Jun 21, 2022
Kind
B1
Abstract

An information handling system may detect handwritten text associated with a gesture. The information handling system may request contextual information corresponding to the handwritten text and may receive contextual information corresponding to the handwritten text. The information handling system may display, on a display of the information handling system, the received contextual information.

Claims (72)

1. A method for providing contextual information to a user of an information handling system, comprising:

detecting, by an application of the information handling system, handwritten text associated with a gesture;

determining, by the information handling system in response to detection of the gesture, one or more databases of a plurality of databases from which contextual information will be requested based, at least in part, on the handwritten text associated with the gesture;

requesting, by the information handling system from a remote service, contextual information corresponding to the handwritten text from the one or more databases by transmitting a request to the remote service for the contextual information, the request comprising an indication of the one or more databases determined based on the handwritten text;

receiving, by the information handling system from the remote service in response to the request, contextual information retrieved from the one or more databases corresponding to the handwritten text; and

displaying, by the application on a display of the information handling system, the received contextual information.

2. The method of claim 1 , wherein the handwritten text comprises a name of an individual and wherein the received contextual information comprises contextual information related to at least one of:

emails generated by or received by the individual;

messaging conversations generated by or received by the individual;

documents generated or edited by the individual; or

a corporate profile of the individual.

3. The method of claim 1 , wherein the handwritten text comprises a term, and wherein the received contextual information comprises at least one of:

one or more links to one or more documents stored in a database that are tagged with the term;

one or more links to one or more web documents that are tagged with the term;

one or more links to one or more web pages that are tagged with the term;

contextual information describing one or more individuals tagged as experts or collaborators with expertise in the term; or

one or more links to one or more messaging conversations tagged with the term.

4. The method of claim 1 , wherein the handwritten text comprises at least one of a date or a time frame, and wherein the received contextual information comprises one or more links to one or more documents associated with the date or time frame that are stored in a database.

5. The method of claim 1 , wherein the steps of requesting and receiving are performed by a background service executed by the information handling system, and wherein the step of displaying the received contextual information comprises overlaying the received contextual information on an application window, of the application, displaying the handwritten text, and wherein only a subset of the contextual information is provided by the background service to the application for overlaying on the application window, the subset of the contextual information being less than all of the contextual information.

6. The method of claim 1 , wherein receiving contextual information comprises receiving contextual information via one or more application programming interfaces (APIs).

7. The method of claim 1 , further comprising:

receiving a plurality of rankings for a plurality of contextual information elements of the contextual information received by the information handling system,

wherein displaying the received contextual information comprises displaying the received contextual information based, at least in part, on the received plurality of rankings.

8. An information handling system, comprising:

a processor; and

a memory,

wherein the processor is configured to perform steps comprising:

detecting, by an application, handwritten text associated with a gesture;

determining, in response to detection of the gesture, one or more databases of a plurality of databases from which contextual information will be requested based, at least in part, on the handwritten text associated with the gesture;

requesting, from a remote service, contextual information corresponding to the handwritten text from the one or more databases by transmitting a request to the remote service for the contextual information, the request comprising an indication of the one or more databases;

receiving, from the remote service, contextual information from the one or more databases in response to the request, the contextual information corresponding to the handwritten text; and

displaying, by the application on a display of the information handling system, the received contextual information.

9. The information handling system of claim 8 , wherein the handwritten text comprises a name of an individual and wherein the received contextual information comprises contextual information related to at least one of:

emails generated by or received by the individual;

messaging conversations generated by or received by the individual;

documents generated or edited by the individual; or

a corporate profile of the individual.

10. The information handling system of claim 8 , wherein the handwritten text comprises a term, and wherein the received contextual information comprises at least one of:

one or more links to one or more documents stored in a database that are tagged with the term;

one or more links to one or more web documents that are tagged with the term;

one or more links to one or more web pages that are tagged with the term;

contextual information describing one or more individuals tagged as experts or collaborators with expertise in the term; or

one or more links to one or more messaging conversations tagged with the term.

11. The information handling system of claim 8 , wherein the handwritten text comprises at least one of a date or a time frame, and wherein the received contextual information comprises one or more links to one or more documents associated with the date or time frame that are stored in a database.

12. The information handling system of claim 8 , wherein the steps of requesting and receiving are performed by a background service executed by the information handling system, wherein the step of displaying the received contextual information comprises overlaying the received contextual information on an application window, of the application, displaying the handwritten text, and wherein only a subset of the contextual information is provided by the background service to the application for overlaying on the application window, the subset of the contextual information being less than all of the contextual information.

13. The information handling system of claim 8 , wherein receiving contextual information comprises receiving contextual information via one or more application programming interfaces (APIs).

14. The information handling system of claim 8 , wherein the processor is further configured to perform steps comprising:

receiving a plurality of rankings for a plurality of contextual information elements of the contextual information received by the information handling system,

wherein displaying the received contextual information comprises displaying the received contextual information based, at least in part, on the received plurality of rankings.

15. A computer program product, comprising:

a non-transitory computer readable medium, wherein the non-transitory computer readable medium comprises instructions for causing an information handling system to perform steps comprising:

detecting, by an application, handwritten text associated with a gesture;

determining, by the information handling system in response to detection of the gesture, one or more databases of a plurality of databases from which contextual information will be requested based, at least in part, on the handwritten text associated with the gesture;

requesting, from a remote service, contextual information corresponding to the handwritten text from the one or more databases by transmitting a request to the remote service for the contextual information, the request comprising an indication of the one or more databases;

receiving, from the remote service, contextual information from the one or more databases in response to the request, the contextual information corresponding to the handwritten text; and

displaying, by the application on a display of the information handling system, the received contextual information.

16. The computer program product of claim 15 , wherein the handwritten text comprises a name of an individual and wherein the received contextual information comprises contextual information related to at least one of:

emails generated by or received by the individual;

messaging conversations generated by or received by the individual;

documents generated or edited by the individual; or

a corporate profile of the individual.

17. The computer program product of claim 15 , wherein the handwritten text comprises a term, and wherein the received contextual information comprises at least one of:

one or more links to one or more documents stored in a database that are tagged with the term;

one or more links to one or more web documents that are tagged with the term;

one or more links to one or more web pages that are tagged with the term;

contextual information describing one or more individuals tagged as experts or collaborators with expertise in the term; or

one or more links to one or more messaging conversations tagged with the term.

18. The computer program product of claim 15 , wherein the handwritten text comprises at least one of a date or a time frame, and wherein the received contextual information comprises one or more links to one or more documents associated with the date or time frame that are stored in a database.

19. The computer program product of claim 15 , wherein receiving contextual information comprises receiving contextual information via one or more application programming interfaces (APIs).

20. The computer program product of claim 15 , wherein the non-transitory computer-readable medium comprises instructions for causing an information handling system to perform steps further comprising:

receiving a plurality of rankings for a plurality of contextual information elements of the contextual information received by the information handling system,

wherein displaying the received contextual information comprises displaying the received contextual information based, at least in part, on the received plurality of rankings.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0280) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0255 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0001) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062021/0844 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0124) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0012 →
RELEASE OF SECURITY INTEREST Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058297/0332 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0280 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0001 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0124 →
CORRECTIVE ASSIGNMENT TO CORRECT THE MISSING PATENTS THAT WERE ON THE ORIGINAL SCHEDULED SUBMITTED BUT NOT ENTERED PREVIOUSLY RECORDED AT REEL: 056250 FRAME: 0541. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 17, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056311/0781 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: TAY, BENEDICT TIONG CHEE; LAW, MARK JOHN; ONG, CHIN LEONG; WOOD, JONATHAN SEBASTIAN YARBOROUGH; KNOPPERT, MICHIEL SEBASTIAAN EMANUEL PETRUS; TAN, YE CHANG RON
To: DELL PRODUCTS L.P.
Reel/Frame 055250/0019 →