IP Library Granted Patent US 11,693,677
Granted Patent B2
US 11,693,677 · App. 17/574,114 · Granted Jul 4, 2023

System and methods for live help

Inventors: David King (Menlo Park, CA); Chungsoo Charles Park (Redwood City, CA)
Assignee: INTEGENX, INC.
G06F9/453G06F3/0487G06Q30/016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,693,677
App. No.
17/574,114
Granted
Jul 4, 2023
Kind
B2
Abstract

A live help system provides an intuitive display of help information on a user's graphical user interface. A request is received from a client device for help, and a live help provider interface is initiated at a live help location. Data is acquired regarding a user's location, including data on external devices in the user's location. Indicators are provided to allow the live help provider to point to or otherwise indicate items on the user interface or outside of the user interface. Live help input is captured at the live help provider interface. Instructions are then transmitted to the display of the client device to display live help input, as though the agent were present and interacting with or indicating items on the screen or off the screen.

Claims (29)

1. A method for providing live help to a user of a client device, the method comprising:

displaying a live help provider graphical user interface depicting a provider graphical representation of a client device located at a user location and respective provider graphical representations of additional devices located at the user location in a manner that identifies each of the additional devices and depicts a spatial relationship of each of the additional devices relative to the client device at the user location, the additional devices comprising one or more of medical diagnostic devices, medical treatment devices, or laboratory equipment;

processing inputs from a live help provider using the live help provider graphical user interface, wherein each input specifies one of the respective provider graphical representations of the additional devices as being referenced; and

transmitting instructions to the client device, each instruction being configured to cause a respective indicator to be displayed at a graphical user interface of the client device, the graphical user interface of the client device depicting respective client graphical representations of the additional devices in a manner that depicts the spatial relationship of each of the additional devices relative to the client device at the user location, the instructions corresponding, respectively, to the inputs from a live help provider, such that each respective indicator specifies one of the respective client graphical representations of the additional devices at the graphical user interface of the client device, thereby spatially indicating which of the additional devices the user is being instructed to operate.

2. The method of claim 1 further comprising displaying or causing to be displayed one or more live help elements at the graphical user interface of the client device, the one or more live help elements appearing as though the graphical user interface of the client device were a transparent or semitransparent window and the live help provider were touching, gesturing, or indicating from an opposite side of the window.

3. The method of claim 1 further comprising receiving the inputs from the live help provider from one or more of: a pointing device, a gesturing device, a keyboard, a motion capture device, and an imaging device.

4. The method according to claim 3 , wherein the motion capture device includes one or more of: a camera, a proximity sensor, a smart glove, a sonar, and an echolocation sensor.

5. The method according to claim 1 , wherein the live help provider is one or both of a remote human assistant and an automated help service.

6. The method according to claim 1 further comprising presenting, at the live help provider graphical user interface, a virtual reality environment, the virtual reality environment configured to allow the live help provider to indicate one or more actions corresponding to the additional devices at the user location.

7. The method of claim 1 , wherein the additional devices are selected from the group consisting of medical devices, diagnostic devices, laboratory devices, and research devices.

8. A system for providing live help to a user of a client device, the system comprising: a processor; and

a memory storing instructions that are configurable to cause the system to:

display a live help provider graphical user interface depicting a provider graphical representation of a client device located at a user location and respective provider graphical representations of additional devices located at the user location in a manner that identifies each of the additional devices and depicts a spatial relationship of each of the additional devices relative to the client device at the user location, the additional devices comprising one or more of medical diagnostic devices, medical treatment devices, or laboratory equipment,

process inputs from a live help provider using the live help provider graphical user interface, wherein each input specifies one of the respective provider graphical representations of the additional devices as being referenced; and

transmit instructions to the client device, each instruction being configured to cause a respective indicator to be displayed at a graphical user interface of the client device, the graphical user interface of the client device depicting respective client graphical representations of the additional devices in a manner that depicts the spatial relationship of each of the additional devices relative to the client device at the user location, the instructions corresponding, respectively, to the inputs from a live help provider, such that each respective indicator specifies one of the respective client graphical representations of the additional devices at the graphical user interface of the client device, thereby spatially indicating which of the additional devices the user is being instructed to operate.

9. The system of claim 8 , wherein the instructions are further configurable to cause the system to display one or more live help elements at the graphical user interface of the client device, the one or more live help elements appearing as though the graphical user interface of the client device were a transparent or semitransparent window and the live help provider were touching, gesturing, or indicating from an opposite side of the window.

10. The system of claim 8 , wherein the instructions are further configurable to cause receiving the one or more inputs from the live help provider from one or more of: a pointing device, a gesturing device, a keyboard, a motion capture device, and an imaging device.

11. The system of claim 10 , wherein the motion capture device includes one or more of: a camera, a proximity sensor, a smart glove, a sonar, and an echolocation sensor.

12. The system of claim 8 , wherein the live help provider is one or both of a remote human assistant and an automated help service.

13. The system of claim 8 , wherein the instructions are further configurable to cause the system to present, at the live help provider graphical user interface, a virtual reality environment, the virtual reality environment configured to allow the live help provider to indicate one or more actions corresponding to the additional devices at the location of the user.

14. The system of claim 8 , wherein the additional devices are selected from the group consisting of medical devices, diagnostic devices, laboratory devices, and research devices.

15. A computer program product comprising a non-transitory computer-readable medium and computer-readable program code capable of being executed by one or more processors when retrieved from the non-transitory computer-readable medium, the program code comprising instructions configurable to cause:

displaying a live help provider graphical user interface depicting a provider graphical representation of a client device located at a user location and respective provider graphical representations of additional devices located at the user location in a manner that identifies each of the additional devices and depicts a spatial relationship of each of the additional devices relative to the client device at the user location, the additional devices comprising one or more of medical diagnostic devices, medical treatment devices, or laboratory equipment;

processing inputs from a live help provider using the live help provider graphical user interface, wherein each input specifies one of the respective provider graphical representations of the additional devices as being referenced; and

transmitting instructions to the client device, each instruction being configured to cause a respective indicator to be displayed at a graphical user interface of the client device, the graphical user interface of the client device depicting respective client graphical representations of the additional devices in a manner that depicts the spatial relationship of each of the additional devices relative to the client device at the user location, the instructions corresponding, respectively, to the inputs from a live help provider, such that each respective indicator specifies one of the respective client graphical representations of the additional devices at the graphical user interface of the client device, thereby spatially indicating which of the additional devices is the user is being instructed to operate.

16. The computer program product of claim 15 , wherein the instructions are further configurable to cause displaying one or more live help elements at the graphical user interface of the client device, the one or more live help elements appearing as though the graphical user interface of the client device were a transparent or semitransparent window and the live help provider were touching, gesturing, or indicating from the opposite side of the window were touching, gesturing, or indicating from the opposite side of the window.

17. The computer program product of claim 15 , wherein the instructions are further configurable to cause receiving the one or more inputs from the live help provider from one or more of: a pointing device, a gesturing device, a keyboard, a motion capture device, and an imaging device.

18. The computer program product of claim 15 , wherein the live help provider is one or both of a remote human assistant and an automated help service.

19. The computer program product of claim 15 , wherein the instructions are further configurable to cause presenting, at the live help provider graphical user interface, a virtual reality environment, the virtual reality environment configured to allow the live help provider to indicate one or more actions corresponding to the additional devices at the location of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2022
From: KING, DAVID; PARK, CHUNGOO CHARLES
To: INTEGENX, INC.
Reel/Frame 058633/0543 →
Continuity (4)
Continuation 16941169 · Jul 28, 2020
Continuation 15761066
Provisional Application 62222485 · Sep 23, 2015
Related Publication 20220137993A1 · May 5, 2022