IP Library Granted Patent US 10,376,336
Granted Patent B2
US 10,376,336 · App. 15/799,470 · Granted Aug 13, 2019

Touchless advanced image processing and visualization

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,376,336
App. No.
15/799,470
Granted
Aug 13, 2019
Kind
B2
Abstract

A server receives a request from a client device initiated from a user operating the client device. The server determines a user action identifier (ID) based on the request, the user action ID identifying a user physical action that was captured by one or more sensors. One or more image processing commands are determined based on the user action ID in view of a first medical image currently displayed at the client device. An image processing operation is performed based on the first medical image by executing the one or more image processing commands, generating a second medical image. The second medical image is transmitted to the client device to be presented to the user at the client device.

Claims (50)

1. A computer-implemented method for medical image processing, the method comprising:

displaying a first medical image at a display device of a client device, wherein the first medical image was received from an image processing server over a network;

receiving, by a gesture control module hosted by the client device, a signal from one or more sensors;

determining, by the gesture control module, a user action of a user based on the signal, the user action representing a physical action of the user;

determining, by a command processing module, whether the user action is valid in view of the first medical image, including

performing a lookup operation in an action data structure to determine whether the user action is listed in the action data structure, and

in response to determining that the user action is not listed in the action data structure, presenting a message to the user indicating that the user action is invalid;

in response to determining that the user action is valid, transmitting a request to the image processing server over the network, the request including a user action identifier (ID) identifying the user action and an optional image ID identifying the first medical image;

receiving a second medical image from the image processing server, wherein the second medical image was generated by the image processing server by performing one or more image processing operations that were determined based on the user action ID and the image ID of the first medical image; and

displaying the second medical image at the display device of the client device.

2. The method of claim 1 , wherein the image processing operation comprises performing a measurement based on one or more landmarks of the first medical image, and wherein the second medical image represents a result of the measurement based on the first medical image.

3. The method of claim 1 , wherein the one or more sensors comprise at least one of a microphone, a camera, an infrared sensor, or a motion detector, and wherein the user action was performed without physically touching the client device.

4. The method of claim 1 , wherein the request further comprises one or more landmarks associated with the first medical image currently displayed at the client device.

5. The method of claim 1 , wherein the action data structure contains a list of predetermined actions that have been configured as valid for the first medical image.

6. The method of claim 1 , wherein the image processing server is configured to determine one or more image processing commands based on the user action ID, including

performing a lookup operation in an action to command (action/command) mapping data structure based on one or more landmarks of the first medical image to identify a first set of one or more image processing commands; and

determining a second set of one or more image processing commands from the first set based on the user action ID.

7. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform a method for medical image processing, the method comprising:

displaying a first medical image at a display device of a client device, wherein the first medical image was received from an image processing server over a network;

receiving, by a gesture control module hosted by the client device, a signal from one or more sensors;

determining, by the gesture control module, a user action of a user based on the signal, the user action representing a physical action of the user;

determining, by a command processing module, whether the user action is valid in view of the first medical image, including

performing a lookup operation in an action data structure to determine whether the user action is listed in the action data structure, and

in response to determining that the user action is not listed in the action data structure, presenting a message to the user indicating that the user action is invalid;

in response to determining that the user action is valid, transmitting a request to the image processing server over the network, the request including a user action identifier (ID) identifying the user action and an optional image ID identifying the first medical image;

receiving a second medical image from the image processing server, wherein the second medical image was generated by the image processing server by performing one or more image processing operations that were determined based on the user action ID and the image ID of the first medical image; and

displaying the second medical image at the display device of the client device.

8. The machine-readable medium of claim 7 , wherein the image processing operation comprises performing a measurement based on one or more landmarks of the first medical image, and wherein the second medical image represents a result of the measurement based on the first medical image.

9. The machine-readable medium of claim 7 , wherein the one or more sensors comprise at least one of a microphone, a camera, an infrared sensor, or a motion detector, and wherein the user action was performed without physically touching the client device.

10. The machine-readable medium of claim 7 , wherein the request further comprises one or more landmarks associated with the first medical image currently displayed at the client device.

11. The machine-readable medium of claim 7 , wherein the action data structure contains a list of predetermined actions that have been configured as valid for the first medical image.

12. The machine-readable medium of claim 7 , wherein the image processing server is configured to determine one or more image processing commands based on the user action ID, including

performing a lookup operation in an action to command (action/command) mapping data structure based on one or more landmarks of the first medical image to identify a first set of one or more image processing commands; and

determining a second set of one or more image processing commands from the first set based on the user action ID.

13. A data processing system, comprising:

a processor; and

a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform a method, the method including

displaying a first medical image at a display device of a client device, wherein the first medical image was received from an image processing server over a network,

receiving, by a gesture control module hosted by the client device, a signal from one or more sensors,

determining, by the gesture control module, a user action of a user based on the signal, the user action representing a physical action of the user, including

performing a lookup operation in an action data structure to determine whether the user action is listed in the action data structure, and

in response to determining that the user action is not listed in the action data structure, presenting a message to the user indicating that the user action is invalid,

determining, by a command processing module, whether the user action is valid in view of the first medical image,

in response to determining that the user action is valid, transmitting a request to the image processing server over the network, the request including a user action identifier (ID) identifying the user action and an optional image ID identifying the first medical image,

receiving a second medical image from the image processing server, wherein the second medical image was generated by the image processing server by performing one or more image processing operations that were determined based on the user action ID and the image ID of the first medical image, and

displaying the second medical image at the display device of the client device.

14. The system of claim 13 , wherein the image processing operation comprises performing a measurement based on one or more landmarks of the first medical image, and wherein the second medical image represents a result of the measurement based on the first medical image.

15. The system of claim 13 , wherein the one or more sensors comprise at least one of a microphone, a camera, an infrared sensor, or a motion detector, and wherein the user action was performed without physically touching the client device.

16. The system of claim 13 , wherein the request further comprises one or more landmarks associated with the first medical image currently displayed at the client device.

17. The system of claim 13 , wherein the action data structure contains a list of predetermined actions that have been configured as valid for the first medical image.

Assignments (2)
SECURITY INTEREST Recorded Apr 4, 2022
From: CONCERTAI LLC; PROMTERICS, LLC; TERARECON, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 059495/0334 →
SECURITY INTEREST Recorded Mar 6, 2020
From: TERARCON, INC.
To: OXFORD FINANCE LLC
Reel/Frame 052115/0187 →