IP Library Granted Patent US 11,464,484
Granted Patent B2
US 11,464,484 · App. 16/135,617 · Granted Oct 11, 2022

Systems and methods of establishing a communication session for live review of ultrasound scanning

Inventors: Julien Lemaitre (Vancouver, CA); Kris Dickie (Vancouver, CA); Laurent Pelissier (North Vancouver, CA); Trevor Stephen Hansen (North Vancouver, CA)
Assignee: Clarius Mobile Health Corp.
A61B8/4427A61B8/467H04L51/224H04L67/55H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,464,484
App. No.
16/135,617
Granted
Oct 11, 2022
Kind
B2
Abstract

An application running in a mobile device displays an ultrasound image obtained by a connected ultrasound scanner. A button is displayed on the device, which, when activated, automatically connects the device to a remote reviewer in a virtual videoconferencing room, without the operator of the scanner needing to input user credentials. Upon activating the button, or otherwise triggering the request for a review, pre-stored login credentials are automatically retrieved and used for connecting the operator to the room. The remote reviewer may be connected to the room upon accepting the request for review, without having to input user credentials, which are pre-stored and automatically retrieved.

Claims (76)

1. A method for establishing a communication session for live review of ultrasound scanning, the method:

a mobile device displaying an ultrasound image obtained by a scanner connected to the mobile device;

the mobile device receiving a single input to initiate the communication session for live review of the ultrasound image obtained by the scanner connected to the mobile device;

in response to receipt of the single input, the mobile device sending a request for review to a server;

the mobile device receiving connection information from the server for connecting to a virtual room, the connection information comprising a virtual room identifier and a network location that allows for entrance into the virtual room by any computing device, the mobile device not having connection information for the virtual room prior to receipt of the single input;

the server retrieving a list of live responding reviewers and sending, in response to the request, a notification to each of a plurality of responding computing devices, the notification comprising the connection information for the virtual room for the plurality of responding computing devices to connect to the virtual room;

the mobile device connecting to the virtual room using the connection information for the virtual room;

a responding computing device, of the plurality of responding computing devices, connecting to the virtual room using the connection information for the virtual room without requiring further input of connection information after receipt of an input responding to the notification at the responding computing device;

upon the responding computing device using the connection information to also connect to the virtual room, the mobile device connecting to the responding computing device via the virtual room;

the mobile device transmitting the ultrasound image to the virtual room, and the ultrasound image is provided to the responding computing device via the virtual room; and

the mobile device outputting audio signals received, via the virtual room, from the responding computing device.

2. The method of claim 1 , wherein the mobile device connects to the virtual room without requiring further input after receipt of the single input.

3. The method of claim 1 , wherein the single input is a single tap on a button displayed by an application on the mobile device.

4. The method of claim 1 , wherein the connection information for connecting to the virtual room further comprises login credentials to the virtual room.

5. The method of claim 1 , further comprising:

capturing, by a camera of the mobile device, a live video of the scanner connected to the mobile device; and

merging a video stream of the camera with a video stream of the ultrasound image;

wherein transmitting the ultrasound image to the virtual room is achieved by transmitting the merged video streams to the virtual room.

6. The method of claim 5 , further comprising:

receiving, at the responding computing device, the merged video streams; and

displaying, concurrently on the responding computing device, the ultrasound image and the live video of the scanner connected to the mobile device.

7. The method of claim 1 , further comprising establishing a two-way audio connection between the mobile device and the responding computing device.

8. The method of claim 1 , further comprising:

capturing, by a supplementary camera connected to the mobile device, a live video of a scanner connected to the mobile device; and

merging a video stream of the supplementary camera with a video stream of the ultrasound image;

wherein transmitting the ultrasound image to the virtual room is achieved by transmitting the merged video streams to the virtual room.

9. The method of claim 1 , further comprising:

displaying a live video image from the responding computing device on the mobile device; and

displaying a live video image from the mobile device on the responding computing device.

10. The method of claim 1 , wherein the connection information for connecting to the virtual room is also provided as configuration data that is provisioned at the mobile device before an application for displaying the ultrasound image obtained by the scanner is initialized at the mobile device.

11. The method of claim 1 , further comprising:

receiving, at the mobile device, from the responding computing device, coordinates of a point on the ultrasound image; and

displaying a cursor on the ultrasound image displayed on the mobile device, at the coordinates.

12. A system for establishing a communication session for live review of ultrasound scanning, the system comprising:

a server;

an ultrasound scanner;

a mobile device connected to the server and ultrasound scanner; and

a responding computing device capable of being connected to the server;

wherein the mobile device is configured to:

display an ultrasound image obtained by the scanner;

receive a single input to initiate the communication session for live review of the ultrasound image obtained by the scanner connected to the mobile device;

in response to single input, send a request for review to the server, wherein the server retrieves a list of live responding reviewers and the server is configured to send, in response to the request, a notification to each of a plurality of responding computing devices, the notification comprising the connection information for the virtual room;

receive connection information from the server for connecting to a virtual room, the connection information comprising a virtual room identifier and a network location that allows for entrance into the virtual room by any computing device, the mobile device not having the connection information prior to receipt of the single input, wherein a responding computing device of the plurality of responding computing devices connects to the virtual room using the connection information for the virtual room without requiring further input of connection information after receipt of an input responding to the notification at the responding computing device;

connect the mobile device to the virtual room using the connection information for the virtual room;

upon the responding computing device using the connection information to also connect to the virtual room, connect the mobile device to the responding computing device via the virtual room;

transmit the ultrasound image to the virtual room, and the ultrasound image is provided to the responding computing device via the virtual room; and

output audio signals received, via the virtual room, from the responding computing device.

13. The system of claim 12 , wherein:

the mobile device connects to the virtual room without requiring further input after receipt of the single input;

the single input is a one-click input on the mobile device;

the connection information for connecting to the virtual room further comprises login credentials to the virtual room;

wherein the connection between the mobile device and the responding computing device comprises:

a one-way video link from the mobile device to the responding computing device, which carries the ultrasound image and a video captured by a camera of the mobile device; and

a two-way audio link that permits audio interaction between the mobile device and the responding computing device.

14. The system of claim 12 , comprising a supplementary camera connected to the mobile device, wherein the mobile device is configured to:

merge a video stream of the supplementary camera with a video stream of the ultrasound image; and

transmit the ultrasound image to the virtual room by transmitting the merged video streams to the virtual room.

15. The system of claim 12 , wherein the server comprises a main server, a push notification server, and a web real-time communication server, wherein:

the main server is configured to:

obtain the connection information from a database;

receive the request for review; and

transmit a notification request to a push notification server;

the push notification server is configured to:

receive the notification request; and

transmit a notification to each of the plurality of responding computing devices,

the notification comprising the connection information for the virtual room; and

the web real-time communication server is configured to provide the virtual room.

16. Non-transitory computer readable media for establishing a communication session for live review of ultrasound scanning, the media comprising computer-readable instructions, which, when executed by one or more processors on a mobile device, configures the mobile device to:

display an ultrasound image obtained by a scanner connected to the mobile device;

receive a single input to initiate the communication session for live review of the ultrasound image obtained by the scanner connected to the mobile device;

in response to receipt of the single input, send a request for review to a server, wherein the server retrieves a list of live responding reviewers and is configured to send, in response to the request, a notification to each of a plurality of responding computing devices, the notification comprising the connection information for the virtual room;

receive connection information from the server for connecting to a virtual room, the connection information comprising a virtual room identifier and a network location that allows for entrance into the virtual room by any computing device, the mobile device not having the connection information prior to receipt of the single input wherein a responding computing device of the plurality of responding computing devices connects to the virtual room using the connection information for the virtual room without requiring further input of connection information after receipt of an input responding to the notification at the responding computing device;

connect the mobile device to the virtual room using the connection information for the virtual room;

upon the responding computing device using the connection information to also connect to the virtual room, connect the mobile device to the responding computing device via the virtual room;

transmit the ultrasound image to the virtual room, and the ultrasound image is provided to the responding computing device via the virtual room; and

output audio signals received, via the virtual room, from the responding computing device.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE STATE/COUNTRY OF THE RECEIVING PARTY PREVIOUSLY RECORDED AT REEL: 047237 FRAME: 0379. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Nov 15, 2018
From: LEMAITRE, JULIEN; DICKIE, KRIS; PELISSIER, LAURENT; HANSEN, TREVOR STEPHEN
To: CLARIUS MOBILE HEALTH CORP.
Reel/Frame 047578/0446 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2018
From: LEMAITRE, JULIEN; DICKIE, KRIS; PELISSIER, LAURENT; HANSEN, TREVOR STEPHEN
To: CLARIUS MOBILE HEALTH CORP.
Reel/Frame 047237/0379 →
Continuity (1)
Related Publication 20200085408A1 · Mar 19, 2020
Cited By (2)
US 12,521,095 US 12,551,191