IP Library › Granted Patent US 10,976,806
Granted Patent B1
US 10,976,806 · App. 16/728,758 · Granted Apr 13, 2021

Methods and systems for immersive reality in a medical environment

Inventors: Laurence Vancamberg (Poissy, FR); Caroline DeCock (Jouy en Josas, FR); Ludovic Avot (Croissy sur Seine, FR); Serge Muller (Buc, FR); Julie Manzano (Malakoff, FR)
Assignee: GE Precision Healthcare LLC
G06F3/011A61B5/0091A61B5/01A61B5/6803G06F3/04815G06F3/16A61B2562/0271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,976,806
App. No.
16/728,758
Granted
Apr 13, 2021
Kind
B1
Abstract

Embodiments are disclosed herein for providing an immersive reality experience to a patient during a medical procedure. In one example, a method includes determining a location of a stressful object in a medical environment that includes a patient undergoing a medical procedure. The method further includes, upon determining that the stressful object is in a field of view (FOV) of the patient, adjusting display content based on the location of the stressful object within the FOV and outputting the display content for display on an immersive device.

Claims (39)

1. A method, comprising:

determining a location of a stressful object in a medical environment that includes a patient undergoing a medical procedure;

upon determining that the stressful object is in a field of view (FOV) of the patient, adjusting display content based on the location of the stressful object within the FOV; and

outputting the display content for display on an immersive device;

wherein the display content includes one or more virtual objects positioned based on a position of the stressful object relative to the patient and wherein the display content is further updated based on patient anxiety.

2. The method of claim 1 , wherein determining the location of the stressful object comprises determining the location of the stressful object based on image information received from an image sensor and/or based on RFID information received from an RFID reader, and further comprising receiving user input identifying the stressful object.

3. The method of claim 1 , wherein determining the location of the stressful object comprises determining the location of the stressful object based on a current phase of the medical procedure, the current phase of the medical procedure determined based on output from a medical device used to carry out the medical procedure.

4. The method of claim 1 , further comprising determining the FOV of the patient based on output received from the immersive device, and determining that the stressful object is in the FOV of the patient based on the determined FOV and the determined location of the stressful object.

5. The method of claim 1 , wherein adjusting the display content comprises inpainting the display content so that the stressful object appears, to the patient, to be removed from the FOV.

6. The method of claim 1 , further comprising determining that a stressful sound associated with the medical procedure is occurring or about to occur, and in response, adjusting sound output by one or more loudspeakers in the medical environment.

7. The method of claim 1 , further comprising determining that a perceived temperature of the patient is outside a desired range, and in response, further adjusting the display content based on whether the perceived temperature is above or below the desired range.

8. A system, comprising:

a medical device configured to be utilized during a medical procedure on a patient;

an immersive device configured to be worn by the patient during the medical procedure;

a memory storing instructions; and

a processor communicably coupled to the medical device, the immersive device, and the memory, and when executing the instructions, configured to:

receive output from the medical device;

determine that a selected phase of the medical procedure is about to occur based on the output from the medical device;

generate display content based on the selected phase of the medical procedure; and

output the display content to the immersive device;

wherein the medical device is a digital mammography machine, and wherein determining that the selected phase of the medical procedure is about to occur based on the output from the medical device includes determining that delivery of local anesthetic or biopsy needle insertion is about to occur based the output from the digital mammography machine indicating that a biopsy target has been located.

9. The system of claim 8 , wherein the display content includes inpainting based on a position of a real-world stressful object relative to the patient such that an estimated background is displayed on the position of the real-world stressful object.

10. The system of claim 8 , wherein the display content includes one or more virtual objects positioned based on a position of a real-world stressful object relative to the patient and wherein the display content is further updated based on patient anxiety.

11. The system of claim 10 , wherein the real-world stressful object is a needle and wherein the one or more virtual objects of the display content include a first virtual object positioned to obscure the needle from a field of view of the patient.

12. The system of claim 10 , wherein the position of the real-world stressful object is determined based on the determination that the selected phase of the medical procedure is about to occur and/or based on feedback from the medical device.

13. The system of claim 8 , further comprising a temperature sensor configured to measure a skin temperature of the patient, and wherein the processor, when executing the instructions, is configured to adjust the display content based on the skin temperature of the patient.

14. A system, comprising:

a heat lamp positioned above a patient during a medical procedure;

a sensor;

a memory storing instructions;

a processor communicably coupled to the heat lamp, the sensor, and the memory, and when executing the instructions, configured to:

receive output from the sensor;

determine if a perceived temperature of the patient is outside of a desired range based on the output from the sensor;

if the perceived temperature of the patient is outside of the desired range, adjust a heat output of the heat lamp;

the system further comprises an immersive device configured to be worn by the patient during the medical procedure, and wherein the processor, when executing the instructions, is configured to adjust display content output to the immersive device if the perceived temperature of the patient is outside of the desired range; and

wherein the display content includes one or more virtual objects positioned based on a position of a stressful object relative to the patient and wherein the display content is further updated based on patient anxiety.

15. The system of claim 14 , wherein the instructions are executable to determine the perceived temperature of the patient based on natural language processing (NLP).

16. The system of claim 14 , wherein the location of the stressful object is determined based on image information received from an image sensor and/or based on RFID information received from an RFID reader.

17. The system of claim 16 , wherein adjusting the display content comprises adjusting the display content to include one or more virtual objects positioned based on the location of the stressful object and/or wherein adjusting the display content comprises diminishing the stressful object via inpainting.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2019
From: VANCAMBERG, LAURENCE; DECOCK, CAROLINE; AVOT, LUDOVIC; MULLER, SERGE; MANZANO, JULIE
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 051378/0422 →
Cited By (3)
US 12,208,213 US 12,465,304 US 12,573,188