IP Library › Granted Patent US 12,191,033
Granted Patent B2
US 12,191,033 · App. 17/126,000 · Granted Jan 7, 2025

Monitoring system for monitoring a patient and method for operating the monitoring system

Inventors: Marcus Pfister (Bubenreuth, DE); Martin Berger (Erlangen, DE)
Assignee: Siemens Healthineers AG
G16H40/67A61B5/165A61B5/741A61M21/00G06N20/00G06T11/00G10L21/007G16H20/70G16H50/30G16H80/00A61M2021/0027A61M2021/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,191,033
App. No.
17/126,000
Filed
Dec 17, 2020
Granted
Jan 7, 2025
Kind
B2
Examiner
ZHAI, KYLE
Art Unit
2612
USPC
345/632
Abstract

For particularly good communication even with difficult patients, a monitoring system for monitoring a patient, such as during a medical diagnostic or therapeutic procedure, is provided. The monitoring system includes a voice cloning device having a voice generator. The voice cloning device is configured to replace a natural voice of a person with a cloned synthetic voice different from the voice of the person. At least two synthetic voices may be selected. The monitoring system also includes a measuring unit configured to record at least one physiological parameter of the patient, an evaluation unit configured to evaluate the at least one measured physiological parameter of the patient, and an actuation unit configured to actuate the voice cloning device such that a synthetic voice is selected or rejected depending on a result of the evaluation by the evaluation unit.

Claims (36)

1. A monitoring system for monitoring a patient, the monitoring system comprising:

a voice cloning device including a voice generator, the voice cloning device being configured to:

replace a natural voice of a person with a first cloned synthetic voice different from the natural voice of the person, the first cloned synthetic voice being selectable from at least two cloned synthetic voices; and

output the first cloned synthetic voice;

a measuring unit configured to record at least one physiological parameter of the patient during operation of the voice cloning device using the first cloned synthetic voice;

an evaluation unit configured to evaluate the at least one physiological parameter of the patient; and

an actuation unit configured to actuate the voice cloning device such that the first cloned synthetic voice is selected or rejected depending on a result of the evaluation of the at least one physiological parameter of the patient by the evaluation unit,

wherein the evaluation of the at least one physiological parameter of the patient comprises comparison of the at least one physiological parameter with at least one threshold value, and

wherein the actuation of the voice cloning device takes place such that the first cloned synthetic voice is selected when the evaluation of the at least one physiological parameter indicates that a threshold value of the at least one threshold value for the at least one physiological parameter is not exceeded, and that the first cloned synthetic voice is rejected when the evaluation of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is exceeded.

2. The monitoring system of claim 1 , wherein the actuation unit is further configured to actuate the voice cloning device such that a second cloned synthetic voice of the at least two cloned synthetic voices that does not cause the threshold value to be exceeded is selected or a third cloned synthetic voice of the at least two cloned synthetic voices that causes the threshold value to be exceeded is rejected.

3. The monitoring system of claim 1 , wherein the first cloned synthetic voice has been generated using a pre-trained algorithm for machine learning.

4. The monitoring system of claim 3 , wherein pre-training of the algorithm was carried out by speech samples of persons known to the patient.

5. The monitoring system of claim 1 , wherein the measuring unit is further configured to measure a physiological parameter that is usable as an indicator for a state of mind of the patient, and

wherein the evaluation unit is further configured to evaluate the physiological parameter with respect to the state of mind of the patient.

6. The monitoring system of claim 1 , wherein the at least one physiological parameter is constituted by blood pressure, pulse, or EEG.

7. The monitoring system of claim 1 , wherein the actuation unit is further configured to actuate the voice cloning device such that a second cloned synthetic voice of the least two cloned synthetic voices that produces a positive state of mind is selected or a third cloned synthetic voice of the least two cloned synthetic voices that produces a negative state of mind is rejected.

8. A method for operating a monitoring system for monitoring a patient, the monitoring system comprising a voice cloning device, the voice cloning device including a voice generator and being configured to replace a natural voice of a person with a first cloned synthetic voice different from the natural voice of the person, and output the first cloned synthetic voice, the method comprising:

activating the voice cloning device, wherein the first synthetic voice is set;

recording, by a measuring unit of the monitoring system, at least one physiological parameter of the patient during operation of the voice cloning device using the first synthetic voice;

evaluating, by an evaluation unit of the monitoring system, the at least one physiological parameter of the patient for the first synthetic voice;

automatically actuating, by an actuation unit of the monitoring system, the voice cloning device depending on a result of the evaluating of the at least one physiological parameter of the patient;

measuring and evaluating at least one physiological parameter for at least one second synthetic voice; and

depending on the evaluating of the at least one physiological parameter for the at least one second synthetic voice, selecting a synthetic voice from the first synthetic voice and the at least one second synthetic voice for further operation of the voice cloning device.

9. The method of claim 8 , wherein, depending on the result of the evaluating by the evaluation unit, the first synthetic voice is selected or rejected for further operation of the voice cloning device.

10. The method of claim 8 , wherein evaluating the at least one physiological parameter of the patient comprises comparing the at least one physiological parameter with at least one threshold value.

11. The method of claim 10 , wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the evaluating of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is not exceeded, and that the first synthetic voice is rejected when the evaluating of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is exceeded.

12. The method of claim 8 , wherein evaluating the at least one physiological parameter comprises evaluating the at least one physiological parameter with respect to a state of mind of the patient.

13. The method of claim 12 , wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the first synthetic voice produces a positive state of mind in the patient, and that the first synthetic voice is rejected when the first synthetic voice produces a negative state of mind.

14. The method of claim 12 , wherein the synthetic voice that produces a most positive state of mind in the patient is selected.

15. A method for operating a monitoring system for monitoring a patient, the method comprising:

activating a voice cloning device of the monitoring system, such that a first synthetic voice is set, the voice cloning device comprising a voice generator and being configured to replace a natural voice of a person with the first synthetic voice, which is different than the natural voice of the person, and output the first synthetic voice, the first synthetic voice being selectable from at least two synthetic voices;

recording, by a measuring unit of the monitoring system, the at least one physiological parameter of the patient during operation of the voice cloning device using the first synthetic voice;

evaluating, by an evaluation unit of the monitoring system, the at least one physiological parameter of the patient; and

automatically actuating, by an actuation unit of the monitoring system, the voice cloning device depending on a result of the evaluating,

wherein evaluating the at least one physiological parameter of the patient comprises comparing the at least one physiological parameter with at least one threshold value, and

wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the evaluating of the at least one physiological parameter indicates that a threshold value of the at least one threshold value for the at least one physiological parameter is not exceeded, and that the first synthetic voice is rejected when the evaluating of the at least one physiological parameter indicates that the threshold value for the at least one physiological parameter is exceeded.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2021
From: PFISTER, MARCUS; BERGER, MARTIN
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 056564/0267 →
Priority Claims (1)
DE 10 2019 220 224.1 · Dec 19, 2019 · national
Continuity (1)
Related Publication 20210186339A1 · Jun 24, 2021
References Cited (33)
US 5356287A · Mcintyre · 1994 [cited by applicant]
US 5676633A · August · 1997 [cited by applicant]
US 5917414A · Oppelt et al. · 1999 [cited by applicant]
US 10827961B1 · Iyengar · 2020 [cited by examiner]
US 20040130449A1 · Hung · 2004 [cited by examiner]
US 20070176920A1 · Raijmakers et al. · 2007 [cited by applicant]
US 20080281164A1 · Stebor et al. · 2008 [cited by applicant]
US 20130231581A1 · Kaellstrand · 2013 [cited by applicant]
US 20180137875A1 · Liu · 2018 [cited by examiner]
US 20200281532A1 · Davis · 2020 [cited by examiner]
US 20200410976A1 · Zhou · 2020 [cited by examiner]
CN 1886170A · 2006 [cited by applicant]
CN 101923669A · 2010 [cited by applicant]
CN 102178540A · 2011 [cited by applicant]
CN 103298398A · 2013 [cited by applicant]
CN 103996155A · 2014 [cited by applicant]
CN 204840598U · 2015 [cited by applicant]
CN 109830304A · 2019 [cited by applicant]
DE 19637383A1 · 1998 [cited by applicant]
DE 102004001801A1 · 2005 [cited by applicant]
DE 102016219157A1 · 2017 [cited by applicant]
DE 102017220500A1 · 2019 [cited by applicant]
JP 2009020794A · 2009 [cited by applicant]
JP 2018121967A · 2018 [cited by applicant]
KR 20140099569A · 2014 [cited by applicant]
TW 201801678A · 2018 [cited by applicant]
WO 2015158017A1 · 2015 [cited by applicant]
Arik, Sercan, et al. “Neural voice cloning with a few samples.” Advances in Neural Information Processing Systems 31 (2018): 1-18. [cited by applicant]
Kietzmann, Jan, et al. “Deepfakes: Trick or treat?. ” Business Horizons 63.2 (2020): 135-146. [cited by applicant]
Samantha Cole “This AI only needs a 3.7-second recording to clone your voice.” VICE online magazine, 2018.https://www.vice.com/de/article/3k7mgn/diese-ki-braucht-nur-eine-37-sekunden-lange-aufnahme-dann-klont-sie-eure-s… [cited by applicant]
Solsman, E. J. “Samsung deepfake AI could fabricate a video of you from a single profile pic.” (May 2019). pp. 1-6. [cited by applicant]
Thies, Justus, et al. “Face2face: Real-time face capture and reenactment of rgb videos.” Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. pp. 1-9. [cited by applicant]
Thies, Justus, et al. “Headon: Real-time reenactment of human portrait videos.” ACM Transactions on Graphics (TOG) 37.4 (2018): 1-13. [cited by applicant]