IP Library Granted Patent US 12,419,493
Granted Patent B2
US 12,419,493 · App. 18/442,533 · Granted Sep 23, 2025

Automatically controlling an on/off state of a light source for an endoscope during a surgical procedure in an operating room

Inventor: Jagadish Venkataraman (Menlo Park, CA)
Assignee: Verb Surgical Inc.
A61B1/00036A61B1/00006G06T7/70H04N23/74H04N23/88A61B1/063A61B1/0684G06T2207/10016G06T2207/10068G06T2207/20081G06T2207/30196G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,419,493
App. No.
18/442,533
Granted
Sep 23, 2025
Kind
B2
Abstract

An endoscope system capable of automatically turning on/off a light source during a surgical procedure is disclosed. This endoscope system includes: an endoscope module; a light source module coupled to the endoscope module; and a light-source control module. Moreover, the light-source control module controls an ON/OFF state of the light source by: (1) receiving real-time video images captured by the endoscope module; (2) processing the real-time video images to determine whether the endoscope module is inserted into a patient's body or is outside of the patient's body; and (3) in response to determining the endoscope module being outside of the patient's body while the light source is turned on, generating a control signal to immediately turn off the light source to the endoscope module, thereby ensuring safety of people in the operating room and preventing sensitive information in the operating room from being captured by the endoscope module.

Claims (30)

1. A computer-implemented method for controlling an on/off state of a light source of an endoscope during a surgical procedure, the method comprising:

receiving real-time video images captured by the endoscope;

determining, by a computer, a state of the endoscope, the state of the endoscope including a first state inside a patient's body or a second state outside the patient's body, wherein determining the state of the endoscope occurs when the light source is turned on and off;

detecting, by the computer, a transitional event based on the received real-time video images, wherein the transitional event includes a first transitional event from the second state to the first state, wherein detecting the transitional event based on the received real-time video images includes detecting the transitional event based on a single real-time video image or a sequence of real-time video images, wherein a machine-learning classifier identifies a correlation between the sequence of real-time video images and the transitional event; and

automatically generating, by the computer, a control signal upon detection of the transitional event, the control signal changing the on/off state of the light source.

2. The method of claim 1 , wherein determining the state of the endoscope includes applying a machine-learning classifier to classify the real-time video images as either a first class of real-time video images inside the patient's body or a second class of real-time video images outside the patient's body.

3. The method of claim 1 , wherein changing the on/off state of the light source in response to the first transitional event includes turning on the light source.

4. The method of claim 1 , wherein the transitional event further includes a second transitional event from the first state to the second state.

5. The method of claim 4 , wherein changing the on/off state of the light source in response to the second transitional event includes turning off the light source.

6. A non-transitory computer-readable medium to store instructions that, when executed by a processor of a computer system, cause the computer system to:

receive real-time video images captured by an endoscope;

determine a state of the endoscope, the state of the endoscope including a first state inside a patient's body or a second state outside the patient's body, wherein determining the state of the endoscope occurs when a light source of the endoscope is turned on and off;

detect a transitional event based on the received real-time video images, wherein the transitional event includes a first transitional event from the second state to the first state, wherein the processor executes the instructions to detect the transitional event based on the received real-time video images by detecting the transitional event based on a single real-time video image or a sequence of real-time video images, wherein a machine-learning classifier identifies a correlation between the sequence of real-time video images and the transitional event; and

automatically generate a control signal upon detection of the transitional event, the control signal changing an on/off state of the light source of the endoscope.

7. The non-transitory computer-readable medium of claim 6 , wherein the processor executes the instructions to determine the state of the endoscope by applying a machine-learning classifier to classify the real-time video images as either a first class of real-time video images inside the patient's body or a second class of real-time video images outside the patient's body.

8. The non-transitory computer-readable medium of claim 6 , wherein the processor executes the instructions to change the on/off state of the light source in response to the first transitional event by turning on the light source.

9. The non-transitory computer-readable medium of claim 6 , wherein the transitional event further includes a second transitional event from the first state to the second state.

10. The non-transitory computer-readable medium of claim 9 , wherein the processor executes the instructions to change the on/off state of the light source in response to the second transitional event by turning off the light source.

11. An endoscope system, comprising:

an endoscope camera module;

a light source module coupled to the endoscope camera module for providing a light source for the endoscope camera module; and

a light-source control module coupled to the endoscope camera module and the light source module, and configured to control an on/off state of the light source of an endoscope during a surgical procedure by:

receiving real-time video images captured by the endoscope;

determining a state of the endoscope, the state of the endoscope including a first state inside a patient's body or a second state outside the patient's body, wherein

determining the state of the endoscope occurs when the light source is turned on and off;

detecting a transitional event based on the received real-time video images, wherein the transitional event includes a first transitional event from the second state to the first state, wherein detecting the transitional event based on the received real-time video images includes detecting the transitional event based on a single real-time video image or a sequence of real-time video images, wherein a machine-learning classifier identifies a correlation between the sequence of real-time video images and the transitional event; and

automatically generating a control signal upon detection of the transitional event, the control signal changing the on/off state of the light source.

12. The endoscope system of claim 11 , wherein determining the state of the endoscope includes applying a machine-learning classifier to classify the real-time video images as either a first class of real-time video images inside the patient's body or a second class of real-time video images outside the patient's body.

13. The endoscope system of claim 11 , wherein changing the on/off state of the light source in response to the first transitional event includes turning on the light source.

14. The endoscope system of claim 11 , wherein the transitional event further includes a second transitional event from the first state to the second state, and changing the on/off state of the light source in response to the second transitional event by turning off the light source.

Assignments (1)
MERGER Recorded Jan 26, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073583/0666 →
Continuity (4)
Continuation 17721004 · Apr 14, 2022
Continuation 17037056 · Sep 29, 2020
Continuation 16440552 · Jun 13, 2019
Related Publication 20240260813A1 · Aug 8, 2024
References Cited (98)
US 4721359A · Nishioka · 1988 [cited by examiner]
US 6033426A · Kaji · 2000 [cited by applicant]
US 6154560A · Cothren et al. · 2000 [cited by applicant]
US 8493446B2 · Li · 2013 [cited by examiner]
US 8998802B2 · Gono · 2015 [cited by examiner]
US 10796147B1 · Hanna · 2020 [cited by examiner]
US 11067718B1 · Brett · 2021 [cited by examiner]
US 20020013512A1 · Sendai et al. · 2002 [cited by applicant]
US 20040054259A1 · Hasegawa et al. · 2004 [cited by applicant]
US 20040059215A1 · Nishimura et al. · 2004 [cited by applicant]
US 20070165932A1 · Nishimura et al. · 2007 [cited by applicant]
US 20070185384A1 · Bayer et al. · 2007 [cited by applicant]
US 20070191671A1 · Kawano et al. · 2007 [cited by applicant]
US 20070191677A1 · Nishimura et al. · 2007 [cited by applicant]
US 20070292011A1 · Nishimura et al. · 2007 [cited by applicant]
US 20080069400A1 · Zhu · 2008 [cited by examiner]
US 20080119691A1 · Yagi et al. · 2008 [cited by applicant]
US 20080278575A1 · Matsui · 2008 [cited by applicant]
US 20080312504A1 · Kimoto · 2008 [cited by applicant]
US 20090073260A1 · Nagase et al. · 2009 [cited by applicant]
US 20090196476A1 · Inoue · 2009 [cited by applicant]
US 20100272358A1 · Kanda · 2010 [cited by applicant]
US 20120147166A1 · Minetoma et al. · 2012 [cited by applicant]
US 20120262621A1 · Sato et al. · 2012 [cited by applicant]
US 20130028470A1 · Kanda · 2013 [cited by applicant]
US 20130116561A1 · Rothberg · 2013 [cited by examiner]
US 20140036259A1 · Kamee et al. · 2014 [cited by applicant]
US 20140052004A1 · D'Alfonso et al. · 2014 [cited by applicant]
US 20140187931A1 · Wood et al. · 2014 [cited by applicant]
US 20140206988A1 · Ramachandran et al. · 2014 [cited by applicant]
US 20140219062A1 · Rothberg · 2014 [cited by examiner]
US 20140243614A1 · Rothberg · 2014 [cited by examiner]
US 20140288365A1 · Henley et al. · 2014 [cited by applicant]
US 20150031990A1 · Boctor et al. · 2015 [cited by applicant]
US 20150283370A1 · Chae · 2015 [cited by examiner]
US 20150297807A1 · Leblanc et al. · 2015 [cited by applicant]
US 20150332196A1 · Stiller · 2015 [cited by examiner]
US 20150342443A1 · Tanabe et al. · 2015 [cited by applicant]
US 20160247043A1 · Rieutort-Louis · 2016 [cited by examiner]
US 20170032521A1 · Kubo · 2017 [cited by applicant]
US 20170071504A1 · Wang · 2017 [cited by applicant]
US 20170095297A1 · Richmond et al. · 2017 [cited by applicant]
US 20170100019A1 · Ikuma et al. · 2017 [cited by applicant]
US 20170144671A1 · Memani · 2017 [cited by examiner]
US 20170270368A1 · Gosch · 2017 [cited by examiner]
US 20170296032A1 · Li · 2017 [cited by applicant]
US 20170325670A1 · Koizumi et al. · 2017 [cited by applicant]
US 20180153381A1 · Wei et al. · 2018 [cited by applicant]
US 20180174311A1 · Kluckner et al. · 2018 [cited by applicant]
US 20180220873A1 · Tani · 2018 [cited by applicant]
US 20180253839A1 · Zur · 2018 [cited by applicant]
US 20180308235A1 · Yuan · 2018 [cited by examiner]
US 20180317758A1 · Okada · 2018 [cited by examiner]
US 20190011703A1 · Robaina et al. · 2019 [cited by applicant]
US 20190129026A1 · Sumi · 2019 [cited by examiner]
US 20190133416A1 · Henley et al. · 2019 [cited by applicant]
US 20190133519A1 · Gannot · 2019 [cited by examiner]
US 20190201129A1 · Shelton, IV · 2019 [cited by examiner]
US 20190204423A1 · O'Keeffe · 2019 [cited by examiner]
US 20190206053A1 · Ichiki · 2019 [cited by applicant]
US 20190207932A1 · Bud · 2019 [cited by examiner]
US 20190280025A1 · Sakakibara · 2019 [cited by applicant]
US 20190348452A1 · Ootsuka · 2019 [cited by applicant]
US 20190362221A1 · Ando et al. · 2019 [cited by applicant]
US 20200015925A1 · Scheib · 2020 [cited by examiner]
US 20200037864A1 · Ushiroda · 2020 [cited by examiner]
US 20200042925A1 · Ramani · 2020 [cited by examiner]
US 20200120293A1 · Gruev et al. · 2020 [cited by applicant]
US 20200196869A1 · Narayanan · 2020 [cited by examiner]
US 20200289223A1 · Denlinger · 2020 [cited by examiner]
US 20200363868A1 · Freiin von Kapri · 2020 [cited by examiner]
US 20200369468A1 · Searle · 2020 [cited by examiner]
US 20200387753A1 · Brill · 2020 [cited by examiner]
US 20210014412A1 · Miyatani · 2021 [cited by examiner]
US 20220005332A1 · Metzler · 2022 [cited by examiner]
CN 102551642A · 2012 [cited by applicant]
JP 08076029A · 1996 [cited by applicant]
JP 2002034911A · 2002 [cited by applicant]
JP 2010082041A · 2010 [cited by applicant]
KR 1020180138037A · 2018 [cited by applicant]
Advisory Action received for U.S. Appl. No. 17/721,004, mailed on Sep. 26, 2023, 3 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/037,056, mailed on Oct. 6, 2021, 7 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/721,004, mailed on May 25, 2023, 5 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2019/038606 mailed Dec. 23, 2021, 8 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2019/038606, dated Mar. 9, 2020. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/440,552, mailed on Feb. 13, 2020, 10 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/037,056, mailed on Jun. 18, 2021, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/721,004, mailed on Feb. 3, 2023, 12 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/440,552, mailed on Jul. 16, 2020, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/440,552, mailed on Jun. 8, 2020, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/037,056, mailed on Dec. 22, 2021, 8 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/037,056, mailed on Feb. 9, 2022, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/721,004, mailed on Nov. 2, 2023, 8 pages. [cited by applicant]
Search report IP.com. [cited by applicant]
Supplementary European Search Report and Search Opinion received for EP Application No. 19932924.4, mailed on May 12, 2023, 10 pages. [cited by applicant]
Office Action received for Korean Patent Application No. 10-2022-7000491, mailed on May 19, 2024, 21 pages (10 pages of English Translation and 11 pages of Original Document). [cited by applicant]
First Office Action received for Chinese Patent Application No. 201980097436.8, mailed on Apr. 18, 2025, 26 pages (16 pages of Original Document and 10 pages of English Translation). [cited by applicant]
Second Office Action received for Chinese Patent Application No. 201980097436.8, mailed on Jul. 22, 2025, 19 pages (7 pages of Original Document and 12 pages of English Translation). [cited by applicant]