IP Library Granted Patent US 12,408,823
Granted Patent B2
US 12,408,823 · App. 18/530,103 · Granted Sep 9, 2025

Method of alerting a user to off-screen events during surgery

Inventors: Tal Nir (Haifa, IL); Yehuda Pfeffer (Moshav Dvorah, IL)
Assignee: Asensus Surgical Europe S.a.r.l.
A61B1/00183A61B1/00009A61B1/0004A61B1/00045A61B1/0005A61B1/00188A61B1/045G02B13/06G02B23/243H04N23/58H04N23/60A61B90/37H04N23/555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,408,823
App. No.
18/530,103
Granted
Sep 9, 2025
Kind
B2
Abstract

An image of a field of view is captured by the endoscope and a portion of the image is displayed on a display. A popup image is generated and displayed upon image analysis identification of an occurrence of bleeding or motion of edges of an incision that is within the field of view, but outside the portion of the field of view displayed on the display.

Claims (16)

1. A method of alerting a user to events during surgery, comprising:

positioning an endoscope in a body cavity, the endoscope having a field of view,

capturing images of the body cavity using the endoscope;

selecting a portion of said field of view and displaying said portion of the field of view on the display;

analyzing, in real time, the images to identify a change of state of a tool disposed within the field of view but outside the portion of the field of view, said change of state being at least one of articulation of the tool, activation of the tool or deactivation of the tool,

upon image analysis identification of said change of state of a tool disposed within the field of view but outside the portion of said field of view, displaying an overlay on the portion of the field of view displayed on the display, wherein said overlay is positioned to indicate a location of the tool relative to the portion of the field of view.

2. The method of claim 1 , wherein the overlay comprises an image of said tool.

3. The method of claim 1 , wherein the overlay comprises an icon.

4. The method of claim 1 , wherein the change of state is activation of the tool.

5. The method of claim 1 , wherein the change of state is deactivation of the tool.

6. The method of claim 1 , wherein the change of state is articulation of the tool.

7. The method to claim 1 , wherein the method additionally comprises automatically digitally moving said portion of said field of view displayed on the display to maintain a predetermined object at the center of said portion of said field of view.

8. The method of claim 1 , wherein the method additionally comprises automatically digitally moving said portion of said field of view displayed on the display to maintain a predetermined horizon.

9. The method of claim 1 , wherein the method additionally comprises automatically digitally moving said portion of said field of view displayed on the display to maintain a predetermined object at a predetermined apparent size.

10. The method of claim 1 , wherein the method additionally comprises automatically selecting a portion of a field of view; removing distortion from said portion of the field of view, and displaying said portion of said field of view on the display.

11. The method of claim 1 , wherein the method additionally comprises combining a plurality of said images to form a display image, said display image selected from a group consisting of: a unitary two-dimensional display; a unitary three-dimensional display; a stereoscopic display and any combination thereof.

Assignments (4)
SECURITY INTEREST Recorded Dec 31, 2024
From: ASENSUS SURGICAL, INC.; ASENSUS SURGICAL US, INC.; ASENSUS SURGICAL EUROPE S.À R.L.; ASENSUS SURGICAL ITALIA S.R.L.
To: KARL STORZ SE & CO. KG
Reel/Frame 069795/0381 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2024
From: M.S.T. MEDICAL SURGERY TECHNOLOGIES LTD.
To: TRANSENTERIX EUROPE S.À.R.L.
Reel/Frame 067358/0258 →
CHANGE OF NAME Recorded May 9, 2024
From: TRANSENTERIX EUROPE S.À.R.L.
To: ASENSUS SURGICAL EUROPE S.À.R.L.
Reel/Frame 067358/0727 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2024
From: NIR, TAL; PFEFFER, YEHUDA
To: M.S.T. MEDICAL SURGERY TECHNOLOGIES LTD.
Reel/Frame 067345/0213 →
Continuity (6)
Continuation 18119259 · Mar 8, 2023
Continuation 17190310 · Mar 2, 2021
Continuation 15232836 · Aug 10, 2016
Continuation In Part PCTIL2015050345 · Mar 31, 2015
Provisional Application 62203936 · Aug 12, 2015
Related Publication 20240306897A1 · Sep 19, 2024
References Cited (58)
US 5185667A · Zimmermann · 1993 [cited by applicant]
US 5313306A · Kuban et al. · 1994 [cited by applicant]
US 5547455A · McKenna et al. · 1996 [cited by applicant]
US 5800341A · McKenna et al. · 1998 [cited by applicant]
US 5836869A · Kudo et al. · 1998 [cited by applicant]
US 6036637A · Kudo · 2000 [cited by applicant]
US 6192267B1 · Scherninski et al. · 2001 [cited by applicant]
US 6243131B1 · Martin · 2001 [cited by applicant]
US 6255746B1 · Takahashi et al. · 2001 [cited by applicant]
US 6387044B1 · Tachibana et al. · 2002 [cited by applicant]
US 6656110B1 · Irion et al. · 2003 [cited by applicant]
US 6930705B2 · Tanaka · 2005 [cited by applicant]
US 7136098B1 · Burnett et al. · 2006 [cited by applicant]
US 7684851B2 · Miyake et al. · 2010 [cited by applicant]
US 7833152B2 · Chatenever et al. · 2010 [cited by applicant]
US 8758234B2 · Hale et al. · 2014 [cited by applicant]
US 20030135092A1 · Cline et al. · 2003 [cited by applicant]
US 20080004603A1 · Larkin et al. · 2008 [cited by applicant]
US 20080108873A1 · Gattani et al. · 2008 [cited by applicant]
US 20080231692A1 · Higuchi et al. · 2008 [cited by applicant]
US 20090245600A1 · Hoffman et al. · 2009 [cited by applicant]
US 20090248036A1 · Hoffman et al. · 2009 [cited by applicant]
US 20100134264A1 · Nagamine · 2010 [cited by applicant]
US 20100217075A1 · Shigeta · 2010 [cited by applicant]
US 20110007129A1 · Martin et al. · 2011 [cited by applicant]
US 20110069160A1 · Ning · 2011 [cited by applicant]
US 20140031659A1 · Zhao et al. · 2014 [cited by applicant]
US 20140046131A1 · Morita et al. · 2014 [cited by applicant]
US 20140066703A1 · Blumenkranz et al. · 2014 [cited by applicant]
US 20140118551A1 · Ikeda et al. · 2014 [cited by applicant]
US 20140135792A1 · Larkin et al. · 2014 [cited by applicant]
US 20140194722A1 · Lee et al. · 2014 [cited by applicant]
US 20140323801A1 · Konno et al. · 2014 [cited by applicant]
US 20140375683A1 · Salter et al. · 2014 [cited by applicant]
US 20140378763A1 · Atarot et al. · 2014 [cited by applicant]
US 20150078615A1 · Staples et al. · 2015 [cited by applicant]
US 20150213602A1 · Verstraeten et al. · 2015 [cited by applicant]
US 20150238071A1 · Hua et al. · 2015 [cited by applicant]
US 20160012604A1 · Firouzian et al. · 2016 [cited by applicant]
US 20160231411A1 · Kumar et al. · 2016 [cited by applicant]
US 20160275709A1 · Gotmn et al. · 2016 [cited by applicant]
US 20160379363A1 · Kitamura et al. · 2016 [cited by applicant]
US 20170027650A1 · Merck et al. · 2017 [cited by applicant]
US 20170035278A1 · Ojima et al. · 2017 [cited by applicant]
US 20170303869A1 · Goshen · 2017 [cited by applicant]
US 20170305016A1 · Larkin et al. · 2017 [cited by applicant]
US 20170367566A1 · Kikuchi et al. · 2017 [cited by applicant]
US 20180035895A1 · Herzlinger et al. · 2018 [cited by applicant]
US 20180296280A1 · Kurihara et al. · 2018 [cited by applicant]
AU 2013202775A1 · 2013 [cited by applicant]
CN 203042209U · 2013 [cited by applicant]
JP 6063003A · 1994 [cited by applicant]
KR 1020090123260B1 · 2009 [cited by applicant]
WO 1996009587A1 · 1996 [cited by applicant]
WO 2013027200A2 · 2013 [cited by applicant]
WO 2015151094A1 · 2015 [cited by applicant]
International Search Report from International Application No. PCT/IL2015/050345 dated Sep. 2, 2015. [cited by applicant]
Written Opinion of the International Authority from International Application No. PCT/IL2015/050345 dated Sep. 2, 2015. [cited by applicant]