IP Library Granted Patent US 10,806,325
Granted Patent B2
US 10,806,325 · App. 13/966,642 · Granted Oct 20, 2020

Methods and systems for optimizing video streaming

Inventors: Brian E. Miller (Los Gatos, CA); Joey Chau (Cupertino, CA); Govinda Payyavula (Fremont, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B1/00009A61B1/00011A61B1/00045A61B1/04A61B17/00234A61B34/30H04N19/114H04N19/137H04N19/164H04N19/172A61B90/361H04N19/146H04N19/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,806,325
App. No.
13/966,642
Granted
Oct 20, 2020
Kind
B2
Abstract

A method for performing a surgical procedure includes adjusting an encoding configuration of a video encoder in response to receiving an input associated with a change of state of a surgical system performing the surgical procedure, and encoding image data of the surgical procedure captured after the change of state based on the adjusted encoding configuration.

Claims (59)

1. A method of processing video of a surgical procedure captured by an image capturing device of a surgical system, the method comprising:

adjusting an encoding configuration of a video encoder in response to an input that effects a change of state of the surgical system performing the surgical procedure, wherein:

the input comprises a control command input at an input device of the surgical system, the input device being operably coupled to control at least one of the image capturing device and a surgical instrument of the surgical system, and

the input and adjusting occur in advance of the change of state of the surgical system; and

encoding image data of the surgical procedure captured after the change of state, the encoding using the video encoder having the adjusted encoding configuration.

2. The method of claim 1 , wherein:

adjusting the encoding configuration comprises increasing an image encoding resolution for encoding at least one image frame of the image data.

3. The method of claim 2 , wherein:

adjusting the encoding configuration further comprises decreasing an image encoding rate for encoding the image data.

4. The method of claim 1 , wherein:

encoding the image data based on the adjusted encoding configuration comprises generating intra-frames (i-frames) at an i-frame rate and generating predictive inter-frames (p-frames) at a p-frame rate; and

adjusting the encoding configuration comprises adjusting the i-frame rate.

5. The method of claim 4 , wherein:

adjusting the encoding configuration further comprises adjusting the p-frame rate.

6. The method of claim 5 , further comprising:

transmitting the generated i-frames and p-frames to a video decoder at a predetermined transmission data rate wherein:

the adjusting of the p-frame rate is based on the adjusting of the i-frame rate and the predetermined transmission data rate.

7. The method of claim 1 , wherein:

the input that effects the change of state comprises at least one of an input that effects movement of the image capture device, an input that effects an adjustment of a field of view of the image capture device, and an input that effects movement of an element within the field of view of the image capture device; and

adjusting the encoding configuration is based on a predicted difference between current captured image data and anticipated captured image data as affected by the change of state.

8. The method of claim 1 , further comprising:

adjusting the encoding configuration in response to receiving a link status input indicative of a change of a bandwidth available for transmission of encoded images.

9. A surgical system comprising:

an endoscopic image capture device for capturing image data of a surgical site during a surgical procedure;

an input device for receiving a control command input that effects a change of state of the surgical system, the input device being operably coupled to control at least one of the endoscopic image capture device and a surgical instrument of the surgical system; and

a video processor for generating video encoding configuration data to encode the image data, the video processor configured to:

output adjusted video encoding configuration data based on the received input, wherein the input and the output occur before the change of state.

10. The surgical system of claim 9 , further comprising:

an image encoder logically coupled to the video processor and the endoscopic image capture device, the image encoder configured to:

receive from the video processor the video encoding configuration data;

receive from the endoscopic image capture device the image data; and

encode the received image data based on the received video encoding configuration data.

11. The surgical system of claim 10 , further comprising:

an output communication interface logically coupled to the image encoder to provide to a display the encoded image data.

12. The surgical system of claim 10 , wherein:

the adjusted video encoding configuration data comprises an intra-frames (i-frames) rate parameter and a predictive inter-frames (p-frames) rate parameter for encoding the image data based on an anticipated effect of the change of state.

13. The surgical system of claim 12 , further comprising:

an output communication interface logically coupled to the image encoder to provide to a display through a communication link the encoded image data, wherein:

the video processor is further configured to receive a link status input indicative of a communication link condition; and

the adjusted video encoding configuration data comprising the intra-frames (i-frames) rate parameter and the predictive inter-frames (p-frames) rate parameter for encoding the captured image data being further based on the link status input indicative of the communication link condition.

14. The surgical system of claim 9 , wherein:

the adjusted video encoding configuration data comprises an image encoding resolution for encoding the image data based on an anticipated effect of the change of state on the image data.

15. The surgical system of claim 14 , wherein:

the adjusted video encoding configuration data further comprises an image encoding rate for encoding the image data based on the anticipated effect of the change of state on the image data.

16. The surgical system of claim 9 , wherein:

the adjusted video encoding configuration data further comprises an image encoding rate for encoding the image data based on an anticipated effect of the change of state on the image data.

17. The surgical system of claim 9 , further comprising:

an output communication interface logically coupled to an image encoder to provide to a display encoded image data through a communication link, wherein:

the video processor is further configured to receive a link status input indicative of a condition of the communication link; and

the adjusted video encoding configuration data further comprises an image encoding resolution for encoding the image data based on the link status input indicative of the communication link condition.

18. The surgical system of claim 17 , wherein:

the adjusted video encoding configuration data further comprises an image encoding rate for encoding the image data based on the link status input indicative of the communication link condition.

19. The surgical system of claim 9 , wherein the input that effects a change of state of the surgical system comprises at least one of an input that effects movement of the image capture device, an input that effects an adjustment of a field of view of the image capture device, and an input that effects movement of an element within the field of view of the image capture device.

20. A method of processing video of a surgical procedure captured by an image capturing device of a surgical system, the method comprising:

adjusting an encoding configuration of a video encoder in response to an input that effects a change of state of the surgical system performing the surgical procedure, wherein:

the input comprises a control command input at an input device of the surgical system, the input comprising at least one of an input that effects movement of the image capture device, an input that effects an adjustment of a field of view of the image capture device, and an input that effects movement of an element within the field of view of the image capture device,

the input device being operably coupled to control at least one of the image capturing device and a surgical instrument of the surgical system, and

the input and adjusting occur in advance of the change of state of the surgical system; and

encoding image data of the surgical procedure captured after the change of state, the encoding using the video encoder having the adjusted encoding configuration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2013
From: MILLER, BRIAN E.; CHAU, JOEY; PAYYAVULA, GOVINDA
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 031368/0003 →
Continuity (2)
Provisional Application 61683493 · Aug 15, 2012
Related Publication 20140051921A1 · Feb 20, 2014
Cited By (5)
US 12,211,605 US 12,396,869 US 12,537,091 US 12,582,330 US 12,694,512