Systems and methods for offscreen indication of instruments in a teleoperational medical system

1. A medical imaging system comprising:

a teleoperational assembly configured to control movement of a medical instrument including an instrument tip; and

a control system comprising a processing unit, the processing unit including one or more processors, wherein the processing unit is configured to:

determine a position error for the instrument tip, wherein the position error is based on at least one error factor of the teleoperational assembly;

determine a set of predicted positions for the instrument tip from the position error;

determine at least one instrument tip bounding volume from the set of predicted positions for the instrument tip, wherein the at least one instrument tip bounding volume includes:

a first volume, the first volume based on an error radius of a position error for a distal end of the instrument tip; and

a second volume, the second volume based on an error radius of a position error for a proximal end of the instrument tip,

wherein the first volume surrounds and moves with the distal end of the instrument tip, and wherein the second volume surrounds and moves with the proximal end of the instrument tip;

determine whether the at least one instrument tip bounding volume is outside a field of view of an imaging instrument; and

based on a determination that the at least one instrument tip bounding volume is outside the field of view, indicate the instrument tip is outside the field of view.

2. The system of claim 1 wherein indicating the instrument tip is outside the field of view includes generating an out-of-view instrument indicator for display with an image of the field of view.

3. The system of claim 2 wherein the out-of-view instrument indicator includes a graphical bar extending along at least one edge of the image of the field of view.

4. The system of claim 2 wherein the out-of-view instrument indicator includes a textual display related to the medical instrument.

5. The system of claim 1 wherein indicating the instrument tip is outside the field of view includes generating an audible out-of-view instrument indication.

6. The system of claim 1 wherein the field of view of the imaging instrument is a stereo field of view of a stereo imaging instrument.

7. The system of claim 1 wherein, based on the determination that the at least one instrument tip bounding volume is outside the field of view, the processing unit is further configured to:

recognize a first context when the out-of-view instrument indicator is to be displayed; and

recognize a second context when the out-of-view instrument indicator is not to be displayed.

8. The system of claim 1 wherein the position error for the instrument tip is determined from kinematic variability in the teleoperational assembly.

9. The system of claim 1 wherein the position error for the instrument tip is determined from kinematic variability in the medical instrument.

10. The system of claim 1 wherein the at least one instrument tip bounding volume is further based upon a distance of the instrument tip from a distal end of the imaging instrument.

11. The system of claim 1 wherein the processing unit is further configured to:

generate a warning indicator if the instrument tip is within the field of view of the imaging instrument and within a predefined proximity to an edge of the field of view.

12. The system of claim 11 wherein the warning indicator includes a visual indicator for display with an image of the field of view.

13. The system of claim 1 further comprising the medical instrument.

14. A method of imaging, the method comprising:

determining a position error for an instrument tip of a medical instrument controlled by a teleoperational assembly, wherein the position error is based on at least one error factor of the teleoperational assembly;

determining a set of predicted positions for the instrument tip from the position error;

determining at least one instrument tip bounding volume from the set of predicted positions for the instrument tip, wherein the at least one instrument tip bounding volume includes a first volume based on an error radius of a position error for a distal end of the instrument tip and a second volume based on an error radius of a position error for a proximal end of the instrument tip, wherein the first volume surrounds and moves with the distal end of the instrument tip, and wherein the second volume surrounds and moves with the proximal end of the instrument tom;

determining whether the at least one instrument tip bounding volume is outside a field of view of an imaging instrument; and

based on a determination that the at least one instrument tip bounding volume is outside the field of view, indicating the instrument tip is outside the field of view.

15. The method of claim 14 wherein indicating the instrument tip is outside the field of view includes generating an out-of-view instrument indicator for display with an image of the field of view.

16. The method of claim 15 wherein the out-of-view instrument indicator includes a graphical bar extending along at least one edge of the image of the field of view.

17. The method of claim 15 wherein the out-of-view instrument indicator includes textual information about the medical instrument.

18. The method of claim 14 wherein indicating the instrument tip is outside the field of view includes generating an audible out-of-view instrument indication.

19. The method of claim 14 wherein the field of view of the imaging instrument is a stereo field of view of a stereo imaging instrument.

20. The method of claim 14 wherein determining the position error for the instrument tip includes determining the position error from kinematic variability in the teleoperational assembly.

21. The method of claim 14 wherein determining the position error for the instrument tip includes determining the position error from kinematic variability in the medical instrument.

22. The method of claim 14 wherein determining the at least one instrument tip bounding volume includes determining a bounding volume based upon a distance of the instrument tip from a distal end of the imaging instrument.

23. The method of claim 14 wherein determining the at least one instrument tip bounding volume includes determining a bounding volume based upon a projected size of the position error on a display.

24. The method of claim 14 further comprising:

generating a warning indicator if the instrument tip is within the field of view of the imaging instrument and within a predefined proximity to an edge of the field of view.

25. The method of claim 24 wherein the warning indicator includes a visual indicator for display with an image of the field of view.

26. The method of claim 14 further comprising:

receiving an acknowledgement of an out-of-view instrument status for the medical instrument; and

responsive to the received out-of-view instrument status, enabling functionality of the medical instrument.

27. The system of claim 1 wherein the processing unit is further configured to:

receive an acknowledgement of an out-of-view instrument status for the medical instrument; and

responsive to the received out-of-view instrument status, enable functionality of the medical instrument.

28. The system of claim 1 wherein the set of predicted positions for the instrument tip includes predicted positions for the instrument tip to a degree of certainty of at least 90%.

29. The system of claim 1 wherein determining whether the at least one instrument tip bounding volume is outside the field of view of the imaging instrument comprises determining that both the first volume and the second volume are outside the field of view.

30. The method of claim 14 wherein determining whether the at least one instrument tip bounding volume is outside the field of view of the imaging instrument comprises determining that both the first volume and the second volume are outside the field of view.