Systems and methods for medical imaging
The disclosed technology relates to high resolution imagery for a medical environment. Various embodiments provide for a surgical camera, such as an endoscopic camera, comprising an array of image sensors. The array of image sensors may be configured to capture static images or video, may be configured to capture imagery of biological tissue (e.g., surfaces), and may be specifically configured to capture imagery within a surgical environment. For some embodiments, the array of image sensors multiplies the number of available pixels by the number of image sensors, thereby facilitating high resolution image data (e.g., one or more static images or video). The collected image data may be processed at or near real-time to provide very high-quality imagery (e.g., images or video) that can be enhanced or magnified for medical purposes, which can provide a medical care giver (e.g., surgeon) better visibility during medical procedures.
1 . A medical imaging system comprising:
a surgical camera configured to capture an image of a selected subject via a plurality of image sensors, wherein each image is mapped to a corresponding portion of the selected subject;
an optical system used to transmit said images from an objective lens to said plurality of image sensors;
a user input device configured to accept input from a system user via a user interface to select an area of interest (AOI) of the selected subject wherein each of the plurality of image sensors focus on differing areas of the selected subject to provide a greater resolution of the selected subject;
an image processing module comprising one or more processors, a first input configured to receive images captured by the surgical camera via connection to an external communication medium, a second input configured to receive the user input identifying an AOI via the user interface, and an output including raw image data to a display monitor wherein said raw image data is representative of uncompressed and unprocessed video or static image data captured by the surgical camera; the image processing module configured to select a proper subset of images, via the one or more processors, that is mapped to the AOI of the selected subject by determining which image sensor or group of image sensors corresponds to the AOI based on a known mapping between portions of the displayed image and the plurality of image sensors, and to provide an image of the AOI, captured by a selected proper subset of fewer than all of the plurality of image sensors at the output;
wherein said imaging processing module comprises logic for a plurality of purposes including stitching various image data from said plurality of image sensors into a single picture, compressing high resolution images to a format suitable for display devices that have lower resolutions, and providing image enhancement;
wherein users are enabled to use stored image data in non-real time;
the display monitor having an input coupled to the output of the image processing module to display the image of the AOI; and
a clarifying algorithm configured to process said first input, wherein said processing comprises removing visual obfuscation;
wherein said image processing module further comprises an image sensor data compression module configured to employ one or more compression algorithms which, when employed, compress image data from the selected proper subset of image sensors corresponding to the AOI with a reduced amount of compression relative to image data outside the AOI.
2 . The medical imaging system of claim 1 , wherein the image processing module is further configured to determine a pixel size of the display monitor and to apply data compression at a first compression rate to reduce an image size of the captured image of the selected subject to a size that is no greater than the resolution of the display monitor.
3 . The medical imaging system of claim 2 , wherein the image processing module is further configured to determine the image size of the image of the AOI, and to apply data compression at a second compression rate to reduce an image size of the image of the AOI to a size that is no greater than the pixel size of the display monitor, wherein the second compression rate is less than the first compression rate.
4 . The medical imaging system of claim 1 , wherein the image processing module is further configured to determine an image size of the image of the AOI, and to send the image of the AOI at its native image resolution if the image size of the image of the AOI is no greater than the pixel size of the display monitor.
5 . The medical imaging system of claim 1 , wherein the proper subset of images comprises a quantity of one or more of the images that is less than the total quantity of images captured.
6 . The medical imaging system of claim 1 , wherein the surgical camera further comprises illumination structures.
7 . The medical imaging system of claim 6 , wherein the illumination structures comprise illumination fibers.
8 . The medical imaging system of claim 1 , wherein the image processing module is further configured to determine a pixel size of a sub-window of the display monitor and to apply data compression at a first compression rate to reduce an image size of the captured image of the selected subject to a size that is no greater than the resolution of the display monitor.
9 . The medical imaging system of claim 8 , wherein the image processing module is further configured to determine the image size of the image of the AOI, and to apply data compression at a second compression rate to reduce an image size of the image of the AOI to a size that is no greater than the pixel size of the sub-window of the display monitor, wherein the second compression rate is less than the first compression rate.
10 . The medical imaging system of claim 1 , wherein the image processing module is further configured to determine an image size of the image of the AOI, and to send the image of the AOI at its native image resolution if the image size of the image of the AOI is no greater than the pixel size of a sub-window of the display monitor.
11 . The medical imaging system of claim 1 , wherein the display monitor comprises a plurality of display monitors coupled to the output of the image processing module.
12 . The medical imaging system of claim 11 , wherein the plurality of display monitors is configured to display different views of the selected subject on different monitors of the plurality of display monitors.
13 . The medical imaging system of claim 12 , wherein the different views comprise different AOIs of the selected subject.
14 . The medical imaging system of claim 11 , wherein the plurality of display monitors is configured as a mural of displays to allow a tiled display surface having a pixel size larger in size than that of a single display monitor, and wherein each display monitor is arranged to formulate the mural.
15 . The medical imaging system of claim 14 , wherein the mural of displays is configured with a sufficient number of displays to allow a contiguous representation of a full-size image captured of the selected subject.
16 . The medical imaging system of claim 14 , wherein the mural of displays is configured to present a contiguous representation of a full size image captured by the proper subset of captured images.
17 . The medical imaging system of claim 11 , wherein the plurality of display monitors are configured to display different views, different levels of magnification or different AOIs on different display monitors of the plurality of display monitors.
18 . The medical imaging system of claim 17 , the display monitors are configured to provide different sessions for different practitioners in the same or in different locations.
19 . The medical imaging system of claim 1 , wherein the surgical camera comprises CMOS image sensors, CCDs, or EMCCDs.
20 . A medical imaging system comprising:
a surgical camera for capturing an image of a selected subject via a plurality of image sensors, wherein each image is mapped to a corresponding portion of the selected subject;
an optical system used to transmit said images from an objective lens to said plurality of image sensors;
a user input device comprising at least one of: (i) a user-operated pointing device or (ii) a touchscreen device, the user input device being configured to allow a user to control said medical imaging system or provide input to said system and being further configured to receive a user input identifying an area of interest (AOI) of the selected subject;
wherein each of the plurality of image sensors focus on differing areas of the selected subject to provide a greater resolution of the selected subject;, and wherein each of the plurality of image sensors captures raw image data, wherein said raw image data is representative of uncompressed and unprocessed video or static image data;
wherein, in response to the identified AOL, a proper subset of images that are mapped to the AOI of the selected subject are selected by determining which image sensor or group of image sensors corresponds to the AOI based on a known mapping between portions of the displayed image and the plurality of image sensors, to provide an image of the AOI captured by the selected proper subset of image sensors for display;
wherein receiving images captured by the image sensor, or said image data, can be processed by an image processing module, wherein said imaging processing module comprises logic for a plurality of purposes including stitching various image data from said plurality of image sensors into a single picture, compressing high resolution images to a format suitable for display devices that have lower resolutions, and providing image enhancement;
wherein image data from the selected proper subset of image sensors corresponding to the AOI is compressed with a reduced amount of compression relative to image data outside the AOI; and
wherein users are enabled to use stored image data in non-real time.