IP Library › Granted Patent US 9,930,316
Granted Patent B2
US 9,930,316 · App. 14/743,993 · Granted Mar 27, 2018

Camera imaging systems and methods

Inventor: Yun Zhang (Fredericton, CA)
Assignee: University of New Brunswick
H04N13/025H04N5/33H04N5/332H04N9/045H04N9/09H04N13/0239H04N13/0257H04N2013/0077H04N2013/0081H04N2013/0092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,930,316
App. No.
14/743,993
Granted
Mar 27, 2018
Kind
B2
Abstract

System and method to (1) directly capture data-volume-reduced or compressed color images or video image frames by a camera system compared to those from conventional color camera systems with the same image resolution, and (2) retrieve uncompressed color images or video image frames for display, visualization, or other image/video processing at the end user side.

Claims (62)

1. A method comprising:

providing a low resolution multispectral digital image from a camera imaging system,

providing a high resolution monochromatic digital image from the camera imaging system, where the images are of the same scene and have a degree of overlap,

generating, at the camera imaging system, a single digital file comprising the images,

where the images

have a common file format, and

are suitable for processing into a fused high resolution multispectral image by a client device, and where the combined data volume of the low resolution multispectral digital image and the monochromatic digital image is less than the data volume of the fused high resolution multispectral image.

2. The method of claim 1 , further comprising binning a high resolution color image into the low resolution multispectral image.

3. The method of claim 1 , wherein the low resolution multispectral digital image comprise color bands selected from the group consisting of red, green, blue, near infrared and beyond.

4. The method of claim 1 , the digital file further comprising a format name which is readable by a digital image fusion software to enable the software to process the images into a fused high resolution multispectral image.

5. The method of claim 1 , wherein the common file format is selected from the group consisting of a file compression format, TIFF, JPEG, JPEG2000, raw format, and other formats.

6. The method of claim 1 , wherein the multispectral digital image comprises a plurality of multispectral digital image frames forming a video, and the monochromatic digital image comprises a plurality of monochrome digital image frames forming a video.

7. The method of claim 6 , wherein the common file format is selected from the group consisting of a video compression format, H.264, MPEG-4, and other formats.

8. A camera imaging system comprising:

a multispectral digital sensor,

a monochromatic digital sensor,

a processor,

a memory in communication with the processor, the memory storing a plurality of processing instructions that, when executed, cause the processor to perform operations comprising:

receiving a low resolution multispectral digital image from the multispectral digital sensor,

receiving a high resolution monochromatic digital image from the monochromatic digital sensor, where the images are of the same scene and have a degree of overlap,

formatting the images with a common file format,

generating a single digital file comprising the formatted images, where the file can be read by a digital image fusion software at a client device to enable the software to process the images into a fused high resolution multispectral image at the client device, and where the combined data volume of the low resolution multispectral digital image and the monochromatic digital image is less than the data volume of the fused high resolution multispectral image.

9. The camera imaging system of claim 8 , wherein the operations performed by the processor further comprising:

binning a high resolution color image into the low resolution multispectral image.

10. The camera imaging system of claim 8 , wherein the low resolution multispectral digital image comprises color bands selected from the group consisting of red, green, blue, near infrared, and beyond.

11. The camera imaging system of claim 8 , wherein the operations performed by the processor further comprising:

assigning a format name to the single digital file which is readable by the digital image fusion software to indicate to the software that the single file comprises a low resolution multispectral digital image and a high resolution monochromatic digital image which are in a format suitable for processing into a fused high resolution multispectral image by the software at the client device.

12. The camera imaging system of claim 8 , where in the operations performed by the processor, the common file format is selected from the group consisting of a file compression format, TIFF, JPEG, JPEG2000, raw format and other image formats.

13. The camera imaging system of claim 8 , wherein the multispectral digital image, in the operations performed by the processor, comprises a plurality of multispectral digital image frames forming a video, and the monochromatic digital image comprises a plurality of monochrome digital image frames forming a video.

14. The camera imaging system of claim 13 , wherein the operations performed by the processor, the common file format is selected from the group consisting of a video compression format, H.264, MPEG-4, and other formats.

15. A method comprising:

receiving a single digital file comprising a low resolution multispectral digital image and a high resolution monochromatic digital image, where the images:

have been acquired by a camera imaging system,

have a common file format, and

are suitable for processing into a fused high resolution multispectral image, and where the combined data volume of the low resolution multispectral digital image and the monochromatic digital image is less than the data volume of the fused high resolution multispectral image, and

processing the images at a client device, using digital image fusion software, into a fused high resolution multispectral image.

16. The method of claim 15 , wherein the single digital file is received on the client device over a network or by direct connection to the camera imaging system.

17. The method of claim 15 , further comprising:

de-bayering the low resolution multispectral digital image into individual color image bands and including the individual color image bands in place of the low resolution multispectral digital image in the processing step.

18. The method of claim 15 , wherein the low resolution multispectral digital image comprises color bands selected from the group consisting of red, green, blue, near infrared, and beyond.

19. The method of claim 15 , the digital file further comprising:

a format name which is readable by the digital image fusion software to indicate to the software that the single file comprises a low resolution multispectral digital image and a high resolution monochromatic digital image which are in a format suitable for processing into a fused high resolution multispectral image by the software.

20. The method of claim 15 , wherein the common file format is selected from the group consisting of a file compression format, TIFF, JPEG, JPEG2000, raw format and other formats.

21. The method of claim 15 , wherein the multispectral digital image comprises a plurality of multispectral digital image frames forming a video, and the monochromatic digital image comprises a plurality of monochrome digital image frames forming a video.

22. The method of claim 21 , wherein the common file format is selected from the group consisting of a video compression format, H.264 MPEG-4, and other formats.

23. A client device comprising:

a processor,

a memory in communication with the processor, the memory storing a plurality of processing instructions that, when executed, cause the processor to perform operations comprising:

receiving a single digital file comprising a low resolution multispectral digital image and a high resolution monochromatic digital image, where the images:

have been acquired by a camera imaging system,

have a common file format and,

are suitable for processing into a fused high resolution multispectral image, and

where the combined data volume of the low resolution multispectral digital image and the monochromatic digital image is less than the data volume of the fused high resolution multispectral image,

processing the images at a client device, using digital image fusion software, into a fused high resolution multispectral image.

24. The device of claim 23 , wherein the operations performed by the processor further comprising:

de-bayering the low resolution multispectral digital image into individual color image bands and including the individual color image bands in place of the low resolution multispectral digital image in the processing operation.

25. The device of claim 24 , wherein the low resolution multispectral digital image comprises color bands selected from the group consisting of red, green, blue, near infrared and beyond.

26. The device of claim 24 , further comprising

a format name which is readable by the digital image fusion software to indicate to the software that the single file comprises a low resolution multispectral digital image and a high resolution monochromatic digital image which are in a format suitable for processing into a fused high resolution multispectral image by the software.

27. The device of claim 24 , wherein the common file format is selected from the group consisting of a file compression format, TIFF, JPEG, JPEG2000, raw format, and other suitable compression formats.

28. The method of claim 24 , wherein the multispectral digital image comprises a plurality of multispectral digital image frames forming a video, and the monochromatic digital image comprises a plurality of monochrome digital image frames forming a video.

29. The method of claim 28 , wherein the common file format is selected from the group consisting of a video compression format, H.264, MPEG-4, and other suitable compression formats.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2015
From: ZHANG, YUN
To: UNIVERSITY OF NEW BRUNSWICK
Reel/Frame 036558/0161 →
Continuity (2)
Continuation In Part 13880703 · Aug 16, 2013
Related Publication 20150288950A1 · Oct 8, 2015