IP Library Granted Patent US 10,986,323
Granted Patent B2
US 10,986,323 · App. 16/888,224 · Granted Apr 20, 2021

Image capturing apparatus and image capturing method

Inventors: Ryota Kosakai (Tokyo, JP); Katsutoshi Aiki (Kanagawa, JP); Nobuyuki Sato (Tokyo, JP); Hiroki Nagahama (Tokyo, JP); Masatoshi Sase (Kanagawa, JP); Yutaka Yoneda (Kanagawa, JP)
Assignee: Sony Corporation
H04N9/735G11B27/005G11B27/031G11B31/006H04N5/232H04N5/23232H04N5/23245H04N5/23293H04N5/378H04N5/77H04N5/772H04N5/783H04N5/91H04N7/0127H04N9/045H04N9/04515H04N9/04557H04N9/69H04N9/7904H04N9/80H04N9/87H04N7/0105
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,986,323
App. No.
16/888,224
Granted
Apr 20, 2021
Kind
B2
Abstract

In a high speed image capturing state, a camera signal processing circuit is not needed to perform a signal process at a high screen rate, but at a regular screen rate. In the high speed image capturing mode, raw data of 240 fps received from an image sensor 101 are recorded on a recording device 111 through a conversion processing, section 201 and a recording device controlling circuit 210 . Raw data that have been decimated and size-convert d are supplied to a camera signal processing circuit 203 through a pre-processing circuit 202 and an image being captured is displayed on a display section 112 with a signal for which a camera process has been performed. In a reproducing state, raw data are read from the recording device 111 at a low screen rate according to a display performance of the display section 112 and the raw data that have been read are processed are processed by the pre-processing circuit 202 and the camera signal processing circuit 203 and a reproduced image is displayed by the display section 112.

Claims (74)

1. An image processing apparatus, comprising:

circuitry configured to receive a first number of first frames of image data that have not yet been subjected to white balance processing, gamma correction processing, and YC conversion processing at a first rate image size outputted by an image sensor that includes a color filter array; and

at least one first storage medium encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in a recording process, compress the first frames of image data, without previously performing white balance processing, gamma correction processing, and YC conversion processing thereon, to generate compressed image data;

store the compressed image data, without performing white balance processing, gamma correction processing, and YC conversion processing thereon, on a second storage medium while the second storage medium is attached to the image processing apparatus, the second storage medium being configured to be detachable from the image processing apparatus so as to allow the image data to be processed by a first external device separate from the image processing apparatus when the second storage medium is detached from the image processing apparatus; and

generate a first signal representing a first white-balanced, gamma-corrected, and YC converted image sequence that is to be outputted to a second external device by processing the first frames of image data to generate a second number of second frames of image data, and by performing at least one of white balance processing, gamma correction processing, or YC conversion processing on the second frames of image data at a second image size which is lower than the first image size.

2. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in a reproduction process,

read the compressed image data from the second storage medium;

decompress the compressed image data to produce decompressed frames of image data; and

generate a second signal representing a second white-balanced, gamma-corrected, and YC converted image sequence to be outputted to the second external device as a slow motion reproduced image by processing the decompressed image data.

3. The image processing apparatus of claim 2 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the reproduction process, generate the second signal by processing the decompressed image data at a third frame rate which is lower than the first frame rate.

4. The image processing apparatus of claim 3 , wherein the third frame rate is the same as the second frame rate.

5. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, process the first and second frames of image data such that a ratio of the first number of frames to the second number of frames is the same as a ratio of the first frame rate to the second frame rate.

6. The image processing apparatus of claim 5 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the second number of second frames of image data by decimating the first number of first frames of image data.

7. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal such that the first white-balanced, gamma-corrected, and YC converted image sequence corresponds to at least some of the image data that is currently being captured by the image sensor.

8. The image processing apparatus of claim 2 , wherein:

the image sensor is further configured to output the first number of first frames of image data throughout a first time period; and

the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to, in the reproduction process, generate the second signal so that the second white-balanced, gamma-corrected, and YC converted image sequence is outputted to the second external device throughout a second time period, which is longer than the first time period.

9. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, convert the first number of first frames of image data to the second number of second frames of image data by decimating the first number of first frames of image data.

10. The image processing apparatus of claim 9 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, convert the first number of first frames of image data to the second number of second frames of image data by performing a size adjustment processing on at least some frames of image data.

11. The image processing apparatus of claim 1 , wherein the second frame rate is one fourth of the first frame rate.

12. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing a simultaneous forming process on at least some frames of image data.

13. The image processing apparatus of claim 12 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing each of white balance processing, gamma correction processing, and YC conversion processing on the second frames of image data.

14. The image processing apparatus of claim 1 , wherein the second external device comprises a liquid crystal display and the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing display processing on the second frames of image data, after performing the at least one of white balance processing, gamma correction processing, and YC conversion processing thereon, and providing the first signal to the liquid crystal display so as to cause the liquid crystal display to display the first white-balanced, gamma-corrected, and YC converted image sequence.

15. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, compress the first frames of image data, without previously performing simultaneous forming processing thereon, to generate the compressed image data stored on the second storage medium.

16. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, compress the first frames of image data, without previously performing white balance processing thereon, to generate the compressed image data stored on the second storage medium.

17. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, compress the first frames of image data, without previously performing gamma correction processing thereon, to generate the compressed image data stored on the second storage medium.

18. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, compress the first frames of image data, without previously performing YC conversion processing thereon, to generate the compressed image data stored on the second storage medium.

19. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, compress the first frames of image data by encoding each frame according to a predetermined format for each frame to generate the compressed image data stored on the second storage medium.

20. The image processing apparatus of claim 19 , wherein the predetermined format for each frame is JPEG (Joint Photographic Experts Group) format.

21. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry control the circuitry such that, in the recording process, the image data that is stored on the second storage medium is RAW image data.

22. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing white balance processing on the second frames of image data at the second frame rate.

23. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing gamma correction processing on the second frames of image data at the second frame rate.

24. The image processing apparatus of claim 1 , wherein the at least one first storage medium is further encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in the recording process, generate the first signal by performing YC conversion processing on the second frames of image data at the second frame rate.

25. The image processing apparatus of claim 1 , wherein the circuitry comprises a microcomputer.

26. The image processing apparatus of claim 1 , wherein the circuitry comprises at least one signal processor.

27. The image processing apparatus of claim 1 further comprising: an interface for an external output of the first signal to the second external device.

28. The image processing apparatus of claim 1 , wherein the first frame rate is approximately 240 fps and the second frame rate is approximately 60 fps.

29. The image processing apparatus of claim 1 , wherein a number of pixels of the first frames of the image data is approximately 1.6 million pixels.

30. An image processing apparatus, comprising:

circuitry configured to receive a first number of first frames of image data that have not yet been subjected to white balance processing, gamma correction processing, and YC conversion processing at a first image size outputted by an image sensor that includes a color filter array; and

at least one first storage medium encoded with executable instructions that, when executed by the circuitry, cause the circuitry to:

in a recording process,

store the first frames of image data, without performing white balance processing, gamma correction processing, and YC conversion processing thereon, on a second storage medium while the second storage medium is attached to the image processing apparatus, the second storage medium being configured to be detachable from the image processing apparatus as to allow the image data to be processed by a first external device separate from the image processing apparatus when the second storage medium is detached from the image processing apparatus; and

generate a first signal representing a first white-balanced, gamma-corrected, and YC converted image sequence that is to be outputted to a second external device by processing the first frames of image data to generate a second number of second frames of image data, and by performing at least one of white balance processing, gamma correction processing, or YC conversion processing on the second frames of image data at a second image size which is lower than the first image size.

31. A method for operating an image processing apparatus, comprising:

receiving a first number of first frames of image data that have not yet been subjected to white balance processing, gamma correction processing, and YC conversion processing at a first image size outputted by an image sensor that includes a color filter array;

in a recording process,

compressing the first frames of image data, without previously performing white balance processing, gamma correction processing, and YC conversion processing thereon, to generate compressed image data;

storing the compressed image data, without performing white balance processing, gamma correction processing, and YC conversion processing thereon, on a storage medium while the storage medium is attached to the image processing apparatus, the storage medium being configured to be detachable from the image processing apparatus as to allow the image data to be processed by a first external device separate from the image processing apparatus when the storage medium is detached from the image processing apparatus; and

generating a first signal representing a first white-balanced, gamma-corrected, and YC converted image sequence that is to be outputted to a second external device by processing the first frames of image data to generate a second number of second frames of image data, and by performing at least one of white balance processing, gamma correction processing, or YC conversion processing on the second frames of image data at a second image size which is lower than the first image size.

32. A method for operating an image processing apparatus, comprising:

receiving a first number of first frames of image data that have not yet been subjected to white balance processing, gamma correction processing, and YC conversion processing at a first image size outputted by an image sensor that includes a color filter array;

in a recording process,

storing the first frames of image data, without performing white balance processing, gamma correction processing, and YC conversion processing thereon, on a storage medium while the storage medium is attached to the image processing apparatus, the storage medium being configured to be detachable from the image processing apparatus as to allow the image data to be processed by a first external device separate from the image processing apparatus when the storage medium is detached from the image processing apparatus; and

generating a first signal representing a first white-balanced, gamma-corrected, and YC converted image sequence that is to be outputted to a second external device by processing the first frames of image data to generate a second number of second frames of image data, and by performing at least one of white balance processing, gamma correction processing, or YC conversion processing on the second frames of image data at a second image size which is lower than the first image size.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2021
From: KOSAKAI, RYOTA; AIKI, KATSUTOSHI; SATO, NOBUYUKI; NAGAHAMA, HIROKI; SASE, MASATOSHI; YONEDA, YUTAKA
To: SONY CORPORATION
Reel/Frame 054952/0261 →
Priority Claims (1)
JP 2006-293836 · Oct 30, 2006 · national
Continuity (8)
Continuation 16391771 · Apr 23, 2019
Continuation 15855060 · Dec 27, 2017
Continuation 15581208 · Apr 28, 2017
Continuation 15001442 · Jan 20, 2016
Continuation 14662291 · Mar 19, 2015
Continuation 14462615 · Aug 19, 2014
Continuation 12447480
Related Publication 20200296342A1 · Sep 17, 2020