IP Library Granted Patent US 8,624,993
Granted Patent B2
US 8,624,993 · App. 13/210,951 · Granted Jan 7, 2014

Video image pickup device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,624,993
App. No.
13/210,951
Granted
Jan 7, 2014
Kind
B2
Abstract

An image processor detects an on-screen motion of a photographic subject in video image data generated by an image sensor provided in a camera body and outputs a photographic subject motion information. A sensor detects a motion of the camera body and outputs the detected motion as a camera body motion information. A scene decision encoding controller decides an image pickup condition of the video image data based on the photographic subject motion information and the camera body motion information, and performs an encoding amount regulation control suitable for the decided image pickup condition to an image compression processor.

Claims (85)

1. A video image pickup device, comprising:

an image processor configured to detect an on-screen motion of a photographic subject in video image data generated by an image sensor provided in a camera body and output a photographic subject motion information;

an image compression processor configured to compress the video image data into codes;

a sensor configured to detect a motion of the camera body and output the detected motion as a camera body motion information; and

a scene decision encoding controller configured to decide an image pickup condition of the video image data based on the photographic subject motion information and the camera body motion information, wherein

the scene decision encoding controller performs an encoding amount regulation control suitable for the decided image pickup condition to the image compression processor.

2. The video image pickup device as claimed in claim 1 , wherein

the image pickup condition is a condition where an actual motion of the photographic subject and the motion of the camera body are combined.

3. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller decides the image pickup condition based on combination of a degree of the motion of the camera body indicated by the camera body motion information and a degree of the on-screen motion of the photographic subject in the video image data indicated by the photographic subject motion information.

4. The video image pickup device as claimed in claim 1 , wherein

the sensor detects an angular rate applied to the camera body as the motion of the camera body.

5. The video image pickup device as claimed in claim 4 , further comprising:

a lens controller configured to give a motion to balance out the angular rate to a lens unit which condenses an imaging light on the image sensor to thereby compensate for an on-screen motion of the photographic subject generated by the angular rate which should be disregarded; and

an angular rate sensor configured to detect the angular rate and output the detected angular rate to the lens controller, wherein

the angular rate sensor serves as the sensor.

6. The video image pickup device as claimed in claim 1 , wherein

the image processor detects a representative point motion information obtained from inter-frame matching of a representative point defined on a screen as the photographic subject motion information.

7. The video image pickup device as claimed in claim 1 , wherein

the image processor further detects a frequency distribution information in the video image data, and

the scene decision encoding controller controls the image compression processor so that the encoding amount regulation control is performed suitably for the decided image pickup condition in each of frequency bands divided based on the frequency distribution information in the video image data.

8. The video image pickup device as claimed in claim 1 , wherein

the sensor detects an angular rate applied to the camera body as the motion of the camera body,

the image processor detects a representative point motion information obtained from inter-frame matching of a representative point defined on a screen as the photographic subject motion information,

the image processor further detects a frequency distribution information in the video image data, and

the scene decision encoding controller selects one of the angular rate, the representative point motion information, and the frequency distribution information depending on an intended purpose of the video image pickup device and uses the selected information to decide the image pickup condition.

9. The video image pickup device as claimed in claim 8 , wherein

the scene decision encoding controller differently combines the angular rate, the representative point motion information, and the frequency distribution information depending on an intended purpose of the video image pickup device and uses the combined information to decide the image pickup condition.

10. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by filtering/removing high frequency components.

11. The video image pickup device as claimed in claim 10 , wherein

the scene decision encoding controller performs a filtering setting in multiple stages per a plurality of frames in the filtering/removal of the high frequency components.

12. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by skipping a frame.

13. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by inserting a dummy frame.

14. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by multiplexing a frame.

15. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by increasing a quantization step.

16. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller performs the encoding amount regulation control by performing one of the followings; filtering/removal of high frequency components, insertion of a dummy frame, multiplexing of a frame, and increasing of a quantization step.

17. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller uses threshold values in multiple stages to decide the motion of the photographic subject.

18. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller uses threshold values and selects one of the threshold values to be used depending on an encoding search range magnitude.

19. The video image pickup device as claimed in claim 1 , wherein

the scene decision encoding controller uses threshold values and selects one of the threshold values to be used depending on an encoding frame rate or a bit rate.

20. The video image pickup device as claimed in claim 1 , wherein

the image compression processor is an image compression/decompression processor capable of decompressing the video image data.

21. The video image pickup device as claimed in claim 1 , further comprising an image display processor in charge of image display control of the video image data.

22. A device deciding an image pickup condition, comprising:

a scene decision controller configured to decide the image pickup condition of a video image data based on a photographic subject motion information and a camera body motion information, wherein

the photographic subject motion information is generated by detecting an on-screen motion of a photographic subject in the video image data,

the camera body motion information is generated by detecting a motion of a camera body, and

the scene decision controller performs an encoding amount regulation control.

23. The device deciding an image pickup condition as claimed in claim 22 , wherein the camera body motion information is generated by detecting an angular rate applied to the camera body as the motion of the camera body.

24. The device deciding an image pickup condition as claimed in claim 22 , wherein

the scene decision controller performs the encoding amount regulation control by skipping a frame.

25. The device deciding an image pickup condition as claimed in claim 22 , wherein

the scene decision controller performs the encoding amount regulation control by inserting a dummy frame.

26. The device deciding an image pickup condition as claimed in claim 23 , further comprising: a lens controller configured to detect the angular late and give a motion to balance out the angular rate to a lens unit which condenses an imaging light on an image sensor to thereby compensate for a on-screen motion of the photographic subject generated by the angular rate which should be disregarded.

27. The device deciding an image pickup condition as claimed in claim 22 , further comprising:

an image processor configured to detect the on-screen motion of the photographic subject in the video image data and output the photographic subject motion information;

an image compression processor configured to compress the video image data into codes, wherein

the image processor further detects a frequency distribution information in the video image data, and

the scene decision controller controls the image compression processor so that the encoding amount regulation control is performed suitably for the decided image pickup condition in each of frequency bands divided based on the frequency distribution information in the video image data.

28. The device deciding an image pickup condition as claimed in claim 22 , further comprising:

an image processor configured to detect the on-screen motion of the photographic subject in the video image data and output the photographic subject motion information, wherein the camera body motion information is generated by detecting an angular rate applied to the camera body as the motion of the camera body,

the image processor detects a representative point motion information obtained from inter-frame matching of a representative point defined on a screen as the photographic subject motion information,

the image processor further detects a frequency distribution information in the video image data, and

the scene decision controller selects one of the angular rate, the representative point motion information, and the frequency distribution information depending on an intended purpose of a video image pickup device and uses the selected information to decide the image pickup condition.

29. The video image pickup device as claimed in claim 28 , wherein the scene decision controller differently combines the angular rate, the representative point motion information, and the frequency distribution information depending on an intended purpose of a video image pickup device and uses the combined information to decide the image pickup condition.

30. The video image pickup device as claimed in claim 22 , wherein the scene decision controller uses threshold values and selects one of the threshold values to be used depending on an encoding search range magnitude.

31. The video image pickup device as claimed in claim 22 , wherein the video image data is generated by an image sensor provided in the camera body, and the motion of the camera body is detected by a sensor provided in the camera body.

32. An image pickup condition deciding method, comprising:

receiving a photographic subject motion information generated by detecting an on-screen motion of a photographic subject in a video image data;

receiving a camera body motion information generated by detecting a motion of a camera body;

deciding an image pickup condition of the video image data based on the photographic subject motion information and the camera body motion information, and

performing an encoding amount regulation control.

33. The image pickup condition deciding method as claimed in claim 32 , wherein the camera body motion information is generated by detecting an angular rate applied to the camera body as the motion of the camera body.

34. The image pickup condition deciding method as claimed in claim 32 ,

wherein the encoding amount regulation control is performed by skipping a frame.

35. The image pickup condition deciding method as claimed in claim 32 ,

wherein the encoding amount regulation control is performed by inserting a dummy frame.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: PANASONIC CORPORATION
To: PANASONIC SEMICONDUCTOR SOLUTIONS CO., LTD.
Reel/Frame 052755/0917 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2011
From: UCHIDA, TOMOKAZU; OGAWA, MASAHIRO; HOJO, MASAHIRO
To: PANASONIC CORPORATION
Reel/Frame 026994/0330 →