IP Library Granted Patent US 9,554,137
Granted Patent B2
US 9,554,137 · App. 14/752,883 · Granted Jan 24, 2017

Image receiving device, image transmission system, and image receiving method

Inventors: Kenichi Iwata (Kawasaki, JP); Tetsuya Shibayama (Kawasaki, JP); Katsushige Matsubara (Kawasaki, JP); Ren Imaoka (Kawasaki, JP); Seiji Mochizuki (Kawasaki, JP)
Assignee: RENESAS ELECTRONICS CORPORATION
H04N19/117H04N19/124H04N19/164H04N19/172H04N19/174H04N19/18H04N19/44H04N19/86
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,554,137
App. No.
14/752,883
Granted
Jan 24, 2017
Kind
B2
Abstract

To improve an image recognition rate by quickly changing a parameter in a proper manner without being affected by a transmission delay of an image encoding stream in an image receiving device that recognizes a decoded image obtained by decoding the received image encoding stream. The image receiving device includes a data receiving unit, a parameter changing unit, a decoding unit, and an image recognition unit. The data receiving unit receives an image encoding stream including image encoding data and the parameter. The parameter changing unit changes the parameter received by the data receiving unit, that is, the parameter specified for encoding performed by a sender, to a value suitable for image recognition performed in the subsequent stage. The decoding unit generates the image decoding data by decoding the received image encoding data according to the changed parameter. The image recognition unit performs image recognition on the image decoding data.

Claims (51)

1. An image receiving device comprising:

a data receiving unit;

a parameter changing unit;

a decoding unit; and

an image recognition unit,

the data receiving unit receiving an image encoding stream including image encoding data and a parameter, the image encoding stream comprising an elementary stream, the image encoding data comprising an encoded image, and the parameter comprising an encoding parameter in accordance with which an image is encoded to generate the encoded image,

the parameter changing unit being configured to change the parameter in the image encoding stream received by the data receiving unit so as to increase accuracy of image recognition performed by the image recognition unit,

the decoding unit generating image decoding data, the image decoding data comprising a decoded image, by decoding the image encoding stream including the image encoding data received by the data receiving unit and the parameter changed by the parameter changing unit, using the parameter changed by the parameter changing unit as a decoding parameter,

the image recognition unit performing the image recognition on the image decoding data, and

wherein in a process of the image recognition, the image recognition unit calculates an index indicating the accuracy of image recognition, and the parameter changing unit changes the parameter received by the data receiving unit, based on the index indicating the accuracy of image recognition calculated in the process of image recognition.

2. The image receiving device according to claim 1 ,

wherein the parameter changing unit changes the parameter received by the data receiving unit, based on environmental information of the image receiving device.

3. The image receiving device according to claim 2 ,

wherein the image receiving device is mounted on a vehicle, the image acquired by a camera mounted on the vehicle is encoded by an image encoding device, the image encoding stream generated by encoding the image is received by the data receiving unit, and the parameter changing unit changes, according to a running condition of the vehicle, the parameter received by the data receiving unit.

4. The image receiving device according to claim 1 ,

wherein the decoding unit includes a deblocking filter, and the parameter changing unit changes, as the parameter received by the data receiving unit, at least one of a parameter indicating whether to use the deblocking filter for the image encoding data and a filter coefficient of the deblocking filter.

5. The image receiving device according to claim 1 ,

wherein the decoding unit includes an inverse quantization unit, the parameter contains a quantization parameter for quantization included in encoding for generating the image encoding data, and the parameter changing unit changes the quantization parameter contained in the parameter received by the data receiving unit and then supplies the quantization parameter to the inverse quantization unit.

6. The image receiving device according to claim 1 ,

wherein the decoding unit includes an orthogonal inverse transform unit, the parameter contains an orthogonal transform coefficient for orthogonal transformation included in encoding for generating the image encoding data, and the parameter changing unit changes the orthogonal transform coefficient contained in the parameter received by the data receiving unit and then supplies the coefficient to the orthogonal inverse transform unit.

7. The image receiving device according to claim 1 ,

wherein the image receiving device further includes a parameter transmitting unit, the image recognition unit calculates an index indicating accuracy of image recognition in a process of image recognition, the parameter changing unit changes the parameter received by the data receiving unit, according to the index indicating the accuracy of image recognition calculated in the process of image recognition, and the parameter transmitting unit transmits, to the image transmitting device having generated and transmitted the image encoding stream, the index indicating the accuracy of image recognition calculated in the process of image recognition.

8. The image receiving device according to claim 7 ,

wherein the parameter changing unit changes, based on environmental information of the image receiving device, the parameter received by the data receiving unit, and the parameter transmitting unit transmits, to the image transmitting device having generated and transmitted the image encoding stream, an index indicating the environmental information of the image receiving device.

9. The image receiving device according to claim 8 ,

wherein the image receiving device is mounted on a vehicle, an image acquired by a camera mounted on the vehicle is encoded by an image encoding device, the image encoding stream generated by encoding the image is received by the data receiving unit, the parameter changing unit changes, according to a running condition of the vehicle, the parameter received by the data receiving unit, and the parameter transmitting unit transmits, to the image transmitting device having generated and transmitted the image encoding stream, an index indicating the running condition of the vehicle.

10. The image receiving device according to claim 1 , further comprising another decoding unit and a display unit,

wherein the data receiving unit supplies the received image encoding stream to the another decoding unit, the another decoding unit decodes, according to the parameter included in the image encoding stream, the image encoding data included in the image encoding stream, generates another image decoding data, and supplies the image decoding data to the display unit.

11. An image transmission system comprising:

the image receiving device according to claim 1 , and

an image transmitting device including an image encoding device that receives, as the image, an original image and generates the image encoding data by encoding the original image according to the encoding parameter corresponding to the parameter, the image transmitting device supplying the image encoding stream to the image receiving device.

12. The image transmission system according to claim 11 ,

wherein the image transmission system is mounted on a vehicle including a camera that acquires a surrounding image as the original image and an on-board network, and

the image transmitting device and the image receiving device are coupled to each other so as to communicate with each other via the on-board network.

13. An image receiving method in which a data receiving unit, a parameter changing unit, a decoding unit, and an image recognition unit are provided,

the method comprising:

inputting, to the data receiving unit, an image encoding stream including image encoding data and a parameter, the image encoding stream comprising an elementary stream, the image encoding data comprising an encoded image, and the parameter comprising an encoding parameter in accordance with which an image is encoded to generate the encoded image;

allowing the parameter changing unit to change the parameter in the image encoding stream received by the data receiving unit so as to increase an accuracy of image recognition performed by the image recognition unit;

generating image decoding data, the image decoding data comprising a decoded image, by decoding, in the decoding unit, the image encoding stream including the image encoding data received by the data receiving unit and the parameter changed by the parameter changing unit, using the parameter changed by the parameter changing unit as a decoding parameter; and

allowing the image recognition unit to perform image recognition on the image decoding data,

wherein in the image recognition, the image recognition unit calculates an index indicating accuracy of image recognition, and the parameter changing unit changes the parameter inputted to the data receiving unit, based on the index indicating the accuracy of image recognition calculated in the image recognition.

14. The image receiving method according to claim 13 ,

wherein the parameter changing unit changes the parameter received by the data receiving unit, based on environmental information of an image receiving device according to the image receiving method.

15. The image receiving method according to claim 14 ,

wherein the image receiving device is mounted on a vehicle, the image acquired by a camera mounted on the vehicle is encoded by an image encoding device, the image encoding stream generated by encoding the image is received by the data receiving unit, and the parameter changing unit changes, according to a running condition of the vehicle, the parameter received by the data receiving unit.

16. The image receiving method according to claim 13 ,

wherein the decoding unit includes a deblocking filter, and the parameter changing unit changes, as the parameter received by the data receiving unit, at least one of a parameter indicating whether to use the deblocking filter for the image encoding data and a filter coefficient of the deblocking filter.

17. The image receiving method according to claim 13 ,

wherein the decoding unit includes an inverse quantization unit, the parameter contains a quantization parameter for quantization included in encoding for generating the image encoding data, and the parameter changing unit changes the quantization parameter contained in the parameter received by the data receiving unit and then supplies the quantization parameter to the inverse quantization unit.

18. The image receiving method according to claim 13 ,

wherein the decoding unit includes an orthogonal inverse transform unit, the parameter contains an orthogonal transform coefficient for orthogonal transformation included in encoding for generating the image encoding data, and the parameter changing unit changes the orthogonal transform coefficient contained in the parameter received by the data receiving unit and then supplies the coefficient to the orthogonal inverse transform unit.

Assignments (2)
CHANGE OF ADDRESS Recorded Nov 29, 2017
From: RENESAS ELECTRONICS CORPORATION
To: RENESAS ELECTRONICS CORPORATION
Reel/Frame 044928/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2015
From: IWATA, KENICHI; SHIBAYAMA, TETSUYA; MATSUBARA, KATSUSHIGE; IMAOKA, REN; MOCHIZUKI, SEIJI
To: RENESAS ELECTRONICS CORPORATION
Reel/Frame 035938/0369 →
Priority Claims (1)
JP 2014-148574 · Jul 22, 2014 · national
Continuity (1)
Related Publication 20160029021A1 · Jan 28, 2016