IP Library › Granted Patent US 11,012,619
Granted Patent B2
US 11,012,619 · App. 16/635,404 · Granted May 18, 2021

Transmission device, transmission method, reception device, reception method, and imaging device

Inventors: Yukio Ichikawa (Saitama, JP); Makoto Urushihara (Tokyo, JP); Yukinobu Mine (Tokyo, JP)
Assignee: Sony Corporation
H04N5/23238G02B13/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,012,619
App. No.
16/635,404
Granted
May 18, 2021
Kind
B2
Abstract

High image quality real-time distribution of omnidirectional images is enabled. An imaging unit obtains a front image and a back image each having an ultra-wide viewing angle of greater than or equal to 180°. A transmission unit transmits the front image and the back image each having the ultra-wide viewing angle to an external device. For example, the imaging unit includes: a first imager that captures a front-side image taken in by a fisheye lens to obtain a front image having an ultra-wide viewing angle; and a second imager that captures a back-side image taken in by a fisheye lens to obtain a back image having an ultra-wide viewing angle, in which the second imager is arranged in a state of being rotated by 90° with respect to the first imager, the first imager captures the front-side image taken in by the fisheye lens in a state where the upper end side and the lower end side of the front-side image are partially missing, and the second imager captures the back-side image taken in by the fisheye lens in a state where the left end side and the right end side of the back-side image are partially missing.

Claims (59)

1. A transmission device comprising:

an imaging unit that obtains a front image and a back image each having an ultra-wide viewing angle of greater than or equal to 180°; and

a transmission unit that transmits the front image and the back image each having the ultra-wide viewing angle to an external device, wherein

the imaging unit includes a first imager having a first fisheye lens and a first light receiver that captures the front image having the ultra-wide viewing angle, and a second imager having a second fisheye lens and a second light receiver that captures the back image having the ultra-wide viewing angle,

the first imager and the second imager are positioned in a back-to-back configuration such that the first fisheye lens and the second fisheye lens face opposite directions,

the second light receiver is positioned to be rotated by 90° with respect to the first light receiver,

the first light receiver captures the front image such that an upper end side and a lower end side of the front image as taken in by the first fisheye lens are partially missing, and

the second light receiver captures the back image such that a left end side and a right end side of the back image as taken in by the second fisheye lens are partially missing.

2. The transmission device according to claim 1 , wherein

the transmission unit further transmits, together with the front image and the back image each having the ultra-wide viewing angle, lens information for obtaining an omnidirectional image by pasting the front image and the back image on an inner surface of a sphere.

3. The transmission device according to claim 1 , wherein

the transmission unit combines the front image and the back image each having the ultra-wide viewing angle into a combined image and transmits the combined image to the external device.

4. A transmission method comprising:

obtaining a front image and a back image each having an ultra-wide viewing angle of greater than or equal to 180° via an imaging unit; and

transmitting the front image and the back image each having the ultra-wide viewing angle to an external device via a transmission unit, wherein

the imaging unit includes a first imager having a first fisheye lens and a first light receiver that captures the front image having the ultra-wide viewing angle, and a second imager having a second fisheye lens and a second light receiver that captures the back image having the ultra-wide viewing angle,

the first imager and the second imager are positioned in a back-to-back configuration such that the first fisheye lens and the second fisheye lens face opposite directions,

the second light receiver is positioned to be rotated by 90° with respect to the first light receiver,

the first light receiver captures the front image such that an upper end side and a lower end side of the front image as taken in by the first fisheye lens are partially missing, and

the second light receiver captures the back image such that a left end side and a right end side of the back image as taken in by the second fisheye lens are partially missing.

5. The transmission method according to claim 4 , further comprising:

transmitting, together with the front image and the back image each having the ultra-wide viewing angle, lens information for obtaining an omnidirectional image by pasting the front image and the back image on an inner surface of a sphere to the external device via the transmission unit.

6. The transmission method according to claim 4 , wherein transmitting the front image and the back image each having the ultra-wide viewing angle further includes combining the front image and the back image into a combined image and transmitting the combined image to the external device via the transmission unit.

7. A reception device comprising:

a reception unit that receives a front image and a back image each having an ultra-wide viewing angle of greater than or equal to 180° from an external device, wherein

the front image having the ultra-wide viewing angle is captured by a first light receiver such that an upper end side and a lower end side of the front image as taken in by a first fisheye lens are partially missing,

the back image having the ultra-wide viewing angle is captured by a second light receiver such that a left end side and a right end side of the back image as taken in by a second fisheye lens are partially missing,

the first fisheye lens and the second fisheye lens are positioned in a back-to-back configuration such that the first fisheye lens and the second fisheye lens face opposite directions,

the second light receiver is positioned to be rotated by 90° with respect to the first light receiver, and

the reception device further includes an image processing unit that obtains an omnidirectional image by pasting the front image and the back image each having the ultra-wide viewing angle on an inner surface of a sphere.

8. The reception device according to claim 7 , wherein

the reception unit further receives, together with the front image and the back image each having the ultra-wide viewing angle, lens information for obtaining the omnidirectional image, and

the image processing unit obtains the omnidirectional image by pasting the front image and the back image each having the ultra-wide viewing angle on the inner surface of the sphere based on the lens information.

9. The reception device according to claim 7 , wherein the omnidirectional image is obtained by pasting the back image at 90° with respect to the front image on the inner surface of the sphere.

10. The reception device according to claim 7 , wherein

the reception unit further receives a combined image comprising the front image and the back image from the external device and separates the combined image into the front image and the back image each having the ultra-wide viewing angle.

11. A reception method comprising:

receiving a front image and a back image each having an ultra-wide viewing angle of greater than or equal to 180° from an external device via a reception unit, wherein

the front image having the ultra-wide viewing angle is captured by a first light receiver such that an upper end side and a lower end side of the front image as taken in by a first fisheye lens are partially missing,

the back image having the ultra-wide viewing angle is captured by a second light receiver such that a left end side and a right end side of the back image as taken in by a second fisheye lens are partially missing,

the first fisheye lens and the second fisheye lens are positioned in a back-to-back configuration such that the first fisheye lens and the second fisheye lens face opposite directions,

the second light receiver is positioned to be rotated by 90° with respect to the first light receiver, and

the reception method further includes obtaining an omnidirectional image by pasting the front image and the back image each having the ultra-wide viewing angle on an inner surface of a sphere via an image processing unit.

12. The reception method according to claim 11 , wherein

the reception unit further receives, together with the front image and the back image each having the ultra-wide viewing angle, lens information for obtaining the omnidirectional image, and

the image processing unit obtains the omnidirectional image by pasting the front image and the back image each having the ultra-wide viewing angle on the inner surface of the sphere based on the lens information.

13. The reception method according to claim 11 , wherein the omnidirectional image is obtained by pasting the back image at 90° with respect to the front image on the inner surface of the sphere.

14. The reception method according to claim 11 , wherein

the reception unit further receives a combined image comprising the front image and the back image from the external device and separates the combined image into the front image and the back image each having the ultra-wide viewing angle.

15. An imaging device comprising:

a first imager having a first fisheye lens and a first light receiver that captures a front-side image having an ultra-wide viewing angle; and

a second imager having a second fisheye lens and a second light receiver that captures a back-side image having an ultra-wide viewing angle, wherein

the first imager and the second imager are positioned in a back-to-back configuration such that the first fisheye lens and the second fisheye lens face opposite directions, and

the second light receiver is positioned to be rotated by 90° with respect to the first light receiver,

the first light receiver captures the front-side image such that an upper end side and a lower end side of the front-side image as taken in by the first fisheye lens are partially missing, and

the second light receiver captures the back-side image such that a left end side and a right end side of the back-side image as taken in by the second fisheye lens are partially missing.

16. The imaging device according to claim 15 , wherein the front-side image and the back-side image each having the ultra-wide viewing angle are pasted on an inner surface of a sphere based on lens information to obtain an omnidirectional image.

17. The imaging device according to claim 16 , wherein the omnidirectional image is obtained by pasting the back-side image at 90° with respect to the front-side image on the inner surface of the sphere.

18. The imaging device according to claim 15 , wherein the front-side image and the back-side image each having the ultra-wide viewing angle are combined to obtain a combined image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: ICHIKAWA, YUKIO; URUSHIHARA, MAKOTO; MINE, YUKINOBU
To: SONY CORPORATION
Reel/Frame 051675/0045 →
Priority Claims (1)
JP JP2017-152768 · Aug 7, 2017 · national
Continuity (1)
Related Publication 20200162670A1 · May 21, 2020