Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor
View Patent ↗An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.
1. An apparatus comprising:
a plurality of image modules each comprising (i) a sensor configured to capture images and (ii) a lens mounted to said sensor; and
a plurality of processors each configured to (A) receive said images from a subset of said plurality of image modules and (B) generate a plurality of video streams, wherein (i) each one of said video streams is generated by one of said processors in response to said images received from one of said image modules, (ii) said subset of said plurality of image modules comprises at least two distinct image modules of said plurality of image modules, (iii) said lenses are arranged to allow said images to provide coverage for a spherical field of view of a scene surrounding the apparatus, (iv) said multiple streams share a common system clock and (v) one or more timestamps are based on a common real-time clock.
2. The apparatus according to claim 1 , further comprising:
an interface configured to (i) connect said apparatus to an external device and (ii) provide power to said apparatus.
3. The apparatus according to claim 2 , wherein said interface is compliant with at least one of a (i) Power Over Ethernet (PoE) standard and (ii) a Universal Serial Bus (USB) standard.
4. The apparatus according to claim 2 , wherein said interface is configured to use a single cable to (i) transmit said plurality of video streams and (ii) receive power for said apparatus.
5. The apparatus according to claim 1 , further comprising:
a communication circuit configured to (i) receive said plurality of video streams packaged by said plurality of processors, (ii) forward said plurality of video streams into a single transmission and (iii) transmit said single transmission to a network, wherein said single transmission transmits said plurality of video streams on a first in first out basis.
6. The apparatus according to claim 1 , further configured to synchronize exposures of said plurality of image modules for video stitching operations performed by an external computing device.
7. The apparatus according to claim 6 , wherein said synchronization is performed by at least one of (a) a unified clock generator, (b) a circuit configured to perform negotiation operations over I 2 C, (c) a circuit configured to perform negotiation operations over Ethernet and (d) one of said image modules providing a clock signal to other of said plurality of image modules.
8. The apparatus according to claim 1 , wherein (i) said apparatus further comprises an inertial measurement unit connected to at least one of said plurality of processors and (ii) information recorded by said inertial measurement unit is transmitted as one of (a) metadata with at least one of said video streams and (b) a metadata channel separate from said video streams.
9. The apparatus according to claim 8 , wherein said metadata shares one of (i) a common clock and (ii) a timestamp with said video streams, wherein said common clock or said timestamp is generated based on a common real-time clock.
10. The apparatus according to claim 8 , further comprising:
an interface configured to (i) connect said apparatus to an external device and (ii) provide power to said apparatus.
11. The apparatus according to claim 10 , wherein (A) said interface is compliant with at least one of a (i) Power Over Ethernet (POE) standard and (ii) a Universal Serial Bus (USB) standard and (B) said interface is configured to use a single cable to (i) transmit said first video stream, said second video stream, said third video stream and said fourth video stream and (ii) receive power for said apparatus.
12. An apparatus comprising:
a casing configured to secure a plurality of sensors, each of said sensors configured to capture images;
a first processor configured to receive (i) said images from a first of said plurality of sensors and (ii) said images from a second of said plurality of sensors; and
a second processor configured to receive (i) said images from a third of said plurality of sensors and (ii) said images from a fourth of said plurality of sensors, wherein (i) said first processor is configured to generate (a) a first video stream in response to said images from said first of said plurality of sensors and a second video stream in response to said images from said second of said plurality of sensors and (b) said second processor is configured to generate a third video stream in response to said images from said third of said plurality of sensors and a fourth video stream in response to said images from said fourth of said plurality of sensors and (ii) lenses for said sensors are arranged to allow said images to provide coverage for a spherical field of view of a scene surrounding the apparatus.
13. The apparatus according to claim 12 , further comprising:
a communication circuit configured to (i) receive said first video stream, said second video stream, said third video stream and said fourth video stream packaged by said first processor and said second processor, (ii) forward said first video stream, said second video stream, said third video stream and said fourth video stream into a single transmission and (iii) transmit said single transmission to a network, wherein said single transmission transmits said first video stream, said second video stream, said third video stream and said fourth video stream on a first in first out basis.
14. The apparatus according to claim 13 , wherein said apparatus uses said communication circuit to transmit said single transmission without storing said first video stream, said second video stream, said third video stream and said fourth video stream.
15. The apparatus according to claim 12 , further configured to synchronize exposures of said plurality of sensors for video stitching operations performed by an external computing device.
16. The apparatus according to claim 15 , wherein said synchronization is performed by at least one of (a) a unified clock generator, (b) a circuit configured to perform negotiation operations over I 2 C, (c) a circuit configured to perform negotiation operations over Ethernet and (d) one of said sensors providing a clock signal to other of said plurality of sensors.
17. The apparatus according to claim 12 , wherein (i) said apparatus further comprises an inertial measurement unit connected to said first processor and (ii) information recorded by said inertial measurement unit is transmitted as one of (a) metadata with at least one of said first video stream, said second video stream, said third video stream and said fourth video stream and (b) a metadata channel separate from said first video stream, said second video stream, said third video stream and said fourth video stream.
18. An apparatus comprising:
a plurality of image modules each comprising (i) a sensor configured to capture images and (ii) a lens mounted to said sensor;
a plurality of processors each configured to (A) receive said images from a subset of said plurality of image modules and (B) generate a plurality of video streams, wherein (i) each one of said video streams is generated by one of said processors in response to said images received from one of said image modules, (ii) said subset of said plurality of image modules comprises at least two distinct image modules of said plurality of image modules and (iii) said lenses are arranged to allow said images to provide coverage for a spherical field of view of a scene surrounding the apparatus; and
a communication circuit configured to (i) receive said plurality of video streams packaged by said plurality of processors, (ii) forward said plurality of video streams into a single transmission and (iii) transmit said single transmission to a network, wherein said single transmission transmits said plurality of video streams on a first in first out basis.
19. The apparatus according to claim 18 , wherein said single transmission comprises single stream with a plurality of separately encoded subparts corresponding to each of said plurality of video streams.
20. The apparatus according to claim 18 , wherein said apparatus uses said communication circuit to transmit said single transmission without storing said plurality of video streams.