Camera bus carrier images
View Patent ↗The present specification describes examples of a computing device for reducing camera bus channels and bandwidth. The example computing device includes a plurality of tracking cameras to capture a plurality of tracking images. The computing device also includes a processor to receive the plurality of tracking images captured by the plurality of tracking cameras. The processor is to combine the plurality of tracking images into a carrier image. The computing device also includes a camera bus to transmit the carrier image.
1 . A computing device, comprising:
a plurality of tracking cameras to capture a plurality of tracking images;
a processor to:
receive the plurality of tracking images captured by the plurality of tracking cameras;
extract, using a machine-learning model, a set of tracking data from each of the plurality of tracking images; and
integrate the sets of tracking data from the plurality of tracking images into a carrier image; and
a camera bus to transmit the carrier image.
2 . The computing device of claim 1 , wherein the plurality of tracking images comprise images capturing a view of trackable features.
3 . The computing device of claim 1 , wherein the camera bus comprises a wired or wireless channel.
4 . The computing device of claim 1 , wherein the plurality of tracking images are captured by the plurality of tracking cameras at a same time instant.
5 . The computing device of claim 1 , wherein the camera bus is to transmit the carrier image to a system-on-chip (SOC) processor, wherein the SOC processor is to extract the plurality of tracking images from the carrier image.
6 . The computing device of claim 1 , further comprising a plurality of cameras to capture a plurality of display images, wherein:
the processor is to combine the plurality of display images and the sets of tracking data into the carrier image for transmission on the camera bus.
7 . The computing device of claim 1 , wherein the processor is to merge a plurality of input camera channels into a single camera output channel with the carrier image transmitted over the camera bus.
8 . The computing device of claim 6 , wherein the processor is to combine the plurality of display images and the sets of tracking data into the carrier image for transmission on the camera bus via concatenation of the sets of tracking data after the display images.
9 . The computing device of claim 1 , further comprising a first camera to capture a display image, wherein the processor is to use the display image as the carrier image and integrate the sets of tracking data into the display image.
10 . The computing device of claim 9 , wherein the processor is to integrate the sets of tracking data into the display image using image stenography.
11 . A method, comprising:
with a processor:
receiving a plurality of display images captured by a first plurality of cameras;
receiving a plurality of tracking images captured by a plurality of tracking cameras;
extracting, using a machine-learning model, a set of tracking data from each of the plurality of tracking images;
combining the plurality of display images and the sets of tracking data from the plurality of tracking images into a carrier image; and
transmitting the carrier image on a camera bus.
12 . The method of claim 11 , further comprising synchronizing the plurality of display images and the plurality of tracking images.
13 . The method of claim 11 , wherein the tracking data comprises feature-tracking data.
14 . The method of claim 11 , wherein with a second processor:
receiving the carrier image on the camera bus; and
extracting the plurality of display images and the tracking data from the carrier image.
15 . A non-transitory computer readable storage medium comprising computer usable program code embodied therewith, the computer usable program code to, when executed by a processor:
receive a plurality of tracking images captured by a plurality of tracking cameras;
extract, using a machine-learning model, a set of tracking data from each of the plurality of tracking images; and
integrate the sets of tracking data from the plurality of tracking images into a carrier image; and
transmit the carrier image on a camera bus.
16 . The non-transitory computer readable storage medium of claim 15 , further comprising to:
receive a display image captured by a first camera; and
create the carrier image by modifying the display image and performing image steganography to combine the sets of tracking data into the display image.
17 . The non-transitory computer readable storage medium of claim 16 , wherein performing the image steganography comprises adding a digital watermark that includes the tracking data to the display image.
18 . The non-transitory computer readable storage medium of claim 16 , wherein the plurality of tracking images are lower resolution than the display image.
19 . The non-transitory computer readable storage medium of claim 15 , wherein the sets of tracking data comprise eye-feature measurements, 6DOF measurements, or mouth-feature measurements extracted from the tracking images.
20 . The non-transitory computer readable storage medium of claim 15 , further comprising to:
receive a plurality of display images captured by a plurality of display cameras; and
combine the plurality of display images and the sets of tracking data into the carrier image for transmission on the camera bus.