Video overlay systems
View Patent ↗A system may include computing equipment and a handheld video overlay accessory. A video overlay accessory may include one or more light sources, an image sensor, and processing circuitry. The video overlay accessory may include an image projector that projects images onto external objects. The video overlay accessory may include a partially transparent beam splitter and a display that projects display content onto the partially transparent beam splitter. A user that views a scene through the partially transparent beam splitter may view the display content apparently overlaid onto the scene. Light sources in the video overlay accessory may be laser diodes or other light-emitting diodes that project tracking spots such as infrared tracking spots on to external objects. The image sensor may be used to capture images of the tracking spots. The processing circuitry may determine distance and position information based on the captured images.
1. An image display system, comprising:
a light source configured to project optical tracking spots onto an external object, wherein the light source comprises a grating structure that generates a plurality of light beams for projecting the optical tracking spots, wherein the grating structure comprises a two-dimensional grating pattern configured to produce the plurality of light beams, and wherein the plurality of light beams are separated by a common angle;
a camera configured to capture images of the projected optical tracking spots;
an image projector configured to project display images onto the external object;
processing circuitry configured to generate the display images to be projected using the captured images of the projected optical tracking spots; and
a housing structure in which the light source and the image projector are mounted.
2. The image display system defined in claim 1 wherein the camera comprises an image pixel array having a pixel projection angle that is different from the common angle.
3. The image display system defined in claim 1 , wherein the housing structure is configured to fit into a human hand, and wherein the camera and the processing circuitry are mounted in the housing structure.
4. The image display system defined in claim 3 , further comprising a user input component mounted in the housing structure.
5. The image display system defined in claim 4 wherein the user input component comprises a button.
6. An image display system, comprising:
a light source configured to project optical tracking spots onto an external object;
a camera configured to capture images of the projected optical tracking spots;
a partially transparent beam splitter;
a display that projects device-generated display content onto the partially transparent beam splitter, wherein when a portion of a real-world scene is viewed through the partially transparent beam splitter, the device-generated display content that is projected onto the partially transparent beam splitter appears to be overlaid onto the portion of the real world scene; and
processing circuitry configured to generate position data by determining distances between the optical tracking spots in the captured images.
7. The image display system defined in claim 6 wherein the display comprises a liquid crystal display.
8. The image display system defined in claim 6 wherein the light source comprises a plurality of light sources configured to form a plurality of light beams for projecting the optical tracking spots.
9. The image display system defined in claim 6 wherein the light source comprises a light-generating element and a grating structure configured to form a plurality of light beams for projecting the optical tracking spots.
10. The image display system defined in claim 6 wherein the light source comprises a light-generating element and a slit configured to form a plurality of light beams for projecting the optical tracking spots.
11. The image display system defined in claim 6 wherein the light source comprises a laser diode.
12. The image display system defined in claim 6 wherein the processing circuitry is further configured to generate the device-generated display content based on the generated position data.
13. The image display system defined in claim 6 wherein the camera includes at least one complementary metal-oxide-semiconductor image pixel.
14. The image display system defined in claim 6 wherein generating the position data comprises determining a number of pixels between the optical tracking spots in a given one of the captured images.
15. A system, comprising:
a central processing unit;
memory;
input-output circuitry; and
a video overlay accessory, wherein the video overlay accessory comprises:
a light source that generates optical tracking spots in a real world scene;
a camera; and
video overlay components that overlay device-generated display content over objects in the real-world scene, wherein the video overlay components change the device-generated display content based on the position of the video overlay accessory relative to the objects in the real-world scene, and wherein the camera captures images of the real world scene that include the optical tracking spots and the overlaid device-generated display content, wherein the video overlay components comprise:
a partially transparent beam splitter; and
a display that projects the device-generated display content onto the partially transparent beam splitter.
16. The system defined in claim 15 wherein the video overlay components comprise an image projector that projects the device-generated display content onto a surface of at least one of the objects in the real-world scene.