Three-dimensional imager and projection device
The systems and methods described herein include a device that can scan the surrounding environment and construct a 3D image, map, or representation of the surrounding environment using, for example, invisible light projected into the environment. In some implementations, the device can also project into the surrounding environment one or more visible radiation pattern patterns (e.g., a virtual object, text, graphics, images, symbols, color patterns, etc.) that are based at least in part on the 3D map of the surrounding environment.
1. A device comprising:
one or more cameras, the one or more cameras being configured to detect visible light and invisible light from one or more fields of view, and to create one or more visible light images and one or more invisible light images of the one or more fields of view;
one or more projectors, the one or more projectors being configured to project at least invisible light into at least one of the one or more fields of view; and
one or more processors, the one or more processors being configured to
control the one or more projectors to project at least one or more invisible light patterns into at least one of the one or more fields of view;
analyze the one or more invisible light images detected by the one or more cameras in order to generate depth data indicative of the depth of at least one item in at least one of the one or more fields of view; and
combine the one or more visible light images and the depth data to create three-dimensional data of at least one of the one or more fields of view,
wherein the one or more invisible light patterns corresponding to the same one of the one or more projectors are dynamically adjusted so as to increase the resolution of the depth data in at least one portion of the field of view, the one or more invisible light patterns being spatially shifted in time to generate a first subset of the depth data corresponding to a first set of locations at a first time and to generate a second subset of the depth data corresponding to a second set of locations at a second time, the second set of locations being different from the first set of locations, and
wherein the one or more invisible light patterns are dynamically adjusted so as to increase resolution of the depth data in a portion of the field of view where the depth data, or the rate of change of the depth data, exceeds a threshold.