Projecting and receiving input from one or more input interfaces attached to a display device
Multiple projection input devices may be permanently attached or temporarily attached to a display device. Each projection input device may project, using one or more projectors, a representation of an input device on a work surface, receive video data from one or more cameras, identify one or more fingers interacting with the representation of the input device, track a motion of the one or more fingers relative to the representation of the input device, predict, using a machine learning algorithm and based on tracking the motion of the one or more fingers relative to the representation of the input device, a particular input being provided, and transmit the particular input to a computing device. The representation of the particular input device may include a representation of one of: a keyboard, a mouse, a trackpad, a numeric keypad, a trackball, or a gaming controller.
1. A display device comprising:
an enclosure to house:
a display panel; and
a plurality of projection input devices attached to the enclosure, wherein:
individual projection input devices of the plurality of projection input devices correspond to individual users of a plurality of users;
the individual projection input devices comprise one or more cameras and one or more projectors; and
the individual projection input devices of the plurality of projection input devices are configured to perform operations comprising:
receiving first video data from the one or more cameras;
determining that the first video data includes a particular gesture;
projecting, using the one or more projectors, a representation of an input device on a work surface, wherein the representation of the input device corresponds to the particular gesture included in the first video data;
receiving second video data from the one or more cameras;
identifying, in the second video data, one or more fingers interacting with the representation of the input device;
tracking a motion of the one or more fingers relative to the representation of the input device;
predicting, using a machine learning algorithm and based on tracking the motion of the one or more fingers relative to the representation of the input device, a particular input being provided; and
transmitting the particular input to a computing device;
wherein the plurality of projection input devices enable the plurality of users to simultaneously provide input while viewing the display panel; and
wherein at least one projection input device of the plurality of projection input devices is:
stored in a retracted position in a cavity of the enclosure of the display device when not in use; and
placed in a projection position in which at least a portion of the at least one projection input device extends past an external surface of the enclosure of the display device when in use.
2. The display device of claim 1 , wherein:
at least one projection input device of the plurality of projection input devices is permanently attached to the enclosure of a display device.
3. The display device of claim 1 , wherein:
at least one projection input device of the plurality of projection input devices is temporarily attached to the enclosure of a display device by inserting a plug of the projection input device into a port located on the enclosure of the display device.
4. The display device of claim 3 , wherein:
the plug comprises:
a locking mechanism to temporarily secure the projection input device to the enclosure of the display device;
a release mechanism to release the projection input device from the enclosure of the display device after the projection input device is secured to the enclosure of the display device;
one or more motors to position the projection input device in three dimensions; and
one or more electrical connections to route power from the display device to the projection input device.
5. The display device of claim 1 , the operations further comprising:
receiving additional video data from the one or more cameras;
performing a gesture recognition analysis of a content of the additional video data;
determining, based on the gesture recognition analysis, that the additional video data includes a pre-defined gesture; and
performing one or more actions associated with the pre-defined gesture.
6. The display device of claim 5 , wherein the one or more actions comprise at least one of:
initiating projection of a representation of a particular input device;
modifying an appearance of the representation of the particular input device, including modifying at least one of a brightness or a color of the representation of the particular input device;
moving the projection of the representation from a first location to a second location; or
stopping displaying the representation of the particular input device.
7. The display device of claim 1 , wherein the representation of the at least one input device comprises a representation of one of:
a keyboard;
a mouse;
a trackpad;
a numeric keypad;
a trackball; or
a gaming controller.
8. A display device comprising:
an enclosure;
a display panel; and
a plurality of projection input devices attached to the enclosure, wherein individual projection input devices of the plurality of projection input devices correspond to individual users of a plurality of users and wherein individual projection input devices of the plurality of projection input devices are configured to:
receive first video data from one or more cameras;
determine that the first video data includes a particular gesture;
project, using one or more projectors, a representation of an input device on a work surface, wherein the representation of the input device corresponds to the particular gesture included in the first video data;
receive second video data from the one or more cameras;
identify, in the second video data, one or more fingers interacting with the representation of the input device;
track a motion of the one or more fingers relative to the representation of the input device;
predict, using a machine learning algorithm and based on tracking the motion of the one or more fingers relative to the representation of the input device, a particular input being provided; and
transmit the particular input to a computing device that is connected to the display device;
wherein the plurality of projection input devices enable the plurality of users to simultaneously provide input while viewing the display panel; and
wherein at least one projection input device of the plurality of projection input devices is:
stored in a retracted position in a cavity of the enclosure of the display device when not in use; and
placed in a projection position in which at least a portion of the at least one projection input device extends past an external surface of the enclosure of the display device when in use.
9. The display device of claim 8 , wherein:
at least one projection input device of the plurality of projection input devices is permanently attached to the enclosure of a display device.
10. The display device of claim 8 , wherein:
at least one projection input device of the plurality of projection input devices is temporarily attached to the enclosure of a display device by inserting a plug included in each projection input device into a port located on the enclosure of the display device.
11. The display device of claim 10 , wherein the plug comprises:
a locking mechanism to temporarily secure a particular projection input device of the plurality of projection input devices to the enclosure of the display device;
a release mechanism to release the particular projection input device from the enclosure of the display device after the particular projection input device is secured to the enclosure of the display device;
one or more motors to position the particular projection input device in three dimensions; and
one or more electrical connections to route power from the display device to the particular projection input device.
12. The display device of claim 8 , wherein each projection input device is further configured to:
receive additional video data from the one or more cameras;
perform a gesture recognition analysis of a content of the additional video data;
determine, based on the gesture recognition analysis, that the additional video data includes a pre-defined gesture; and
perform one or more actions associated with the pre-defined gesture.
13. The display device of claim 12 , wherein the one or more actions comprise at least one of:
initiating projection of a representation of a particular input device;
modifying an appearance of the representation of the particular input device, including modifying at least one of a brightness or a color of the representation of the particular input device;
moving the projection of the representation from a first location to a second location; or
stopping displaying the representation of the particular input device.
14. The display device of claim 8 , wherein the representation of the input device comprises a representation of one of:
a keyboard;
a mouse;
a trackpad;
a numeric keypad;
a trackball; or
a gaming controller.
15. An all-in-one device comprising:
an enclosure to house:
a motherboard comprising one or more processors and one or more non-transitory computer-readable storage media;
a display panel; and
a plurality of projection input devices attached to the enclosure, wherein individual projection input devices of the plurality of projection input devices correspond to individual users of a plurality of users and wherein individual projection input devices of the plurality of projection input devices are configured to:
receive first video data from one or more cameras;
determine that the first video data includes a particular gesture;
project, using one or more projectors, a representation of an input device on a work surface, wherein the representation of the input device corresponds to the particular gesture included in the first video data;
receive video data from the one or more cameras;
identify one or more fingers interacting with the representation of the input device;
track a motion of the one or more fingers relative to the representation of the input device;
predict, using a machine learning algorithm and based on tracking the motion of the one or more fingers relative to the representation of the input device, a particular input being provided; and
transmit the particular input to the motherboard;
wherein the plurality of projection input devices enable the plurality of users to simultaneously provide input while viewing the display panel; and
wherein at least one projection input device of the plurality of projection input devices is:
stored in a retracted position in a cavity of the enclosure when not in use; and
placed in a projection position in which at least a portion of the at least one projection input device extends past an external surface of the enclosure when in use.
16. The all-in-one device of claim 15 , wherein:
at least one projection input device of the plurality of projection input devices is permanently attached to the enclosure of a display device.
17. The all-in-one device of claim 15 , wherein:
at least one projection input device of the plurality of projection input devices is temporarily attached to the enclosure of a display device by inserting a plug included in each projection input device into a port located on the enclosure of the display device.
18. The all-in-one device of claim 17 , wherein the plug comprises:
a locking mechanism to temporarily secure a particular projection input device of the plurality of projection input devices to the enclosure of the display device;
a release mechanism to release the particular projection input device from the enclosure of the display device after the particular projection input device is secured to the enclosure of the display device;
one or more motors to position the particular projection input device in three dimensions;
and
one or more electrical connections to route power from the display device to the particular projection input device.
19. The all-in-one device of claim 15 , wherein each projection input device is further configured to:
receive additional video data from the one or more cameras;
perform a gesture recognition analysis of a content of the additional video data;
determine, based on the gesture recognition analysis, that the additional video data includes a pre-defined gesture; and
perform one or more actions associated with the pre-defined gesture, wherein the one or more actions comprise at least one of:
initiating projection of a representation of a particular input device;
modifying an appearance of the representation of the particular input device, including modifying at least one of a brightness or a color of the representation of the particular input device;
moving the projection of the representation from a first location to a second location; or
stopping displaying the representation of the particular input device.
20. The all-in-one device of claim 19 , wherein the representation of the particular input device comprises a representation of one of:
a keyboard;
a mouse;
a trackpad;
a numeric keypad;
a trackball; or
a gaming controller.