Wearable multimedia device and cloud computing platform with application ecosystem
Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a method comprises: receiving, by one or more processors of a cloud computing platform, context data from a wearable multimedia device, the wearable multimedia device including at least one data capture device for capturing the context data; creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and a user request; processing the context data through the data processing pipeline; and sending output of the data processing pipeline to the wearable multimedia device or other device for presentation of the output.
1. An apparatus comprising:
a time of flight (TOF) sensor;
a camera;
a laser projection system;
one or more processors;
memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:
training a deep learning network with historical user context data;
capturing, with at least one of the TOF sensor or the camera, context data;
determining, with the trained deep learning network, a user preference based on the context data;
selecting, an application, based on the user preference and the context data;
processing, with the selected application, the context data into a presentation; and
projecting, using the laser projection system, at least a portion of the presentation on a surface.
2. The apparatus of claim 1 , further comprising:
a global navigation satellite receiver configured to determine a geographic location of the apparatus, wherein the operations further comprise:
generating or obtaining second data based on the geographic location; and
projecting, using the laser projection system, at least a portion of the second data on the surface.
3. The apparatus of claim 1 , further comprising:
a biometric sensor configured to detect a heartbeat of a user and to generate heart rate data, wherein the operations further comprise:
generating or obtaining second data based on the heart rate data; and
projecting, using the laser projection system, at least a portion of the second data on the surface.
4. The apparatus of claim 1 , further comprising:
a biometric sensor configured to detect a fingerprint of the user and to generate fingerprint data, wherein the operations further comprise:
generating or obtaining second data based on the fingerprint data; and
projecting, using the laser projection system, at least a portion of the second data on the surface.
5. The apparatus of claim 1 , further comprising:
a biometric sensor configured to detect an emotional state of the user and generating emotional state data, wherein the operations further comprise:
generating or obtaining second data based on the emotional state data; and
projecting, using the laser projection system, at least a portion of the second data on the surface.
6. The apparatus of claim 1 , further comprising:
one or more earbuds coupled to the apparatus; and
one or more inertial sensors included in or coupled to the earbuds and configured to provide direction data indicative of a direction the user is facing or head gestures, and wherein the operations further comprise:
generating or obtaining second data based on the direction data; and
projecting, using the laser projection system, at least a portion of the second data on the surface.
7. The apparatus of claim 6 , wherein the direction data is used to steer the sensor in the direction that the user is facing.