Wearable multimedia device and cloud computing platform with application ecosystem

1. A method comprising:

receiving, using one or more processors of a cloud computing platform, two or more data streams, each data stream including a unique identifier and context data captured by a wearable multimedia device in a real-world environment, the context data including one or more digital images and depth data;

for each data stream:

identifying, using the one or more processors and based on the context data, a real-world object and one or more gestures associated with the real-world object; and

creating, using the one or more processors, a data processing pipeline with one or more applications based on one or more characteristics of the context data and the unique identifier;

generating, using the data processing pipeline, a description of the identified real-world object, the description including a label for the real-world object; and

sending, using the one or more processors, the description to the wearable multimedia device or other device.

2. The method of claim 1 , wherein the context data further includes audio, and the method further comprises:

determining that the audio includes a user request in a form of speech;

converting the speech into text;

identifying the real-world object using at least in part the text.

3. The method of claim 1 , wherein the context data further includes audio, and the method further comprises:

determining that the audio includes a user request in a form of speech;

converting the speech into text;

sending the text to a transportation service processor;

receiving a transport status and description of a vehicle in response to the text; and

sending the transportation status and the description of the vehicle to the wearable multimedia device or other device.

4. The method of claim 1 , wherein the one or more applications includes a virtual reality (VR) or augmented reality (AR) application, and the method further comprises:

generating, by the VR or AR application, VR or AR content using at least one of the one or more digital images or the depth data; and

sending the VR or AR content to the wearable multimedia device or other device.

5. The method of claim 1 , wherein the one or more applications includes an artificial intelligence application, the method further comprising:

determining, using the artificial intelligence application, a user preference from a past history of user requests; and

processing, using the one or more processors, the context data in accordance with the user preference.

6. The method of claim 1 , wherein the one or more applications includes a localization application, and the method further comprises:

determining, using the localization application, a location of the wearable multimedia device based on at least one of the one or more digital images or the depth data; and

sending the location to the wearable multimedia device or other device.

7. The method of claim 1 , wherein the context data includes financial transaction data for a financial transaction, biometric data and location data indicating a location of the financial transaction, the one or more applications includes a financial application, and the processing further comprises:

creating, using the financial application, a financial record of the financial transaction based on the financial transaction data, biometric data and location data; and

sending the financial record to the wearable multimedia device or other device.

8. The method of claim 1 , wherein the context data includes environmental sensor data, the one or more applications includes an environmental application, and the processing further comprises:

generating, using the environmental application, content associated with an operating environment of the wearable multimedia device based on environmental sensor data; and

sending the content to the wearable multimedia device or other device.

9. The method of claim 1 , wherein the context data includes video and audio, the one or more applications includes a video editing application, and the processing further comprises:

editing the video and audio in accordance with a user request or user preference for a particular film style; and

sending the edited video and audio to the wearable multimedia device or other device.

10. A system comprising:

one or more processors;

memory storing instructions that when executed by the one or more processors, causes the one or more processors to perform operations comprising:

receiving two or more data streams, each data stream including a unique identifier and context data captured by a wearable multimedia device in a real-world environment, the context data including one or more digital images and depth data;

for each data stream:

identifying, based on the context data, a real-world object and one or more gestures associated with the real-world object; and

creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and the unique identifier;

generating, using the data processing pipeline, a description of the identified real-world object, the description including a label for the real-world object; and

sending the description to the wearable multimedia device or other device.

11. The system of claim 10 , wherein the context data further includes audio, and the operations further comprise:

determining that the audio includes a user request in a form of speech;

converting the speech into text;

identifying the real-world object using at least in part the text.

12. The system of claim 10 , wherein the context data further includes audio, and the processing further comprises:

determining that the audio includes a user request in a form of speech;

converting the speech into text;

sending the text to a transportation service processor;

receiving a transportation status and a description of a vehicle in accordance with the text; and

sending the transportation status and the description of the vehicle to the wearable multimedia device or other device.

13. The system of claim 10 , wherein the one or more applications includes a virtual reality (VR) or augmented reality (AR) application, and the operations further comprise:

generating, by the VR or AR application, VR or AR content based on at least one of the one or more digital images or the depth data; and

sending the VR or AR content to the wearable multimedia device or other device.

14. The system of claim 10 , wherein the one or more applications includes an artificial intelligence application, and the operations further comprise:

determining, using the artificial intelligence application, a user preference from a past history of user requests; and

processing, by the one or more processors, the context data in accordance with the user preference.

15. The system of claim 10 , wherein the one or more applications includes a localization application, and the operations further comprise:

determining, by the localization application, a location of the wearable multimedia device based on at least one of the one or more digital images or the depth data; and

sending the location to the wearable multimedia device or other device.

16. The system of claim 10 , wherein the context data includes financial transaction data for a financial transaction, biometric data and location data indicating a location of the financial transaction, the one or more applications includes a financial application, and the operations further comprise:

creating, by the financial application, a financial record of the financial transaction based on the financial transaction data, biometric data and location data; and

sending the financial record to the wearable multimedia device or other device.

17. The system of claim 10 , wherein the context data includes environmental sensor data, the one or more applications includes an environmental application, and the operations further comprise:

generating, by the environmental application, content associated with an operating environment of the wearable multimedia device based on environmental sensor data; and

sending the content the wearable multimedia device or other device.

18. The system of claim 10 , wherein the system is a distributed streaming platform.

19. The system of claim 10 , wherein the context data includes video and audio, the one or more applications includes a video editing application, and the processing further comprises:

editing the video and audio in accordance with a user request or user preference for a particular film style; and

sending the edited video and audio to the wearable multimedia device or other device.

20. A non-transitory, computer-readable storage medium having instructions stored thereon, that when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving two or more data streams, each data stream including a unique identifier and context data captured by a wearable multimedia device in a real-world environment, the context data including one or more digital images and depth data;

for each data stream:

identifying, based on the context data, a real-world object and one or more gestures associated with the real-world object; and

creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and the unique identifier;

generating, using the data processing pipeline, a description of the identified real-world object, the description including a label for the real-world object; and

sending the description to the wearable multimedia device or other device.

21. A method comprising:

capturing, using a camera of a wearable multimedia device, a first set of digital images, the first set of digital images including two or more objects;

capturing, using a depth sensor of the wearable multimedia device, first depth data, the first depth data indicative of a first gesture by a user wearing the wearable multimedia device;

isolating a portion of at least one digital image in the first set of digital images based on the first gesture, the isolated portion including one of the two or more objects;

sending, using a wireless transceiver of the wearable multimedia device, the isolated portion to a network-based data processing pipeline;

receiving, using the wireless transceiver, first data from the network-based data processing pipeline, the first data associated with the object, the first data including a label for the object; and

projecting, using a laser projection system of the wearable multimedia device, an ephemeral display on a surface, the ephemeral display including at least a portion of the first data.

22. The method of claim 21 , further comprising:

receiving, using the camera and depth sensor, a second set of digital images and second depth data, the second depth data indicative of a second gesture of the user associated with the ephemeral display;

sending, using the wireless transceiver, the second set of digital images to the network-based data processing pipeline;

receiving, using the wireless transceiver, second data from the network-based data processing pipeline that is responsive to the second gesture; and

projecting, using the laser projection system, at least a portion of the second data in the ephemeral display on the surface.

23. The method of claim 21 , further comprising:

capturing, using one or more microphones of the wearable multimedia device, audio including speech;

sending, using the wireless transceiver, the speech to the network-based data processing pipeline; and

receiving, using the wireless transceiver processing pipeline that is responsive to the speech.

24. The method claim 23 , wherein the two or more objects and the audio including speech are sent to the network-based data processing pipeline as separate data streams and each data stream includes a unique identifier.

25. The method of claim 21 , further comprising:

obtaining, using a global navigation satellite system receiver or the wireless transceiver of the wearable multimedia device, a geographic location of the wearable multimedia device;

sending, using the wireless transceiver, the geographic location of the wearable multimedia device to the network-based data processing pipeline; and

receiving, using the wireless transceiver, second data from the network-based data processing pipeline that is responsive to a second gesture and the geographic location.

26. The method of claim 21 , wherein the wearable multimedia device includes a magnetic attachment mechanism for attaching the apparatus to a user's clothing.

27. The method of claim 21 , wherein the first data is associated with an ontology that is personal to the user.

28. The method of claim 27 , wherein one of the one or more real-world objects is an individual, and the first data includes the name of the individual taken from the ontology.

29. The method of claim 21 , wherein the wearable multimedia device does not include a screen for viewing the set of digital images.

30. The method of claim 21 , wherein the first data includes location data and a description of the two or more objects.

31. An apparatus comprising:

a camera;

a laser projection system;

a wireless transceiver;

one or more processors;

memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:

capturing, using the camera, a first set of digital images, the first set of digital images including two or more real-world objects;

isolating a first portion of at least one digital image in the first set of digital images, the isolated first portion including a first object of the two or more real-world objects;

isolating a second portion of the at least one digital image in the first set of digital images, the isolated second portion including a second object of the two or more real-world objects;

sending, using the wireless transceiver, a first data stream have a first unique identifier to a network-based data processing pipeline;

sending, using the wireless transceiver, a second data stream have a second unique identifier to the network-based data processing pipeline;

receiving, using the wireless transceiver, first data from the network-based data processing pipeline, the first data associated with the first real-world object

receiving, using the wireless transceiver, second data from the network-based data processing pipeline, the second data associated with the second real-world object; and

projecting, using the laser projection system, an ephemeral display on a surface that includes at least a portion of the first data or the second data on a surface.

32. The apparatus of claim 31 , wherein the operations further comprise:

capturing, using the camera, a second set of digital images including a gesture interacting with the ephemeral display;

sending, using the wireless transceiver, the second set of digital images to the network-based data processing pipeline;

receiving, using the wireless transceiver, third data from the network-based data processing pipeline that is responsive to the gesture; and

projecting, using the laser projection system, at least a portion of the third data in the ephemeral display on the surface.

33. The apparatus of claim 31 , further comprising one or more microphones of the apparatus, and wherein the operations further comprise:

capturing, using the one or more microphones, speech input;

sending, using the wireless transceiver, the speech input to the network-based data processing pipeline; and

receiving, using the wireless transceiver, third data from the network-based data processing pipeline that is responsive to the speech input.

34. The apparatus of claim 31 , further comprising a global navigation satellite system receiver, wherein the operations further comprise:

obtaining, using the global navigation satellite system receiver or the wireless transceiver, a geographic location of the apparatus;

sending, using the wireless transceiver, the geographic location of the apparatus to the network-based data processing pipeline;

receiving, using the wireless transceiver, third data from the network-based data processing pipeline associated with geographic location.

35. The apparatus of claim 31 , further comprising:

a magnetic attachment mechanism for attaching the apparatus to a user's clothing.

36. The apparatus of claim 31 , further comprising:

inductive charging circuitry for inductive charging or wireless over-the-air charging.

37. The apparatus of claim 31 , wherein the first data is associated with an ontology that is personal to a user.

38. The apparatus of claim 37 , wherein one of the one or more real-world objects is an individual, and the first data includes the name of the individual taken from the ontology.

39. The apparatus of claim 31 , wherein the apparatus does not include a screen for viewing the set of digital images.

40. An apparatus comprising:

an attachment mechanism for attaching the apparatus to a user's clothing;

a camera;

a depth sensor;

a laser projection system;

one or more processors;

memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:

capturing, using the camera, a set of digital images;

capturing, using the depth sensor, depth data;

identifying one or more real-world objects using the set of digital images and the depth data, wherein identifying the one or more real-world objects includes determining a label for each of the one or more real-world objects;

obtaining data associated with the identified one or more real-world objects; and

projecting, using the laser projection system, the data associated on a surface.

41. A screenless apparatus comprising:

an attachment mechanism for attaching the apparatus to a user's clothing;

a camera;

a laser projection system;

one or more processors;

memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:

capturing, using the camera, a set of digital images;

labeling, using the one or more processors, one or more real-world objects in the set of digital images;

obtaining, using the one or more processors, data associated with the one or more real-world objects based at least in part on the labeling; and

projecting, using the laser projection system, the data on a surface.

42. The apparatus of claim 41 , further comprising:

inductive charging circuitry for inductive charging or wireless over-the-air charging.