IP Library Granted Patent US 11,899,911
Granted Patent B2
US 11,899,911 · App. 17/687,503 · Granted Feb 13, 2024

Message composition interfaces for use with wearable multimedia devices

Inventors: Kenneth Luke Kocienda (Mill Valley, CA); Imran A. Chaudhri (San Francisco, CA)
Assignee: Humane, Inc.
G06F3/0484G06F3/017G06F3/0482G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,899,911
App. No.
17/687,503
Filed
Mar 4, 2022
Granted
Feb 13, 2024
Kind
B2
Art Unit
2175
USPC
715/728
Abstract

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device presents a user interface for composing a message. The device receives a first user input indicating a recipient of the message and first data for inclusion in the message. In response, the device presents at least the recipient and the first data in a first user interface element of the user interface. Further, subsequent to receiving the first user input, the device receives a second user input indicating a selection of a first application or service from a plurality of applications or services presented in a second user interface element of the user interface. Subsequently, the device transmits the message to the recipient using the first application or service.

Claims (89)

1. A method comprising:

presenting, by a wearable multimedia device, a user interface for composing a message, wherein presenting the user interface comprises concurrently presenting:

a first user interface element configured to present contents of the message, and

a second user interface element configured to present a plurality of applications or services for transmitting the message;

receiving, by the wearable multimedia device, a first user input indicating:

a recipient of the message, and

first data for inclusion in the message;

responsive to receiving the first user input:

presenting, by the wearable multimedia device, at least the recipient and the first data in the first user interface element, and

modifying the second user interface element based on the recipient;

subsequent to receiving the first user input, receiving, by the wearable multimedia device, a second user input indicating a selection of a first application or service from the plurality of applications or services presented in the second user interface element; and

subsequent to receiving the second user input, transmitting, by the wearable multimedia device, the message to the recipient using the first application or service.

2. The method of claim 1 , wherein the wearable multimedia device transmits the message responsive to receiving the second user input.

3. The method of claim 1 , further comprising:

receiving, by the wearable multimedia device, a third user input instructing the wearable multimedia device to transmit the message,

wherein the wearable multimedia device transmits the message responsive to receiving the third user input.

4. The method of claim 1 , wherein presenting the user interface comprises:

projecting, using a laser projector of the wearable multimedia device, the user interface on a surface.

5. The method of claim 4 , wherein the surface is a surface of a hand of a user.

6. The method of claim 4 , wherein the surface is a palm of a user.

7. The method of claim 1 , wherein receiving the first user input comprises:

generating, using one or more microphones of the wearable multimedia device, a first audio signal representing a first spoken command by a user; and

determining the first user input based on the first audio signal.

8. The method of claim 1 , wherein receiving the second user input comprises:

generating, using one or more microphones of the wearable multimedia device, a second audio signal representing a second spoken command by the user; and

determining the second user input based on the second audio signal.

9. The method of claim 1 , wherein receiving the first user input comprises:

detecting, using one or more cameras or depth sensors of the wearable multimedia device, one or more first gestures performed by the user; and

determining the first user input based on the one or more first gestures.

10. The method of claim 9 , wherein receiving the second user input comprises:

detecting, using the one or more cameras or depth sensors of the wearable multimedia device, one or more second gestures performed by the user; and

determining the second user input based on the one or more second gestures.

11. The method of claim 1 , wherein the plurality of applications or services comprises at least one of:

an e-mail application or service,

a text message application or service,

a chat application or service, or

a collaboration application or service.

12. The method of claim 1 , wherein modifying the second user interface element comprises:

determining an availability of the recipient to receive messages using a first subset of the plurality of applications or services; and

visually emphasizing the first subset of the plurality of applications or services in the second user interface element.

13. The method of claim 12 , wherein determining the availability of the recipient to receive messages using the first subset of the plurality of applications or services comprises:

obtaining, for each of the plurality of applications or services, presence information regarding the recipient, wherein the presence information indicates at least one of an availability or an unavailability of the recipient to receive messages using that application or service; and

determining, based on the presence information, that the recipient is available to receive messages using the first subset of the plurality of applications or services.

14. The method of claim 12 , wherein modifying the second user interface element comprises:

determining an unavailability of the recipient to receive messages using a second subset of the plurality of applications or services; and

at least one of:

removing the second subset of the plurality of applications or services from the second user interface element, or

visually deemphasizing the second subset of the plurality of applications or services in the second user interface element.

15. The method of claim 1 , wherein modifying the second user interface element comprises:

obtaining historical data comprising previous communications between the user and the recipient;

determining that the user and the recipient previously communicated with one another using a particular application or service from among the plurality of applications or services; and

visually emphasizing that application or service in the second user interface element.

16. The method of claim 1 , wherein modifying the second user interface element comprises:

determining a quality metric for each of the plurality of applications or services; and

visually emphasizing one or more of the plurality of applications or services based on the quality metrics.

17. The method of claim 16 , wherein, for each of the plurality of applications or services, the quality metric represents at least one of:

a reliability of the application or service, or

a latency of the application or service.

18. The method of claim 1 , wherein modifying the second user interface element comprises at least one of:

modifying an order of the plurality of applications or services,

filtering the plurality of applications or services,

visually emphasizing at least some of the plurality of applications or services, or

visually deemphasizing at least some of the plurality of applications or services.

19. A wearable multimedia device, comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

presenting a user interface for composing a message, wherein presenting the user interface comprises concurrently presenting:

a first user interface element configured to present contents of the message, and

a second user interface element configured to present a plurality of applications or services for transmitting the message;

receiving a first user input indicating:

a recipient of the message, and

first data for inclusion in the message;

responsive to receiving the first user input:

presenting at least the recipient and the first data in the first user interface element, and

modifying the second user interface element based on the recipient;

subsequent to receiving the first user input, receiving a second user input indicating a selection of a first application or service from the plurality of applications or services presented in the second user interface element; and

responsive to receiving the second user input, transmitting the message using the first application or service.

20. One or more non-transitory computer-readable media storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

presenting a user interface for composing a message, wherein presenting the user interface comprises concurrently presenting:

a first user interface element configured to present contents of the message, and

a second user interface element configured to present a plurality of applications or services for transmitting the message;

receiving a first user input indicating:

a recipient of the message, and

first data for inclusion in the message;

responsive to receiving the first user input

presenting at least the recipient and the first data in the first user interface element, and

modifying the second user interface element based on the recipient;

subsequent to receiving the first user input, receiving a second user input indicating a selection of a first application or service from the plurality of applications or services presented in the second user interface element; and

responsive to receiving the second user input, transmitting the message using the first application or service.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: HUMANE, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 071844/0747 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2023
From: KOCIENDA, KENNETH LUKE; CHAUDHRI, IMRAN A.
To: HUMANE, INC.
Reel/Frame 064634/0212 →
Continuity (1)
Related Publication 20230280883A1 · Sep 7, 2023
Cited By (4)
US 12,541,881 US 12,556,802 US 12,608,041 US 12,699,420