IP Library › Granted Patent US 10,740,389
Granted Patent B2
US 10,740,389 · App. 15/951,826 · Granted Aug 11, 2020

Remembering audio traces of physical actions

Inventors: Priya Ganadas (Seattle, WA); Adolfo Hernandez Santisteban (Bothell, WA); Aaron Daniel Krauss (Snoqualmie, WA); Andrew Frederick Muehlhausen (Seattle, WA)
Assignee: Microsoft Technology Licensing, KKC
G06F16/61G06F16/683G06F16/686G06F16/9535G10L25/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,389
App. No.
15/951,826
Granted
Aug 11, 2020
Kind
B2
Abstract

Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Claims (50)

1. A computer device, comprising:

a memory to store data and instructions;

a processor in communication with the memory; and

an operating system in communication with the memory and the processor, wherein the operating system is operable to:

receive, from at least one sensor on the computer device, a detected sound generated as a result of an event taking place around a user or generated by an object as a result of an action taken by the user on the object;

compare the detected sound to a plurality of audio patterns stored in a sound database;

identify a sound event for the detected sound based on a comparison of the detected sound to the plurality of audio patterns, wherein the sound event identifies the event taking place around the user or the action taken by the user on the object;

identify context information that describes the sound event; and

update a sound log with the sound event and the context information.

2. The computer device of claim 1 , wherein the operating system is further operable to identify the sound event when a match occurs between the detected sound and at least one audio pattern of the plurality of audio patterns stored in the sound database.

3. The computer device of claim 1 , wherein the context information includes at least one or more of a location of the computer device and a time when the detected sound occurred.

4. The computer device of claim 1 , wherein the sound log provides a chronological order of a plurality of sound events and associated context information.

5. The computer device of claim 1 , wherein the computer device further includes an assistant in communication with the memory, the processor, and the operating system, wherein the assistant is operable to:

query the sound log to provide recommendations to the user of the computer device.

6. The computer device of claim 5 , wherein the assistant is further operable to:

receive a request from the user;

query the sound log based at least upon the request to identify the sound event and the context information associated with the sound event; and

provide a response to the request based on the context information associated with the sound event.

7. The computer device of claim 5 , wherein the assistant is further operable to:

receive one or more audio patterns and corresponding sound events; and

upload the one or more audio patterns and the corresponding sound events to the sound database.

8. The computer device of claim 1 , wherein the sound database is curated for the user of the computer device.

9. The computer device of claim 1 , wherein the at least one sensor is part of a network of sensors in communication with the computer device.

10. The computer device of claim 1 , wherein the context information identifies a time of the sound event or a location of the user from a global positioning system (GPS).

11. A method for creating a sound log of activities, comprising:

receiving, at an operating system executing on a computer device, a detected sound from at least one sensor on the computer device, wherein the detected sound is generated as a result of an event taking place around a user or generated by an object as a result of an action taken by the user on the object;

comparing the detected sound to a plurality of audio patterns stored in a sound database;

identifying a sound event for the detected sound based on a comparison of the detected sound to the plurality of audio patterns, wherein the sound event identifies the event taking place around the user or the action taken by the user on the object;

identifying context information that describes the sound event; and

updating the sound log with the sound event and the context information.

12. The method of claim 11 , wherein identifying the sound event further comprises a match occurring between the detected sound and at least one audio pattern of the plurality of audio patterns stored in the sound database.

13. The method of claim 11 , wherein the context information includes at least one or more of a location of the computer device and a time when the detected sound occurred.

14. The method of claim 11 , wherein the sound log provides a chronological order of a plurality of sound events and associated context information.

15. The method of claim 11 , further comprising:

querying the sound log to provide recommendations to the user of the computer device.

16. The method of claim 15 , further comprising:

receiving a request from the user;

querying the sound log based at least upon the request to identify the sound event and the context information associated with the sound event; and

providing a response to the request based on the context information associated with the sound event.

17. The method of claim 15 , further comprising:

receiving one or more audio patterns and corresponding sound events; and

uploading the one or more audio patterns and the corresponding sound events to the sound database.

18. The method of claim 11 , wherein the sound database is curated for the user of the computer device.

19. The method of claim 11 , wherein the at least one sensor is part of a network of sensors in communication with the computer device.

20. A non-transitory computer-readable medium storing instructions executable by a computer device, comprising:

at least one instruction for causing the computer device to receive, from at least one sensor on the computer device, a detected sound generated as a result of an event taking place around a user or generated by an object as a result of an action taken by the user on the object;

at least one instruction for causing the computer device to compare the detected sound to a plurality of audio patterns stored in a sound database;

at least one instruction for causing the computer device to identify a sound event for the detected sound based on a comparison of the detected sound to the plurality of audio patterns, wherein the sound event identifies the event taking place around the user or the action taken by the user on the object;

at least one instruction for causing the computer device to identify context information that describes the sound event; and

at least one instruction for causing the computer device to update a sound log with the sound event and the context information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2018
From: GANADAS, PRIYA; HERNANDEZ SANTISTEBAN, ADOLFO; KRAUSS, AARON DANIEL; MUEHLHAUSEN, ANDREW FREDERICK
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 045583/0751 →
Continuity (1)
Related Publication 20190318033A1 · Oct 17, 2019