IP Library Granted Patent US 10,296,586
Granted Patent B2
US 10,296,586 · App. 15/425,099 · Granted May 21, 2019

Predicting human behavior by machine learning of natural language interpretations

Inventors: Pranav Singh (Santa Clara, CA); Bernard Mont-Reynaud (Sunnyvale, CA); Kheng Khov (Santa Clara, CA); Jonah Probell (Alviso, CA)
Assignee: SoundHound, Inc.
G06F17/2785G06F16/00G06F16/29G06F16/9537G06F17/2775G06Q30/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,296,586
App. No.
15/425,099
Granted
May 21, 2019
Kind
B2
Abstract

An accurate thought map is created by recording people's many utterances of natural language expressions together with the location at which each expression was made. The expressions are input into a Natural Language Understanding system including a semantic parser, and the resulting interpretations stored in a database with the geolocation of the speaker. Emotions, concepts, time, user identification, and other interesting information may also be detected and stored. Interpretations of related expressions may be linked in the database. The database may be indexed and filtered according to multiple aspects of interpretations such as geolocation ranges, time ranges or other criteria, and analyzed according to multiple algorithms. The analyzed results may be used to render map displays, determine effective locations for advertisements, preemptively fetch information for users of mobile devices, and predict the behavior of individuals and groups of people.

Claims (30)

1. A method of predicting a person's behavior, the method comprising:

storing, in a database, interpretations of prior natural language expressions obtained from a user device and one or more geolocation based movement behaviors of the user device that occurred within a specific amount of time after the prior natural language expressions were received, each of the stored one or more geolocation based movement behaviors being related to one or more of the stored interpretations of the prior natural language expressions;

receiving a current natural language expression after the one or more geolocation based movement behaviors occurred;

interpreting the current natural language expression to create a current interpretation;

comparing the current interpretation to the stored interpretations of the prior natural language expressions to identify a closest matching stored interpretation of the stored interpretations;

predicting the person's geolocation based movement behavior by selecting a stored geolocation based movement behavior, of the stored one or more geolocation based movement behaviors, related to the closest matching stored interpretation; and

providing the person's predicted geolocation based movement to an entity.

2. The method of claim 1 , further comprising:

storing, in the database, user IDs in association with the stored interpretations of the prior natural language expressions; and

filtering the database according to a current user ID of a user that uttered the current natural language expression,

wherein the filtering selects, from among the stored interpretations, interpretations that are associated with user IDs that match the current user ID.

3. The method of claim 1 , wherein the prior natural language expressions are unrelated to an operational function of the user device.

4. At least one non-transitory computer readable medium storing code that, if executed by at least one computer processor would cause the at least one computer processor to:

store, in a database, interpretations of prior natural language expressions obtained from a user device and one or more geolocation based movement behaviors of the user device that occurred within a specific amount of time after the prior natural language expressions were received, each of the stored one or more geolocation based movement behaviors being related to one or more of the stored interpretations of the prior natural language expressions;

receive a current natural language expression after the one or more geolocation based movement behaviors occurred;

interpret the current natural language expression to create a current interpretation;

compare the current interpretation to the stored interpretations of the prior natural language expressions to identify a closest matching stored interpretation of the stored interpretations;

predict the person's geolocation based movement behavior by selecting a stored geolocation based movement behavior, of the stored one or more geolocation based movement behaviors, related to the closest matching stored interpretation; and

provide the person's predicted geolocation based movement to an entity.

5. The at least one non-transitory computer readable medium of claim 4 , wherein the code, if executed by at least one computer processor further causes the at least one computer processor to:

store, in the database, user IDs in association with the stored interpretations of the prior natural language expressions; and

filter the database according to a current user ID of a user that uttered the current natural language expression, by selecting, from among the stored interpretations, interpretations that are associated with user IDs that match the current user ID.

6. The at least one non-transitory computer readable medium of claim 4 , wherein the prior natural language expressions are unrelated to an operational function of the user device.

7. A system including one or more processors coupled to memory, the memory loaded with computer instructions to predict a person's behavior, the instructions, when executed on the processors, implement actions comprising:

storing, in a database, interpretations of prior natural language expressions obtained from a user device and one or more geolocation based movement behaviors of the user device that occurred within a specific amount of time after the prior natural language expressions were received, each of the stored one or more geolocation based movement behaviors being related to one or more of the stored interpretations of the prior natural language expressions;

receiving a current natural language expression after the one or more geolocation based movement behaviors occurred;

interpreting the current natural language expression to create a current interpretation;

comparing the current interpretation to the stored interpretations of the prior natural language expressions to identify a closest matching stored interpretation of the stored interpretations;

predicting the person's geolocation based movement behavior by selecting a stored geolocation based movement behavior, of the stored one or more geolocation based movement behaviors, related to the closest matching stored interpretation; and

providing the person's predicted geolocation based movement to an entity.

Assignments (10)
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2017
From: PROBELL, JONAH; MONT-REYNAUD, BERNARD; SINGH, PRANAV; KHOV, KHENG
To: SOUNDHOUND, INC.
Reel/Frame 041483/0350 →
Continuity (2)
Provisional Application 62438731 · Dec 23, 2016
Related Publication 20180182381A1 · Jun 28, 2018
Cited By (1)
US 12,411,880