Automatic call categorization and screening
Implementations described herein relate to methods, systems, and computer-readable media to automatically answer a call. In some implementations, a method includes receiving a call from a caller device at a client device. The method further includes determining, based on an identifier associated with the call, whether the call matches auto answer criteria, and yin response to determining that the call matches the auto answer criteria, answering the call without user input and without alerting a user of the client device. The method further includes generating a call embedding for the call based on received audio of the call, comparing the call embedding with spam embeddings to determine whether the call is a spam call, and in response to determining that the call is a spam call, terminating the call.
1. A computer-implemented method comprising:
receiving a plurality of audio recordings wherein each audio recording corresponds to a respective call of a plurality of calls, and metadata for each of the plurality of calls;
generating, using a trained machine-learning model, a respective embedding for each of the plurality of calls based on the corresponding audio recording, wherein the respective embedding is a numerical representation of the call;
grouping the plurality of calls into a plurality of clusters based on the respective embeddings; and
storing, in a database, a plurality of tuples, each tuple including a particular audio recording of the plurality of audio recordings, associated metadata, the embedding for the particular audio recording, and a cluster identifier for the particular audio recording.
2. The computer-implemented method of claim 1 , further comprising:
obtaining respective text transcripts of the plurality of audio recordings; and
storing the respective text transcripts in a corresponding tuple,
wherein generating the respective embedding for each of the plurality of calls is further based on the text transcript of the call.
3. The computer-implemented method of claim 1 , further comprising, for each of the plurality of clusters:
determining a representative embedding for the cluster;
determining a count of calls that match the cluster;
determining a spam call count for the cluster; and
calculating a score for the cluster based on one or more of the count of calls or the spam call count.
4. The computer-implemented method of claim 3 , further comprising:
determining a subset of the plurality of clusters, wherein the score for each cluster in the subset of clusters meets a score threshold; and
sending the representative embedding for each cluster in the subset to a client device.
5. The computer-implemented method of claim 4 , further comprising receiving data indicative of one or more of a current country or a home country for the client device, and wherein determining the subset further comprises:
selecting the subset based on the received data, wherein clusters that include calls that have metadata that does not match the current country or the home country are excluded from the subset.
6. The computer-implemented method of claim 3 , wherein determining the representative embedding for the cluster comprises one of:
selecting an embedding that corresponds to a first audio recording in the cluster as the representative embedding;
selecting an average of a plurality of embeddings that correspond to calls in the cluster as the representative embedding; or
selecting a particular embedding of the plurality of embeddings that is closest to the average of the plurality of embeddings.
7. The computer-implemented method of claim 1 , wherein the embedding for each call within each of the plurality of clusters is within a threshold edit distance of embeddings from other calls in the cluster.
8. The computer-implemented method of claim 1 , further comprising:
receiving performance metrics; and
updating the machine-learning model based on the performance metrics.
9. A computer-implemented method to automatically answer a call, the method comprising:
receiving, at a client device, a call from a caller device;
determining, by the client device, based on an identifier associated with the call, whether the call matches auto answer criteria;
in response to determining that the call matches the auto answer criteria, answering the call, by the client device, without user input and without alerting a user of the client device; and
after answering the call,
generating, by the client device, using a trained machine-learning model, a call embedding for the call based on received audio of the call, wherein the call embedding is a numerical representation of the call;
comparing, by the client device, the call embedding with spam embeddings to determine whether the call is a spam call; and
in response to determining that the call is a spam call, terminating the call.
10. The computer-implemented method of claim 9 , further comprising, after answering the call:
generating and storing, by the client device, a text transcript of the call.
11. The computer-implemented method of claim 10 , wherein the generating the call embedding is further based on the text transcript of the call.
12. The computer-implemented method of claim 9 , further comprising:
in response to determining that the call is not a spam call, alerting the user of the client device, wherein alerting the user comprises ringing the client device and providing a text transcript of the received audio of the call.
13. The computer-implemented method of claim 9 , wherein answering the call comprises: establishing a connection with a caller device; and
sending audio from the client device to the caller device, wherein the sent audio is generated by the client device without user input.
14. The computer-implemented method of claim 9 , wherein determining that the call matches auto answer criteria is based on at least one of:
determining that the identifier associated with the call matches a spam caller list;
determining that the identifier associated with the call is a fake number;
determining that the identifier associated with the call is a private number;
determining that the identifier associated with the call and an identifier associated with the client device meet a similarity threshold;
determining that the identifier associated with the call is not in a contact list of a user of the client device; or
determining that the identifier associated with the call is not in a call log of the client device.
15. The computer-implemented method of claim 9 , wherein determining that the call does not match the auto answer criteria is based on at least one of:
determining that the identifier associated with the call is in a contact list of a user of the client device;
determining that the identifier associated with the call is in a call log of the client device;
determining that the identifier associated with the call indicates that the call is an emergency call; or
determining that an emergency call was placed from the client device within a threshold from a current time.
16. The computer-implemented method of claim 9 , in response to determining that the call does not match the auto answer criteria, alerting the user of the client device.
17. The computer-implemented method of claim 9 , wherein the spam embeddings are stored locally on the client device, and wherein the method further comprises receiving the spam embeddings from a server and storing the spam embeddings locally on the client device.
18. A computing device comprising:
a processor; and
a memory coupled to the processor, with instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising:
receiving a call from a caller device;
determining, based on an identifier associated with the call, whether the call matches auto answer criteria;
in response to determining that the call matches the auto answer criteria, answering the call without user input and without alerting a user of the computing device; and
after answering the call,
generating using a trained machine-learning model, a call embedding for the call based on received audio of the call, wherein the call embedding is a numerical representation of the call;
comparing the call embedding with spam embeddings to determine whether the call is a spam call; and
in response to determining that the call is a spam call, terminating the call.
19. The computing device of claim 18 , wherein the memory has further instructions stored thereon that, when executed by the processor, cause the processor to perform further performs operations comprising:
after answering the call, generating and storing a text transcript of the call,
wherein the generating the call embedding is further based on the text transcript of the call.
20. The computing device of claim 18 , wherein the operation of answering the call comprises:
establishing a connection with a caller device; and
sending audio from the computing device to the caller device, wherein the sent audio is generated by the computing device without user input.