Smart and interactive book audio services
In some examples, a computing device may initiate audible play back of a book in response to an instruction from a user. While the book is being audibly played back, the computing device may determine (e.g., in the background) that a content of a recently played back portion of the book matches one or more interests associated with a user, initiate a search, and receive search results. The computing device may re-rank the search results based on the user's interests, pause play back of the book, and audibly read out the re-ranked search results. If the user asks a question, the computing device may pause play back of the book, perform an additional search, and read out loud the additional search results. The computing device may resume the audible play back of the book after the user provides a resume play back instruction.
1. A method comprising:
receiving, by the one or more processors of a computing device that comprises a display device, an instruction to audibly play back a book, which is stored in memory of the computing device in an electronic format that enables the electronic book to be displayed on the display device for reading by a user;
initiating, by the one or more processors executing instructions of a text to speech converter, audible play back of the book;
determining, by the one or more processors and while the book is being audibly played back, that the computing device is being shaken;
in response to determining that the computing device is being shaken, determining that content in a recently played back portion of the book matches at least one interest of one of more interests associated with the user, wherein the content is matched with the at least one interest using a machine learning module configured to compare the content to the at least one interest, and wherein the one or more interests associated with the user are identified using interest determination processing, the interest determination processing including:
receiving one or more answers in response to asking the user one or more questions;
performing a first analysis of a browser history of an internet browser application;
performing a second analysis of posts made by the user on one or more social media sites;
performing a third analysis of files stored in the memory, the files including music files, video files, audio books, books stored in electronic format, and documents;
combining the one or more answers with the first analysis, the second analysis, and the third analysis to obtain personal data of the user; and
using the combined personal data to determine the one or more interests associated with the user;
sending, by the one or more processors and while the book is being audibly played back, a search request to a search engine, the search request formulated based on the content in the recently played back portion of the book and the at least one interest;
pausing, by the one or more processors, the audible play back of the book without receiving an associated instruction from the user;
audibly prompting the user whether the user wishes to learn more about the content and the at least one interest associated with the user;
in response to determining that the user wishes to learn more about the content and the at least one interest, initiating, by the one or more processors executing instructions of the text to speech converter, audible play back of search results received from the search engine based on the search request; and
resuming, by the one or more processors executing instructions of a text to speech converter, the audible play back of the book.
2. The method of claim 1 , further comprising:
determining an approximate age of the user;
determining an approximate education level associated with the user;
determining an education specialty associated with the user;
determining an approximate location of the user; and
combining the approximate age, the approximate education level, the education specialty, and the approximate location of the user with the personal data to determine the one or more interests associated with the user.
3. The method of claim 1 , wherein the book is stored in the memory in PDF format.
4. The method of claim 1 , wherein determining, while the book is being audibly played back, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user comprises:
while the book is being audibly played back, executing a background process to:
determine the content in the recently played back portion of the book;
perform a comparison of the content with the one or more interests associated with the user; and
determine, based on the comparison, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user.
5. The method of claim 1 , further comprising:
receiving a second instruction to pause audible play back of the book;
pausing audible play back of the book in response to the second instruction;
receiving a third instruction to provide more information about the content in the recently played back portion of the book;
sending an additional search request to the search engine, the additional search request formulated based on the content in the recently played back portion of the book;
receiving additional search results from the search engine; and
audibly playing back at least a portion of the additional search results.
6. The method of claim 1 , wherein reading out loud the search results received from the search engine comprises:
receiving, while the book is being audibly played back, search results from the search engine in response to sending the search request to the search engine;
re-ranking the search results based on the one or more interests associated with the user to create re-ranked search results; and
audibly reading out the re-ranked search results.
7. A computing device comprising:
a display device;
a memory;
one or more processors; and
one or more non-transitory computer readable media storing instructions executable by the one or more processors to perform operations comprising:
receiving an instruction to audibly play back a book, which is stored in the memory in an electronic format that enables the electronic book to be displayed on the display device for reading by a user;
initiating audible play back of the book by executing instructions of a text to speech converter in the non-transitory computer readable media;
determining, while the book is being audibly played back, that the computing device is being shaken;
in response to determining that the computing device is being shaken, determining that content in a recently played back portion of the book matches at least one interest of one of more interests associated with the user, wherein the content is matched with the at least one interest using a machine learning module configured to compare the content to the at least one interest, and wherein the one or more interests associated with the user are identified using interest determination processing, the interest determination processing including:
receiving one or more answers in response to asking the user one or more questions;
performing a first analysis of a browser history of an internet browser application;
performing a second analysis of posts made by the user on one or more social media sites;
performing a third analysis of files stored in the memory, the files including music files, video files, audio books, books stored in electronic format, and documents;
combining the one or more answers with the first analysis, the second analysis, and the third analysis to obtain personal data of the user; and
using the combined personal data to determine the one or more interests associated with the user;
sending, while the book is being audibly played back, a search request to a search engine, the search request formulated based on the content in the recently played back portion of the book and the at least one interest;
pausing the audible play back of the book without receiving an associated instruction from the user;
audibly prompting the user whether the user wishes to learn more about the content and the at least one interest associated with the user;
in response to determining that the user wishes to learn more about the content and the at least one interest, initiating, by executing instructions of the text to speech converter, audible play back of search results received from the search engine based on the search request; and
resuming the audible play back of the book.
8. The computing device of claim 7 , wherein the operations further comprise:
determining an approximate age of the user;
determining an approximate education level associated with the user;
determining an education specialty associated with the user;
determining an approximate location of the user; and
combining the approximate age, the approximate education level, the education specialty, and the approximate location of the user with the personal data to determine the one or more interests associated with the user.
9. The computing device of claim 7 , wherein the book is stored in the memory in PDF format.
10. The computing device of claim 7 , wherein determining, while the book is being audibly played back, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user comprises:
while the book is being audibly played back, executing a background process to:
determine the content in the recently played back portion of the book;
perform a comparison of the content with the one or more interests associated with the user; and
determine, based on the comparison, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user.
11. The computing device of claim 7 , wherein reading out loud the search results received from the search engine comprises:
receiving, while the book is being audibly played back, the search results from the search engine in response to sending the search request to the search engine;
re-ranking the search results based on the one or more interests associated with the user to create re-ranked search results; and
audibly reading out the re-ranked search results.
12. One or more non-transitory computer readable media storing instructions executable by one or more processors of a computing device that comprises a memory and a display device, wherein a method is implemented in response to executing the instructions, the method comprising:
receiving a first instruction to audibly play back a book, which is stored in the memory in an electronic format that enables the electronic book to be displayed on the display device for reading by a user;
initiating audible play back of the book by executing instructions in the one or more non-transitory computer readable media, of a text to speech converter;
determining, while the book is being audibly played back, that the computing device is being shaken;
in response to determining that the computing device is being shaken, determining that a content in a recently played back portion of the book matches at least one interest of one of more interests associated with the user, wherein the content is matched with the at least one interest using a machine learning module configured to compare the content to the at least one interest, and wherein the one or more interests associated with the user are identified using interest determination processing, the interest determination processing including:
receiving one or more answers in response to asking the user one or more questions;
performing a first analysis of a browser history of an internet browser application;
performing a second analysis of posts made by the user on one or more social media sites;
performing a third analysis of files stored in the memory, the files including music files, video files, audio books, books stored in electronic format, and documents;
combining the one or more answers with the first analysis, the second analysis, and the third analysis to obtain personal data of the user; and
using the combined personal data to determine the one or more interests associated with the user;
sending, while the book is being audibly played back, a search request to a search engine, the search request formulated based on the content in the recently played back portion of the book and the at least one interest;
pausing the audible play back of the book without receiving an associated instruction from the user;
audibly prompting the user whether the user wishes to learn more about the content and the at least one interest associated with the user;
in response to determining that the user wishes to learn more about the content and the at least one interest, initiating, by executing instructions of the text to speech converter, audible play back of search results received from the search engine based on the search request; and
resuming the audible play back of the book.
13. The one or more non-transitory computer readable media of claim 12 , wherein the operations further comprise:
determining an approximate age of the user;
determining an approximate education level associated with the user;
determining an education specialty associated with the user;
determining an approximate location of the user; and
combining the approximate age, the approximate education level, the education specialty, and the approximate location of the user with the personal data to determine the one or more interests associated with the user.
14. The one or more non-transitory computer readable media of claim 12 , wherein the book is stored in the memory in PDF format.
15. The one or more non-transitory computer readable media of claim 12 , wherein determining, while the book is being audibly played back, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user comprises:
while the book is being audibly played back, executing a background process to:
determine the content in the recently played back portion of the book;
perform a comparison of the content with the one or more interests associated with the user; and
determine, based on the comparison, that the content in the recently played back portion of the book matches the at least one interest of the one of more interests associated with the user.
16. The one or more non-transitory computer readable media of claim 12 , further comprising:
receiving a second instruction to pause audible play back of the book;
pausing audible play back of the book in response to the second instruction;
receiving an additional instruction to provide more information about the content in the recently played back portion of the book;
sending an additional search request to the search engine, the additional search request formulated based on the content in the recently played back portion of the book;
receiving additional search results from the search engine; and
audibly playing back at least a portion of the additional search results.
17. The one or more non-transitory computer readable media of claim 12 , wherein reading out loud the search results received from the search engine comprises:
receiving, while the book is being audibly played back, search results from the search engine in response to sending the search request to the search engine;
re-ranking the search results based on the one or more interests associated with the user to create re-ranked search results; and
audibly reading out the re-ranked search results.