IP Library Granted Patent US 11,627,417
Granted Patent B2
US 11,627,417 · App. 17/208,154 · Granted Apr 11, 2023

Voice interactive system

Inventors: David M. Barrett (San Francisco, CA); Robert Chen (San Francisco, CA)
Assignee: Expensify, Inc.
H04R19/04G10L15/22H04R1/08H04R1/1058H04R1/14G10L2015/223H04R2201/003H04R2460/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,417
App. No.
17/208,154
Granted
Apr 11, 2023
Kind
B2
Abstract

An interactive system can utilize microtechnology (e.g., a micro-electromechanical system (MEMS)), such as miniaturized microphone (e.g., a bone-conducting microphone), audio output device, microprocessor, and signal conversion and propagation means to create a personal area network (PAN) for a user. The system can include a voice input device (e.g., worn on one or more teeth of the user) that outputs a near-field magnetic induction (NFMI) signal based on a whisper input by the user. The NFMI signal is either detected by the user's mobile device, or converted into a wireless signal (e.g., a Bluetooth RF signal) detectable by the user's mobile device, for receiving voice commands (e.g., to provide personal assistant services) via a designated application running on the mobile device.

Claims (39)

1. An interactive system comprising:

a computing device executing a virtual assistance application;

a voice input device comprising (i) a microphone to receive a voice input from a user, and (ii) a near-field magnetic induction (NFMI) transmitter to modulate a localized magnetic field based on the voice input;

an NFMI converter to (i) detect the modulated localized magnetic field, and (ii) convert the modulated localized magnetic field to transmit a wireless signal based on the voice input to the computing device of the user, the wireless signal comprising one or more commands;

wherein the virtual assistance application executing on the computing device of the user processes the one or more commands in the wireless signal, as converted from the localized magnetic field, to perform a set of assistance functions on the computing device; and

a feedback device comprising an audio output device, the feedback device to receive feedback signals from the virtual assistance application executing on the computing device of the user and output audio signals to the user using the audio output device based on the feedback signals.

2. The interactive system of claim 1 , wherein the feedback signals are based on the one or more commands provided in the voice input from the user.

3. The interactive system of claim 1 , wherein the audio output device comprises one or more earpieces worn by the user.

4. The interactive system of claim 1 , wherein the voice input device comprises an intraoral device worn within the mouth of the user.

5. The interactive system of claim 1 , wherein the microphone comprises a micro-electromechanical system (MEMS) microphone.

6. The interactive system of claim 1 , wherein the microphone comprises a bone-conducting microphone.

7. The interactive system of claim 1 , wherein the NFMI converter comprises an eyeglasses form factor.

8. The interactive system of claim 1 , wherein the NFMI converter comprises a neck-worn device.

9. The interactive system of claim 1 , wherein the NFMI converter and the feedback device are included in a same peripheral device.

10. The interactive system of claim 9 , wherein the same peripheral device comprises a head-worn form factor.

11. The interactive system of claim 10 , wherein the head-worn form factor comprises bone-conducting headphones as the audio output device.

12. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive a voice input from a user via a voice input device comprising a microphone;

modulate a localized magnetic field based on the voice input using a near-field magnetic induction (NFMI) transmitter;

detect the modulated localized magnetic field using an NFMI converter;

convert the modulated localized magnetic field to transmit, using the NFMI transmitter, a wireless signal based on the voice input to a computing device of the user, the wireless signal comprising one or more commands;

process, by a virtual assistance application executing on the computing device of the user, the one or more commands in the wireless signal, as converted from the localized magnetic field, to perform a set of assistance functions on the computing device;

receive feedback signals, using a feedback device comprising an audio output device, from the virtual assistance application executing on the computing device of the user; and

output, using the audio device, audio signals to the user based on the feedback signals.

13. The non-transitory computer-readable medium of claim 12 , wherein the feedback signals are based on the one or more commands provided in the voice input from the user.

14. The non-transitory computer-readable medium of claim 12 , wherein the audio output device comprises one or more earpieces worn by the user.

15. The non-transitory computer-readable medium of claim 12 , wherein the detected voice input is detected from an intraoral device worn within the mouth of the user.

16. The non-transitory computer-readable medium of claim 15 , wherein the intraoral device comprises a micro-electromechanical system (MEMS) microphone.

17. The non-transitory computer-readable medium of claim 15 , wherein the intraoral device comprises a bone-conducting microphone.

18. The non-transitory computer-readable medium of claim 12 , wherein the NFMI converter comprises an eyeglasses form factor.

19. The communication system of claim 12 , wherein the NFMI converter comprises a neck-worn device.

20. A computer-implemented method of performing communications, the method being performed by one or more processors and comprising:

receiving a voice input from a user via a voice input device comprising a microphone;

modulating a localized magnetic field based on the voice input using a near-field magnetic induction (NFMI) transmitter;

detecting the modulated localized magnetic field using an NFMI converter;

converting the modulated localized magnetic field to transmit, using the NFMI transmitter, a wireless signal based on the voice input to a computing device of the user, the wireless signal comprising one or more commands;

processing, by a virtual assistance application executing on the computing device of the user, the one or more commands, as converted from the localized magnetic field, to perform a set of assistance functions on the computing device;

receiving feedback signals, using a feedback device comprising an audio output device, from the virtual assistance application executing on the computing device of the user; and

outputting, using the audio device, audio signals to the user based on the feedback signals.

Assignments (2)
SECURITY INTEREST Recorded Feb 27, 2024
From: EXPENSIFY, INC.
To: CANADIAN IMPERIAL BANK OF COMMERCE
Reel/Frame 066573/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2021
From: BARRETT, DAVID M.; CHEN, ROBERT
To: EXPENSIFY, INC.
Reel/Frame 057630/0274 →
Continuity (2)
Provisional Application 63000372 · Mar 26, 2020
Related Publication 20210306762A1 · Sep 30, 2021