IP Library Granted Patent US 12,340,800
Granted Patent B2
US 12,340,800 · App. 17/193,828 · Granted Jun 24, 2025

Method and voice assistant device for managing confidential data as a non-voice input

Inventors: Sathwick Mahadeva (Bangalore, IN); Indira Preethi Jain Gargatti Ajith (Bangalore, IN); Vishwanath Pethri Kamath (Bangalore, IN); Bharath Kumar Natarajan (Bangalore, IN); Madhushree Suresh Gowda (Bangalore, IN); Vijetha Kannukere Vinaya Prasad (Bangalore, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G06F21/6281G10L15/25G10L25/78G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,800
App. No.
17/193,828
Granted
Jun 24, 2025
Kind
B2
Abstract

A method and a voice assistant device for managing private data are provided. The voice assistant device includes a processor configured to detect a privacy triggering event while obtaining at least one voice input from a first user in a voice input mode, switch from the voice input mode to a non-voice input mode in response to the privacy triggering event, obtain a non-voice input from the first user in the non-voice input mode, and execute an operation of the voice assistant device corresponding to the non-voice input.

Claims (30)

1. A method of managing private data in a voice assistant device, the method comprising:

detecting a privacy triggering event while obtaining at least one voice input from a first user, based on a dialog-based verbal conversation input from the first user

obtaining a first plurality of parameters associated with the voice assistant device and a second plurality of parameters associated with an electronic device communicatively connected to the voice assistant device,

wherein the first plurality of parameters comprise at least one of a location of the voice assistant device, an indication of whether a non-voice input mode is supported by the voice assistant device, a distance between the voice assistant device and the first user, and a distance between the voice assistant device or a second user, and

wherein the second plurality of parameters comprise at least one of a location of the electronic device, an operational status of the electronic device, a current activity of the electronic device, a distance between the electronic device and the first user, and a distance between the electronic device or the second user;

determining that between the voice assistant device and the electronic device, only the electronic device is capable of receiving at least one non-voice input based on the first plurality of parameters and the second plurality of parameters; and

notifying the first user to communicate private data corresponding to the at least one non-voice input with the electronic device instead of the voice assistant device.

2. The method of claim 1 , wherein the non-voice input mode comprises at least one of a lip-reading mode, a text mode, or a gesture mode, and

wherein the at least one non-voice input comprises at least one of lip movements of the first user, a text input of the first user, or a gesture input of the first user.

3. The method of claim 2 , wherein the non-voice input mode corresponds to the lip-reading mode, and the at least one non-voice input corresponds to the lip movements of the first user, and

wherein the at least one non-voice input is obtained by:

activating a camera to read the lip movements of the first user in the lip-reading mode.

4. The method of claim 1 , wherein the detecting of the privacy triggering event comprises:

detecting a presence of the second user based on at least one of ambient noise, a voice input of the second user, or an input from the electronic device communicatively coupled with the voice assistant device.

5. A voice assistant device for managing private data, the voice assistant device comprising:

at least one memory configured to store one or more instructions; and

at least one processor configured to execute the one or more instructions to:

detect a privacy triggering event while obtaining at least one voice input from a first user, based on a dialog-based verbal conversation input from the first user,

obtain a first plurality of parameters associated with the voice assistant device and a second plurality of parameters associated with an electronic device communicatively connected to the voice assistant device,

wherein the first plurality of parameters comprise at least one of a location of the voice assistant device, an indication of whether a non-voice input mode is supported by the voice assistant device, a distance between the voice assistant device and the first user, or a distance between the voice assistant device and a second user, and

wherein the second plurality of parameters comprise at least one of a location of the electronic device, an operational status of the electronic device, a current activity of the electronic device, a distance between the electronic device and the first user, or a distance between the electronic device and the second user;

determine that between the voice assistant device and the electronic device, only the electronic device is capable of receiving at least one non-voice input based on the first plurality of parameters and the second plurality of parameters; and

notify the first user to communicate the private data corresponding to the at least one non-voice input with the electronic device instead of the voice assistant device.

6. The voice assistant device of claim 5 , wherein the non-voice input mode comprises at least one of a lip-reading mode, a text mode, or a gesture mode, and

wherein the non-voice input comprises at least one of lip movements of the first user, a text input of the first user, or a gesture input of the first user.

7. The voice assistant device of claim 6 , wherein the non-voice input mode corresponds to the lip-reading mode, and the non-voice input corresponds to the lip movements of the first user,

wherein the voice assistant device further comprises or is connected to a camera, and

wherein the at least one processor is further configured to execute the one or more instructions to: activate the camera to read the lip movements of the first user in the lip-reading mode.

8. The voice assistant device of claim 5 , wherein the at least one processor is further configured to execute the one or more instructions to:

detect a presence of the second user based on at least one of ambient noise, a voice input of the second user, or an input from the electronic device communicatively coupled with the voice assistant device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: MAHADEVA, SATHWICK; GARGATTI AJITH, INDIRA PREETHI JAIN; KAMATH, VISHWANATH PETHRI; NATARAJAN, BHARATH KUMAR; SURESH GOWDA, MADHUSHREE; PRASAD, VIETHA KANNUKERE VINAYA
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 055906/0023 →
Priority Claims (1)
IN 202041009532 · Mar 5, 2020 · national
Continuity (1)
Related Publication 20210280186A1 · Sep 9, 2021
References Cited (11)
US 9883023B2 · Schuster · 2018 [cited by examiner]
US 10990954B2 · Park et al. · 2021 [cited by applicant]
US 11508382B2 · Dunjic · 2022 [cited by examiner]
US 20160371504A1 · Huang et al. · 2016 [cited by applicant]
US 20170083282A1 · Tsunoda · 2017 [cited by applicant]
US 20190012449A1 · Cheyer · 2019 [cited by applicant]
US 20200105262A1 · Abhinav et al. · 2020 [cited by applicant]
IN 201741009370 · 2018 [cited by applicant]
KR 1020160053391A · 2016 [cited by applicant]
KR 1020160099397A · 2016 [cited by applicant]
Communication dated Jun. 23, 2021, issued by the International Searching Authority in counterpart International Application No. PCT/KR2021/002753 (PCT/ISA/220, 210, 237). [cited by applicant]