IP Library › Granted Patent US 12,211,499
Granted Patent B2
US 12,211,499 · App. 17/748,128 · Granted Jan 28, 2025

Electronic device mounted in vehicle, and method of operating the same

Inventors: Minsu Jung (Gyeonggi-do, KR); Hyunwoo Kang (Gyeonggi-do, KR); Taejun Kim (Gyeonggi-do, KR); Jonghee Choi (Gyeonggi-do, KR); Woong Lee (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L15/22B60K35/00B60K35/60B60K35/10B60K35/28B60K2360/1438B60K2360/148B60K2360/164B60K2360/166B60K2360/167G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,499
App. No.
17/748,128
Granted
Jan 28, 2025
Kind
B2
Abstract

A method and electronic device for a vehicle are disclosed herein. The electronic device is mounted in the vehicle and includes a display, a memory storing voice commands, and a processor. The processor implements the method, including: obtaining at least one of vehicle driving information, occupant information, or display output information, generating one or more short commands by shortening one or more of the voice commands, based on the obtained at least one of the vehicle driving information, the occupant information and the display output information, and controlling the display to display one or more voice command guidance user interface (UI) displaying the one or more short commands.

Claims (61)

1. An electronic device mounted in a vehicle, the electronic device comprising:

a display;

a memory storing voice commands executable by voice input to execute one or more functions of the vehicle or the electronic device, and a program including one or more instructions; and

at least one processor configured to execute the one or more instructions to cause the electronic device to:

obtain status information including at least one of vehicle driving information, occupant information, or display output information,

generate one or more short commands by shortening one or more of the voice commands, based on the obtained status information,

generate one or more voice command guidance user interfaces (UIs) for representing the one or more short commands,

determine a safe speed based on at least one of a current location, a driving road, and a driving speed of the vehicle included in the vehicle driving information,

determine weights of the one or more voice command guidance UIs based on the driving speed of the vehicle and the safe speed,

determine a number, location, and size of the one or more voice command guidance UIs to be displayed, based on the determined weights, and

control the display to display the one or more voice command guidance UIs based on the determined number, the determined location, and the determined size,

wherein the at least one processor is further configured to execute the one or more instructions to cause the electronic device to adjust, based on a result of comparing the driving speed of the vehicle with the safe speed, a first weight of a first voice command guidance UI for executing driving-related functions of the vehicle from among the one or more voice command guidance UIs and a second weight of a second voice command guidance UI for executing convenience-related functions unrelated to driving of the vehicle from among the one or more voice command guidance UIs.

2. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to cause the electronic device to:

obtain a user identification and a usage history for an occupant of the vehicle, and

detect one or more applications that are frequently-used by the occupant, based on the user identification and the usage history,

wherein the one or more of the voice commands are selected for generation of the one or more short commands based on association with the detected one or more frequently-used applications.

3. The electronic device of claim 1 , wherein the display comprises a plurality of displays, and wherein each display corresponds in position to a seat included within the vehicle, and

wherein the at least one processor is further configured to execute the one or more instructions to cause the electronic device to:

receive, from an occupant on the vehicle, a user input requesting a voice recognition function,

in response to the user input, activate the voice recognition function on a display from among the plurality of displays corresponding to a seat occupied by an occupant, and

control the display to display the one or more voice command guidance UIs.

4. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to cause the electronic device to:

adjust a third weight of a third voice command guidance UI for executing a function of removing a pop-up message from the display, in a case that the pop-up message is displayed overlaying on a UI displayed on the display.

5. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to cause the electronic device to:

determine a display area for displaying the one or more voice command guidance UIs, based on a distance between a location of an occupant within the vehicle, and the display, and

control the display to display the one or more voice command guidance UIs on the determined display area.

6. A method of operating an electronic device mounted in a vehicle, the method comprising:

storing, in a memory, voice commands executable by voice input to execute one or more functions of the vehicle or the electronic device;

obtaining status information including at least one of vehicle driving information, occupant information, or display output information;

generating, via at least one processor, one or more short commands by shortening one or more of the voice commands, based on the obtained status information;

generating one or more voice command guidance user interfaces (UIs) for representing the one or more short commands;

determining a safe speed based on at least one of a current location, a driving road, and a driving speed of the vehicle included in the vehicle driving information;

determine weights of the one or more voice command guidance UIs based on the driving speed of the vehicle and the safe speed;

determine a number, location, and size of the one or more voice command guidance UIs to be displayed, based on the determined weights; and

displaying the one or more voice command guidance UIs based on the determined number, the determined location, and the determined size,

wherein the determining of the weights of the one or more voice command guidance UIs comprises:

adjusting, based on a result of comparing the driving speed of the vehicle with the safe speed, a first weight of a first voice command guidance UI for executing driving-related functions of the vehicle from among the one or more voice command guidance UIs and a second weight of a second voice command guidance UI for executing convenience-related functions unrelated to driving of the vehicle from among the one or more voice command guidance UIs.

7. The method of claim 6 , wherein the obtaining of the information comprises:

obtaining a user identification and a usage history for an occupant of the vehicle; and

detecting one or more applications that are frequently-used by the occupant, based on the user identification and the usage history,

wherein the one or more of the voice commands are selected for generation of the one or more short commands based on association with the detected one or more frequently-used applications.

8. The method of claim 6 , wherein the display comprises a plurality of displays, and wherein each display corresponds in position to a seat included within the vehicle,

the method further comprising:

receiving, from an occupant on the vehicle, a user input requesting a voice recognition function;

in response to the user input, activating the voice recognition function on a display from among the plurality of displays corresponding to a seat occupied by an occupant; and

controlling the display to display the one or more voice command guidance UIs.

9. The method of claim 6 , wherein the determining of the weights of the one or more voice command guidance UIs comprises adjusting a third weight of a third voice command guidance UI for executing a function for removing a pop-up message from a display in a case that the pop-up message is output to be overlaid on GUIs displayed on the display.

10. The method of claim 6 , further comprising:

determining a display area for displaying the one or more voice command guidance UIs, based on a distance between a location of an occupant within the vehicle, and the display; and

displaying on the display the one or more voice command guidance UIs on the determined display area.

11. A computer program product comprising a non-transitory computer-readable storage medium having instructions executable by an electronic device mounted in a vehicle for performing:

storing, in a memory, voice commands executable by voice input to execute one or more functions of the vehicle or the electronic device;

obtaining status information including at least one of vehicle driving information, occupant information, or display output information;

generating, via at least one processor, one or more short commands by shortening one or more of the voice commands, based on the obtained status information;

generating one or more voice command guidance user interfaces (UIs) for representing the one or more short commands;

determining a safe speed based on at least one of a current location, a driving road, and a driving speed of the vehicle included in the vehicle driving information;

determine weights of the one or more voice command guidance UIs based on the driving speed of the vehicle and the safe speed;

determine a number, location, and size of the one or more voice command guidance UIs to be displayed, based on the determined weights; and

displaying the one or more voice command guidance UIs based on the determined number, the determined location, and the determined size,

wherein the determining of the weights of the one or more voice command guidance UIs comprises:

adjusting, based on a result of comparing the driving speed of the vehicle with the safe speed, a first weight of a first voice command guidance UI for executing driving-related functions of the vehicle from among the one or more voice command guidance UIs and a second weight of a second voice command guidance UI for executing convenience-related functions unrelated to driving of the vehicle from among the one or more voice command guidance UIs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2022
From: JUNG, MINSU; KANG, HYUNWOO; KIM, TAEJUN; CHOI, JONGHEE; LEE, WOONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059955/0140 →
Priority Claims (1)
KR 10-2021-0083184 · Jun 25, 2021 · national
Continuity (2)
Continuation PCTKR2022005406 · Apr 14, 2022
Related Publication 20220415321A1 · Dec 29, 2022
References Cited (42)
US 9248788B2 · Sekiguchi · 2016 [cited by examiner]
US 9305555B2 · Kato et al. · 2016 [cited by applicant]
US 9404765B2 · Jiyama et al. · 2016 [cited by applicant]
US 9666189B2 · Lee et al. · 2017 [cited by applicant]
US 10347246B2 · Lee · 2019 [cited by examiner]
US 10831268B1 · Golard · 2020 [cited by examiner]
US 11158327B2 · Choi · 2021 [cited by examiner]
US 20070033055A1 · Tanaka · 2007 [cited by examiner]
US 20100153111A1 · Hirai · 2010 [cited by examiner]
US 20100312547A1 · Van Os · 2010 [cited by examiner]
US 20110257973A1 · Chutorash · 2011 [cited by examiner]
US 20120245945A1 · Miyauchi · 2012 [cited by examiner]
US 20120271636A1 · Fujisawa · 2012 [cited by examiner]
US 20130307771A1 · Parker · 2013 [cited by examiner]
US 20140136013A1 · Wolverton · 2014 [cited by examiner]
US 20150006167A1 · Kato · 2015 [cited by examiner]
US 20150211878A1 · Jiyama · 2015 [cited by examiner]
US 20160240189A1 · Lee · 2016 [cited by examiner]
US 20170075653A1 · Dawidowsky · 2017 [cited by examiner]
US 20170323641A1 · Shimizu · 2017 [cited by examiner]
US 20180093673A1 · Yuhara · 2018 [cited by examiner]
US 20180130467A1 · Chikuri · 2018 [cited by examiner]
US 20180357040A1 · Spiewla · 2018 [cited by examiner]
US 20200073629A1 · Lee · 2020 [cited by examiner]
US 20200075006A1 · Chen · 2020 [cited by examiner]
US 20200111489A1 · Kuramochi · 2020 [cited by examiner]
US 20200265065A1 · Ashe · 2020 [cited by examiner]
US 20200320998A1 · Wagatsuma · 2020 [cited by examiner]
US 20210149397A1 · Shin · 2021 [cited by examiner]
US 20210233528A1 · Maeda · 2021 [cited by examiner]
US 20220415321A1 · Jung · 2022 [cited by examiner]
CN 112540741A · 2021 [cited by applicant]
EP 3603040B1 · 2022 [cited by applicant]
JP 6348831B2 · 2018 [cited by applicant]
KR 1020180025379A · 2018 [cited by applicant]
KR 101860731B1 · 2018 [cited by applicant]
KR 1020180109631A · 2018 [cited by applicant]
KR 101971513B1 · 2019 [cited by applicant]
KR 1020190106943A · 2019 [cited by applicant]
KR 1020160044652B1 · 2021 [cited by applicant]
KR 1020210059860A · 2021 [cited by applicant]
International Search Report dated Jul. 6, 2022. [cited by applicant]