IP Library › Granted Patent US 11,440,408
Granted Patent B2
US 11,440,408 · App. 16/754,611 · Granted Sep 13, 2022

Electronic device and text providing method therefor

Inventor: Young-min Won (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
B60K35/00G06F3/013G06F40/279G06F40/58G06V20/20B60K2370/149B60K2370/1529B60K2370/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,440,408
App. No.
16/754,611
Granted
Sep 13, 2022
Kind
B2
Abstract

An electronic device is disclosed. The electronic device comprises: a display for displaying an image on a windshield of a transportation means; a first camera for capturing an image of a user riding in the transportation means; a second camera for capturing an image of the outside of the transportation means; and a processor for translating text included in the image captured by the second camera into any other language, and controlling the display such that the translated text is displayed on the windshield, wherein the processor displays the translated text on different areas of the windshield, on the basis of the driving speed of the transportation means and the gaze of the user in the image captured by the first camera.

Claims (23)

1. An electronic device provided in a vehicle, the electronic device comprising:

a display configured to display an image on a windshield of the vehicle;

a first camera configured to capture an image of a user riding in the vehicle;

a second camera configured to capture an image of the outside of the vehicle; and

a processor configured to translate text included in the image captured by the second camera into another language and control the display in order to display the translated text on the windshield,

wherein the processor is configured to display the translated text on different areas of the windshield based on a comparison of a driving speed of the vehicle with a predetermined speed and a user's gaze captured by the first camera.

2. The electronic device as claimed in claim 1 , wherein the processor is configured, based on the driving speed being lower than the predetermined speed, to detect the user's gaze captured by the first camera, and display the translated text on an area of the windshield determined based on the user's gaze.

3. The electronic device as claimed in claim 2 , wherein the processor is configured, based on the detected user's gaze, to identify text to which the user's gaze is directed among at least one text captured by the second camera, translate the identified text into the other language, and display the translated text on an area to which the user's gaze is directed on the windshield.

4. The electronic device as claimed in claim 3 , wherein the processor is configured, based on the user's gaze being changed, to identify text to which the user's gaze is directed among at least one text captured by the second camera, translate the identified text into the other language, and display the translated text on the area to which the user's gaze is directed on the windshield.

5. The electronic device as claimed in claim 1 , wherein the processor is configured, based on the driving speed being faster than the predetermined speed, to display the translated text on a predetermined area of the windshield without detecting the user's gaze.

6. The electronic device as claimed in claim 5 , wherein the processor is configured to identify text transmitted on the predetermined area of the windshield among at least one text captured by the second camera, translate the identified text into the other language, and display the translated text on the predetermined area of the windshield.

7. The electronic device as claimed in claim 1 , wherein the processor is configured, based on there being text that matches text input by the user among the translated text, to provide feedback for indicating that there is the matched text.

8. A method of providing text of an electronic device provided in a vehicle, the method comprising:

capturing an image of a user riding in the vehicle by a first camera;

capturing an image of the outside of the vehicle by a second camera; and

translating text included in an image captured by the second camera into another language, and displaying the translated text on a windshield of the vehicle,

wherein the displaying comprises, based on a comparison of a driving speed of the vehicle with a predetermined speed and a user's gaze captured by the first camera, displaying the translated text on different areas of the windshield.

9. The method as claimed in claim 8 , wherein the displaying comprises, based on the driving speed being slower than the predetermined speed, detecting the user's gaze captured by the first camera, and displaying the translated text on an area of the windshield determined by the user's gaze.

10. The method as claimed in claim 9 , wherein the displaying comprises, based on the detected user's gaze, identifying text to which the user's gaze is directed among at least one text captured by the second camera, translating the identified text into the other language, and displaying the translated text on the area to which the user's gaze is directed on the windshield.

11. The method as claimed in claim 10 , wherein the displaying comprises, based on the user's gaze being changed, identifying text to which the changed user's gaze is directed, translating the identified text into the other language, and displaying the translated text on an area to which the changed user's gaze is directed on the windshield.

12. The method as claimed in claim 8 , wherein the displaying comprises, based on the driving speed being faster than the predetermined speed, displaying the translated text on a predetermined area of the windshield without detecting the user's gaze.

13. The method as claimed in claim 12 , wherein the displaying comprises, identifying text transmitted on the predetermined area of the windshield among at least one text captured by the second camera, translate the identified text into the other language, and displaying the translated text on the predetermined area of the windshield.

14. The method as claimed in claim 8 further comprising, based on there being text that matches text input by the user among the translated text, providing feedback for indicating that there is the matched text.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2020
From: WON, YOUNG-MIN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 052350/0854 →
Priority Claims (1)
KR 10-2017-0161962 · Nov 29, 2017 · national
Continuity (1)
Related Publication 20210197665A1 · Jul 1, 2021