IP Library › Granted Patent US 12,223,755
Granted Patent B2
US 12,223,755 · App. 18/135,088 · Granted Feb 11, 2025

Electronic device and method for identifying sentence indicated by strokes

Inventor: Taewon Kwak (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06V30/1801G06F3/04883G06F40/279G06V30/222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,755
App. No.
18/135,088
Filed
Apr 14, 2023
Granted
Feb 11, 2025
Kind
B2
Art Unit
2171
USPC
715/268
Abstract

A processor of an electronic device is configured to display a plurality of strokes in the display. The processor is configured to display, in response to a first input indicating selection of at least one character distinguished by the strokes, a first visual object for identifying a first sentence including the at least one character. The processor is configured to identify, in response to a second input indicating selection of the first visual object, strokes included in the first sentence among the strokes, based on a spacing between a first word including the at least one character and a second word, and moments of a plurality of words including the first word, and the second word are inputted. The processor is configured to display, in the display based on identification of the strokes included in the first sentence, a second visual object corresponding to the identified strokes among the strokes.

Claims (62)

1. An electronic device, comprising:

a display; and

a processor,

memory comprising instructions that, when executed by the processor, cause the electronic device to:

display a plurality of strokes and an image in the display;

display, in response to a first input indicating selection of at least one character distinguished by the plurality of strokes, a first visual object for identifying a first sentence including the at least one character;

identify, in response to a second input indicating selection of the first visual object, strokes included in the first sentence among the plurality of strokes, based on a spacing between a first word including the at least one character and a second word, and based on moments a plurality of words are inputted, the plurality of words including the first word and the second word;

display, in the display based on identification of the strokes included in the first sentence, a second visual object corresponding to the strokes identified among the plurality of strokes;

in response to receiving a selection of the first sentence, search media content being displayed; and

in response to identifying that the first sentence selected is related to the image, display an additional visual object that includes a combination of the first sentence selected and the image.

2. The electronic device of claim 1 , wherein the processor is configured to:

identify the strokes included in the first sentence, based on information for indicating a sequence in which the plurality of words is inputted, wherein the sequence is indicated by the moments or locations of the plurality of words.

3. The electronic device of claim 2 , wherein the processor is configured to:

obtain, by using the information, sets including at least one of the plurality of words and probabilities that the sets are a single sentence; and

identify, based on the probabilities obtained, one or more words included in the first sentence including the first word among the plurality of words.

4. The electronic device of claim 3 , wherein the processor is configured to:

obtain, by using a model trained based on a set of strokes corresponding to a single sentence, the probabilities.

5. The electronic device of claim 2 , wherein the processor is configured to:

obtain, among the plurality of words, the spacing between the first word and the second word connected to the first word in the sequence; and

identify, based on at least one of a difference between a first moment when the first word is inputted and a second moment when the second word is inputted, or the spacing, whether the second word is included in a second sentence different from the first sentence.

6. The electronic device of claim 1 , wherein the processor is configured to:

identify, based on identifying the first word and the second word included in a first line formed along a first direction where characters distinguished by the plurality of strokes are arranged, the spacing between the first word and the second word in the first direction.

7. The electronic device of claim 1 , wherein the processor is configured to:

identify, based on identifying the first word included in the first line formed along the first direction where characters distinguished by the plurality of strokes are arranged and the second word included in a second line parallel to the first line, another spacing between the first word and the second word in a second direction different from the first direction.

8. The electronic device of claim 1 , wherein the processor is configured to:

display, with the first visual object in response to the first input, at least one third visual object for executing a function associated with at least one word selected by the first input.

9. The electronic device of claim 8 , wherein the at least one third visual object is configured to:

execute the function independent from other characters different from the at least one character in the first sentence.

10. The electronic device of claim 1 , wherein the processor is configured to:

identify, in response to the second input, the image associated with the first sentence in the media content including the plurality of strokes; and

display, based on identifying the image, the second visual object corresponding to the strokes included in the first sentence and the image identified.

11. The electronic device of claim 1 , wherein the processor is configured to:

identify, in response to the second input, an audio signal associated with the first sentence in the media content including the plurality of strokes; and

display, based on identifying the audio signal, the second visual object corresponding to the strokes included in the first sentence and a third visual object indicating the audio signal.

12. The electronic device of claim 1 , wherein the processor is configured to:

display, based on information including particular moments and particular locations in which each of the plurality of strokes is inputted, the plurality of strokes in the display.

13. A method of an electronic device, comprising:

displaying, in a display of the electronic device, a plurality of characters and an image;

displaying, in response to a first input indicating selection of at least one first character among the plurality of characters, a list of functions associated with the at least one first character;

identifying, in response to a second input indicating selection of a first function for identifying a sentence including the at least one first character that is identified based on the list, the sentence including the at least one first character among the plurality of characters;

displaying, based on identifying of the sentence, at least one visual object in association with a plurality of second characters included in the sentence and including the at least one first character;

in response to receiving a selection of the sentence, searching media content being displayed; and

in response to identifying that the sentence selected is related to the image, displaying an additional visual object that includes a combination of the first sentence selected and the image.

14. The method of claim 13 , wherein the displaying the at least one visual object comprises:

displaying another list of functions associated with the sentence indicated by the plurality of second characters, independently of a first visual object for executing the first function.

15. The method of claim 13 , wherein the displaying the another list comprises:

displaying, with the first visual object for executing the first function, at least one of a second visual object for executing a second function for copying the at least one first character selected by the first input, or a third visual object for executing a third function for extracting the at least one first character from the plurality of characters displayed in the display.

16. The method of claim 15 , further comprising:

at least temporarily storing, in response to a third input for selecting the second visual object, the at least one first character selected by the first input in a memory of the electronic device.

17. The method of claim 13 , wherein the identifying comprises:

identifying the sentence, based on spacings between the plurality of characters and a difference between moments when each of the plurality of characters are inputted.

18. The method of claim 13 , wherein the displaying the plurality of characters comprises:

displaying, based on information indicating a plurality of strokes sequentially drawn by a user, the plurality of characters distinguished by the plurality of strokes.

19. The method of claim 13 , wherein the displaying the at least one visual object comprises:

displaying, in the media content including the plurality of characters, the at least one visual object for highlighting at least one of the image, video, or audio associated with the sentence identified.

20. A method of an electronic device, comprising:

displaying a plurality of strokes in a display of the electronic device;

displaying, in response to a first input indicating selection of at least one character distinguished by the plurality of strokes, a first visual object for identifying a first sentence including the at least one character;

identifying, in response to a second input indicating selection of the first visual object, strokes included in the first sentence among the plurality of strokes, based on a spacing between a first word including the at least one character and a second word, and based on moments a plurality of words are inputted, the plurality of words including the first word, and the second word;

displaying, in the display based on identification of the strokes included in the first sentence, a second visual object corresponding to the strokes identified among the plurality of strokes;

in response to receiving a selection of the first sentence, searching media content being displayed; and

in response to identifying that the first sentence selected is related to the image, displaying an additional visual object that includes a combination of the first sentence selected and the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2023
From: KWAK, TAEWON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063332/0642 →
Priority Claims (2)
KR 10-2022-0086840 · Jul 14, 2022 · national
KR 10-2022-0096382 · Aug 2, 2022 · national
Continuity (2)
Continuation PCTKR2023004611 · Apr 5, 2023
Related Publication 20240020996A1 · Jan 18, 2024
References Cited (26)
US 9542094B2 · Park et al. · 2017 [cited by applicant]
US 10089389B1 · Van Rotterdam · 2018 [cited by examiner]
US 10848482B1 · Eisen · 2020 [cited by examiner]
US 11023661B2 · Sun et al. · 2021 [cited by applicant]
US 11087156B2 · Zubarieva et al. · 2021 [cited by applicant]
US 20080056574A1 · Heck · 2008 [cited by examiner]
US 20120137246A1 · Pyo · 2012 [cited by examiner]
US 20120229505A1 · Kuga · 2012 [cited by examiner]
US 20150073779A1 · Ahn et al. · 2015 [cited by applicant]
US 20150286886A1 · Wimmer · 2015 [cited by examiner]
US 20160048318A1 · Markiewicz · 2016 [cited by examiner]
US 20160162446A1 · Demiya · 2016 [cited by examiner]
US 20210350122A1 · Dixon · 2021 [cited by examiner]
JP 2007172640A · 2007 [cited by applicant]
JP 4741977B2 · 2011 [cited by applicant]
JP 5723697B2 · 2015 [cited by applicant]
JP 6464055B2 · 2019 [cited by applicant]
KR 101623213B1 · 2016 [cited by applicant]
KR 20160064925A · 2016 [cited by applicant]
KR 102075433B1 · 2020 [cited by applicant]
KR 102133532B1 · 2020 [cited by applicant]
KR 20200103236A · 2020 [cited by applicant]
KR 102344144B1 · 2021 [cited by applicant]
KR 20220003662A · 2022 [cited by applicant]
KR 102379660B1 · 2022 [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/KR2023/004611; International Filing Date Apr. 5, 2023; Date of Mailing Jul. 3, 2023, 10 Pages. [cited by applicant]