IP Library Granted Patent US 9,852,335
Granted Patent B2
US 9,852,335 · App. 15/109,851 · Granted Dec 26, 2017

Method of processing a visual object

Inventors: Sergey Aleksandrovich Fayfer (Moscow, RU); Anton Viktorovich Slesarev (Republic of Tatarstan, RU); Alexander Alexandrovich Chigorin (Moscow region, RU)
Assignee: YANDEX EUROPE AG
G06K9/00456G06F3/0488G06F3/04842G06K9/2081G06K9/22G06Q10/10G06K2209/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,852,335
App. No.
15/109,851
Granted
Dec 26, 2017
Kind
B2
Abstract

A computer-implemented method executed on an electronic device, the electronic device having a display screen, the method comprising: displaying an image on the display screen; receiving a user selection of a first portion of the image; responsive to the user selection of the first portion of the image, the first portion of the image containing a selected text portion, performing text recognition of the selected text portion and of an unselected text portion, the unselected text portion located in a second portion of the image being distinct from the first portion of the image, to render a recognized text element.

Claims (41)

1. A computer-implemented method executed on an electronic device, the electronic device having a display screen, the method comprising:

displaying an image on the display screen;

receiving a user selection of a first portion of the image;

responsive to the user selection of the first portion of the image, the first portion of the image containing a selected text portion, performing text recognition of the selected text portion and of an unselected text portion, the unselected text portion located in a second portion of the image being distinct from the selected text portion located in the first portion of the image, the second portion of the image being immediately adjacent to the first portion of the image;

after performing the text recognition of the selected text portion and of the unselected text portion, determining if the unselected text portion should form part of a recognized text element, the determining comprises detecting at least one of a logical continuation and a logical extension of the unselected text portion relative to the selected text portion;

responsive to determining that the unselected text portion should form part of the recognized text element, creating the recognized text element that includes the selected text portion and at least a portion of the unselected text portion;

the display screen being a touch screen, wherein receiving the user selection of the first portion of the image is effected by identifying a touch action performed by the user on the display screen; and

wherein the displaying the image on the display screen comprises displaying a blurred version of the image, and wherein the touch action performed by the user on the display screen is sweeping a portion of the blurred version of the image, the portion of the blurred version of the image corresponding to the first portion of the image.

2. The method claim 1 , the electronic device comprising a camera, the method further comprising, prior to the displaying the image on the display screen, capturing the image using the camera.

3. The method of claim 1 , wherein the displaying the image on the display screen comprises displaying a blurred version of the image.

4. The method of claim 1 , wherein said detecting of at least one of the logical continuation and the logical extension comprises:

performing text recognition of an entirety of the text contained within the image to render an entirety of recognized text;

analyzing the entirety of recognized text to determine if the entirety of recognized text potentially contains the unselected text portion.

5. The method of claim 4 , wherein said analyzing further comprises choosing the unselected text portion based on the unselected text portion being the logical continuation of the selected text portion.

6. The method of claim 4 , wherein said analyzing further comprises choosing the unselected text portion based on the unselected text portion being the logical extension of the selected text portion.

7. The method of claim 4 , the selected text portion including a first selected text portion and a second selected text portion, the unselected text portion including a first unselected text portion and a second unselected text portion, wherein said analyzing further comprises choosing:

the first unselected text portion based on the first unselected text portion being one of the logical continuation and the logical extension of at least one of the first selected text portion and the second selected text portion, and

the second unselected text portion based on the second unselected text portion being one of the logical continuation and the logical extension of at least one of the first selected text portion and the second selected text portion.

8. The method of claim 1 , further comprising displaying at least a portion of the recognized text element.

9. The method of claim 1 , further comprising defining a category of the at least a portion of the recognized text element.

10. The method of claim 8 , further comprising displaying suggestion to perform an action with regard to the at least a portion of the recognized text element.

11. The method of claim 10 , wherein suggestion to perform the action with regard to the at least a portion of the recognized text element is selected based on the category of the at least a portion of the recognized text element.

12. The method of claim 10 , further comprising performing the action with regard to the at least a portion of the recognized text element.

13. The method of claim 12 , wherein said performing the action is executed in response to receiving a user confirmation to perform the action with regard to the at least a portion of the recognized text element.

14. The method of claim 12 , wherein said performing the action with regard to the at least a portion of the recognized text element comprises at least one:

entering the at least a portion of the recognized text element into calendar;

entering the at least a portion of the recognized text element into contacts database;

showing an address on a map;

creating an itinerary to a destination;

saving the at least a portion of the recognized text element.

15. The method claim 1 , further comprising storing the first portion of the image and the second portion of the image in association with the recognized text element.

16. The method of claim 1 further comprising storing the image and both the first portion of the image and the second portion of the image, in association with the recognized text element.

17. The method of claim 1 , further comprising indexing at least one of: the recognized text element, the image, the first portion of the image and the second portion of the image, the at least a portion of the recognized text element, and storing a derived index.

18. An electronic device comprising a display screen, a processor coupled to the display screen, the processor being configured to have access to computer readable commands which commands, when executed, cause the processor to:

display an image on the display screen;

receive a user selection of a first portion of the image;

responsive to the user selection of the first portion of the image, the first portion of the image containing a selected text portion, perform text recognition of the selected text portion and of an unselected text portion, the unselected text portion located in a second portion of the image being distinct from the selected text portion located in the first portion of the image, the second portion of the image being immediately adjacent to the first portion of the image;

after performing the text recognition of the selected text portion and of the unselected text portion, determine if the unselected text portion should form part of a recognized text element, to determine comprises to detect at least one of a logical continuation and a logical extension of the unselected text portion relative to the selected text portion;

responsive to determining that the unselected text portion should form part of the recognized text element, create the recognized text element that includes the selected text portion and at least a portion of the unselected text portion;

the display screen being a touch screen, wherein computer readable commands, when executed, further cause the processor to receive the user selection of the first portion of the image by identifying a touch action performed by the user on the touch screen; and

wherein the touch action performed by the user on the touch screen is sweeping a portion of the blurred version of the image, the portion of the blurred version of the image corresponding to the first portion of the image.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: DIRECT CURSUS TECHNOLOGY L.L.C
To: Y.E. HUB ARMENIA LLC
Reel/Frame 068524/0184 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: YANDEX EUROPE AG
To: DIRECT CURSUS TECHNOLOGY L.L.C
Reel/Frame 064925/0808 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2017
From: FAYFER, SERGEY ALEKSANDROVICH; SLESAREV, ANTON VIKTOROVICH; CHIGORIN, ALEXANDER ALEXANDROVICH
To: YANDEX LLC
Reel/Frame 042610/0959 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2017
From: YANDEX LLC
To: YANDEX EUROPE AG
Reel/Frame 042611/0063 →
Priority Claims (1)
RU 2014122127 · May 29, 2014 · national
Continuity (1)
Related Publication 20160328608A1 · Nov 10, 2016