IP Library › Granted Patent US 10,812,739
Granted Patent B2
US 10,812,739 · App. 16/063,787 · Granted Oct 20, 2020

Image processing device, image processing method, and image processing system

Inventors: Tomohiro Takahashi (Tokyo, JP); Hiroshi Tayanaka (Kanagawa, JP)
Assignee: Sony Semiconductor Solutions Corporation
H04N5/3456H04N5/23206H04N5/23229H04N5/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,812,739
App. No.
16/063,787
Granted
Oct 20, 2020
Kind
B2
Abstract

Methods and apparatus for image processing. The method comprises generating a first image having a first resolution, searching, by processing circuitry, the first image to determine whether a target object can be identified in the first image, specifying, when it is determined that the target object can be identified in the first image, a region-of-interest in the first image, generating, when it is determined that the target object cannot be identified in the first image, a second image having a second resolution higher than the first resolution, searching, by the processing circuitry, the second image to determine whether the target object can be identified in the second image, and specifying, when it is determined that the target object can be identified in the second image, a region-of-interest in the second image.

Claims (38)

1. An image processing method, comprising:

generating a first image having a first resolution, wherein generating the first image comprises selecting, from each of a plurality of pixel blocks that includes at least two pixels, one or more pixels to include in the first image;

searching, by processing circuitry, the first image to determine whether a target object can be identified in the first image;

specifying, when it is determined that the target object can be identified in the first image, a region-of-interest in the first image, wherein the region-of-interest in the first image includes the identified target object;

generating, when it is determined that the target object cannot be identified in the first image, a second image having a second resolution higher than the first resolution, wherein generating the second image comprises including in the second image a larger number of pixels from each pixel block than were used to generate the first image;

searching, by the processing circuitry, the second image to determine whether the target object can be identified in the second image; and

specifying, when it is determined that the target object can be identified in the second image, a region-of-interest in the second image, wherein the region-of-interest in the second image includes the identified target object.

2. The image processing method of claim 1 , wherein selecting, from each of the pixel blocks, one or more pixels of the at least two pixels to include in the first image comprises selecting the one or more pixels in each pixel block at a same location within a respective pixel block.

3. The image processing method of claim 1 , wherein each of the pixel blocks includes at least four pixels, and wherein generating the second image comprises selecting, from each of the pixel blocks, at least two of the at least four pixels to include in the second image.

4. The image processing method of claim 1 , further comprising:

generating a third image corresponding to the specified region-of-interest in the second image, wherein the third image has a third resolution higher than the second resolution.

5. The image processing method of claim 4 , wherein generating the third image comprises activating one or more analog-to-digital converters (ADCs) corresponding to the region-of-interest specified in the second image.

6. The image processing method of claim 4 , further comprising:

recognizing, by the processing circuitry, an item in the third image.

7. The image processing method of claim 6 , wherein the recognized item comprises text.

8. The image processing method of claim 6 , wherein recognizing the item in the third image comprises processing at least a portion of the third image using a machine learning classifier.

9. The image processing method of claim 8 , wherein recognizing the item in the third image comprises recognizing an attribute of the target object.

10. An image processing system, comprising:

processing circuitry configured to:

generate a first image having a first resolution, wherein generating the first image comprises selecting, from each of a plurality of pixel blocks that includes at least two pixels, one or more pixels to include in the first image;

search the first image to determine whether a target object can be identified in the first image;

specify, when it is determined that the target object can be identified in the first image, a region-of-interest in the first image, wherein the region-of-interest in the first image includes the identified target object;

generate, when it is determined that the target object cannot be identified in the first image, a second image having a second resolution higher than the first resolution, wherein generating the second image comprises including in the second image a larger number of pixels from each pixel block than were used to generate the first image;

search the second image to determine whether the, target object can be identified in the second image; and

specify, when it is determined that the target object can be identified in the second image, a region-of-interest in the second image, wherein the region-of-interest in the second image includes the identified target object.

11. The image processing system of claim 10 , wherein the processing circuitry is further configured to generate a third image corresponding to the specified region-of-interest in the second image, wherein the third image has a third resolution higher than the second resolution.

12. The image processing system of claim 11 , further comprising: a plurality of analog-to-digital converters (ADCs), each of which is configured to process data from a plurality of pixels, and wherein generating the third image comprises activating one or more of the plurality of ADCs corresponding to the region-of-interest specified in the second image.

13. The image processing system of claim 11 , wherein the processing circuitry is further configured to recognize an item in the third image.

14. The image processing system of claim 13 , wherein recognizing the item in the third image comprises processing at least a portion of the third image using a machine learning classifier.

15. The image processing system of claim 14 , wherein recognizing the item in the third image comprises recognizing an attribute of the target object.

16. An image processing method, comprising:

generating a first image having a first resolution, wherein generating the first image comprises selecting, from each of a plurality of pixel blocks that includes at least two pixels, one or more pixels to include in the first image;

searching the first image to identify a target object in the first image;

specifying, based on an identification of the target object, a region-of-interest in the first image, wherein the region-of-interest in the first image include the identified target object; and

activating one or more analog-to-digital converters (ADCs) corresponding to the region-of-interest specified in the first image to generate a second image corresponding to the region-of-interest, wherein the second image has a second resolution higher than the first resolution.

17. The image processing method of claim 16 , further comprising recognizing, by the processing circuitry, an item in the second image.

18. The image processing method of claim 17 , wherein recognizing the item in the second image comprises processing at least a portion of the second image using a machine learning classifier.

19. The image processing method of claim 18 , wherein recognizing the item in the second image comprises recognizing an attribute of the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2018
From: TAKAHASHI, TOMOHIRO; TAYANAKA, HIROSHI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 046271/0391 →
Priority Claims (1)
JP 2016-255290 · Dec 28, 2016 · national
Continuity (1)
Related Publication 20190149752A1 · May 16, 2019