IP Library › Granted Patent US 11,089,289
Granted Patent B2
US 11,089,289 · App. 15/554,179 · Granted Aug 10, 2021

Image processing device, imaging device, image processing method and program

Inventors: Takeo Ohishi (Kanagawa, JP); Kazuyuki Yamamoto (Kanagawa, JP); Shuzo Sato (Kanagawa, JP); Takayuki Yoshigahara (Tokyo, JP); Jun Murayama (Tokyo, JP); Ken Nishida (Chiba, JP); Kazuhiro Yamada (Kanagawa, JP)
Assignee: Sony Semiconductor Solutions Corporation
H04N13/271G02B27/0093G02B27/0172G06T7/11G06T7/136G06T7/194G06T7/593G06T7/70H04N13/239H04N13/344H04N13/398G02B2027/014G02B2027/0134G02B2027/0138G02B2027/0178G06T2207/10012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,089,289
App. No.
15/554,179
Granted
Aug 10, 2021
Kind
B2
Abstract

An image processing device includes depth acquisition circuitry that uses a parallax corresponding to image data to electronically generate a depth map of an image and object detection circuitry that uses distance information and the depth map to electronically detect a specific object in the image by identifying specific pixels in the image data. The depth map includes information that pertains to distances from a reference position for each pixel in the image.

Claims (32)

1. An image processing unit comprising:

depth acquisition circuitry configured to:

receive a first electronic image of various objects after a first camera captures the first electronic image,

receive a second electronic image of the various objects after a second camera captures the second electronic image, and

process a parallax of the first electronic image and the second electronic image in a manner that generates a depth map, the depth map includes information pertaining to distances from a reference position to the various objects; and

object detection circuitry configured to:

receive a main electronic image of the various objects after a main camera captures the main electronic image,

process the depth map so as to obtain a detection region of the main electronic image, and

detect, in the detection region, a specificone of the various objects without detecting another of the various objects in any other region of the main electronic image,

wherein a first one of the distances is larger than a predetermined value.

2. The image processing unit according to claim 1 , wherein the object detection circuitry is configured to associate, in advance, coordinates of pixels in the depth map to coordinates of pixels in the main electronic image.

3. The image processing unitaccording to claim 2 , wherein the depth map shows depths of the pixels in the main electronic image.

4. The image processing unit according to claim 1 , wherein an imaging range of the first electronicimage overlaps an imaging range of the second electronic image and an imaging range of the main electronic image.

5. The image processing unit according to claim 4 , wherein the imaging range of the main electronic image overlaps the imaging range of the first electronic image and the imaging range of the second electronic image.

6. The image processing unit according to claim 1 , wherein a resolution of the first electronic image is lower than a resolution of the main electronic image.

7. The image processing unitaccording to claim 6 , wherein a resolution of the second electronic image is lower than the resolution of the main electronic image.

8. The image processing unit according to claim 1 , wherein color information is absentfrom the first electronic image and is absent from the second electronic image.

9. The image processing unit according to claim 8 , wherein the main electronic image includes the color information.

10. The image processing unitaccording to claim 1 , wherein the object detection circuitry is configured to convert pixels in the detection region into display data.

11. The image processing unit according to claim 10 , wherein the object detection circuitry is configured to prevent an excluded pixel from being in the display data, the excluded pixel is a pixel in the main image that is outside of the detection region.

12. The image processing unit according to claim 10 , wherein the display data includes a detection result from the group consisting of a contour of the specific one of the various objects and a frame that surrounds the specificone of the various objects.

13. An image processing device comprising:

the image processing unit according to claim 10 ; and

a terminal that includes a display unit that outputs the display data as a viewable image.

14. The image processing device according to claim 13 , wherein the reference position is at the terminal.

15. The image processingdevice according to claim 13 , wherein the terminal includes the first camera, the second camera, and the main camera.

16. The image processing device according to claim 13 , further comprising:

an external interface that outputs the main electronic image.

17. The image processing device according to claim 13 , further comprising:

an external interface that outputsthe display data.

18. The image processing device according to claim 13 , wherein the display unit includes a first transmissive display.

19. The image processing device according to claim 18 , wherein the display unit includes a second transmissive display.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 043425 FRAME 0978. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 6, 2017
From: OHISHI, TAKEO; YAMAMOTO, KAZUYUKI; SATO, SHUZO; YOSHIGAHARA, TAKAYUKI; MURAYAMA, JUN; NISHIDA, KEN; YAMADA, KAZUHIRO
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 044380/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2017
From: OHISHI, TAKEO; YAMAMOTO, KAZUYUKI; SATO, SHUZO; YOSHIGAHARA, TAKAYUKI; MURAYAMA, JUN; NISHIDA, KEN; YAMADA, KAZUHIRO
To: SONY SEMICONDUCTOR SOUTIONS CORPORATION
Reel/Frame 043425/0978 →
Priority Claims (1)
JP JP2015-089983 · Apr 27, 2015 · national
Continuity (1)
Related Publication 20180035097A1 · Feb 1, 2018
Cited By (1)
US 12,535,882