IP Library Granted Patent US 10,692,379
Granted Patent B2
US 10,692,379 · App. 15/760,412 · Granted Jun 23, 2020

Image processing device and image processing method

Inventors: Suguru Aoki (Tokyo, JP); Taketo Akama (Tokyo, JP); Hideki Oyaizu (Tokyo, JP); Yasutaka Hirasawa (Tokyo, JP); Yuhi Kondo (Tokyo, JP)
Assignee: SONY CORPORATION
G08G1/166B60W30/0956B60W40/064B60W50/14G06K9/00342G06T7/60G08G1/16B60W2420/42B60W2554/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,692,379
App. No.
15/760,412
Granted
Jun 23, 2020
Kind
B2
Abstract

An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a judgment unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The judgment unit judges a possibility of the target object slipping on the basis of the estimated posture.

Claims (71)

1. An information processing apparatus, comprising:

circuitry configured to:

detect a target object from an input image;

estimate a posture of the target object;

calculate each of a feature point associated with the target object, and a contact point of the target object with a road surface,

wherein the feature point and the contact point are calculated based on the posture of the target object;

determine a possibility of a slip of the target object based on an angle between the road surface and a straight line that connects the feature point and the contact point;

generate danger avoidance information based on the possibility of the slip of the target object; and

output the danger avoidance information.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a pedestrian from the input image;

estimate a posture of the pedestrian; and

determine a possibility of a slip of the pedestrian based on the posture of the pedestrian.

3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a two-wheeled vehicle and a rider of the two-wheeled vehicle from the input image;

estimate a posture of the rider; and

determine a possibility of a slip of the two-wheeled vehicle based on the posture of the rider.

4. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to:

estimate a posture of the two-wheeled vehicle; and

determine the possibility of the slip of two-wheeled vehicle based on each of the posture of the two-wheeled vehicle and the posture of the rider.

5. The information processing apparatus according to claim 1 , wherein the feature point is a barycenter point of the target object.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a two-wheeled vehicle and a rider of the two-wheeled vehicle from the input image; and

calculate, as the feature point, at least one of a barycenter point of the rider or an overall barycenter point of the two-wheeled vehicle and the rider.

7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

acquire road surface information associated with a road surface state; and

determine the possibility of the slip of the target object based on the road surface information.

8. The information processing apparatus according to claim 7 , wherein the circuitry is further configured to:

determine slipperiness of the road surface based on the road surface information; and

determine the possibility of the slip of the target object based on the slipperiness of the road surface.

9. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

acquire road surface information associated with a road surface state, wherein the road surface information includes a tilt angle of the road surface; and

calculate the angle between the straight line and the road surface based on the tilt angle of the road surface.

10. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to estimate a framework of the target object.

11. The information processing apparatus according to claim 1 , wherein

the information processing apparatus is mountable on a mobile object apparatus, and

the circuitry is further configured to generate the danger avoidance information to avoid a danger associated with a drive of the mobile object apparatus.

12. The information processing apparatus according to claim 11 , wherein

the circuitry is further configured to output a target image that includes the target object.

13. The information processing apparatus according to claim 11 , wherein the circuitry is further configured to:

determine a dangerous area for the target object from the input image; and

output a target image that includes the dangerous area for the target object.

14. An information processing method, comprising:

detecting a target object from an input image;

estimating a posture of the target object;

calculating each of a feature point associated with the target object, and a contact point of the target object with a road surface,

wherein the feature point and the contact point are calculated based on the posture of the target object;

determining a possibility of a slip of the target object based on an angle between the road surface and a straight line that connects the feature point and the contact point;

generating danger avoidance information based on the possibility of the slip of the target object; and

outputting the danger avoidance information.

15. A non-transitory computer-readable medium having stored thereon computer-readable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

detecting a target object from an input image;

estimating a posture of the target object;

calculating each of a feature point associated with the target object, and a contact point of the target object with a road surface,

wherein the feature point and the contact point are calculated based on the posture of the target object;

determining a possibility of a slip of the target object based on an angle between the road surface and a straight line that connects the feature point and the contact point;

generating danger avoidance information based on the possibility of the slip of the target object; and

outputting the danger avoidance information.

16. An information processing system, comprising:

an imaging device configured to capture an image; and

circuitry configured to:

detect a target object from the captured image;

estimate a posture of the target object;

calculate each of a feature point associated with the target object, and a contact point of the target object with a road surface,

wherein the feature point and the contact point are calculated based on the posture of the target object;

determine a possibility of a slip of the target object based on an angle between the road surface and a straight line that connects the feature point and the contact point;

generate danger avoidance information based on the possibility of the slip of the target object; and

output the danger avoidance information.

17. An information processing system according to claim 16 , further comprising:

a control device configured to control at least one of a speed or a direction of a vehicle, and

the information processing system is implemented into the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2018
From: AOKI, SUGURU; AKAMA, TAKETO; OYAIZU, HIDEKI; HIRASAWA, YASUTAKA; KONDO, YUHI
To: SONY CORPORATION
Reel/Frame 045606/0349 →
Priority Claims (1)
JP 2015-191190 · Sep 29, 2015 · national
Continuity (1)
Related Publication 20180268700A1 · Sep 20, 2018