IP Library › Granted Patent US 11,672,724
Granted Patent B2
US 11,672,724 · App. 17/530,476 · Granted Jun 13, 2023

Information processing device and information processing method

Inventors: Hiroaki Kawamura (Toyota, JP); Kohei Shintani (Toyota, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
A61H3/061G06F18/00G06F18/22G06F18/2321G06V10/255G06V40/103G06V40/25G09B21/007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,672,724
App. No.
17/530,476
Granted
Jun 13, 2023
Kind
B2
Abstract

An information processing device calculates an occupancy rate of a pedestrian crossing in an image obtained by capturing an image of a traveling direction of a target person, determines a crossing status of the target person for the pedestrian crossing based on the calculated occupancy rate, and generates support information for supporting the target person crossing the pedestrian crossing based on the crossing status.

Claims (31)

1. An information processing device on a cane, comprising:

a camera in a grip portion of the cane;

a calculation unit that calculates an occupancy rate of a pedestrian crossing in an image obtained by capturing an image of a traveling direction of a target person with the camera;

a crossing status determination unit that determines a crossing status of the target person for the pedestrian crossing based on the calculated occupancy rate; and

a support information generation unit that generates support information for supporting the target person crossing the pedestrian crossing based on the crossing status of the target person.

2. The information processing device according to claim 1 , wherein when the occupancy rate is smaller than a predetermined threshold value, the crossing status determination unit determines that there is a possibility that the target person deviates from the pedestrian crossing.

3. The information processing device according to claim 1 , wherein:

the occupancy rate is an occupancy rate of the pedestrian crossing in a lateral direction of the image; and

the calculation unit calculates the occupancy rate based on a ratio of a lateral dimension of a pedestrian crossing strip to a lateral dimension of the image.

4. The information processing device according to claim 1 , wherein:

for a first pedestrian crossing strip located at a bottom of the image and a second pedestrian crossing strip located adjacent to and above the first pedestrian crossing strip, the calculation unit calculates a traveling direction appropriateness rate based on a ratio of a lateral dimension of the second pedestrian crossing strip to a lateral dimension of the first pedestrian crossing strip; and

when the traveling direction appropriateness rate is smaller than a predetermined threshold value, the crossing status determination unit determines that there is a possibility that the target person deviates from the pedestrian crossing.

5. The information processing device according to claim 1 , wherein:

for a first pedestrian crossing strip located at a bottom of the image, the calculation unit obtains a height dimension in a vertical direction from a lower end of the image to the first pedestrian crossing strip, and the calculation unit calculates a starting point distance securing rate based on a ratio of the height dimension of the first pedestrian crossing strip to a vertical dimension of the image; and

when the starting point distance securing rate is equal to or larger than a predetermined threshold value, the crossing status determination unit determines that the target person is located at a point in front of the pedestrian crossing.

6. The information processing device according to claim 1 , wherein:

for a first pedestrian crossing strip located at a bottom of the image and a second pedestrian crossing strip located adjacent to and above the first pedestrian crossing strip, the calculation unit obtains a height dimension in a vertical direction from a lower end of the image to each of the first pedestrian crossing strip and the second pedestrian crossing strip, and calculates a pedestrian crossing entrance rate based on a ratio of the height dimension of the second pedestrian crossing strip to the height dimension of the first pedestrian crossing strip; and

when the pedestrian crossing entrance rate is smaller than a predetermined threshold value, the crossing status determination unit determines that the target person is located at a point in front of the pedestrian crossing.

7. The information processing device according to claim 1 , wherein the calculation unit inputs a captured image to a learned model to estimate a shape of a pedestrian crossing strip of the pedestrian crossing, the learned model being generated using an image of a pedestrian crossing that does not include a pedestrian and an image of a pedestrian crossing that includes a pedestrian as training data, and calculates an occupancy rate of the pedestrian crossing in the captured image based on the estimated shape of the pedestrian crossing strip.

8. The information processing device according to claim 1 , further comprising a signal detection unit, wherein:

the signal detection unit detects a signal state of a traffic light installed at the pedestrian crossing based on the image; and

the support information generation unit generates the support information based on the signal state.

9. The information processing device according to claim 1 , further comprising an obstacle detection unit, wherein:

the obstacle detection unit detects an obstacle approaching in a direction of crossing the pedestrian crossing based on a captured image; and

the support information generation unit generates the support information when an obstacle is recognized.

10. The information processing device according to claim 1 , further comprising:

an output unit that outputs the support information.

11. An information processing method, comprising:

calculating, by a calculation unit, an occupancy rate of a pedestrian crossing in an image obtained by capturing, with a camera in a grip portion of a cane, an image of a traveling direction of a target person;

determining, by a crossing status determination unit, a crossing status of the target person for the pedestrian crossing based on the calculated occupancy rate; and

generating, by a support information generation unit, support information for supporting the target person crossing the pedestrian crossing based on the crossing status of the target person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: KAWAMURA, HIROAKI; SHINTANI, KOHEI
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 058158/0254 →
Priority Claims (1)
JP JP2021-008918 · Jan 22, 2021 · national
Continuity (1)
Related Publication 20220233392A1 · Jul 28, 2022