IP Library Granted Patent US 12,475,781
Granted Patent B2
US 12,475,781 · App. 18/533,750 · Granted Nov 18, 2025

Systems and methods for detecting impaired decision-making pedestrians

Inventors: Benjamin Piya Austin (Saline, MI); Rohit Gupta (Santa Clara, CA); Philip J Babian (Canton, MI); Ali C Eren (Flower Mound, TX); William Patrick Garrett (Plymouth, MI); Rebecca L Kirschweng (Bloomfield Hills, MI); Dianne O Tykoski (Canton, MI)
Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.; Toyota Jidosha Kabushiki Kaisha
G08G1/005G08G1/0112G08G1/0116
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,781
App. No.
18/533,750
Granted
Nov 18, 2025
Kind
B2
Abstract

Systems, methods, and other embodiments described herein relate to identifying and assisting pedestrians identified as experiencing impaired decision-making capabilities. In one embodiment, a method includes determining, from interaction data collected by a user device of a pedestrian, an interaction characteristic of the pedestrian. The method also includes classifying the pedestrian as in an impaired decision-making state based on the interaction characteristic of the pedestrian deviating from baseline interaction data. The method further includes producing a pedestrian assistance countermeasure responsive to a determined impaired decision-making state for the pedestrian.

Claims (63)

1 . A system, comprising:

a processor; and

a memory storing machine-readable instructions that, when executed by the processor, cause the processor to:

determine, from interaction data collected by a user device of a pedestrian, an interaction characteristic of the pedestrian;

classify the pedestrian as in an impaired decision-making state based on the interaction characteristic of the pedestrian deviating from baseline interaction data; and

produce a pedestrian assistance countermeasure responsive to a determined impaired decision-making state for the pedestrian.

2 . The system of claim 1 , wherein:

the machine-readable instruction that, when executed by the processor, causes the processor to determine the interaction characteristic of the pedestrian comprises a machine-readable instruction that, when executed by the processor, causes the processor to determine at least one of a verbal communication characteristic or a written communication characteristic of the pedestrian; and

the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-readable instruction that, when executed by the processor, causes the processor to identify that the pedestrian is having difficulty composing at least one of a verbal communication or a written communication.

3 . The system of claim 2 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-readable instruction that, when executed by the processor causes the processor to classify the pedestrian as in the impaired decision-making state further based on a context of the verbal communication or the written communication.

4 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine the interaction characteristic of the pedestrian comprises a machine-readable instruction that, when executed by the processor, causes the processor to determine a characteristic of an interaction of the pedestrian with an application of the user device.

5 . The system of claim 1 , wherein:

the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-learning instruction that, when executed by the processor, causes the processor to compare the interaction characteristic of the pedestrian to the baseline interaction data; and

the baseline interaction data comprises at least one of:

an interaction pattern of the pedestrian; or

an interaction pattern of an additional individual.

6 . The system of claim 5 , wherein the machine-learning instruction that, when executed by the processor, causes the processor to compare the interaction characteristic of the pedestrian to the baseline interaction data comprises a machine-learning instruction that, when executed by the processor, causes the processor to:

weight the interaction pattern of the pedestrian more heavily than the interaction pattern of the additional individual; and

update a machine-learning instruction set to compare the interaction characteristic of the pedestrian to the baseline interaction data based on continuously collected interaction data for the pedestrian.

7 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state based on at least one of:

a degree of deviation between the interaction characteristic and the baseline interaction data; or

a quantity of deviations between interaction characteristics and the baseline interaction data within a period of time.

8 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to produce the pedestrian assistance countermeasure comprises a machine-readable instruction that, when executed by the processor, causes the processor to produce a notification to at least one of:

a human vehicle operator;

an autonomous vehicle system; or

an infrastructure element.

9 . The system of claim 8 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to produce the pedestrian assistance countermeasure comprises a machine-readable instruction that, when executed by the processor, causes the processor to produce a command signal for at least one of:

a vehicle; or

the infrastructure element.

10 . The system of claim 1 , wherein:

the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to identify an overt feature of confusion based on at least one of a geographical or temporal similarity between pedestrians classified as in the impaired decision-making state; and

the machine-readable instruction that, when executed by the processor, causes the processor to produce the pedestrian assistance countermeasure comprises a machine-readable instruction that, when executed by the processor, causes the processor to produce a report of the overt feature of confusion.

11 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state based on at least one of a physical movement of the pedestrian or a physical trait of the pedestrian.

12 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises a machine-readable instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state based on context data associated with the pedestrian.

13 . A non-transitory machine-readable medium comprising instructions that, when executed by a processor, cause the processor to:

determine, from interaction data collected by a user device of a pedestrian, an interaction characteristic of the pedestrian;

classify the pedestrian as in an impaired decision-making state based on the interaction characteristic of the pedestrian deviating from baseline interaction data; and

produce a pedestrian assistance countermeasure responsive to a determined impaired decision-making state for the pedestrian.

14 . The non-transitory machine-readable medium of claim 13 , wherein:

the instruction that, when executed by the processor, causes the processor to classify the pedestrian as in the impaired decision-making state comprises an instruction that, when executed by the processor, causes the processor to compare the interaction characteristic of the pedestrian to the baseline interaction data; and

the baseline interaction data comprises at least one of:

an interaction pattern of the pedestrian; or

an interaction pattern of an additional individual.

15 . The non-transitory machine-readable medium of claim 13 , wherein the instruction that, when executed by the processor, causes the processor to produce the pedestrian assistance countermeasure comprises an instruction that, when executed by the processor, causes the processor to produce a command signal to at least one of a vehicle or an infrastructure element in a vicinity of the pedestrian.

16 . A method, comprising:

determining, from interaction data collected by a user device of a pedestrian, an interaction characteristic of the pedestrian;

classifying the pedestrian as in an impaired decision-making state based on the interaction characteristic of the pedestrian deviating from baseline interaction data; and

producing a pedestrian assistance countermeasure responsive to a determined impaired decision-making state for the pedestrian.

17 . The method of claim 16 , wherein:

determining the interaction characteristic of the pedestrian comprises determining, for the pedestrian at least one of a verbal communication characteristic, a written communication characteristic, or an application interaction characteristic; and

classifying the pedestrian as in the impaired decision-making state comprises identifying that the pedestrian is having difficulty composing a communication or interacting with an application.

18 . The method of claim 16 , wherein:

classifying the pedestrian as in the impaired decision-making state comprises comparing the interaction characteristic of the pedestrian to the baseline interaction data; and

the baseline interaction data comprises at least one of:

an interaction pattern of the pedestrian; or

an interaction pattern of an additional individual.

19 . The method of claim 16 , wherein producing the pedestrian assistance countermeasure comprises producing a notification to at least one of:

a human vehicle operator;

an autonomous vehicle system; or

an infrastructure element.

20 . The method of claim 16 :

further comprising identifying an overt feature of confusion based on at least one of a geographical or temporal similarity between multiple pedestrians classified as in the impaired decision-making state; and

wherein producing the pedestrian assistance countermeasure comprises producing a report of the overt feature of confusion.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2026
From: TOYOTA JIDOSHA KABUSHIKI KAISHA
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 073670/0071 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2025
From: AUSTIN, BENJAMIN PIYA; GUPTA, ROHIT; BABIAN, PHILIP J; EREN, ALI C.; GARRETT, WILLIAM PATRICK; KIRSCHWENG, REBECCA L.; TYKOSKI, DIANNE O
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 071864/0358 →
Continuity (1)
Related Publication 20250191461A1 · Jun 12, 2025
References Cited (20)
US 7958201B2 · Lindsay · 2011 [cited by applicant]
US 9687187B2 · Dagum · 2017 [cited by applicant]
US 9734390B2 · Maurer et al. · 2017 [cited by applicant]
US 9904846B2 · Kindo et al. · 2018 [cited by applicant]
US 10028971B2 · Bird · 2018 [cited by applicant]
US 10782138B2 · Kaiser et al. · 2020 [cited by applicant]
US 10885785B2 · Xu et al. · 2021 [cited by applicant]
US 10971003B2 · Busch et al. · 2021 [cited by applicant]
US 20150109149A1 · Duncan · 2015 [cited by examiner]
US 20190200915A1 · Baker et al. · 2019 [cited by applicant]
US 20200151440A1 · Wang · 2020 [cited by examiner]
US 20200275243A1 · Ueno · 2020 [cited by examiner]
US 20200367816A1 · Panneer Selvam · 2020 [cited by applicant]
US 20210070322A1 · Noy · 2021 [cited by examiner]
US 20210118303A1 · Chan · 2021 [cited by examiner]
US 20220022747A1 · Malfavon · 2022 [cited by applicant]
US 20220242453A1 · Hahn · 2022 [cited by examiner]
JP 2022021168A · 2022 [cited by applicant]
WO 2023087917A1 · 2023 [cited by applicant]
Liu et al. “Mining Indecisiveness in Customer Behaviors”, 2015 IEEE International Conference on Data Mining. 2015. [cited by applicant]