IP Library › Granted Patent US 12,307,890
Granted Patent B2
US 12,307,890 · App. 17/823,759 · Granted May 20, 2025

Brain-computer interface enabled communication between autonomous vehicles and pedestrians

Inventors: Saraswathi Sailaja Perumalla (Visakhapatnam, IN); Sarbajit K. Rakshit (Kolkata, IN); Mahesh Malatesh Chitragar (Bangalore, IN)
Assignee: International Business Machines Corporation
G08G1/096716B60W50/14B60W60/0015G06F3/015G08G1/096783B60W2050/146B60W2554/4029B60W2554/4041B60W2554/4043B60W2554/4044B60W2554/4045B60W2556/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,890
App. No.
17/823,759
Granted
May 20, 2025
Kind
B2
Abstract

Systems, methods and/or computer program products for improving autonomous vehicle operation by enabling communication between the autonomous vehicles and BCI systems publishing signals from nearby pedestrians. Wearable BCI devices worn by pedestrians analyze brainwave signals and classify the brainwave signals in order to filter out signals that are unrelated to crossing the street or the directionality of travel by the pedestrian. BCI devices publish, or broadcast brain wave signals related to crossing the street or directionality of travel to the surrounding area where autonomous vehicle receive and process the brainwave signals being published. The autonomous vehicles predict movements of nearby pedestrians based on the intended direction of travel signified by the collected brainwave signals, and the autonomous vehicles select driving actions in response to the anticipated movements of nearby pedestrians.

Claims (52)

1. A computer-implemented method for enabling communication between an autonomous vehicle and a nearby pedestrian, the computer-implemented method comprising:

receiving, by a processor of a brain-communication interface (BCI) device, brainwave signals generated by the nearby pedestrian, wherein the BCI device is adapted to receive brainwave signals from the nearby pedestrian and send the brainwave signals to the processor;

classifying, by the processor, the brainwave signals;

identifying, by the processor, the brainwave signals that are classified as relating to movement of the nearby pedestrian;

filtering, by the processor, the brainwave signals unrelated to the movement of the nearby pedestrian;

broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian to the autonomous vehicle; and

in response to broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian, displaying, by the processor, one or more driver actions being implemented by the autonomous vehicle to the nearby pedestrian.

2. The computer-implemented method of claim 1 , wherein the BCI device is a head-mounted cap, glasses or earbud.

3. The computer-implemented method of claim 1 , wherein brainwave signals that are classified as relating to the movement of the nearby pedestrian indicate to the autonomous vehicle whether the nearby pedestrian intends to cross a roadway.

4. The computer-implemented method of claim 1 , wherein the broadcasting of the brainwave signals further comprises:

transmitting, by the processor of the BCI device, the brainwave signals classified as relating to the movement of the nearby pedestrian, directly to any autonomous vehicles within a predetermined range of the nearby pedestrian or a smart road transmitter configured to broadcast the brainwave signals to the autonomous vehicles within a predetermined range of the nearby pedestrian.

5. The computer-implemented method of claim 4 , wherein the broadcasting of the brainwave signals further comprises:

broadcasting, by the processor, location, speed of movement, and direction of movement, of the nearby pedestrian.

6. The computer-implemented method of claim 2 , wherein displaying one or more driver actions being implemented by the autonomous vehicle comprises:

previewing to the nearby pedestrian, the one or more driver actions being implemented by the autonomous vehicle on an augmented reality device indicating how the autonomous vehicle will respond as the autonomous vehicle approaches the nearby pedestrian as the nearby pedestrian crosses the roadway.

7. The computer-implemented method of claim 1 , wherein the brainwave signals being received by the BCI device from the nearby pedestrian further include a prediction of movement of a second nearby pedestrian; and

broadcasting the brainwave signals classified as relating to the prediction of movement of the second nearby pedestrian to the autonomous vehicle.

8. A computer system for enabling communication between an autonomous vehicle and a nearby pedestrian, the system comprising:

a processor of a brain-communication interface (BCI) device, wherein the BCI device is adapted to receive brainwave signals from the nearby pedestrian and send the brainwave signals to the processor; and

a computer-readable storage media coupled to the processor, wherein the computer-readable storage media contains program instructions executing, via the processor, a computer-implemented method comprising:

receiving, by the processor, brainwave signals generated by the nearby pedestrian;

classifying, by the processor, the brainwave signals;

identifying, by the processor, the brainwave signals that are classified as relating to movement of the nearby pedestrian;

filtering, by the processor, the brainwave signals unrelated to the movement of the nearby pedestrian;

broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian to the autonomous vehicle; and

in response to broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian, displaying, by the processor, one or more driver actions being implemented by the autonomous vehicle to the nearby pedestrian.

9. The computer system of claim 8 , wherein the BCI device is a head-mounted cap, glasses or earbud.

10. The computer system of claim 8 , wherein brainwave signals that are classified as relating to the movement of the nearby pedestrian indicate to the autonomous vehicle whether the nearby pedestrian intends to cross a roadway.

11. The computer system of claim 8 , wherein the broadcasting of the brainwave signals further comprises:

transmitting, by the processor of the BCI device, the brainwave signals classified as relating to the movement of the nearby pedestrian, directly to any autonomous vehicles within a predetermined range of the nearby pedestrian or a smart road transmitter configured to broadcast the brainwave signals to the autonomous vehicles within a predetermined range of the nearby pedestrian.

12. The computer system of claim 11 , wherein the broadcasting of the brainwave signals further comprises:

broadcasting, by the processor, location, speed of movement, and direction of movement, of the nearby pedestrian.

13. The computer system of claim 9 , wherein displaying one or more driver actions being implemented by the autonomous vehicle comprises:

previewing to the nearby pedestrian, the one or more driver actions being implemented by the autonomous vehicle on an augmented reality device indicating how the autonomous vehicle will respond as the autonomous vehicle approaches the nearby pedestrian as the nearby pedestrian crosses the roadway.

14. The computer system of claim 8 , wherein the brainwave signals being received by the BCI device from the nearby pedestrian further include a prediction of movement of a second nearby pedestrian; and

broadcasting the brainwave signals classified as relating to the prediction of movement of the second nearby pedestrian to the autonomous vehicle.

15. A computer program product for enabling communication between an autonomous vehicle and a nearby pedestrian, the computer program product comprising:

one or more computer readable storage media having computer-readable program instructions stored on the one or more computer readable storage media, said program instructions executes a computer-implemented method comprising:

receiving, by a processor of a brain-communication interface (BCI) device, brainwave signals generated by the nearby pedestrian, wherein the BCI device is adapted to receive brainwave signals from the nearby pedestrian and send the brainwave signals to the processor;

classifying, by the processor, the brainwave signals;

identifying, by the processor, the brainwave signals that are classified as relating to movement of the nearby pedestrian;

filtering, by the processor, the brainwave signals unrelated to the movement of the nearby pedestrian;

broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian to the autonomous vehicle; and

in response to broadcasting the brainwave signals classified as relating to the movement of the nearby pedestrian, displaying, by the processor, one or more driver actions being implemented by the autonomous vehicle to the nearby pedestrian.

16. The computer program product of claim 15 , wherein the BCI device is a head-mounted cap, glasses or earbud.

17. The computer program product of claim 15 , wherein brainwave signals that are classified as relating to the movement of the nearby pedestrian indicate to the autonomous vehicle whether the nearby pedestrian intends to cross a roadway.

18. The computer program product of claim 15 , wherein the broadcasting of the brainwave signals further comprises:

transmitting, by the processor of the BCI device, the brainwave signals classified as relating to the movement of the nearby pedestrian, directly to any autonomous vehicles within a predetermined range of the nearby pedestrian or a smart road transmitter configured to broadcast the brainwave signals to the autonomous vehicles within a predetermined range of the nearby pedestrian.

19. The computer program product of claim 16 , wherein displaying one or more driver actions being implemented by the autonomous vehicle comprises:

previewing to the nearby pedestrian, the one or more driver actions being implemented by the autonomous vehicle on an augmented reality device indicating how the autonomous vehicle will respond as the autonomous vehicle approaches the nearby pedestrian as the nearby pedestrian crosses the roadway.

20. The computer program product of claim 15 , wherein the brainwave signals being received by the BCI device from the nearby pedestrian further include a prediction of movement of a second nearby pedestrian; and

broadcasting the brainwave signals classified as relating to the prediction of movement of the second nearby pedestrian to the autonomous vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: PERUMALLA, SARASWATHI SAILAJA; RAKSHIT, SARBAJIT K.; CHITRAGAR, MAHESH MALATESH
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 060955/0965 →
Continuity (1)
Related Publication 20240071220A1 · Feb 29, 2024
References Cited (16)
US 9881503B1 · Goldman-Shenhar · 2018 [cited by examiner]
US 9947215B2 · Di Censo · 2018 [cited by applicant]
US 20130096453A1 · Chung · 2013 [cited by examiner]
US 20140330404A1 · Abdelghani · 2014 [cited by examiner]
US 20170345292A1 · Haran · 2017 [cited by examiner]
US 20180096605A1 · Bai · 2018 [cited by examiner]
US 20200180647A1 · Anthony · 2020 [cited by applicant]
US 20210078598A1 · Kim · 2021 [cited by examiner]
US 20210233406A1 · Lu · 2021 [cited by examiner]
US 20210394705A1 · Kourous-Harrigan · 2021 [cited by applicant]
CN 109375776B · 2021 [cited by examiner]
CN109375776B_Machine Translation (Year: 2021). [cited by examiner]
M. K. Ishak and M. Dyson, “Human movement intentions based on EEG using brain computer interfaces,” 2015 International Conference on Control, Electronics, Renewable Energy and Communications (ICCEREC), Bandung, Indonesi… [cited by examiner]
Bellan, Rebecca, “NHTSA probes Tesla Autopilot crash that killed three people”, TechCrunch, May 18, 2022, 11 pages, <https://techcrunch.com/2022/05/18/nhtsa-probes-tesla-autopilot-crash-that-killed-three-people/>. [cited by applicant]
Parikh et al., “Conceptual Neuroadaptive Brain Computer Interface for Autonomous Control of Automobile Brakes”, 2020 11th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), pp. 095… [cited by applicant]
Waytowich, Nicholas, “BCI Control of a Motorized Wheelchair for Disabled Individuals using a calibrationless SSVEP system”, YouTube, Nov. 20, 2014, 3 pages, <https://www.youtube.com/watch?v=qhK572LJhSc>. [cited by applicant]