IP Library Granted Patent US 11,866,063
Granted Patent B2
US 11,866,063 · App. 17/146,071 · Granted Jan 9, 2024

Communication system and method

Inventors: Ramiro Almeida (Key Biscayne, FL); Pierre Beaudreau (Cambridge, MA); Alexandra Klotz (Cambridge, MA); Dana Kirsanov (Boston, MA); Disha Sule (Quincy, MA); Louise Katzovitz (Boston, MA)
Assignee: MAGNA ELECTRONICS INC.
B60W60/001G01C21/3438G10L15/22B60W2540/21G10L2015/221G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,866,063
App. No.
17/146,071
Granted
Jan 9, 2024
Kind
B2
Abstract

A method, computer program product, and computing system for monitoring the interior of an autonomous vehicle for information being provided by a rider of the autonomous vehicle to the autonomous vehicle; and processing the information provided by the rider of the autonomous vehicle to the autonomous vehicle to generate a response based, at least in part, upon the information provided by the rider of the autonomous vehicle.

Claims (78)

1. A computer-implemented method, executed on a computing device, comprising:

monitoring, using at least one sensor, the interior of an autonomous vehicle for information being provided by a rider of the autonomous vehicle to the autonomous vehicle;

processing, at an electronic control unit (ECU), the information provided by the rider of the autonomous vehicle to the autonomous vehicle;

generating a response based, at least in part, upon the information provided by the rider of the autonomous vehicle, wherein the response comprises a unique light code; and

emitting light from a light source disposed at the top of the windshield of the autonomous vehicle based on the generated unique light code, wherein the light source comprises animated strip lighting.

2. The computer-implemented method of claim 1 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises a microphone assembly for obtaining the verbal information provided by the rider of the autonomous vehicle.

3. The computer-implemented method of claim 1 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for non-verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises an input device for obtaining the non-verbal information provided by the rider of the autonomous vehicle.

4. The computer-implemented method of claim 3 wherein the non-verbal information comprises one or more of:

text-based information; and

encoded information.

5. The computer-implemented method of claim 1 further comprising:

displaying, on a display disposed within the autonomous vehicle, a message associated with the unique light code to the rider of the autonomous vehicle.

6. The computer-implemented method of claim 1 , further comprising:

providing a verbal response associated with the unique light code to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises a speaker assembly for providing the verbal response to the rider of the autonomous vehicle.

7. The computer-implemented method of claim 1 , further comprising:

providing a non-verbal response to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises an output assembly for providing the non-verbal response to the rider of the autonomous vehicle.

8. The computer-implemented method of claim 7 wherein the non-verbal response comprises a text-based response.

9. The computer-implemented method of claim 1 wherein the information provided by the rider of the autonomous vehicle is verbal information.

10. The computer-implemented method of claim 9 wherein processing the information provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

processing the verbal information provided by the rider of the autonomous vehicle to the autonomous vehicle using Natural Language Understanding (NLU).

11. A computer program product residing on a computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

monitoring, using at least one sensor, the interior of an autonomous vehicle for information being provided by a rider of the autonomous vehicle to the autonomous vehicle; and

processing, at an electronic control unit (ECU), the information provided by the rider of the autonomous vehicle to the autonomous vehicle,

generating a response based, at least in part, upon the information provided by the rider of the autonomous vehicle, wherein the response comprises a unique light code; and

emitting light from a light source disposed at the top of the windshield of the autonomous vehicle based on the generated unique light code, wherein the light source comprises animated strip lighting.

12. The computer program product of claim 11 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises a microphone assembly for obtaining the verbal information provided by the rider of the autonomous vehicle.

13. The computer program product of claim 11 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for non-verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises an input device for obtaining the non-verbal information provided by the rider of the autonomous vehicle.

14. The computer program product of claim 13 wherein the non-verbal information comprises one or more of:

text-based information; and

encoded information.

15. The computer program product of claim 11 further comprising:

displaying, on a display disposed within the autonomous vehicle, a message associated with the unique light code to the rider of the autonomous vehicle.

16. The computer program product of claim 11 , further comprising:

providing a verbal response associated with the unique light code to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises a speaker assembly for providing the verbal response to the rider of the autonomous vehicle.

17. The computer program product of claim 11 , further comprising:

providing a non-verbal response to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises an output assembly for providing the non-verbal response to the rider of the autonomous vehicle.

18. The computer program product of claim 17 wherein the non-verbal response comprises a text-based response.

19. The computer program product of claim 11 wherein the information provided by the rider of the autonomous vehicle is verbal information.

20. The computer program product of claim 19 wherein processing the information provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

processing the verbal information provided by the rider of the autonomous vehicle to the autonomous vehicle using Natural Language Understanding (NLU).

21. A computing system comprising a processor and memory configured to perform operations comprising:

monitoring, using at least one sensor, the interior of an autonomous vehicle for information being provided by a rider of the autonomous vehicle to the autonomous vehicle;

processing, at an electronic control unit (ECU), the information provided by the rider of the autonomous vehicle to the autonomous vehicle;

generating a response based, at least in part, upon the information provided by the rider of the autonomous vehicle, wherein the response comprises a unique light code; and

emitting light from a light source disposed at the top of the windshield of the autonomous vehicle based on the generated unique light code, wherein the light source comprises animated strip lighting.

22. The computing system of claim 21 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises a microphone assembly for obtaining the verbal information provided by the rider of the autonomous vehicle.

23. The computing system of claim 21 wherein monitoring the interior of the autonomous vehicle for information being provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

monitoring the interior of the autonomous vehicle for non-verbal information being provided by the rider of the autonomous vehicle to the autonomous vehicle; and

wherein the at least one sensor comprises an input device for obtaining the non-verbal information provided by the rider of the autonomous vehicle.

24. The computing system of claim 23 wherein the non-verbal information comprises one or more of:

text-based information; and

encoded information.

25. The computing system of claim 21 further comprising:

displaying, on a display disposed within the autonomous vehicle, a message associated with the unique light code to the rider of the autonomous vehicle.

26. The computing system of claim 21 , further comprising:

providing a verbal response associated with the unique light code to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises a speaker assembly for providing the verbal response to the rider of the autonomous vehicle.

27. The computing system of claim 21 , further comprising:

providing a non-verbal response to the rider of the autonomous vehicle; and

wherein the interior of the autonomous vehicle comprises an output assembly for providing the non-verbal response to the rider of the autonomous vehicle.

28. The computing system of claim 27 wherein the non-verbal response comprises a text-based response.

29. The computing system of claim 21 wherein the information provided by the rider of the autonomous vehicle is verbal information.

30. The computing system of claim 29 wherein processing the information provided by the rider of the autonomous vehicle to the autonomous vehicle comprises:

processing the verbal information provided by the rider of the autonomous vehicle to the autonomous vehicle using Natural Language Understanding (NLU).

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2022
From: OPTIMUS RIDE INC.
To: MAGNA ELECTRONICS INC.
Reel/Frame 059088/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2022
From: KLOTZ, ALEXANDRA; KIRSANOV, DANA; SULE, DISHA; KATZOVITZ, LOUISE
To: OPTIMUS RIDE, INC.
Reel/Frame 059054/0371 →
Continuity (2)
Provisional Application 62959400 · Jan 10, 2020
Related Publication 20210213970A1 · Jul 15, 2021
Cited By (2)
US 12,221,130 US 12,466,350