IP Library Granted Patent US 12,211,392
Granted Patent B2
US 12,211,392 · App. 17/127,247 · Granted Jan 28, 2025

Systems and methods for providing aircraft sensory cues

Inventors: Ian Andreas Villa (San Francisco, CA); Matthew Derkach (San Francisco, CA); Philipp Haban (San Francisco, CA); Adam Warmoth (Los Angeles, CA); John Conway Badalamenti (San Francisco, CA)
Assignee: JOBY AERO, INC.
G08G5/025B64D45/00B64D47/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,392
App. No.
17/127,247
Filed
Dec 18, 2020
Granted
Jan 28, 2025
Kind
B2
Art Unit
3663
USPC
701/16
Abstract

Systems and methods for communicating aircraft sensory cues are provided. A method can include obtaining aerial vehicle data and facility data for an aerial portion of a multi-modal transportation service. The method can include determining a plurality of sensory cues indicative of information for the aerial portion of the transportation service such as a safe path across a landing pad of the facility, a seating assignment for a passenger, etc. The method can include communicating sensory data indicative of the plurality of sensory cues to at least one of a facility computing system associated with the facility or an aerial computing system associated with the at least one aerial vehicle. The facility computing system and/or aerial computing system can output the sensory cue(s) to at least one passenger or operator of the aerial portion of the multi-modal transportation service in, for example, the facility's landing area.

Claims (46)

1. A computing system comprising:

one or more processors; and

one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the computing system to perform operations, the operations comprising:

accessing facility data associated with an aerial facility, wherein the facility data is indicative of a physical layout of the aerial facility and locations of a plurality of aircraft that are currently located, or are planned to be located, within a landing area of the aerial facility;

accessing vehicle data indicative of physical dimensions for each of the plurality of aircraft;

based on the facility data and the vehicle data, computing a temporary path on the landing area that extends between an aircraft assigned to transport a passenger and an aerial facility in order to lead the passenger through the landing area to or from the aircraft,

wherein the temporary path is computed based on the physical layout of the aerial facility, the locations of the plurality of aircraft within the landing area at a time the passenger is to board or depart the assigned aircraft, and the physical dimensions of the plurality of aircraft such that the temporary path extends across the landing area of the aerial facility and provides a buffer distance between the passenger and the plurality of aircraft that are currently located, or planned to be located, within the landing area at the time the passenger is to board or depart the assigned aircraft;

computing one or more sensory cues for projection at the landing area, wherein the sensory cues comprise at least one of a visual cue or a sound for guiding the passenger along the temporary path within the landing area; and

activating one or more output devices for the one or more sensory cues at the landing area in order to indicate the temporary path for the passenger at the landing area.

2. The computing system of claim 1 , wherein the operations further comprise accessing data indicative of flight itineraries for a plurality of aircraft.

3. The computing system of claim 2 , wherein the physical layout of the aerial facility comprises a physical layout of the landing area of the aerial facility.

4. The computing system of claim 2 , wherein the vehicle data further comprises data indicative of a vehicle type and a vehicle status associated with each of the plurality of aircraft.

5. The computing system of claim 1 , wherein the plurality of aircraft comprises a plurality of different types of aircraft.

6. The computing system of claim 1 , wherein communicating the data indicative of the one or more of sensory cues comprises:

communicating the data indicative of the one or more of sensory cues to a facility computing system, wherein the facility computing system is configured to output the one or more sensory cues via the one or more output devices positioned at the landing area and associated with the facility computing system.

7. The computing system of claim 1 , wherein the sound comprises a directional audio for directing the passenger along the temporary path within the landing area of the facility.

8. The computing system of claim 1 , wherein the visual cue comprises a color indicative of information for the passenger.

9. The computing system of claim 1 , wherein the visual cue comprises an activation pattern of a plurality of lights projected on the landing area of the aerial facility.

10. The computing system of claim 1 , wherein the aerial facility comprises one or more lighting devices positioned at the landing area and a facility computing system configured to output the visual cue via the one or more lighting devices.

11. The computing system of claim 1 , wherein the operations further comprise accessing passenger data indicative of one or more passenger characteristics associated with the passenger, and

wherein the one or more passenger characteristics comprise data indicative of a passenger name, passenger itinerary information, or a seat assignment for the assigned aircraft.

12. The computing system of claim 11 , wherein at least one of the one or more sensory cues are indicative of at least one of the one or more passenger characteristics.

13. The computing system of claim 1 , wherein the operations further comprise accessing environmental data indicative of one or more atmospheric or lighting conditions associated with a current environment of the aerial facility.

14. A computer implemented method comprising:

accessing facility data associated with an aerial facility, wherein the facility data is indicative of a physical layout of the aerial facility and locations of a plurality of aircraft that are currently located, or are planned to be located, within a landing area of the aerial facility;

accessing vehicle data indicative of physical dimensions for each of the plurality of aircraft;

based on the facility data and the vehicle data, computing a temporary path on the landing area that extends between an aircraft assigned to transport a passenger and an aerial facility in order to lead the passenger through the landing area to or from an aircraft,

wherein the temporary path is computed based on the physical layout of the aerial facility, the locations of the plurality of aircraft within the landing area at a time the passenger is to board or depart the assigned aircraft, and the physical dimensions of the plurality of aircraft such that the temporary path extends across the landing area of the aerial facility and provides a buffer distance between the passenger and the plurality of aircraft that are currently located, or planned to be located, within the landing area at the time the passenger is to board or depart the assigned aircraft;

computing one or more sensory cues for projection at the landing area, wherein the sensory cues comprise at least one of a visual cue or a sound for guiding the passenger along the temporary path within the landing area; and

activating one or more output devices for the one or more sensory cues at the landing area in order to indicate the temporary path for the passenger at the landing area.

15. The computer-implemented method of claim 14 , further comprising:

determining timing data for each respective sensory cue of the one or more sensory cues, wherein the timing data is indicative of a time period to output the respective sensory cue.

16. The computer-implemented method of claim 15 , wherein the timing data is determined based on one or more events associated with an aerial portion of a multi-modal transportation service for the passenger.

17. The computer-implemented method of claim 15 , wherein the data indicative of the one or more sensory cues comprises a sensory cue sequence indicative of a time period to output each of the plurality of sensory cues.

18. A computing system comprising:

one or more output devices comprising at least one visual output device or audio output device, the one or more output devices positioned at a landing area, the one or more output devices configured for outputting one or more sensory cues at the landing area;

one or more processors; and

one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the computing system to perform operations, the operations comprising:

accessing data indicative of the one or more sensory cues for output at an aerial facility to indicate a temporary path for a passenger through the landing area of the aerial facility to or from an aircraft assigned to transport the passenger;

wherein the temporary path is based on a physical layout of the aerial facility, locations of a plurality of aircraft within the landing area of the aerial facility at a time the passenger is to board or depart the assigned aircraft, and physical dimensions of the plurality of aircraft such that the temporary path extends across the landing area of the aerial facility and provides a buffer distance between the passenger and the plurality of aircraft that are currently located, or planned to be located, within the landing area at the time the passenger is to board or depart the assigned aircraft;

determining at least one of the one or more output devices for at least one of the one or more sensory cues; and

activating the at least one output device in order to project the at least one sensory cue at the landing area, wherein the at least one sensory cue indicates the temporary path through the landing area of the aerial facility.

19. The computing system of claim 18 , wherein the computing system comprises one or more computing devices physically located at the aerial facility.

20. The computing system of claim 18 , wherein the temporary path is indicative of a first portion of the landing area in which the passenger is to travel within the landing area and a second portion of the landing area in which the passenger is not to travel within the landing area.

21. The computing system of claim 1 , wherein activating the one or more output devices for the one or more sensory cues at the landing area comprises communicating data indicative of the one or more sensory cues for projection at the landing area via the one or more output devices.

22. The computer-implemented method of claim 14 , activating the one or more output devices for the one or more sensory cues at the landing area comprises communicating data indicative of the one or more sensory cues for projection at the landing area via the one or more output devices.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075403/0137 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075428/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075429/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075429/0561 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075430/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 075430/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: JOBY ELEVATE, INC.
To: JOBY AERO, INC.
Reel/Frame 058937/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: UBER TECHNOLOGIES, INC.
To: UBER ELEVATE, INC.
Reel/Frame 055247/0272 →
CHANGE OF NAME Recorded Feb 12, 2021
From: UBER ELEVATE, INC.
To: JOBY ELEVATE, INC.
Reel/Frame 055299/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2021
From: VILLA, IAN ANDREAS; DERKACH, MATTHEW; WARMOTH, ADAM; BADALAMENTI, JOHN CONWAY; HABAN, PHILIPP
To: UBER TECHNOLOGIES, INC.
Reel/Frame 054872/0667 →
Continuity (2)
Provisional Application 62955901 · Dec 31, 2019
Related Publication 20210201686A1 · Jul 1, 2021
References Cited (79)
US 3035789A · Young · 1962 [cited by applicant]
US 4022405A · Peterson · 1977 [cited by applicant]
US 5823468A · Bothe · 1998 [cited by applicant]
US 5839691A · Lariviere · 1998 [cited by applicant]
US 5842667A · Jones · 1998 [cited by applicant]
US 6343127B1 · Billoud · 2002 [cited by applicant]
US 6892980B2 · Kawai · 2005 [cited by applicant]
US 8016226B1 · Wood · 2011 [cited by applicant]
US 8020804B2 · Yoeli · 2011 [cited by applicant]
US 8311686B2 · Herkes et al. · 2012 [cited by applicant]
US 8733690B2 · Bevirt et al. · 2014 [cited by applicant]
US 8737634B2 · Brown et al. · 2014 [cited by applicant]
US 8849479B2 · Walter · 2014 [cited by applicant]
US 9205930B2 · Yanagawa · 2015 [cited by applicant]
US 9387928B1 · Gentry et al. · 2016 [cited by applicant]
US 9415870B1 · Beckman et al. · 2016 [cited by applicant]
US 9422055B1 · Beckman et al. · 2016 [cited by applicant]
US 9435661B2 · Brenner et al. · 2016 [cited by applicant]
US 9442496B1 · Beckman et al. · 2016 [cited by applicant]
US 9550561B1 · Beckman et al. · 2017 [cited by applicant]
US 9663237B2 · Senkel et al. · 2017 [cited by applicant]
US 9694911B2 · Bevirt et al. · 2017 [cited by applicant]
US 9771157B2 · Gagne et al. · 2017 [cited by applicant]
US 9786961B2 · Dyer et al. · 2017 [cited by applicant]
US 9802702B1 · Beckman et al. · 2017 [cited by applicant]
US 9816529B2 · Grissom et al. · 2017 [cited by applicant]
US 9838436B2 · Michaels · 2017 [cited by applicant]
US 10140873B2 · Adler et al. · 2018 [cited by applicant]
US 10152894B2 · Adler et al. · 2018 [cited by applicant]
US 10216190B2 · Bostick et al. · 2019 [cited by applicant]
US 10249200B1 · Grenier et al. · 2019 [cited by applicant]
US 10304344B2 · Moravek et al. · 2019 [cited by applicant]
US 10330482B2 · Chen et al. · 2019 [cited by applicant]
US 10593215B2 · Villa · 2020 [cited by applicant]
US 10593217B2 · Shannon · 2020 [cited by examiner]
US 10752365B2 · Galzin · 2020 [cited by applicant]
US 10759537B2 · Moore et al. · 2020 [cited by applicant]
US 10768201B2 · Luo et al. · 2020 [cited by applicant]
US 10832581B2 · Westervelt et al. · 2020 [cited by applicant]
US 10836470B2 · Liu et al. · 2020 [cited by applicant]
US 10860115B1 · Tran · 2020 [cited by examiner]
US 10890926B2 · McNair · 2021 [cited by examiner]
US 10913528B1 · Moore et al. · 2021 [cited by applicant]
US 10948910B2 · Taveira et al. · 2021 [cited by applicant]
US 10960785B2 · Villanueva et al. · 2021 [cited by applicant]
US 11130566B2 · Mikic et al. · 2021 [cited by applicant]
US 11145211B2 · Goel et al. · 2021 [cited by applicant]
US 11238745B2 · Villa et al. · 2022 [cited by applicant]
US 11295622B2 · Goel et al. · 2022 [cited by applicant]
US 20100079342A1 · Smith et al. · 2010 [cited by applicant]
US 20140179535A1 · Stückl et al. · 2014 [cited by applicant]
US 20150330797A1 · Shukla · 2015 [cited by examiner]
US 20160311529A1 · Brotherton-Ratcliffe et al. · 2016 [cited by applicant]
US 20170197710A1 · Ma · 2017 [cited by examiner]
US 20170357914A1 · Tulabandhula et al. · 2017 [cited by applicant]
US 20180018887A1 · Sharma et al. · 2018 [cited by applicant]
US 20180053425A1 · Adler et al. · 2018 [cited by applicant]
US 20180216988A1 · Nance · 2018 [cited by applicant]
US 20180308366A1 · Goel et al. · 2018 [cited by applicant]
US 20180354636A1 · Darnell et al. · 2018 [cited by applicant]
US 20190146508A1 · Dean et al. · 2019 [cited by applicant]
US 20190221127A1 · Shannon · 2019 [cited by applicant]
US 20190316849A1 · Abrego et al. · 2019 [cited by applicant]
US 20200055594A1 · Tal · 2020 [cited by examiner]
US 20200103922A1 · Nonami et al. · 2020 [cited by applicant]
US 20200388166A1 · Rostamzadeh et al. · 2020 [cited by applicant]
EP 0945841A1 · 1999 [cited by applicant]
EP 2698749A1 · 2014 [cited by applicant]
EP 3499634A1 · 2019 [cited by applicant]
JP 2010095246A · 2010 [cited by applicant]
JP 2013086795A · 2013 [cited by applicant]
WO WO2018023556A1 · 2018 [cited by applicant]
WO WO2019089677A1 · 2019 [cited by applicant]
WO WO2020252024A1 · 2020 [cited by applicant]
Bennaceur et al., “Passenger-centric urban air mobility: Fairness trade-offs and operational efficiency”, Transportation Research Part C: Emerging Technologies, 2022, 29 pages. [cited by applicant]
Jong, “Optimizing cost effectiveness and flexibility of air taxis: A case study for optimization of air taxi operations”, University of Twente, Master's thesis, 2007, 62 pages. [cited by applicant]
Miao et al., “Data-driven robust taxi dispatch under demand uncertainties”, IEEE Transactions on Control Systems Technology 27, No. 1, 2017, 16 pages. [cited by applicant]
Miao et al., “Taxi dispatch with real-time sensing data in metropolitan areas: A receding horizon control approach”, In Proceedings of the ACM/IEEE Sixth International Conference on Cyber-Physical Systems, 2015, 15 page… [cited by applicant]
Uber, “Fast-forwarding to a future of on-demand urban air transportation”, 2016, 99 pages. [cited by applicant]