IP Library Granted Patent US 11,261,642
Granted Patent B2
US 11,261,642 · App. 16/073,761 · Granted Mar 1, 2022

System and method for tracking moving objects to avoid interference with vehicular door operations

Inventors: Oliver Max Jeromin (Torrance, CA); Hong S. Bae (Torrance, CA)
Assignee: Faraday & Future Inc.
E05F15/40G06K9/00805E05F2015/434E05F2015/767E05Y2400/40E05Y2900/531
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,261,642
App. No.
16/073,761
Granted
Mar 1, 2022
Kind
B2
Abstract

A system that performs a method is disclosed. Image data from a first camera mounted on a vehicle is received, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space. Whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period, is determined. In accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, an action that avoids the interference is performed.

Claims (49)

1. A system comprising:

one or more processors; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising the steps of:

receiving image data from a first camera of a vehicle, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space;

determining whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period; and

in accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, performing an action that avoids the interference;

wherein determining whether the motion of the first object during the first time period indicates that the first object will interfere with the operation of the first element during the second time period comprises:

determining an estimated trajectory of the first object during the first time period;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will reach the first space during the second time period, determining that the first object will interfere with the operation of the first element;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will not reach the first space, determining that the first object will not interfere with the operation of the first element; and

in accordance with a determination that the second time period is greater than a predetermined threshold time after the first time period, forgoing determining that the first object will interfere with the operation of the first element.

2. The system of claim 1 , wherein the first element comprises a door configured to open into an interaction space external to the vehicle.

3. The system of claim 1 , wherein: during the first time period, the first element is open, interfering with the operation of the first element comprises colliding with the first element while the first element is open.

4. The system of claim 1 , wherein: during the first time period, the first element is closed, and interfering with the operation of the first element comprises preventing the first element from opening without colliding with the first object.

5. The system of claim 1 , wherein the first camera is additionally used as a side-view mirror replacement.

6. The system of claim 1 , wherein the first camera is substantially forward-facing on the vehicle.

7. The system of claim 1 , wherein the first camera is additionally used as a rear-view mirror replacement.

8. The system of claim 1 , wherein the action comprises automatically closing the first element.

9. The system of claim 1 , wherein the action comprises automatically preventing the opening of the first element.

10. The system of claim 1 , wherein the action comprises automatically moving the vehicle to a new location, the new location based on the motion of the first object during the first time period, and data from a GPS receiver indicative of a current location of the vehicle.

11. The system of claim 1 , wherein the action comprises providing an alert to a driver or a passenger of the vehicle.

12. The system of claim 1 , wherein the action comprises providing an alert to the first object.

13. The system of claim 1 , wherein the method further comprises: after the first time period, determining that the first object will no longer interfere with the operation of the first element; and in response to determining that the first object will no longer interfere with the operation of the first element, canceling the action.

14. The system of claim 1 , wherein the method further comprises: after the first time period, determining that the first object will no longer interfere with the operation of the first element; and in response to determining that the first object will no longer interfere with the operation of the first element, reversing the action.

15. The system of claim 1 , wherein: the vehicle includes a second element, different from the first element, configured to open into a second space external to the vehicle, different from the first space, determining that the motion of the first object indicates that the first object will interfere with the operation of the first element comprises determining that the motion of the first object indicates that the first object will not interfere with the operation of the second element, and performing the action comprises performing the action with respect to the first element but not the second element.

16. The system of claim 1 , wherein: the method further comprises receiving image data indicative of motion of a second object during the first time period, the second object located outside of the second space, the vehicle includes a second element, different from the first element, configured to open into a second space external to the vehicle, different from the first space, and performing the action comprises, in accordance with a determination that the second object will interfere with operation of the second element during a third time period, after the first time period: performing a first action with respect to the first element that avoids the interference of the first object with the operation of the first element; and performing a second action, different from the first action, with respect to the second element that avoids the interference of the second object with the operation of the second element.

17. A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising the steps of:

receiving image data from a first camera of a vehicle, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space;

determining whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period; and

in accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, performing an action that avoids the interference;

wherein determining whether the motion of the first object during the first time period indicates that the first object will interfere with the operation of the first element during the second time period comprises:

determining an estimated trajectory of the first object during the first time period;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will reach the first space during the second time period, determining that the first object will interfere with the operation of the first element;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will not reach the first space, determining that the first object will not interfere with the operation of the first element; and

in accordance with a determination that the second time period is greater than a predetermined threshold time after the first time period, forgoing determining that the first object will interfere with the operation of the first element.

18. A vehicle comprising:

a first camera;

one or more processors coupled to the first camera;

a door actuator coupled to the one or more processors;

a first element configured to open, using the door actuator, into a first space external to the vehicle; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:

receiving image data from the first camera, the image data indicative of motion of a first object during a first time period, the first object located outside of the first space;

determining whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period; and

in accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, performing an action that avoids the interference;

wherein determining whether the motion of the first object during the first time period indicates that the first object will interfere with the operation of the first element during the second time period comprises:

determining an estimated trajectory of the first object during the first time period;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will reach the first space during the second time period, determining that the first object will interfere with the operation of the first element;

in accordance with a determination that the estimated trajectory of the first object indicates that the first object will not reach the first space, determining that the first object will not interfere with the operation of the first element; and

in accordance with a determination that the second time period is greater than a predetermined threshold time after the first time period, forgoing determining that the first object will interfere with the operation of the first element.

Assignments (8)
SECURITY INTEREST Recorded Sep 25, 2024
From: FARADAY&FUTURE, INC.
To: SENYUN INTERNATIONAL LTD.
Reel/Frame 069048/0562 →
SECURITY INTEREST Recorded Aug 15, 2022
From: FARADAY&FUTURE INC.
To: FF SIMPLICY VENTURES LLC
Reel/Frame 061176/0756 →
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2022
From: JEROMIN, OLIVER MAX; BAE, HONG S.
To: FARADAY&FUTURE INC.
Reel/Frame 058727/0013 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
Continuity (2)
Provisional Application 62288835 · Jan 29, 2016
Related Publication 20190024430A1 · Jan 24, 2019