IP Library Patent Application 15390418
Patent Application
App. No. 15/390,418

CAMERA-BASED DETECTION OF OBJECTS PROXIMATE TO A VEHICLE

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/390,418
Abstract

A system is disclosed. The system comprises one or more processors, and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method. The method includes receiving image data from a first camera mounted on a vehicle, the vehicle including an element configured to open into a space external to the vehicle, and the image data indicative of a motion of the first camera with respect to an environment of the vehicle. Whether an object, external to the vehicle, will interfere with the opening of the element into the space is determined, the determination based on the motion, indicated in the image data, of the first camera with respect to the environment of the vehicle.

Claims (42)

1 . A system comprising:

one or more processors; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:

receiving image data from a first camera mounted on a vehicle, the vehicle including an element configured to open into a space external to the vehicle, and the image data indicative of a motion of the first camera with respect to an environment of the vehicle; and

determining whether an object, external to the vehicle, will interfere with the opening of the element into the space, the determination based on the motion, indicated in the image data, of the first camera with respect to the environment of the vehicle.

2 . The system of claim 1 , wherein the element comprises a door configured to open into an interaction space external to the vehicle.

3 . The system of claim 1 , wherein determining whether the object will interfere with the opening of the element into the space comprises:

generating a depth from motion map of the environment of the vehicle using the image data, the depth from motion map including the object;

in accordance with a determination that the object, in the depth from motion map, is within the space into which the element is configured to open, determining that the object will interfere with the opening of the element into the space; and

in accordance with a determination that the object, in the depth from motion map, is not within the space into which the element is configured to open, determining that the object will not interfere with the opening of the element into the space.

4 . The system of claim 3 , wherein generating the depth from motion map comprises:

in accordance with a determination that the vehicle will likely stop within a time threshold, generating the depth from motion map; and

in accordance with a determination that the vehicle will not likely stop within the time threshold, forgoing generating the depth from motion map.

5 . The system of claim 3 , wherein generating the depth from motion map comprises:

in accordance with a determination that the vehicle is stopped, generating the depth from motion map using the image data from before the vehicle stopped; and

in accordance with a determination that the vehicle is not stopped, forgoing generating the depth from motion map.

6 . The system of claim 1 , wherein the first camera is substantially rear-facing on the vehicle.

7 . The system of claim 1 , wherein the first camera is substantially side-facing on the vehicle.

8 . The system of claim 1 , wherein the first camera is mounted to the element, and the motion of the first camera with respect to the environment is due to the opening of the element, independent of a movement of the vehicle.

9 . The system of claim 1 , wherein the motion of the first camera with respect to the environment is due to a movement of the vehicle.

10 . The system of claim 1 , wherein the first camera is additionally used as a side-view mirror replacement.

11 . The system of claim 1 , wherein the first camera is additionally used for facial recognition to grant a user access to the vehicle.

12 . The system of claim 1 , wherein the method further comprises:

in accordance with a determination that the object will interfere with the opening of the element into the space, preventing the opening of the element; and

in accordance with a determination that the object will not interfere with the opening of the element into the space, allowing the opening of the element.

13 . The system of claim 1 , wherein the method further comprises:

detecting user input for opening the element;

in response to detecting the user input:

in accordance with a determination that the object will interfere with the opening of the element into the space, partially opening the element into the space to the extent allowed by the object; and

in accordance with a determination that the object will not interfere with the opening of the element into the space, fully opening the element into the space.

14 . The system of claim 1 , wherein the object is in the environment of the vehicle.

15 . A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving image data from a first camera mounted on a vehicle, the vehicle including an element configured to open into a space external to the vehicle, and the image data indicative of a motion of the first camera with respect to an environment of the vehicle; and

determining whether an object, external to the vehicle, will interfere with the opening of the element into the space, the determination based on the motion, indicated in the image data, of the first camera with respect to the environment of the vehicle.

16 . A vehicle comprising:

a first camera;

one or more processors coupled to the first camera;

a door actuator coupled to the one or more processors;

an element configured to open, using the door actuator, into a space external to the vehicle; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:

receiving image data from the first camera, the image data indicative of a motion of the first camera with respect to an environment of the vehicle; and

determining whether an object, external to the vehicle, will interfere with the opening of the element into the space, the determination based on the motion, indicated in the image data, of the first camera with respect to the environment of the vehicle.

Assignments (7)
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
RELEASE OF SECURITY INTEREST Recorded Jan 14, 2019
From: SEASON SMART LIMITED
To: FARADAY&FUTURE INC.
Reel/Frame 048069/0704 →
SECURITY INTEREST Recorded Dec 28, 2017
From: FARADAY&FUTURE INC.
To: SEASON SMART LIMITED
Reel/Frame 044969/0023 →