IP Library Granted Patent US 11,845,399
Granted Patent B2
US 11,845,399 · App. 17/881,122 · Granted Dec 19, 2023

Recording video of an operator and a surrounding visual field

Inventors: David Jonathan Julian (San Diego, CA); Sandeep Pandya (Irvine, CA); Adam David Kahn (San Diego, CA); Michael Campos (La Jolla, CA); Avneesh Agrawal (Bangaluru, IN); Venkata Sreekanta Reddy Annapureddy (San Diego, CA); Lance Steven Hetherington (Encinitas, CA); Tejeswara Rao Gudena (Bengaluru, IN); Suresh Babu Yanamala (Bengaluru, IN); Arun Valiaparambil (Bengaluru, IN)
Assignee: NETRADYNE, INC.
B60R25/257B60R11/04B60R25/24G06F3/04842G06F9/451G06F16/182G06V20/59G06V40/166G06V40/172H04L67/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,845,399
App. No.
17/881,122
Granted
Dec 19, 2023
Kind
B2
Abstract

Systems and methods are provided for recording video of a driver in a vehicle and a surrounding visual field of the driver. The system includes a detachable body coupled to a windshield of a vehicle. The system further includes three or more cameras coupled to the detachable body. The three or more cameras are configured to capture surrounding views from the detachable body. One of the three or more cameras faces a driver seat of the vehicle in response to the detachable body being coupled to the windshield of the vehicle. The video may be processed by the system, the cloud, or a combination of them.

Claims (38)

1. A system for recording vehicle occupants and their immediate environment, comprising:

a driver-facing camera for capturing video data;

an input that receives data from one or more sensors configured to detect vehicle related data; and

a processor configured to embed, based on the sensor data, at least one indicator in a portion of the video data, wherein the indicator designates that the portion of the video data is to be obscured during playback of the video data,

wherein the at least one indicator includes an access rights set, such that during playback a user having a matching access rights set can see the video data without obscuration.

2. The system of claim 1 , wherein detecting a presence of a passenger embeds the at least one indicator in the portion of the video data.

3. The system of claim 1 , wherein a first indicator identifies a start time for a playback module to begin obscuring the video data and a second indicator identifies a stop time for the playback module to end obscuring the video data.

4. The system of claim 1 , wherein the at least one indicator includes a value set to indicate at least one of a degree, a type, and a local image area for a region to be obscured in the video data by a playback module.

5. The system of claim 1 , wherein obscuring a portion of the video during playback includes changing at least one of: pixel colors, contrast, or obscuration boundaries.

6. The system of claim 1 , wherein the vehicle related data includes one or more of time, driver or passenger location in the vehicle, or vehicle behavior.

7. The system of claim 1 , further comprising:

a transceiver configured to transmit the video data having the at least one indicator to an off-vehicle server, the off-vehicle server associated with a playback module.

8. A method for recording vehicle occupants and their immediate environment, comprising:

receiving vehicle-related data from one or more sensors;

receiving video data from a driver-facing camera; and

embedding at least one indicator in a portion of the video data based on the sensor data; wherein the indicator designates that the portion of the video data is to be obscured during playback of the video data,

wherein the at least one indicator includes an access rights set, such that during playback a user having a matching access rights set can see the video data without obscuration.

9. The system of claim 8 , further comprising:

a playback module for playing back the video data, wherein the playback module includes the functionality to obscure the video data in response to that at least one indicator.

10. The method of claim 8 , further comprising:

transmitting the video data having the at least one indicator to an off-vehicle server, the off-vehicle server having an associated playback module.

11. The method of claim 8 , further comprising:

playing back the video data on a playback module, wherein the playback module obscures the video data portion associated with the at least one indicator.

12. The method of claim 8 , wherein embedding the at least one indicator includes:

embedding a first indicator identifying a start time for a playback module to begin obscuring of the video data and embedding a second indicator identifying a stop time for the playback module to end obscuring the video data.

13. The method of claim 8 , further comprising:

generating inferred data based on the video data from the driver-facing camera.

14. The method of claim 13 , further comprising:

determining a driver state of a driver based on the inferred data, wherein the driver state is drowsiness, distracted driving, cell phone usage, attentiveness, or some combination thereof.

15. The method of claim 13 , further comprising:

playing back the video data on a playback module, wherein the playback module replaces the video data portion associated with the at least one indicator with the inferred data.

16. The method of claim 15 , wherein the inferred data is represented in the video data portion as a stick-figure of a driver.

17. The method of claim 13 , wherein the inferred data is one or more of:

a parameter describing a gaze direction of a driver; or

a position of a hand of the driver.

18. The method of 8 , further comprising:

detecting an accident based on the sensor data; and

reversing or lessening the obscuration of the video data in response to the detection of the accident.

Assignments (3)
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075435/0670 →
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075359/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2022
From: JULIAN, DAVID JONATHAN; AGRAWAL, AVNEESH; ANNAPUREDDY, VENKATA SREEKANTA REDDY; PANDYA, SANDEEP; KAHN, ADAM DAVID; CAMPOS, MICHAEL; HETHERINGTON, LANCE STEVEN; GUDENA, TEJESWARA RAO; YANAMALA, SURESH BABU; VALIAPARAMBIL, ARUN
To: NETRADYNE, INC.
Reel/Frame 060722/0450 →
Continuity (4)
Continuation 16322438
Provisional Application 62457064 · Feb 9, 2017
Provisional Application 62380342 · Aug 26, 2016
Related Publication 20220377129A1 · Nov 24, 2022
Cited By (1)
US 12,208,769