IP Library Granted Patent US 10,059,347
Granted Patent B2
US 10,059,347 · App. 15/376,237 · Granted Aug 28, 2018

Warning a vehicle occupant before an intense movement

Inventors: Tal Thieberger-Navon (Kiryat Tivon, IL); Gil Thieberger (Kiryat Tivon, IL); Ari M Frank (Haifa, IL)
Assignee: Active Knowledge Ltd.
B60W50/14B60W50/0097G06K9/00335G06K9/00845B60W30/025B60W2050/143B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,059,347
App. No.
15/376,237
Granted
Aug 28, 2018
Kind
B2
Abstract

A safety system for an autonomous vehicle that may be used to warn an occupant engaged in a certain activity that involves handling an object that can harm the occupant in an event of a Sudden Decrease in Ride Smoothness (an SDRS event). The safety system includes a camera that takes images of the occupant and a computer that estimates, based on the images, whether the occupant is engaged in the certain activity. The computer receives from an autonomous-driving control system an indication of whether an SDRS event is imminent. Responsive to both receiving an indication of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer commands a user interface to warn the occupant shortly before the SDRS event.

Claims (34)

1. A safety system for an autonomous vehicle, comprising:

a camera configured to take images of an occupant of the vehicle; and

a computer configured to:

estimate, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

receive an indication indicative of whether an SDRS event is imminent; and

responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, command a user interface to provide a first warning to the occupant shortly before the SDRS.

2. The safety system of claim 1 , wherein responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant, or to command the user interface to provide a second warning to the occupant shortly before the SDRS event wherein the second warning is less noticeable than the first warning.

3. The safety system of claim 2 , wherein the occupant does not drive the vehicle, and the first warning comprises at least one of the followings: a visual cue that is more intense than a visual cue of the second warning, and a sound that is louder than a sound of the second warning.

4. The safety system of claim 2 , wherein the object is a tool for applying makeup, and the certain activity comprises bringing the tool close to an eye.

5. The safety system of claim 2 , wherein the object is an ear swab, and the certain activity comprises cleaning an ear with the ear swab.

6. The safety system of claim 2 , wherein the object is selected from the group comprising the following tools: a knife, a tweezers, a scissors, and a syringe; and the certain activity comprises using the tool.

7. The safety system of claim 2 , wherein the object is a cup that is at least partially filled with liquid, and the certain activity comprises drinking the liquid.

8. The safety system of claim 2 , wherein responsive to both receiving an indication indicative of no imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant.

9. The safety system of claim 2 , wherein warning the occupant shortly before the SDRS event refers to warning the occupant less than 30 seconds before the SDRS event; and wherein the SDRS event may result from one or more of the following: driving on a speed bump, driving over a pothole, starting to drive after a full stop, driving up the pavement, making a sharp turn, and a hard breaking.

10. The safety system of claim 9 , wherein the computer is configured to command the user interface to provide the first warning at least one second before the SDRS event.

11. The safety system of claim 1 , wherein the computer is configured to receive the indication indicative of whether an SDRS event is imminent from an autonomous-driving control system, and the autonomous-driving control system calculates the indication based on at least one of the following sources: sensors mounted to the vehicle, sensors mounted to nearby vehicles, an autonomous-driving control system used to drive a nearby vehicle, and a database comprising descriptions of obstacles in the road that are expected to cause intense movement of the vehicle.

12. The safety system of claim 1 , wherein the camera comprises a video camera, and the computer is configured to utilize an image processing algorithm to identify the object and to estimate whether the occupant is engaged in the certain activity.

13. The safety system of claim 1 , wherein the camera comprises an active 3D tracking device, and the computer is configured to analyze the 3D data to identify the object and to estimate whether the occupant is engaged in the certain activity.

14. The safety system of claim 1 , wherein the camera is physically coupled to the compartment.

15. The safety system of claim 1 , wherein the occupant wears a head-mounted display (HMD), and the camera is physically coupled to the HMD.

16. A method for warning an occupant of an autonomous vehicle, comprising:

receiving images of the occupant;

estimating, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

receiving an indication indicative of whether an SDRS event is imminent; and

responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, commanding a user interface to provide a first warning to the occupant shortly before the SDRS event.

17. The method of claim 16 , wherein responsive to both receiving an indication indicative of no imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant.

18. The method of claim 16 , wherein the indication indicative of whether an SDRS event is imminent is received from an autonomous-driving control system, and warning the occupant shortly before the SDRS event refers to warning the occupant less than 30 seconds before the SDRS event; and wherein the SDRS event may result from one or more of the following: driving on a speed bump, driving over a pothole, starting to drive after a full stop, driving up the pavement, making a sharp turn, and a hard breaking.

19. The method of claim 16 , wherein responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity, commanding the user interface to provide a second warning to the occupant, or not commanding the user interface to warn the occupant shortly before the SDRS event; wherein the second warning is less noticeable than the first warning.

20. A non-transitory computer-readable medium for use in a computer to warn an occupant of an autonomous vehicle, the computer comprises a processor, and the non-transitory computer-readable medium comprising:

program code for receiving images of the occupant;

program code for estimating, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

program code for receiving, from an autonomous-driving control system, an indication indicative of whether an SDRS event is imminent;

program code for commanding a user interface to provide a first warning to the occupant shortly before the SDRS event, responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity; and

program code for commanding the user interface to provide a second warning to the occupant, or not commanding the user interface to warn the occupant, shortly before the SDRS event, responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity; wherein the second warning is less noticeable than the first warning.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2019
From: ACTIVE KNOWLEDGE LTD.
To: ATNOMITY LTD.
Reel/Frame 048010/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2016
From: THIEBERGER-NAVON, TAL; THIEBERGER, GIL; FRANK, ARI M.
To: ACTIVE KNOWLEDGE LTD.
Reel/Frame 040677/0857 →
Continuity (4)
Continuation In Part 15335404 · Oct 26, 2016
Provisional Application 62246187 · Oct 26, 2015
Provisional Application 62369127 · Jul 31, 2016
Related Publication 20170113702A1 · Apr 27, 2017
Cited By (8)
US 12,211,031 US 12,340,371 US 12,367,484 US 12,391,272 US 12,406,283 US 12,429,696 US 12,643,468 US 12,685,942