IP Library Granted Patent US 11,881,054
Granted Patent B2
US 11,881,054 · App. 17/597,254 · Granted Jan 23, 2024

Device and method for determining image data of the eyes, eye positions and/or a viewing direction of a vehicle user in a vehicle

Inventors: Emin Tarayan (Sindelfingen, DE); Maria Hirsch (Stuttgart, DE); Christoph Weckmann (Calw, DE); Peter Schindewolf (Gomaringen, DE)
Assignee: MERCEDES-BENZ GROUP AG
G06V40/193G06V10/141G06V20/597G06V40/19G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,881,054
App. No.
17/597,254
Granted
Jan 23, 2024
Kind
B2
Abstract

A device includes a camera that detects image data of the head and eyes of the vehicle user. An image data evaluating unit determines, using the detected image data, positions of the eyes or the current viewing direction of the vehicle user. Control equipment generates a signal that activates a light source when the current positions of the eyes or the viewing direction is not determinable. The light source has one or more individual light sources arranged so that the one or more individual light sources can only be discerned by the vehicle user or discerned simultaneously if the user's eyes, a vehicle user's eye positions and/or a current viewing direction of the vehicle user are clearly detectable.

Claims (36)

1. A method in a vehicle, the method comprising:

capturing, by a camera in the vehicle, a vehicle user in a first image;

determining, by an image data evaluating unit, whether the vehicle user's eye positions or current viewing direction are determinable in the first image;

activating at least two individual light sources when the vehicle user's eye positions or current viewing direction is not determinable in the first image, wherein the at least two individual light sources and the camera are arranged relative each other in the vehicle and relative to the steering wheel in the vehicle so that the steering wheel obstructs the vehicle user's view of the at least two individual light sources when the vehicle user's eyes, eye positions, or current viewing direction are not detectable by the camera;

deactivating functions of the vehicle dependent on detection of the vehicle user's eyes when the at least two individual light sources are activated;

capturing, by the camera, a second image including the vehicle user;

determining, by the image data evaluating unit, whether the vehicle user's eye positions or current viewing direction are determinable in the second image; and

deactivating the at least two individual light sources when the vehicle user's eye positions or current viewing direction is determinable in the second image.

2. The method of claim 1 , wherein the camera and the at least two individual light sources are integrated in an instrument cluster of the vehicle.

3. The method of claim 1 , wherein each of the at least two individual light sources include a diaphragm or optics configured to restrict light rays emanating from a respective one the at least two individual light sources to a predetermined angle.

4. The method of claim 1 , wherein the at least two individual light sources consist of two individual light sources, each of the two individual light sources is a pixel on a display in the vehicle.

5. The method of claim 1 , further comprising:

outputting, by a display of the vehicle when the at least two individual light sources are activated, information instructing the vehicle user to adjust a vehicle seat or the steering wheel.

6. The method of claim 1 , further comprising:

outputting, by an audio output unit of the vehicle when the at least two individual light sources are activated, information instructing the vehicle user to adjust a vehicle seat or the steering wheel.

7. A vehicle, comprising:

a steering wheel;

at least two individual light sources;

a camera, wherein the at least two individual light sources and the camera are arranged relative each other in the vehicle and relative to the steering wheel in the vehicle so that the steering wheel obstructs a vehicle user's view of the at least two individual light sources when the vehicle user's eyes, eye positions, or current viewing direction are not detectable by the camera;

an image data evaluating unit coupled to the camera;

control equipment coupled to the at least two light sources and the image data evaluating unit, wherein

the camera is configured to capture the vehicle user in a first image,

the image data evaluating unit is configured to determine whether the vehicle user's eye positions or current viewing direction are determinable in the first image,

the control equipment is configured to activate the at least two individual light sources when the vehicle user's eye positions or current viewing direction is not determinable in the first image,

functions of the vehicle are deactivated dependent on detection of the vehicle user's eyes when the at least two individual light sources are activated,

the camera is configured to capture a second image including the vehicle user,

the image data evaluating unit is configured to determine whether the vehicle user's eye positions or current viewing direction are determinable in the second image, and

the control unit is configured to deactivate the at least two individual light sources when the vehicle user's eye positions or current viewing direction is determinable in the second image.

8. The vehicle of claim 7 , wherein the at least two individual light sources comprise a first individual light source arranged left of the camera, a second individual light source arranged right of the camera, a third individual light source arranged above the camera, and a fourth individual light source arranged below the camera, and wherein respective delimited emission regions of the first, second, third, and fourth individual light sources only partially overlap.

9. The vehicle of claim 7 , wherein the control unit is configured, responsive to the vehicle user's eyes not being detectable by the camera, to switch off vehicle functions dependent on detection of the vehicle user's eyes and output warning to the vehicle user.

10. The vehicle of claim 7 , wherein each of the at least two individual light sources include a diaphragm or optics configured to restrict light rays emanating from a respective one the at least two individual light sources to a predetermined angle.

11. The vehicle of claim 7 , wherein the at least two individual light sources consist of two individual light sources, each of the two individual light sources is a pixel on a display in the vehicle.

12. The vehicle of claim 7 , further comprising:

a display configured to output, when the at least two individual light sources are activated, information instructing the vehicle user to adjust a vehicle seat or the steering wheel.

13. The vehicle of claim 7 , further comprising:

an audio output unit configured to output, when the at least two individual light sources are activated, information instructing the vehicle user to adjust a vehicle seat or the steering wheel.

Assignments (3)
CHANGE OF NAME Recorded Jul 29, 2025
From: DAIMLER AG
To: MERCEDES BENZ GROUP AG
Reel/Frame 072886/0467 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2022
From: WECKMANN, CHRISTOPH; SCHINDEWOLF, PETER
To: DAIMLER AG
Reel/Frame 059814/0131 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2022
From: TARAYAN, EMIN; HIRSCH, MARIA
To: MERCEDES-BENZ GROUP AG
Reel/Frame 059814/0294 →
Priority Claims (1)
DE 10 2019 004 692.7 · Jul 3, 2019 · national
Continuity (1)
Related Publication 20220319200A1 · Oct 6, 2022