IP Library Granted Patent US 10,703,278
Granted Patent B2
US 10,703,278 · App. 15/426,476 · Granted Jul 7, 2020

Intelligent rear-view mirror system

Inventor: Jia-Wei Ding (Taipei, TW)
Assignee: THUNDER POWER NEW ENERGY VEHICLE DEVELOPMENT COMPANY LIMITED
B60R1/025B60R1/00B60R1/04B60R1/08B60R1/12B60R11/04G06F3/013G06K9/0061G06K9/00604H04N5/2252H04N5/2253B60R2001/1253B60R2011/0033B60R2300/108B60R2300/30B60R2300/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,703,278
App. No.
15/426,476
Granted
Jul 7, 2020
Kind
B2
Abstract

Described herein is a rear view mirror system that is configured to adjust to a user's position without direct user interaction. In some embodiments, a camera may be included in the rear view mirror system so that its line of sight is perpendicular to a reflective surface. The camera may capture a digital image of the user. Eye patterns may be identified from the image information to determine an appropriate position for the mirror. In some embodiments, the mirror may be repositioned so that the camera's line of sight is directed halfway between the identified eye information and the center of a rear window. In some embodiments, the mirror may be re-adjusted periodically.

Claims (59)

1. A rear view mirror apparatus, comprising:

a mirror housing;

a first planar reflective surface, and a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface;

first and second actuation devices configured to rotate the first and second planar reflective surfaces within the mirror housing along vertical and horizontal axes;

a camera device configured to capture imagery in a night mode using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface, and to capture the imagery in a day mode using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface; and

a processor device configured to:

detect that the planar reflective surface, previously positioned automatically into a particular position, is knocked away from the particular position; and

automatically responsive to the detecting:

determine whether the camera device is in the night mode or the day mode;

capture image information including at least a portion of an image of a vehicle driver when the planar reflective surface is in the default position, where in the capturing is according to the first direction responsive to determining that the camera device is in the night mode, and the capturing is according to the second direction responsive to determining that the camera device is in the day mode;

map the image information to a set of coordinates;

identify, within the image information, a viewer position of the set of coordinates;

identify a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

generate instructions to the first and second actuation devices to rotate the planar reflective surface within the mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

2. The rear view mirror apparatus of claim 1 , wherein the camera device is located within the mirror housing, behind the reflective surface.

3. The rear view mirror apparatus of claim 1 , wherein the viewer position of the set of coordinates is determined using one or more machine vision techniques.

4. The rear view mirror apparatus of claim 1 , wherein the captured image information includes an image of at least one eye.

5. The rear view mirror apparatus of claim 4 , wherein the viewer position is determined based at least in part on a position of the image of at least one eye.

6. The rear view mirror apparatus of claim 5 , wherein the image at least one eye comprises an image of two eyes and the viewer position is determined to be halfway between the two eyes.

7. The rear view mirror apparatus of claim 1 , wherein the processor device is further configured to:

continue to receive captured image information from the camera device;

determine that the viewer position has changed; and

generate new instructions to cause at least one of the first actuation device or the second actuation device to rotate the first and second planar reflective surfaces so that the camera device maintains alignment with a new position located halfway between the viewer position and the origin point.

8. A method comprising:

detecting that a planar reflective surface of a vehicle mirror previously positioned automatically into a particular position, is knocked away from the particular position, the planar reflective surface being one of a first planar reflective surface or a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface; and

responsive to the detecting:

determining whether a camera device is in a night mode or a day mode, the camera device configured to capture imagery using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface in the night mode, and to capture the imagery using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface in the day mode;

capturing image information using the camera device, the image information comprising at least a portion of an image of a vehicle driver;

identifying, within the image information, a viewer position mapped to a set of coordinates;

identifying a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

rotating, via a first actuation device and a second actuation device, the first and second planar reflective surfaces within a mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

9. The method of claim 8 , further comprising:

receiving an updated image information;

determining that the viewer position has changed in the updated image information; and

rotating, using at least one of the first actuation device or the second actuation device, the first and second planar reflective surfaces so that the camera device is aligned with an updated position halfway between an updated viewer position and the origin point within the updated image information.

10. The method of claim 9 , wherein the updated image information is received on a periodic basis.

11. The method of claim 8 , wherein each respective planar reflective surface of the first planar reflective surface and the second planar reflective surface is positioned such that an axis perpendicular to the respective planar reflective surface bisects the viewer position and the origin point within the captured image information.

12. The method of claim 8 , wherein the viewer position is identified by matching patterns in the image information with at least one stored eye pattern.

13. The method of claim 8 , wherein the origin point corresponds to the center of a rear window of the vehicle.

14. A vehicle mirror system, comprising:

a processor device; and

a memory having a default position of a planar reflective surface stored thereon, and including instructions that, when executed with the processor device, cause the processor device to, at least:

detect that the planar reflective surface previously positioned automatically into a particular position, is knocked away from the particular position, the planar reflective surface being one of a first planar reflective surface or a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface; and

automatically responsive to the detecting:

determine whether a camera device is in a night mode or a day mode, the camera device configured to capture imagery using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface in the night mode, and to capture the imagery using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface in the day mode;

capture image information, by the camera device, including at least a portion of an image of a vehicle driver;

identify, within the image information, a viewer position mapped to a set of coordinates;

identify a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

generate instructions to the first and second actuation devices to rotate the first and second planar reflective surfaces within the mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

15. The vehicle rear-view mirror system of claim 14 , wherein at least one of the first actuation device or the second actuation device is a servomotor.

16. The vehicle rear-view mirror system of claim 14 , wherein generating instructions to an actuation device includes calculating a degree of rotation corresponding to an identified position.

17. The vehicle rear-view mirror system of claim 16 , wherein the actuation device is caused to rotate by the calculated degree of rotation.

18. The vehicle rear-view mirror system of claim 14 , wherein the instructions are executed upon detecting a repositioning event.

19. The vehicle rear-view mirror system of claim 14 , wherein the repositioning event comprises detecting that a viewer position has changed.

20. The vehicle rear-view mirror system of claim 14 , wherein the repositioning event comprises detecting that a vehicle in which the vehicle rear-view mirror system is installed has been turned on.

21. The rear view mirror apparatus of claim 1 , further comprising:

a memory having a default position of the first and second planar reflective surfaces stored thereon,

wherein the processor device is further configured, automatically responsive to the detecting, to:

generate instructions to the first and second actuation devices to rotate the first and second planar reflective surfaces within the mirror housing to the default position prior to capturing the image information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2017
From: THUNDER POWER HONG KONG LTD.
To: THUNDER POWER NEW ENERGY VEHICLE DEVELOPMENT COMPANY LIMITED
Reel/Frame 042210/0418 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2017
From: DING, JIA-WEI
To: THUNDER POWER HONG KONG LTD.
Reel/Frame 041193/0715 →
Continuity (3)
Continuation 14967389 · Dec 14, 2015
Continuation 14923431 · Oct 27, 2015
Related Publication 20170158135A1 · Jun 8, 2017