IP Library Granted Patent US 10,778,887
Granted Patent B1
US 10,778,887 · App. 16/426,278 · Granted Sep 15, 2020

Security application using camera SOC with multi-sensor capabilities

Inventor: Ruian Xu (San Jose, CA)
Assignee: Ambarella International LP
H04N5/23219H04N5/2253H04N5/2254H04N5/2259H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,778,887
App. No.
16/426,278
Granted
Sep 15, 2020
Kind
B1
Abstract

An apparatus includes a first lens and first image sensor, a second lens and second image sensor, a first motion sensor, a second motion sensor, and a processor. The first image sensor may be configured to capture a first video image stream of a first field of view (FOV). The second image sensor may be configured to capture a second video image stream of a second FOV. The first motion sensor may be configured to detect motion in the first FOV. The second motion sensor may be configured to detect motion in the second FOV. The processor is generally coupled to the first image sensor, the first motion sensor, the second image sensor, and the second motion sensor, and configured to generate a third video image stream in response to one or more of the first video image stream and the second video image stream.

Claims (33)

1. An apparatus comprising:

a housing;

a first lens and first image sensor disposed within said housing and configured to capture a first video image stream of a first field of view (FOV);

a second lens and second image sensor disposed within said housing and configured to capture a second video image stream of a second FOV;

a first motion sensor disposed within said housing and configured to detect motion in said first FOV;

a second motion sensor disposed within said housing and configured to detect motion in said second FOV; and

a camera system on chip (SOC) with multi-sensor capabilities disposed within said housing and coupled to said first image sensor, said first motion sensor, said second image sensor, and said second motion sensor, wherein a processor of said camera system on chip (SOC) is configured to generate a third video image stream in response to one or more of said first video image stream and said second video image stream.

2. The apparatus according to claim 1 , wherein said first lens and said first image sensor are mounted orthogonally relative to said second lens and said second image sensor.

3. The apparatus according to claim 1 , wherein said first FOV and said second FOV overlap by one or more degrees.

4. The apparatus according to claim 1 , wherein said processor is further configured to track an object moving from the first or the second FOV to the second or the first FOV.

5. The apparatus according to claim 4 , wherein said processor is further configured to switch said first and said second image sensors on and off as said object moves from the first or the second FOV to the second or the first FOV.

6. The apparatus according to claim 5 , wherein said processor is further configured to utilize video analytics to determine when to switch said first and said second image sensors on and off as said object moves from the first or the second FOV to the second or the first FOV.

7. The apparatus according to claim 6 , wherein said processor is further configured to switch said first image sensor or said second image sensor on prior to said object moving from the first or the second FOV to the second or the first FOV, and switch said first image sensor or said second image sensor off after said object has moved from the second or the first FOV to the first or the second FOV.

8. The apparatus according to claim 1 , wherein each of said first motion sensor and said second motion sensor comprises a passive infrared (PIR) sensor.

9. The apparatus according to claim 1 , wherein each of said first motion sensor and said second motion sensor comprises a low resolution image sensor configured to detect at least one of motion and a person.

10. The apparatus according to claim 1 , wherein said processor is further configured to determine when to switch said first and said second image sensors on and off based on inputs from said first motion sensor and said second motion sensor.

11. The apparatus according to claim 1 , wherein said apparatus is battery powered.

12. The apparatus according to claim 1 , wherein said processor is configured to communicate said third video image stream to a monitoring device using a wireless protocol.

13. The apparatus according to claim 1 , wherein said processor performs video analytics to predict a direction of movement of an object to allow said first or said second image sensor to be started ahead of time, to be ready as soon as the object is in the first FOV or the second FOV.

14. A method of monitoring an area using a camera system on chip (SOC) with multi-sensor capabilities, said method comprising:

orienting a first lens and a first image sensor disposed within a housing containing said camera SoC to capture a first video image stream of a first field of view (FOV);

orienting a second lens and a second image sensor disposed within said housing containing said camera SoC to capture a second video image stream of a second FOV;

orienting a first motion sensor disposed within said housing containing said camera SoC and associated with said first image sensor to detect motion in said first FOV;

orienting a second motion sensor disposed within said housing containing said camera SoC and associated with said second image sensor to detect motion in said second FOV; and

generating a third video image stream in response to one or more of said first video image stream and said second video image stream using a processor of said camera SoC coupled to said first image sensor, said first motion sensor, said second image sensor, and said second motion sensor.

15. The method according to claim 14 , wherein said first lens and said first image sensor are mounted orthogonally relative to said second lens and said second image sensor.

16. The method according to claim 14 , wherein said first FOV and said second FOV overlap by one or more degrees.

17. The method according to claim 14 , further comprising:

using said processor to track an object moving from the first or the second FOV to the second or the first FOV; and

switching said first and said second image sensors on and off as said object moves from the first or the second FOV to the second or the first FOV.

18. The method according to claim 17 , wherein said processor utilizes video analytics to determine when to switch said first and said second image sensors on and off as said object moves from the first or the second FOV to the second or the first FOV.

19. The method according to claim 18 , wherein said processor is further configured to switch said first image sensor or said second image sensor on prior to said object moving from the first or the second FOV to the second or the first FOV, and switch said first image sensor or said second image sensor off after said object has moved from the second or the first FOV to the first or the second FOV.

20. The method according to claim 14 , wherein each of said first motion sensor and said second motion sensor comprises at least one of a passive infrared (PIR) sensor and a low resolution image sensor configured to detect at least one of motion and a person.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2020
From: AMBARELLA, INC.
To: AMBARELLA INTERNATIONAL LP
Reel/Frame 051692/0711 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2019
From: XU, RUIAN
To: AMBARELLA, INC.
Reel/Frame 049699/0009 →