IP Library Granted Patent US 10,742,901
Granted Patent B2
US 10,742,901 · App. 16/391,470 · Granted Aug 11, 2020

Audio/video recording and communication devices with multiple cameras for superimposing image data

Inventors: James Siminoff (Pacific Palisades, CA); Mark Siminoff (Mountain View, CA)
Assignee: Amazon Technologies, Inc.
H04N5/272H04N5/2258H04N5/77H04N7/186H04N7/188H04N9/8227
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,742,901
App. No.
16/391,470
Granted
Aug 11, 2020
Kind
B2
Abstract

Audio/video (A/V) recording and communication devices with multiple cameras for superimposing image data in accordance with various embodiments of the present disclosure are provided. In one embodiment, an audio/video (A/V) recording and communication device comprising: a first camera configured to capture image data at a first resolution; a second camera configured to capture image data at a second resolution that is higher than the first resolution; a memory including a rolling buffer; a communication module; and a processing module comprising: a processor; and a camera application that configures the processor to: capture first image data using the first camera; store the first image data in the rolling buffer of the memory; maintain the second camera in a low-power state; power up the second camera in response to motion detection; capture second image data using the second camera; and superimpose the first image data onto the second image data.

Claims (28)

1. A non-transitory machine-readable medium having stored thereon instructions that, when executed by a processing device of a server, cause the server to perform a method for superimposing image data captured by at least one audio/video recording and communication device (A/V device), the method comprising:

receiving first image data captured at a first resolution using a first camera of an A/V device;

receiving second image data captured at a second resolution using a second camera of the A/V device, wherein the second resolution is higher than the first resolution; and

superimposing the first image data captured using the first camera onto the second image data captured using the second camera,

wherein the first camera and second camera have substantially coincident fields of view.

2. The program, stored in the non-transitory machine-readable medium of claim 1 , wherein the first image data captured using the first camera is stored in a rolling buffer of a memory in the A/V device.

3. The program, stored in the non-transitory machine-readable medium of claim 2 , wherein the rolling buffer is configured to store 10-15 seconds of the first image data.

4. The program, stored in the non-transitory machine-readable medium of claim 1 , wherein the program comprises further instructions for selecting a single high-resolution frame from the second image data captured using the second camera.

5. The program, stored in the non-transitory machine-readable medium of claim 4 , wherein the program comprises further instructions for generating background video footage by repeating the single high-resolution frame.

6. The program, stored in the non-transitory machine-readable medium of claim 5 , wherein the first image data captured using the first camera comprises a plurality of low-resolution frames.

7. The program, stored in the non-transitory machine-readable medium of claim 6 , wherein the program comprises further instructions for determining at least one active motion block within the plurality of low-resolution frames.

8. The program, stored in the non-transitory machine-readable medium of claim 7 , wherein the program comprises further instructions for determining the at least one active motion block by comparing pixel values of a first one of the low-resolution frames with corresponding pixel values of a second one of the low-resolution frames.

9. The program, stored in the non-transitory machine-readable medium of claim 8 , wherein the program comprises further instructions for superimposing the first image data onto the second image data by superimposing the at least one active motion block onto at least one of the single high-resolution frames of the background video footage.

10. The program, stored in the non-transitory machine-readable medium of claim 1 , wherein the program comprises further instructions for streaming the superimposed image data to a client device at a first stream rate and streaming the second image data captured to the client device at a second stream rate, wherein the second stream rate is less than the first stream rate.

11. A method for at least one server for superimposing image data captured by at least one audio/video recording and communication device (A/V device), the method comprising:

receiving first image data captured at a first resolution using a first camera of an A/V device;

receiving second image data captured at a second resolution using a second camera of the A/V device, wherein the second camera is maintained in a low-power state and powered up in response to motion detection and wherein the second resolution is higher than the first resolution; and

superimposing the first image data captured using the first camera onto the second image data captured using the second camera,

wherein the first camera and second camera have substantially coincident fields of view.

12. The method of claim 11 , wherein the first image data captured using the first camera is stored in a rolling buffer of a memory in the A/V device.

13. The method of claim 12 , wherein the rolling buffer is configured to store 10-15 seconds of the first image data.

14. The method of claim 11 , further comprising selecting a single high-resolution frame from the second image data captured using the second camera.

15. The method of claim 14 , further comprising generating background video footage by repeating the single high-resolution frame.

16. The method of claim 15 , wherein the first image data captured using the first camera comprises a plurality of low-resolution frames.

17. The method of claim 16 , further comprising determining at least one active motion block within the plurality of low-resolution frames.

18. The method of claim 17 , further comprising determining the at least one active motion block by comparing pixel values of a first one of the low-resolution frames with corresponding pixel values of a second one of the low-resolution frames.

19. The method of claim 18 , further comprising superimposing the first image data captured using the first camera onto the second image data captured using the second camera by superimposing the at least one active motion block onto at least one of the single high-resolution frames of the background video footage.

20. The method of claim 11 , further comprising streaming the superimposed image data to a client device at a first stream rate and streaming the second image data to the client device at a second stream rate, wherein the second stream rate is less than the first stream rate.

Assignments (4)
CHANGE OF NAME Recorded May 6, 2020
From: RING INC.
To: RING LLC
Reel/Frame 052582/0967 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: RING LLC
To: A9.COM, INC.
Reel/Frame 052583/0061 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: A9.COM, INC.
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 052583/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2020
From: SIMINOFF, JAMES; SIMINOFF, MARK
To: RING INC.
Reel/Frame 052573/0470 →
Continuity (3)
Continuation 15887865 · Feb 2, 2018
Provisional Application 62454220 · Feb 3, 2017
Related Publication 20190253642A1 · Aug 15, 2019