IP Library Granted Patent US 11,303,955
Granted Patent B2
US 11,303,955 · App. 16/877,847 · Granted Apr 12, 2022

Video integration with home assistant

Inventors: Jessica Yuan (Union City, CA); James Stewart (San Mateo, CA); Rajeev Nongpiur (Mountain View, CA); Patrick Lister (Mountain View, CA); Chi Yeung Jonathan Ng (San Francisco, CA)
Assignee: Google LLC
H04N21/43615G06Q10/109G10L17/22H04L12/281H04L12/282H04L12/2803H04L67/325H04N21/23418H04N21/25875H04N21/4223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,303,955
App. No.
16/877,847
Granted
Apr 12, 2022
Kind
B2
Abstract

Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

Claims (51)

1. A method for using a home assistant device to manage video recording, the method comprising:

capturing, using a network-enabled video camera, a video stream of a location at which a user is present;

receiving, by a home assistant device, a spoken command from the user that requests video, captured by the network-enabled video camera, be recorded;

analyzing the video stream captured using the network-enabled video camera to determine an identity of the user; and

storing a portion of the video stream linked to a user account of the user based on the spoken command and the determined identity of the user.

2. The method for using the home assistant device to manage video recording of claim 1 , wherein the spoken command that request video be recorded additionally requests that the video be recorded as a highlight reel, the method further comprising:

selecting video from the video stream for the highlight reel based on an amount of movement detected within the video stream.

3. The method for using the home assistant device to manage video recording of claim 1 , wherein:

the spoken command that requests video be recorded additionally requests that the video be recorded as a time lapse video and indicates a start time and an end time for the time lapse video; and

a duration of time between the start time and end time is used to determine a frequency of images to use as the time lapse video.

4. The method for using the home assistant device to manage video recording of claim 1 , wherein:

the spoken command that requests video be recorded additionally indicates a time period for a duration of the recording; and

the portion of the video stream stored has the duration of the indicated time period.

5. The method for using the home assistant device to manage video recording of claim 1 , wherein:

the spoken command that requests video be recorded does not indicate a time period for a duration of the recording; and

the portion of the video stream stored has a duration of a default time period based on the received spoken command not indicating the time period.

6. The method for using the home assistant device to manage video recording of claim 1 , wherein:

the spoken command that requests video be recorded additionally indicates a time at which to commence recording; and

the portion of the video stream stored commences at the indicated time.

7. The method for using the home assistant device to manage video recording of claim 1 , wherein:

determining the identity of the user is unsuccessful; and

storing the portion of the video stream linked to the user account comprises storing the portion of the video stream linked to a master account based on unsuccessfully determining the identity of the user.

8. The method for using the home assistant device to manage video recording of claim 1 , wherein storing the portion of the video stream linked to the user account comprises storing a reference to a portion of a continuous video feed stored to a cloud-based server system.

9. The method for using the home assistant device to manage video recording of claim 1 , wherein storing the portion of the video stream linked to the user account comprises storing a separate file of the portion of the video stream to a cloud-based server system.

10. The method for using the home assistant device to manage video recording of claim 1 , wherein the network-enabled video camera and the home assistant device are separate devices.

11. The method for using the home assistant device to manage video recording of claim 1 , further comprising:

transmitting, to a mobile device of the user, a notification that the portion of the video stream linked to the user account of the user based on the spoken command and the identity of the user is ready for viewing.

12. The method for using the home assistant device to manage video recording of claim 1 , further comprising:

streaming, by the network-enabled video camera, the video stream to a cloud-based home assistant integration platform.

13. The method for using the home assistant device to manage video recording of claim 12 , further comprising:

storing, by the cloud-based home assistant integration platform, the video stream for at least a period of time.

14. The method for using the home assistant device to manage video recording of claim 13 , wherein analyzing the video stream captured using the network-enabled video camera to determine the identity of the user is performed by the cloud-based home assistant integration platform.

15. The method for using the home assistant device to manage video recording of 14 , further comprising:

transmitting, by the home assistant device, the spoken command to the cloud-based home assistant integration platform; and

analyzing, by the cloud-based home assistant integration platform, the spoken command using a speech recognition engine and a natural language interpretation engine.

16. A system for managing video recording, the system comprising:

a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform;

a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to:

receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded; and

the cloud-based home assistant integration platform, configured to:

analyze the video stream captured using the network-enabled video camera to determine an identity of the user; and

store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

17. The system for managing video recording of claim 16 , wherein:

the home assistant device is further configured to transmit the spoken command to the cloud-based home assistant integration platform; and

the cloud-based home assistant integration platform is further configured to analyze the spoken command using a speech recognition engine and a natural language interpretation engine.

18. The system for managing video recording of claim 16 , wherein the spoken command that requests video be recorded additionally requests that the video be recorded as a highlight reel; and

the cloud-based home assistant integration platform is further configured to select video from the video stream for the highlight reel based on an amount of movement, audio, or both being detected within the video stream.

19. The system for managing video recording of claim 16 , wherein the spoken command that requests video be recorded additionally indicates a time period for a duration of the recording; and

the cloud-based home assistant integration platform is further configured to record the video stream for the indicated time period.

20. The system for managing video recording of claim 16 , wherein the spoken command that requests video be recorded additionally indicates a time at which to commence recording; and

the portion of the video stream commences at the indicated time.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: YUAN, JESSICA; STEWART, JAMES; NONGPIUR, RAJEEV; LISTER, PATRICK; NG, CHI YEUNG JONATHAN
To: GOOGLE INC.
Reel/Frame 058509/0056 →
CHANGE OF NAME Recorded Dec 30, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 058601/0258 →