IP Library Granted Patent US 12,266,186
Granted Patent B2
US 12,266,186 · App. 18/176,042 · Granted Apr 1, 2025

Trigger regions

Inventors: Arshan Poursohi (San Francisco, CA); Daniel Aden (San Francisco, CA); Matthew Amacker (San Francisco, CA); Charles Robert Barker (San Francisco, CA); Paul Vincent Byrne (San Francisco, CA); Paul Du Bois (San Francisco, CA); Greg Joseph Klein (San Francisco, CA); Steve Scott Tompkins (San Francisco, CA)
Assignee: Google LLC
G06V20/52G06T19/006G06V10/235
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,266,186
App. No.
18/176,042
Filed
Feb 28, 2023
Granted
Apr 1, 2025
Kind
B2
Art Unit
2616
USPC
345/419
Abstract

A method includes receiving, from a subscriber device, a request including virtual region characteristics and an occupancy threshold, and determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera. The virtual region is smaller than the physical region. The method also includes determining, using the image data, an occupancy of the virtual region and determining that the occupancy of the virtual region satisfies the occupancy threshold. In response to determining that the occupancy of the virtual region satisfies the occupancy threshold, the method also includes generating a notification to the subscriber device.

Claims (56)

1. A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations comprising:

receiving, from a subscriber device, a request comprising virtual region characteristics and an occupancy threshold, the virtual region characteristics specifying a region of interest for the subscriber device;

determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera, the virtual region in the field of view of the camera and smaller than the physical region within the field of view of the camera;

determining, using the image data, an occupancy of the virtual region;

determining that the occupancy of the virtual region satisfies the occupancy threshold; and

in response to determining that the occupancy of the virtual region satisfies the occupancy threshold, generating a notification to the subscriber device.

2. The method of claim 1 , wherein the virtual region characteristics comprises one or more attributes, the one or more attributes comprising at least one of:

a size of the virtual region;

a shape of the virtual region;

a relative location of the virtual region within the physical region; or

a relative orientation of the virtual region within the physical region.

3. The method of claim 1 , determining the virtual region comprises using image data captured by a plurality of cameras.

4. The method of claim 1 , wherein determining the occupancy of the virtual region comprises determining a number of people within the virtual region.

5. The method of claim 1 , wherein the operations further comprise:

determining that an actor has occupied the virtual region for at least a threshold period of time; and

in response to determining that the actor has occupied the virtual region for at least the threshold period of time, generating a second notification to the subscriber device.

6. The method of claim 1 , wherein the operations further comprise:

determining that a physical change has occurred within the virtual region; and

in response to determining that the physical change has occurred within the virtual region, generating a second notification to the subscriber device.

7. The method of claim 1 , wherein the operations further comprise:

determining a number of actors that enter the virtual region; and

generating a second notification to the subscriber device, the second notification comprising the number of actors that enter the virtual region.

8. The method of claim 1 , wherein the notification comprises a time that the occupancy of the virtual region satisfied the occupancy threshold.

9. The method of claim 1 , wherein the operations further comprise:

receiving, from the subscriber device, a second request comprising updated virtual region characteristics; and

updating the virtual region based on the updated virtual region characteristics.

10. The method of claim 1 , wherein the portion of the physical region that the virtual region corresponds to is dynamic.

11. A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving, from a subscriber device, a request comprising virtual region characteristics and an occupancy threshold, the virtual region characteristics specifying a region of interest for the subscriber device;

determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera, the virtual region in the field of view of the camera and smaller than the physical region within the field of view of the camera;

determining, using the image data, an occupancy of the virtual region;

determining that the occupancy of the virtual region satisfies the occupancy threshold; and

in response to determining that the occupancy of the virtual region satisfies the occupancy threshold, generating a notification to the subscriber device.

12. The system of claim 11 , wherein the virtual region comprises one or more attributes, the one or more attributes comprising at least one of:

a size of the virtual region;

a shape of the virtual region;

a relative location of the virtual region within the physical region; or

a relative orientation of the virtual region within the physical region.

13. The system of claim 12 , determining the virtual region comprises using image data captured by a plurality of cameras.

14. The system of claim 11 , wherein determining the occupancy of the virtual region comprises determining a number of people within the virtual region.

15. The system of claim 11 , wherein the operations further comprise:

determining that an actor has occupied the virtual region for at least a threshold period of time; and

in response to determining that the actor has occupied the virtual region for at least the threshold period of time, generating a second notification to the subscriber device.

16. The system of claim 11 , wherein the operations further comprise:

determining that a physical change has occurred within the virtual region; and

in response to determining that the physical change has occurred within the virtual region, generating a second notification to the subscriber device.

17. The system of claim 11 , wherein the operations further comprise:

determining a number of actors that enter the virtual region; and

generating a second notification to the subscriber device, the second notification comprising the number of actors that enter the virtual region.

18. The system of claim 11 , wherein the notification comprises a time that the occupancy of the virtual region satisfied the occupancy threshold.

19. The system of claim 11 , wherein the operations further comprise:

receiving, from the subscriber device, a second request comprising updated virtual region characteristics; and

updating the virtual region based on the updated virtual region characteristics.

20. The system of claim 11 , wherein the portion of the physical region that the virtual region corresponds to is dynamic.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2023
From: POURSOHI, ARSHAN; ADEN, DANIEL; AMACKER, MATTHEW; BARKER, CHARLES ROBERT; BYRNE, PAUL VINCENT; DU BOISE, PAUL; KLEIN, GREG JOSEPH; TOMPKINS, STEVE SCOTT
To: GOOGLE INC.
Reel/Frame 062829/0887 →
CHANGE OF NAME Recorded Feb 28, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 062888/0175 →
Continuity (4)
Continuation 16418143 · May 21, 2019
Continuation 15213843 · Jul 19, 2016
Provisional Application 62259971 · Nov 25, 2015
Related Publication 20230215181A1 · Jul 6, 2023
References Cited (67)
US 6567787B1 · Walker et al. · 2003 [cited by applicant]
US 6940405B2 · Script et al. · 2005 [cited by applicant]
US 7453471B2 · Fukui et al. · 2008 [cited by applicant]
US 7987111B1 · Sharma et al. · 2011 [cited by applicant]
US 8189926B2 · Sharma et al. · 2012 [cited by applicant]
US 8217790B2 · Script · 2012 [cited by applicant]
US 8493202B1 · Trundle et al. · 2013 [cited by applicant]
US 8786425B1 · Hutz · 2014 [cited by applicant]
US 8803917B2 · Meehan · 2014 [cited by applicant]
US 8965042B2 · Borger et al. · 2015 [cited by applicant]
US 8994645B1 · Meehan · 2015 [cited by applicant]
US 9241270B1 · Logue · 2016 [cited by applicant]
US 9311795B2 · Lyman · 2016 [cited by applicant]
US 9626440B2 · Meyerzon et al. · 2017 [cited by applicant]
US 9830805B2 · Trundle et al. · 2017 [cited by applicant]
US 9953512B2 · Lyman · 2018 [cited by applicant]
US 9978238B2 · Fadell et al. · 2018 [cited by applicant]
US 10339791B2 · Baum et al. · 2019 [cited by applicant]
US 10347047B2 · Poursohi et al. · 2019 [cited by applicant]
US 10535251B1 · Trundle et al. · 2020 [cited by applicant]
US 20020114626A1 · Fukui et al. · 2002 [cited by applicant]
US 20020175831A1 · Bergan · 2002 [cited by examiner]
US 20090027225A1 · Farley · 2009 [cited by examiner]
US 20090033622A1 · Kalpaxis · 2009 [cited by applicant]
US 20100152545A1 · Ramsay et al. · 2010 [cited by applicant]
US 20110060652A1 · Morton · 2011 [cited by applicant]
US 20120092492A1 · Carbonell et al. · 2012 [cited by applicant]
US 20120312956A1 · Chang et al. · 2012 [cited by applicant]
US 20130238167A1 · Stanfield · 2013 [cited by examiner]
US 20130314278A1 · Lim et al. · 2013 [cited by applicant]
US 20140157206A1 · Ovsiannikov et al. · 2014 [cited by applicant]
US 20140168062A1 · Katz et al. · 2014 [cited by applicant]
US 20150020031A1 · El Dokor et al. · 2015 [cited by applicant]
JP 2002004097A · 2002 [cited by applicant]
JP 201284160A · 2012 [cited by applicant]
JP 2014164537A · 2014 [cited by applicant]
JP 5769630B2 · 2015 [cited by applicant]
JP 2015532075A · 2015 [cited by applicant]
JP 2020026321A · 2020 [cited by applicant]
KR 1020050047063A · 2005 [cited by applicant]
KR 1020130131805A · 2013 [cited by applicant]
KR 20140054650A · 2014 [cited by applicant]
WO 0169387A2 · 2001 [cited by applicant]
WO 2015161106 · 2014 [cited by examiner]
Butun I, Morgera SD, Sankar R. A survey of intrusion detection systems in wireless sensor networks. IEEE communications surveys & tutorials. May 17, 2013;16(1):266-82. [cited by examiner]
Biswas A, Guha P, Mukerjee A, Venkatesh KS. Intrusion Detection and Tracking with Pan-Tilt Cameras. In2006 IET International Conference on Visual Information Engineering Sep. 26, 2006 (pp. 565-571). IET. [cited by examiner]
Buch N, Velastin SA. Local feature saliency classifier for real-time intrusion monitoring. Optical Engineering. Jul. 1, 2014;53(7): 073108-. [cited by examiner]
Sensaphone, Remote monitoring Solutions Manual, 2014, pp. 1-133. [cited by applicant]
Raty TD. Survey on contemporary remote surveillance systems for public safety. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). Mar. 1, 2010;40(5):493-515, 22 pages. [cited by applicant]
Sodemann AA, Ross MP, Borghetti BJ. A review of anomaly detection in automated surveillance. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). Dec. 21, 2012 ;42(6): 1257-72, 15 pages. [cited by applicant]
Goldszmidt G, Yemini Y. Distributed management by delegation. in Distributed Computing Systems, 1995., Proceedings of the 15th international Conference on May 30, 1995 (pp. 333-340). IEEE*, 7 pages. [cited by applicant]
Goldszmidt, German, Yechiam Yernini, and Shaula Yernini. “Network management by delegation: the MAD approach.” In Gascon First Decade High Impact Papers, pp. 78-92. IBM Corp., 2010*, 14 pages. [cited by applicant]
Gavalas D, Greenwood D, Ghanbari M, O'Mahony M. Hierarchical network management: a scalable and dynamic mobile agent-based approach. Computer Networks. Apr. 22, 2002;38(6):693-711 _ , 20 pages. [cited by applicant]
Monitoring, Remote Network. “Network Working Groups. Waldbusser Request for Comments: 4502 May 2006 Obsoletes: 2021 Updates: 3273 Category: Standards Track.” (2006)*, 142 pages. [cited by applicant]
Wu, Bing-Fei, Hsin-Yuan Peng, and Chao-Jung Chen. “A practical home security system via mobile phones.” WSEAS Transactions on Communications 5, No. 6 (2006): 1061-1066*, 6 pages. [cited by applicant]
Assaf MH, Mootoo R, Das SR, Petriu EM, Groza V, Biswas S. Sensor based home automation and security system. Conference Record—IEEE Instrumentation and Measurement Technology Conference, DOI: 10.1109/I2MTC.2012.6229153 C… [cited by applicant]
Yahg, Lili, Shuang-Hua Yang, and Fang Yao, “Safety and Security of Remote Monitoring and Control of intelligent Home Environments,” 2006 IEEE International Conference on Systems, Man and Cybernetics, Taipei, 2006, pp. 1… [cited by applicant]
Zhang J, Song G, Qiao G, Meng T, Sun H. An indoor security system with a jumping robot as the surveillance terminal. IEEE Transactions on Consumer Electronics. Nov. 2011;57(4)*, 9 pages. [cited by applicant]
Intemational Search Report for corresponding PCT application No. PCT/US2016/063364, dated Mar. 20, 2017*. [cited by applicant]
Written Opinion for corresponding PCT application No. PCT/US2016/063364, dated Mar. 20, 2017*. [cited by applicant]
Japanese Office Action for the related Application No. 2020-023321 dated Feb. 15, 2021. [cited by applicant]
Japanese Office Action for the related Application No. 2020-026321, International Application No. PCT/US2016/063364, Dated May 27, 2021, 2 pages. [cited by applicant]
European Patent Office, Extended European Search Report relating to applicaiton No. 22155010.6, dated Aug. 11, 2022. [cited by applicant]
USPTO. Office Action relating to U.S. Appl. No. 16/418,143, dated Jun. 16, 2022. [cited by applicant]
Bakar UA, Ghayvat H, Hasannn SF, Mukhopadhyay SC. Activity and anomaly detection in smart home: A survey. Next Generation Sensors and Systems. 2016:191-220. [cited by applicant]
Ghayvat H, Liu J, Babu A, Alahi EE, Gui X, Mukhopadhyay SC. Internet of Things for smart homes and buildings: Opportunities and Challenges. Journal of Telecommunications and the Digital Economy. Dec. 2015;3(4):33-47. [cited by applicant]
Korean Office Action for the related Korean Patent Application No. (PCT) 10-2022-7042146, dated Jul. 5, 2023, 7 pages. [cited by applicant]