IP Library Granted Patent US 11,586,857
Granted Patent B2
US 11,586,857 · App. 16/903,176 · Granted Feb 21, 2023

Building entry management system

Inventors: Hao Hu (Sunnyvale, CA); Yanxia Zhang (Cupertino, CA); Qiong Liu (Cupertino, CA)
Assignee: FUJIFILM Business Innovation Corp.
G06K9/6267G06T7/70G06V10/454G06V20/52G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,586,857
App. No.
16/903,176
Granted
Feb 21, 2023
Kind
B2
Abstract

A computer-implemented method comprises receiving an input associated with the arrival of an entity, performing a classification on the input to determine a purpose of the arrival of the entity, and based on a determined classification of the purpose of the arrival of the entity, invoking an action.

Claims (34)

1. A computer-implemented method, comprising:

providing an access code to an entity in advance;

receiving an input associated with an arrival of the entity;

performing a classification on the input to determine a purpose of the arrival of the entity, wherein a prediction is performed based on visual information of the entity to classify a predicted purpose by use of a convolutional neural network (CNN) that converts the visual information into feature vectors, wherein the feature vectors are categorized and referenced to predict the purpose of the arrival of the entity;

based on a determined classification of the purpose of the arrival of the entity, invoking an action without interaction with the entity, wherein the action comprises at least an authentication comprising converting a server image provided by a service provider into a feature vector, and comparing a feature vector of the entity based on distance to identify a server, wherein training is performed with a triplet loss such that images of a common server will have a smallest feature distance; and

when no entity has arrived, monitoring contextual environment and predicting temperature and weather to recommend a delivery location.

2. The computer-implemented method of claim 1 , wherein, the entity comprises at least one of an object and a visitor, and the arrival comprises the at least one of the object and the visitor arriving in a vicinity of a building.

3. The computer-implemented method of claim 2 , wherein the building comprises one or more of a residence, an office building, a retail location, a manufacturing facility or a transportation hub.

4. The computer-implemented method of claim 1 , wherein the receiving comprises a sensor sensing a presence of the entity with a sensing range to obtain locational information associated with the entity and sensed image information, and a code reader that senses information associated with a code on an object.

5. The computer-implemented method of claim 1 , wherein the performing the prediction comprising receiving as the input visual information of the entity captured by a sensor, wherein the feature vectors are categorized with a classifier in an end-to-end fashion, to generate an output including the predicted purpose of the arrival of the entity.

6. The computer-implemented method of claim 5 , wherein the predicted purpose comprises one or more of a common visit, a utility service, a package delivery service, a resident of a location of the arrival, and a blacklisted entity.

7. The computer-implemented method of claim 1 , wherein the invoking the action comprises generating the action based on the prediction by application of rules and settings associated with one or more customized preferences of a resident at a location of the arrival.

8. The computer-implemented method of claim 1 , wherein the action comprises one or more of authentication, monitoring, granting access, denying access, extracting information from the entity, notifying a resident of a location of the arrival, and receiving and/or transmitting information with the entity.

9. A non-transitory computer readable medium including instructions executable on a processor, the instructions comprising:

providing an access code to an entity in advance;

receiving an input associated with an arrival of the entity;

performing a classification on the input to determine a purpose of the arrival of the entity, wherein a prediction is performed based on visual information of the entity to classify a predicted purpose by use of a convolutional neural network (CNN) that converts the visual information into feature vectors, wherein the feature vectors are categorized and referenced to predict the purpose of the arrival of the entity;

based on a determined classification of the purpose of the arrival of the entity, invoking an action without interaction with the entity, wherein the action comprises at least an authentication comprising converting a server image provided by a service provider into a feature vector, and comparing a feature vector of the entity based on distance to identify a server, wherein training is performed with a triplet loss such that images of a common server will have a smallest feature distance; and

when no entity has arrived, monitoring contextual environment and predicting temperature and weather to recommend a delivery location.

10. The non-transitory computer readable medium of claim 9 , wherein, the entity comprises at least one of an object and a visitor, and the arrival comprises the at least one of the object and the visitor arriving in a vicinity of a building that comprises one or more of a residence, an office building, a retail location, a manufacturing facility or a transportation hub.

11. The non-transitory computer readable medium of claim 9 , wherein the receiving comprises a sensor sensing a presence of the entity with a sensing range to obtain locational information associated with the entity and sensed image information, and a code reader that senses information associated with a code on an object.

12. The non-transitory computer readable medium of claim 9 , wherein the performing the prediction comprising receiving as the input visual information of the entity captured by a sensor, wherein the feature vectors are categorized with a classifier in an end-to-end fashion, to generate an output including the predicted purpose of the arrival of the entity.

13. The non-transitory computer readable medium of claim 12 , wherein the predicted purpose comprises one or more of a common visit, a utility service, a package delivery service, a resident of a location of the arrival, and a blacklisted entity.

14. The non-transitory computer readable medium of claim 9 , wherein the invoking the action comprises generating the action based on the prediction by application of rules and settings associated with one or more customized preferences of a resident at a location of the arrival.

15. The non-transitory computer readable medium of claim 9 , wherein the action comprises one or more of authentication, monitoring, granting access, denying access, extracting information from the entity, notifying a resident of a location of the arrival, and receiving and/or transmitting information with the entity.

16. A system, comprising:

a processor that provides an access code to an entity in advance;

a sensor that receives an input associated with an arrival of the entity;

the processor that performs a classification on the input to determine a purpose of the arrival of the entity, wherein a prediction is performed based on visual information of the entity to classify a predicted purpose by use of a convolutional neural network (CNN) that converts the visual information into feature vectors, wherein the feature vectors are categorized and referenced to predict the purpose of the arrival of the entity;

based on a determined classification of the purpose of the arrival of the entity, the processor invoking an action without interaction with the entity executed by a device, wherein the action comprises at least an authentication comprising converting a server image provided by a service provider into a feature vector, and comparing a feature vector of the entity based on distance to identify a server, wherein training is performed with a triplet loss such that images of a common server will have a smallest feature distance; and

when no entity has arrived, the processor monitoring contextual environment and predicting temperature and weather to recommend a delivery location.

17. The system of claim 16 , wherein the sensor a presence of the entity with a sensing range to obtain locational information associated with the entity and sensed image information, and further senses information associated with a code on an object.

18. The system of claim 16 , wherein the performing the prediction comprising receiving as the input visual information of the entity captured by a sensor, wherein the feature vectors are categorized with a classifier in an end-to-end fashion, to generate an output including the predicted purpose of the arrival of the entity.

19. The system of claim 16 , wherein the invoking the action comprises generating the action based on the prediction by application of rules and settings associated with one or more customized preferences of a resident at a location of the arrival, wherein the action comprises one or more of authentication, monitoring, granting access, denying access, extracting information from the entity, notifying a resident of a location of the arrival, and receiving and/or transmitting information with the entity.

Assignments (2)
CHANGE OF NAME Recorded May 25, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056392/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2020
From: HU, HAO; ZHANG, YANXIA; LIU, QIONG
To: FUJI XEROX CO., LTD.
Reel/Frame 052956/0107 →
Continuity (1)
Related Publication 20210390354A1 · Dec 16, 2021