IP Library › Granted Patent US 11,930,476
Granted Patent B2
US 11,930,476 · App. 17/284,609 · Granted Mar 12, 2024

Sensor information integration system, sensor information integration method, program, and recording medium

Inventor: Toshiki Takeuchi (Tokyo, JP)
Assignee: NEC CORPORATION
H04W64/00G06T7/20G06T7/70H04W4/029
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,930,476
App. No.
17/284,609
Granted
Mar 12, 2024
Kind
B2
Abstract

The present invention is designed to make it possible to draw proper associations, when integrating pieces of information estimated in individual sensors, by associating between objects sensed by a plurality of sensors. A sensor information integration system 101 includes a radio frame analyzing section 33 configured to analyze a radio frame transmitted from a first object, to extract the first attribute information, an image analyzing section 40 configured to analyze an image, in which a second object is sensed, to extract second attribute information, and an association judging section 21 configured to judge an association between the first object and the second object, using the first attribute information and the second attribute information.

Claims (44)

1. A sensor information integration system comprising:

a memory storing instructions; and

one or more processors configured to execute the instructions to:

analyze a radio frame transmitted from a first object, to extract first attribute information related to the first object;

analyze an image in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects;

estimate location information of the first object from a radio wave; and

estimate location information of the second object from the image in which the second object is sensed; and

judge an association between the first object and the second object, using the first attribute information and the second attribute information, and using the location information of the first object and the location information of the second object.

2. The sensor information integration system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to integrate identification information of a third object to be sensed, by using a result of judging the association, the first attribute information, and the second attribute information.

3. The sensor information integration system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to integrate location information of a third object to be sensed, by using a result of judging the association, the location information of the first object, and the location information of the second object.

4. The sensor information integration system according to claim 1 , wherein the one or more processors are configured to execute the instructions to:

calculate a similarity between the first attribute information and the second attribute information; and

calculate a distance between the first object and the second object based on the location information of the first object and the location information of the second object.

5. The sensor information integration system according to claim 4 , wherein the one or more processors are further configured to execute the instructions to perform weighted synthesis of the similarity and the distance, using accuracy information of location estimation given based on the location information of the first object and the location information of the second object.

6. The sensor information integration system according to claim 4 , wherein distance axes in the calculated distance include axes of at least two of an angular direction, a depth direction, and an altitude direction.

7. The sensor information integration system according to claim 1 , wherein the first attribute information includes at least one of:

information related to an entity in which the first object is installed;

information related to a communication node to which the radio frame is transmitted; and

information related to a communication operation of the first object.

8. The sensor information integration system according to claim 7 , wherein the information related to the entity in which the first object is installed includes at least one of:

information indicating a type of the entity;

information related to a model name or a manufacturing vendor of the entity; and

information related to a country of manufacture or a country of destination of the entity.

9. The sensor information integration system according to claim 7 , wherein the information related to the communication node to which the radio frame is transmitted includes information related to hub station or a terminal station for a sensor network.

10. The sensor information integration system according to claim 7 , wherein the information related to the communication operation of the first object includes information related to an operation of any one of standby, operating, and talking.

11. The sensor information integration system according to claim 1 , wherein the second attribute information includes at least one of:

information identifying the second object;

information related to a communication operation of the second object; and

information related to an arrangement of an antenna attached to the second object.

12. The sensor information integration system according to claim 11 , wherein the information identifying the second object includes information indicating a type of the second object, and information related to at least one of an age, sex, and birthplace of a person.

13. The sensor information integration system according to claim 11 , wherein the information related to the communication operation of the second object includes information related to an operation of any one of standby, operating, and talking.

14. The sensor information integration system according to claim 11 , wherein the information related to the arrangement of the antenna attached to the second object includes information related to extension or storage of the antenna.

15. A sensor information integration method comprising:

analyzing, by a processor, a radio frame transmitted from a first object, to extract first attribute information related to the first object;

analyzing, by a processor, an image in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects;

estimating, by the processor, location information of the first object from a radio wave; and

estimating, by the processor, location information of the second object from the image in which the second object is sensed; and

judging an association between the first object and the second object, using the first attribute information and the second attribute information, and using the location information of the first object and the location information of the second object.

16. A non-transitory computer readable recording medium storing a program that causes is executable by a processor to perform:

analyzing a radio frame transmitted from a first object, to extract first attribute information related to the first object;

analyzing an image in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects;

estimating location information of the first object from a radio wave; and

estimating location information of the second object from the image in which the second object is sensed; and

judging an association between the first object and the second object, using the first attribute information and the second attribute information, and using the location information of the first object and the location information of the second object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: TAKEUCHI, TOSHIKI
To: NEC CORPORATION
Reel/Frame 061203/0720 →
Priority Claims (1)
JP 2018-203146 · Oct 29, 2018 · national
Continuity (1)
Related Publication 20210345286A1 · Nov 4, 2021