IP Library › Granted Patent US 11,842,511
Granted Patent B2
US 11,842,511 · App. 17/055,304 · Granted Dec 12, 2023

Work analyzing system and work analyzing method

Inventor: Yuji Sato (Kanagawa, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T7/74G06V40/10G06V40/20G06V40/23G06T2207/10016G06T2207/20081G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,842,511
App. No.
17/055,304
Granted
Dec 12, 2023
Kind
B2
Abstract

In order to enable, even when an increased number of workers become analysis targets, efficient analysis on work efficiency statuses of workers without putting a greater burden on an administrator to perform setting operations for the analysis, analytical information is produced by performing a joint position estimation based on respective frames of video recordings to estimate joint positions of a worker, performing a posture match determination based on results of the joint position estimation to determine whether or not to achieve a posture match between a posture of the worker in each frame of the video recordings and a predetermined reference body posture, and measuring, based on results of the posture match determination, a working time and a presence time of the worker used as analytical information on a work efficiency status of the worker.

Claims (40)

1. A work analyzing device in which a processor is caused to perform operations to output analytical information on a work efficiency status of a worker based on second video recordings of working activities of the worker,

wherein the processor is configured to:

generate, based on first video recordings for training and by using machine learning, a posture class estimation model configured to perform a posture match determination;

determine whether the worker is present at a place of working based on the second video recordings;

start measuring a presence time of the worker in response to the worker being at the place of working;

perform a joint position estimation based on the second video recordings to estimate joint positions of the worker;

perform a posture match determination based on results of the joint position estimation and using the posture class estimation model to determine a posture match between a posture of the worker and a predetermined reference body posture;

start measuring a working time of the worker in response to the posture match being determined, the worker being at the place of working, and the worker not working;

stop measuring the working time of the worker in response to the posture match being determined, the worker being at the place of working, and the worker working; and

generate, based on the presence time and the working time, the analytical information on the work efficiency status of the worker.

2. The work analyzing device according to claim 1 , wherein the processor is configured to:

by using the machine learning, create first machine-learned information for the joint position estimation and second machine-learned information for the posture match determination, trained with the first video recordings for training, information records of joint positions of the worker in the first video recordings, and information indicating whether or not to achieve the posture match;

perform the joint position estimation based on the first machine-learned information for the joint position estimation; and

perform the posture match determination based on the results of the joint position estimation and the second machine-learned information for the posture match determination.

3. The work analyzing device according to claim 1 , wherein the processor is configured to:

acquire, based on results of the posture match determination, the working time of the worker during which the worker has been actually working at the place of working, as the analytical information.

4. The work analyzing device according to claim 3 , wherein the processor is configured to:

perform a presence determination to determine whether or not the worker is present at the place of working; and

acquire, based on results of the presence determination, the presence time of the worker during which the worker has been present at the place of working, as the analytical information.

5. The work analyzing device according to claim 3 , wherein the processor is configured to:

acquire a second working time of a skilled worker as a standard time; and

compare the working time of the worker with the standard time, thereby acquiring evaluation information as the analytical information, the evaluation information including an evaluated value of working efficiency of the worker.

6. The work analyzing device according to claim 1 , wherein the processor is configured to:

perform the posture match determination on each of a plurality of workers;

create the analytical information on each worker of the plurality of workers based on results of the posture match determination for each worker; and

perform statistic calculation on analytical information on each worker to generate statistical information on the work efficiency status of the worker.

7. The work analyzing device according to claim 1 , wherein the processor is configured to:

perform the posture match determination to determine the posture match between the posture of the worker and any one of a plurality of predetermined reference body postures; and

generate the analytical information based on the one of the plurality of predetermined reference body postures for which the posture match is determined.

8. The work analyzing device according to claim 1 , wherein the processor is further configured to:

display, on a terminal, an analysis result display screen that includes the analytical information, with the working time and the presence time being superimposed on the analysis result display screen.

9. A work analyzing method for causing a processor to perform operations to output analytical information on a work efficiency status of a worker based on second video recordings of working activities of the worker, the operations comprising:

generating, based on first video recordings for training and by using machine learning, a posture class estimation model configured to perform a posture match determination;

determining whether the worker is present at a place of working based on the second video recordings;

starting measurement of a presence time of the worker in response to the worker being at the place of working;

performing a joint position estimation based on the second video recordings to estimate joint positions of the worker;

performing a posture match determination based on results of the joint position estimation and using the posture class estimation model to determine a posture match between a posture of the worker and a predetermined reference body posture;

starting measurement of a working time of the worker in response to the posture match being determined, the worker being at the place of working, and the worker not working;

stopping measurement of the working time of the worker in response to the posture match being determined, the worker being at the place of working, and the worker working; and

generating, based on the presence time and the working time, the analytical information on the work efficiency status of the worker.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2021
From: SATO, YUJI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 056873/0009 →
Priority Claims (1)
JP 2018-094271 · May 16, 2018 · national
Continuity (1)
Related Publication 20210225029A1 · Jul 22, 2021
Cited By (1)
US 12,567,173