IP Library › Granted Patent US 12,087,180
Granted Patent B2
US 12,087,180 · App. 18/152,703 · Granted Sep 10, 2024

Display control device, display system, welding system, welding method, display control method, storage medium

Inventors: Yasutomo Shiomi (Koza Kanagawa, JP); Tetsuo Sakai (Taito Tokyo, JP); Takayoshi Fujii (Yokohama Kanagawa, JP)
Assignee: KABUSHIKI KAISHA TOSHIBA
G09B5/02G09B19/24G06V10/774G06V20/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,087,180
App. No.
18/152,703
Granted
Sep 10, 2024
Kind
B2
Abstract

According to one embodiment, a display control device extracts a first feature from a first image of a welding operation, and causes a display device to display the first feature and a guide, the guide being related to the welding operation. The guide preferably includes a second feature corresponding to the first feature. The first feature and the second feature each may indicate a shape and position of a component related to the welding operation.

Claims (66)

1. A display control device,

the display control device being configured to:

acquire a first image of a welding operation,

extract a first feature from the first image, the first feature including at least one selected from the group consisting of a feature indicating an outer edge of a torch used in the welding operation, a feature indicating a wire used in the welding operation, and a feature indicating a groove between welded members,

calculate a first welding parameter from the first feature, the first welding parameter including at least one selected from the group consisting of an angle of the torch with respect to the members, a position of the groove, a width of a weld pool, and a movement speed of the torch,

acquire an evaluation for the first welding parameter,

generate a guide including a second feature based on the first welding parameter and the evaluation, the second feature including the at least one selected from the group consisting of the feature indicating the outer edge of the torch, the feature indicating the wire, and the feature indicating a groove,

cause a display device to display the first feature and the guide.

2. The display control device according to claim 1 , wherein the first feature and the second feature each includes the feature indicating an outer edge of the torch, the feature indicating the wire, and the feature indicating the groove.

3. The display control device according to claim 1 , wherein:

the display control device generates history data related to the welding operation, and

the history data includes at least one selected from the first welding parameter and the evaluation of the first welding parameter.

4. The display control device according to claim 1 , wherein:

the display control device extracts the first feature by using at least one of an image processing or a model, and

the model extracts a feature.

5. The display control device according to claim 4 , wherein:

the model is trained using a plurality of training images, and

the plurality of training images is generated by an optical simulation using a three-dimensional model of the welding operation.

6. A display system, comprising:

the display control device according to claim 1 ;

a first imaging device imaging the first image; and

the display device.

7. The display system according to claim 6 , further comprising:

an optical filter, and

the first imaging device generating the first image based on light passing through the optical filter.

8. A welding system, comprising:

the display system according to claim 6 ; and

a welding device used in the welding operation.

9. A welding method, comprising:

performing at least the welding operation while referring to the guide from the display control device according to claim 1 .

10. A display control method, comprising:

causing a processing device to:

acquire a first image of a welding operation,

extract a first feature from the first image, the first feature including at least one selected from the group consisting of a feature indicating an outer edge of a torch used in the welding operation, a feature indicating a wire used in the welding operation, and a feature indicating a groove between welded members,

calculate a first welding parameter from the first feature, the first welding parameter including at least one selected from the group consisting of an angle of the torch with respect to the members, a position of the groove, a width of a weld pool, and a movement speed of the torch,

acquire an evaluation for the first welding parameter,

generate a guide including a second feature based on the first welding parameter and the evaluation, the second feature including the at least one selected from the group consisting of the feature indicating the outer edge of the torch, the feature indicating the wire, and the feature indicating a groove, and

cause a display device to display the first feature and the guide.

11. A storage medium,

the storage medium storing a program, and

the program causing the processing device to perform at least the display control method according to claim 10 .

12. The display control device according to claim 1 , wherein:

the first feature indicates a first position of the outer edge of the torch used in the welding operation,

the second feature indicates a second position of the outer edge of the torch, and

the second position is more appropriate than the first position for the welding operation.

13. The display control device according to claim 1 , wherein:

the first feature indicates a first position of the wire used in the welding operation,

the second feature indicates a second position of the wire, and

the second position is more appropriate than the first position for the welding operation.

14. The display control device according to claim 1 , wherein:

the first feature indicates a first position of the groove in the welding operation,

the second feature indicates a second position of the groove, and

the second position is more appropriate than the first position for the welding operation.

15. The display control method according to claim 10 , wherein the first feature and the second feature each includes the feature indicating an outer edge of the torch, the feature indicating the wire, and the feature indicating the groove.

16. The display control method according to claim 10 , wherein:

the first feature indicates a first position of the outer edge of the torch used in the welding operation,

the second feature indicates a second position of the outer edge of the torch, and

the second position is more appropriate than the first position for the welding operation.

17. The display control method according to claim 10 , wherein:

the first feature indicates a first position of the wire used in the welding operation,

the second feature indicates a second position of the wire, and

the second position is more appropriate than the first position for the welding operation.

18. The display control method according to claim 10 , wherein:

the first feature indicates a first position of the groove in the welding operation,

the second feature indicates a second position of the groove, and

the second position is more appropriate than the first position for the welding operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2023
From: SHIOMI, YASUTOMO; SAKAI, TETSUO; FUJII, TAKAYOSHI
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 062773/0763 →
Priority Claims (1)
JP 2022-002330 · Jan 11, 2022 · national
Continuity (1)
Related Publication 20230222930A1 · Jul 13, 2023