IP Library Granted Patent US 11,099,977
Granted Patent B1
US 11,099,977 · App. 16/823,921 · Granted Aug 24, 2021

Method, device and computer-readable storage medium for testing bios using menu map obtained by performing image identification on bios interface

Inventors: Heshi Wu (Shanghai, CN); Guowu Xia (Shanghai, CN); Zhi Feng (Shanghai, CN); Xiaoxia Shu (Shanghai, CN)
Assignee: EMC IP Holding Company LLC
G06F11/3688
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,099,977
App. No.
16/823,921
Granted
Aug 24, 2021
Kind
B1
Abstract

Embodiments of the disclosure relate to a method, a device, and a computer-readable storage medium for testing a basic input output system (BIOS). The method comprises: acquiring a target attribute of a target menu of a BIOS of a test machine; determining a path to the target menu based on a menu map of the BIOS, wherein the menu map is obtained by performing image identification on a BIOS interface of the test machine; and causing the BIOS of the test machine to enter the target menu based on the path so as to modify the attribute of the target menu into the target attribute.

Claims (53)

1. A method for testing a basic input output system (BIOS) of a test machine, comprising:

acquiring a target attribute of a target menu of the BIOS of the test machine;

determining a path to the target menu based on a menu map of the BIOS, wherein the menu map is obtained by performing image identification on a BIOS interface of the test machine; and

causing the BIOS of the test machine to enter the target menu based on the path so as to modify the attribute of the target menu into the target attribute.

2. The method according to claim 1 , wherein the path to the target menu is the shortest path.

3. The method according to claim 1 , wherein causing the BIOS of the test machine to enter the target menu comprises:

sending, through a serial port, an instruction corresponding to the path so as to enter the target menu.

4. The method according to claim 1 , wherein the menu map is determined by iteratively performing the following operations:

sending instructions to the test machine so as to enter the BIOS interface of the test machine, the BIOS interface corresponding to a main interface of the BIOS or a sub-interface associated with a corresponding menu;

acquiring an image of the BIOS interface from the test machine; and

determining menus in the BIOS interface by identifying the image of the BIOS interface.

5. The method according to claim 1 , wherein the image identification comprises:

dividing an image of the BIOS interface into grids;

obtaining a binarized representation of the image based on whether there is a character in a grid; and

determining menus in the BIOS interface based on the binarized representation of the image.

6. The method according to claim 1 , wherein the menu map is determined at least in part by applying a machine learning algorithm to an image of the BIOS interface to recognize at least portions of one or more menus in the image of the BIOS interface.

7. The method according to claim 6 , wherein the machine learning algorithm comprises at least one neural network.

8. The method according to claim 1 , wherein performing image identification on the BIOS interface of the test machine comprises:

acquiring an image of the BIOS interface from the test machine; and

recognizing at least portions of one or more menus in the image of the BIOS interface.

9. An electronic device, comprising:

a processing unit; and a memory coupled to the processing unit and comprising instructions stored thereon, wherein when executed by the processing unit, the instructions cause the device to perform actions, the actions comprising:

acquiring a target attribute of a target menu of a basic input output system (BIOS) of a test machine;

determining a path to the target menu based on a menu map of the BIOS, wherein the menu map is obtained by performing image identification on a BIOS interface of the test machine; and

causing the BIOS of the test machine to enter the target menu based on the path so as to modify the attribute of the target menu into the target attribute.

10. The electronic device according to claim 9 , wherein the path to the target menu is the shortest path.

11. The electronic device according to claim 9 , wherein causing the BIOS of the test machine to enter the target menu comprises:

sending, through a serial port, an instruction corresponding to the path so as to enter the target menu.

12. The electronic device according to claim 9 , wherein the menu map is determined by iteratively performing the following operations:

sending instructions to the test machine so as to enter the BIOS interface of the test machine, the BIOS interface corresponding to a main interface of the BIOS or a sub-interface associated with a corresponding menu;

acquiring an image of the BIOS interface from the test machine; and

determining menus in the BIOS interface by identifying the image of the BIOS interface.

13. The electronic device according to claim 9 , wherein the image identification comprises:

dividing an image of the BIOS interface into grids;

obtaining a binarized representation of the image based on whether there is a character in a grid; and

determining menus in the BIOS interface based on the binarized representation of the image.

14. A computer-readable storage medium having machine-executable instructions stored thereon, wherein when executed by at least one processor, the machine-executable instructions cause the at least one processor to implement a method for testing a basic input output system (BIOS) of a test machine, comprising:

acquiring a target attribute of a target menu of the BIOS of the test machine;

determining a path to the target menu based on a menu map of the BIOS, wherein the menu map is obtained by performing image identification on a BIOS interface of the test machine; and

causing the BIOS of the test machine to enter the target menu based on the path so as to modify the attribute of the target menu into the target attribute.

15. The computer-readable storage medium according to claim 14 , wherein the path to the target menu is the shortest path.

16. The computer-readable storage medium according to claim 14 , wherein causing the BIOS of the test machine to enter the target menu comprises:

sending, through a serial port, an instruction corresponding to the path so as to enter the target menu.

17. The computer-readable storage medium according to claim 14 , wherein the menu map is determined by iteratively performing the following operations:

sending instructions to the test machine so as to enter the BIOS interface of the test machine, the BIOS interface corresponding to a main interface of the BIOS or a sub-interface associated with a corresponding menu;

acquiring an image of the BIOS interface from the test machine; and

determining menus in the BIOS interface by identifying the image of the BIOS interface.

18. The computer-readable storage medium according to claim 14 , wherein the image identification comprises:

dividing an image of the BIOS interface into grids;

obtaining a binarized representation of the image based on whether there is a character in a grid; and

determining menus in the BIOS interface based on the binarized representation of the image.

19. The computer-readable storage medium according to claim 14 , wherein the menu map is determined at least in part by applying a machine learning algorithm to an image of the BIOS interface to recognize at least portions of one or more menus in the image of the BIOS interface.

20. The computer-readable storage medium according to claim 19 , wherein the machine learning algorithm comprises at least one neural network.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: WU, HESHI; XIA, GUOWU; FENG, ZHI; SHU, XIAOXIA
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 052168/0910 →