Apparatus and method for moderating a skin lesion detection model
According to an aspect, there is provided an apparatus ( 10 ) for moderating a skin lesion detection model ( 30 ). The apparatus ( 10 ) comprising a processor ( 12 ) and a memory ( 11 ). The processor ( 12 ) is configured to: receive user data ( 13 ) associated with a user; receive an output of the skin lesion detection model ( 14 ); modify the output of the skin lesion detection model ( 14 ) in accordance with the user data ( 13 ) to provide a modified output ( 15 ) indicative of skin lesion detection for the user; and output the modified output ( 15 ).
1 . An apparatus for moderating detection results output by a skin lesion detection model, configured to detect one or more skin lesions in image data of the user, the apparatus comprising a processor and a memory, the processor configured to:
receive user data associated with a user, wherein the user data comprises a location of a known skin feature or attention area of the user prone to said one or more skin lesions, and wherein said known skin feature is of a type different from said one or more skin lesions;
receive detection results output by the skin lesion detection model, wherein
the detection results output by the skin lesion detection model comprises a location of a detected skin lesion;
modify the detection results output by the skin lesion detection model in accordance with the user data to provide a modified output indicative of skin lesion detection for the user by:
comparing the location of the detected skin lesion with the location of the known skin feature or attention area of the user to determine whether the location of the detected skin lesion corresponds to the location of the known skin feature or attention area of the user; and
excluding the detected skin lesion from the modified output in response to the location of the detected skin lesion corresponding to the location of the known skin feature of the user; or
reflecting that the detected skin lesion is within the location of the attention area of the user in response to the location of the detected skin lesion corresponding to the location of the attention area of the user; and
output the modified output for a display, such that the modified detection results are provided to the user in an image of the user so that the user can see the location(s) of the detected one or more skin lesions of the modified detection results.
2 . The apparatus of claim 1 , wherein the user data further comprises one or more of:
a known skin feature of the user
a known skin lesion of the user;
an attention area of the user; and
a preference of a type of skin lesion of the user.
3 . The apparatus of claim 1 , wherein the output of the skin lesion detection model comprises a location of a detected skin lesion and a probability score associated with the detected skin lesion.
4 . The apparatus of claim 3 , wherein the modified output comprises one or more detected skin lesions and an accompanying detection score of each of the detected skin lesions.
5 . The apparatus of claim 1 , wherein the processor is configured to store the received user data in a memory device.
6 . The apparatus of claim 1 , wherein
the output of the skin lesion detection model comprises a probability score of a detected skin lesion; and
the processor is configured to modify the output of the skin lesion detection model by weighting the probability score in accordance with the user data to provide a modified probability score in the modified output.
7 . The apparatus of claim 6 , wherein the processor is configured to:
determine whether the modified probability score exceeds a predetermined threshold;
generate an alert in response to the modified probability score exceeding the predetermined threshold; and
output the alert.
8 . The apparatus of claim 1 , wherein the user data is received from one or more of:
a memory device;
a user device associated with the user and communicably connected to the apparatus;
a user interface of the apparatus;
an imaging device communicably connected to the apparatus; and
an audio input of the apparatus.
9 . The apparatus of claim 1 , wherein the processor) is configured to:
acquire an image of the user;
receive input information from the user; and
extract the user data from the image of the user in accordance with the input information received from the user.
10 . A method of moderating detection results output by a skin lesion detection model configured to detect one or more skin lesions in image data of the user, the method comprising:
receiving user data associated with a user, wherein the user data comprises a location of a known skin feature or attention area of the user prone to said one or more skin lesions, and wherein said known skin feature is of a type different from said one or more skin lesions;
receiving detection results output by the skin lesion detection model, wherein
the detection results output by the skin lesion detection model comprises a location of a detected skin lesion;
modifying the detection results output by the skin lesion detection model in accordance with the user data to provide a modified output indicative of skin lesion detection for the user by;
comparing the location of the detected skin lesion with the location of the known skin feature or attention area of the user to determine whether the location of the detected skin lesion corresponds to the location of the known skin feature or attention area of the user; and
excluding the detected skin lesion from the modified output in response to the location of the detected skin lesion corresponding to the location of the known skin feature of the user; or
reflecting that the detected skin lesion is within the location of the attention area of the user in response to the location of the detected skin lesion corresponding to the location of the attention area of the user; and
outputting the modified output for a display, such that the modified detection results are provided to the user in an image of the user so that the user can see the location(s) of the detected one or more skin lesions of the modified detection results.
11 . A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the processors to perform a method of moderating detection results output by a skin lesion detection model configured to detect one or more skin lesions in image data of a user, the method comprising:
receiving user data associated with the user, wherein the user data comprises a location of a known skin feature or attention area of the user prone to said one or more skin lesions, and wherein said known skin feature is of a type different from said one or more skin lesions;
receiving detection results output by the skin lesion detection model, wherein the detection results output by the skin lesion detection model comprises a location of a detected skin lesion;
modifying the detection results output by the skin lesion detection model in accordance with the user data to provide a modified output indicative of skin lesion detection for the user by;
comparing the location of the detected skin lesion with the location of the known skin feature or attention area of the user to determine whether the location of the detected skin lesion corresponds to the location of the known skin feature or attention area of the user; and
excluding the detailed skin lesion from the modified output in response to the location of the detected skin lesion corresponding to the location of the known skin feature of the user; or
reflecting that the detected skin lesion is within the location of the attention area of the user in response to the location of the detected skin lesion corresponding to the location of the attention area of the user; and
outputting the modified output for a display, such that the modified detection results are provided to the user in an image of the user so that the user can see the location(s) of the detected one or more skin lesions of the modified detection results.