Method and system for transforming adaptively visual contents according to terminal user's color vision characteristics
View Patent ↗Disclosed are a method and a system that adaptively transform visual contents inputted from a network, in accordance with the visual characteristics of a terminal user. A visual characteristics descriptor that describes the information of the user visual characteristics in a predetermined format is proposed. The descriptor includes the information of the color vision deficiency type and the color vision deficiency degree. The color vision deficiency may be described in numerical degree or textual degree. The invention adaptively transforms visual contents differently in accordance with the color vision deficiency type.
1. A processor having program instructions stored in a memory therein which cause the processor to operate as a specially programmed processor executing a method for adaptively transforming visual contents to be suitable for color vision characteristics of a user comprising:
receiving information on color vision characteristics of the user in the processor; and
transforming adaptively in the specially programmed processor the visual contents in accordance with the information on color vision characteristics,
wherein the information on color vision characteristics includes descriptions as to color vision deficiency type and color vision deficiency degree of the user; and
wherein the color vision deficiency degree is represented in a numerical or in a textual description.
2. The method according to claim 1 , further comprising:
receiving information on the user environment,
wherein the adaptive transforming is executed in accordance with the information on color vision characteristics and the user environment.
3. The method according to claim 2 , wherein the user environment is described with the illumination of the surrounding of the user.
4. The method according to claim 1 , wherein the color vision deficiency degree is described numerically or textually, and the color vision deficiency degree is described with a normalized numerical value when numerically described.
5. The method according to claim 1 , wherein the adaptive transforming is executed by distinguishing between a dichromat and an anomalous trichromat according to the color vision deficiency degree, and approaching the dichromat and the anomalous trichromat differently.
6. The method according to claim 5 , wherein the adaptive transforming for a dichromat is executed by the steps of:
differentiating a deficiency region which is difficult for the user to detect, from the visual contents according to the color vision deficiency type; and
adjusting at least one of hue, saturation and intensity of pixels in the deficiency region.
7. The method according to claim 6 , wherein the differentiating of the deficiency region is executed by transforming the visual contents from RGB color space to CMYK color space, and discriminating pixels in the deficiency region by using the values of cyan, magenta, and yellow in accordance with the color vision deficiency type.
8. The method according to claim 6 , wherein the differentiating of the deficiency region is executed by transforming the visual contents from RGB color space to LMS color space, transforming the transformed visual contents with LMS response function of the user, which is determined with the color vision deficiency type and the color vision deficiency degree, and measuring the degree of decrease of the respective LMS values.
9. The method according to claim 6 , wherein the adjusting is executed by changing the hue and the saturation of the pixels in the deficiency region.
10. The method according to claim 5 , wherein the adaptive transforming for an anomalous trichromat is executed by the steps of:
transforming the visual contents from RGB color space to LMS color space;
transforming the visual contents in LMS color space with an LMS response function of the user, which is determined with the color vision deficiency type and the color vision deficiency degree; and
transforming again the transformed visual contents from LMS color space to RGB color space.
11. A processor having program instructions stored in a memory therein which cause the processor to operate as a specially programmed processor executing a method for adaptively transforming visual contents to be suitable for the color vision characteristics of a user of an image display device, the method comprising the steps of:
receiving information on the color vision characteristics of the user in the processor;
receiving visual contents in the processor;
transforming adaptively in the specially programmed processor the visual contents in accordance with the information on the color vision characteristics; and
displaying the transformed visual contents through the image display device;
wherein the information on the color vision characteristics contains descriptions as to the color vision deficiency type and the color vision deficiency degree of the user; and
wherein the color vision deficiency degree is represented in a numerical or in a textual description.
12. The method according to claim 11 , wherein the information on the color vision characteristics contains descriptions as to the color vision deficiency type and the color vision deficiency degree of the user.
13. The method according to claim 12 , wherein the color vision deficiency degree is described numerically or textually, and the color vision deficiency degree is described by a normalized numerical value when numerically described.
14. The method according to claim 12 , wherein the numerical description of the color vision deficiency degree is determined in accordance with the shift or the intensity decrease of a response function of the user's cone cells.
15. The method according to claim 12 , wherein the numerical description of the color vision deficiency degree is determined by using the total error score obtained from the Famsworth-Munsell hue test for the user.
16. The method according to claim 12 , wherein the numerical description for the color vision deficiency degree is determined by using the area of the red/green ratio section in a mixture field that is recognized by the user as identical to a test field after anomaloscope testing for the user.
17. The method according to claim 11 , wherein the numerical description for the color vision deficiency degree is determined by the following equation:
{
w
Z
×
(
α
α
max
)
+
w
I
×
(
β
β
max
)
}
/
(
w
Z
max
+
w
I
max
)
wherein α is the shift value of the user's cone cells, α max is the maximum shift value of the user's cone cells, β is the intensity decrease value of the user's cone cells, β max is the maximum intensity decrease value of the user's cone cells, ω z is a weighting value for the shift value, ω I is the weighting value for the intensity decrease value, ω z max is the maximum value of ω z , and ω I max is the maximum value of ω I .
18. The method according to claim 11 , wherein the numerical description of the color vision deficiency degree is determined by the following equation:
{
⌊
E
-
E
min
E
max
-
E
min
⌋
,
E
min
<
E
<
E
max
1.0
,
E
≥
th
max
wherein E is the total error score of the user, E min is the minimum threshold value where the user is determined as an anomalous trichromat, and E max is the maximum threshold value where the user is determined as an anomalous trichromat.
19. The method according to claim 11 , wherein the numerical description for the color vision deficiency degree is determined by the following equation:
{
⌊
R
d
R
th
⌋
,
R
d
≤
R
th
1.0
,
R
d
>
R
th
,
Here
,
R
d
=
R
max
-
R
min
,
R
th
=
{
R
min
normal
,
green
color
vision
deficiency
73
-
R
max
normal
,
red
color
vision
deficiency
wherein R d is the range of a red/green ratio section in a mixture field that is recognized by the user as identical to the test field, R normal min and R normal max are the minimum and maximum values of the range of the red/green ratio section of a normal human, and R th is the minimum threshold value of R d where the user is determined as an anomalous trichromat.
20. The method according to claim 11 , wherein the information on the color vision characteristics further comprises identification information on the user.
21. The method according to claim 11 , further comprising the step of receiving information on the user's environment, wherein the visual contents are transformed in accordance with the information on the color vision characteristics and the user's environment.
22. The method according to claim 21 , wherein the information on the user's environment comprises description as to the illumination of the user's surroundings.
23. A system for adaptively transforming visual contents to be suitable for the color vision characteristics of a user of an image display device, the system comprising:
means for receiving information on the color vision characteristics of the user;
means for receiving visual contents; and
a processing section for adaptively transforming the received visual contents in accordance with the information on the color vision characteristics of the user;
wherein the information on the color vision characteristics contains descriptions as to the color vision deficiency type and the color vision deficiency degree of the user, and the color vision deficiency degree is represented in a numerical or a textual description.
24. The system according to claim 23 , further comprising:
means for storing the information on the color vision characteristics and supplying the information on the color vision characteristics to the processing section in a standardized XML specification.
25. The system according to claim 23 , wherein the information on the color vision characteristics contains descriptions as to the color vision deficiency type and the color vision deficiency degree of the user, and the color vision deficiency degree is described numerically or textually, and the color vision deficiency degree is described with a normalized numerical value when numerically described.
26. The system according to claim 23 , wherein the numerical description for the color vision deficiency degree is determined by the following equation:
{
w
Z
×
(
α
α
max
)
+
w
I
×
(
β
β
max
)
}
/
(
w
Z
max
+
w
I
max
)
wherein α is the shift value of the user's cone cells, α max is the maximum shift value of the user's cone cells, β is the intensity decrease value of the user's cone cells, β max is the maximum intensity decrease value of the user's cone cells, ω z is a weighting value for the shift value, ω I is the weighting value for the intensity decrease value, ω z max is the maximum value of ω z , and ω I max is the maximum value of ω I .
27. The system according to claim 23 , wherein the numerical description of the color vision deficiency degree is determined by the following equation:
{
⌊
E
-
E
min
E
max
-
E
min
⌋
,
E
min
<
E
<
E
max
1.0
,
E
≥
th
max
wherein E is the total error score of the user, E min is the minimum threshold value where the user is determined as an anomalous trichromat, and E max is the maximum threshold value where the user is determined as an anomalous trichromat.
28. The system according to claim 23 , wherein the numerical description for the color vision deficiency degree is determined by the following equation:
{
⌊
R
d
R
th
⌋
,
R
d
≤
R
th
1.0
,
R
d
>
R
th
,
Here
,
R
d
=
R
max
-
R
min
,
R
th
=
{
R
min
normal
,
green
color
vision
deficiency
73
-
R
max
normal
,
red
color
vision
deficiency
wherein R d is the range of a red/green ratio section in a mixture field that is recognized by the user as identical to the test field, R normal min and R normal max are the minimum and maximum values of the range of the red/green ratio section of a normal human, and R th is the minimum threshold value of R d where the user is determined as an anomalous trichromat.
29. The system according to claim 23 , wherein the processing section executes adaptive transforming for dichromat on the received visual contents in accordance with the color vision deficiency type if the user is determined to be a dichromat from the information on the color vision deficiency degree, and executes adaptation for anomalous trichromat on the received visual contents in accordance with the color vision deficiency type if the user is determined to be an anomalous trichromat from the information on the color vision deficiency degree.
30. A system according to claim 29 , wherein the adaptive transforming for dichromat is executed by differentiating a deficiency region, which is difficult for the user to detect, from the visual contents in accordance with the color vision deficiency type; and transforming at least one of hue, saturation and intensity of pixels in the deficiency region.
31. A system according to claim 30 , wherein the differentiating of the deficiency region is executed by transforming the visual contents from RCB color space to CMYK color space, and discriminating pixels corresponding to a predetermined region in the CYMK color space in accordance with the color vision deficiency type.
32. A system according to claim 30 , wherein the differentiating of the deficiency region is executed by transforming the visual contents from RCB color space to CMYK color space, and measuring the degree of decrease of the respective LMS values during the process of transforming the transformed visual contents with a LMS response function of the user, in which the response function is determined in accordance with the color vision deficiency type and the color vision deficiency degree.
33. A system according to claim 29 , wherein the adaptive transforming for dichromat is executed by determining the color vision deficiency region and the color vision deficiency degree of the user at the same time by using a CMY ration of the visual contents.
34. A system according to claim 23 , wherein the adaptive transforming for anomalous trichromat is executed by transforming the visual contents from RGB color space to LMS color space, transforming the visual contents in LMS color space by using the inverse function of an LMS response function of the user, in which the LMS response function is determined in accordance with the color vision deficiency type and the color vision deficiency degree, and transforming again the transformed visual contents from LMS color space to RGB color space.