Method and apparatus for determining wearing state of eye-wearable device
View Patent ↗The embodiments of the present disclosure provide a method and apparatus for determining a wearing state of an eye-wearable device. The eye-wearable device is provided with an image acquisition device, and the image acquisition device is arranged so as to be opposite to the eyes of a user when the eye-wearable device is being worn. The method includes: acquiring an image captured by the image acquisition device; and determining the wearing state of the eye-wearable device according to the image.
1 . A method for determining a wearing state of an eye-wearable device, wherein the eye-wearable device is provided with an image acquisition device, and the image acquisition device is configured to be opposite to eyes of a user when the eye-wearable device is worn,
the method comprising:
acquiring an image captured by the image acquisition device, wherein the image comprises a first image recently captured by the image acquisition device and a second image captured by the image acquisition device before capturing the first image; and
determining the wearing state of the eye-wearable device according to the image, wherein the determining of the wearing state comprises:
determining whether the eye-wearable device is in a moving state based on an image content difference between the first image and the second image; and
in response to determining that the eye-wearable device is in the moving state, outputting information prompting the user to wear the eye-wearable device.
2 . The method according to claim 1 , wherein the eye-wearable device is further provided with a supplementary light source, and the supplementary light source is configured to supplement light for an image capturing area of the image acquisition device.
3 . The method according to claim 2 , wherein one supplementary light source is provided, and a distance between the supplementary light source and the image acquisition device does not exceed a preset first distance.
4 . The method according to claim 1 , wherein
one image acquisition device is provided, and the image acquisition device is configured to be opposite to a left eye or a right eye of the user when the eye-wearable device is worn; or
at least two image acquisition devices are provided, and the at least two image acquisition devices are configured such that at least one of the at least two image acquisition devices is opposite to the left eye of the user and/or at least one of the at least two image acquisition devices is opposite to the right eye of the user when the eye-wearable device is worn.
5 . The method according to claim 1 , further comprising:
in response to determining that the eye-wearable device is in a non-moving state, determining whether the eye-wearable device is worn on the eyes based on the first image.
6 . The method according to claim 5 , wherein determining whether the eye-wearable device is worn on the eyes based on the first image comprises:
inputting the first image into a state classification model to determine a current state category of the eye-wearable device, wherein the current state category represents whether the eye-wearable device is worn on the eyes, and the state classification model is a model trained in advance based on sample images and corresponding state category labels.
7 . The method according to claim 6 , further comprising:
in response to the current state category indicating that the eye-wearable device is not worn on a face, outputting information which instructs to control the eye-wearable device to be in a standby state;
in response to the current state category indicating that the eye-wearable device is worn on the face but not on the eyes, outputting information which instructs the user to wear the eye-wearable device at a preset accurate wearing position.
8 . The method according to claim 6 , further comprising:
in response to the current state category indicating that the eye-wearable device is worn on the eyes, performing position identification on human eyes in the first image to obtain a current eye position of the included human eyes;
acquiring a preset standard eye position corresponding to the eye-wearable device, wherein the standard eye position is determined based on a condition that the eye-wearable device is at a preset accurate wearing position;
determining whether a wearing position of the eye-wearable device is accurate based on the current eye position and the standard eye position.
9 . The method according to claim 8 , wherein performing position identification on human eyes in the first image to obtain the current eye position of the included human eyes, comprising:
performing position identification on human eyes in the first image to determine key point positions of a plurality of eye key points corresponding to the included human eyes; and
determining the current eye position based on the key point positions.
10 . The method according to claim 8 , wherein the determining whether the wearing position of the eye-wearable device is accurate comprises:
in response to determining that a distance between the standard eye position and the current eye position in any specified direction exceeds a preset second distance in the specified direction, it is determined that the wearing position of the eye-wearable device is inaccurate;
in response to determining that the distance between the standard eye position and the current eye position in each specified direction does not exceed the second distance in the specified direction, it is determined that the wearing position of the eye-wearable device is accurate.
11 . The method according to claim 8 , wherein the current eye position comprises a current left-eye position and a current right-eye position; the standard eye position comprises a standard left-eye position and a standard right-eye position;
determining whether the wearing position of the eye-wearable device is accurate comprises:
in response to determining that a difference between, a distance between the current left-eye position and the standard left-eye position, and, a distance between the current right-eye position and the standard right-eye position, exceeds a preset distance difference, it is determined that the wearing position of the eye-wearable device is inaccurate.
12 . The method according to claim 1 , wherein there are a plurality of image acquisition devices and a plurality of first images;
determining the wearing state of the eye-wearable device according to the image comprises:
splicing the plurality of first images to obtain a target image; and
determining the wearing state of the eye-wearable device at least according to the target image.
13 . A non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed in a computer, causes the computer to perform a method for determining a wearing state of an eye-wearable device, wherein the eye-wearable device is provided with an image acquisition device, and the image acquisition device is configured to be opposite to eyes of a user when the eye-wearable device is worn,
the method comprising:
acquiring an image captured by the image acquisition device, wherein the image comprises a first image recently captured by the image acquisition device and a second image captured by the image acquisition device before capturing the first image; and
determining the wearing state of the eye-wearable device according to the image, wherein the determining of the wearing state comprises:
determining whether the eye-wearable device is in a moving state based on an image content difference between the first image and the second image; and
in response to determining that the eye-wearable device is in the moving state, outputting information prompting the user to wear the eye-wearable device.
14 . An eye-wearable device, comprising a memory and a processor, wherein an executable code is stored in the memory, and when the executable code is executed by the processor, a method for determining a wearing state of the eye-wearable device is realized, wherein the eye-wearable device is provided with an image acquisition device, and the image acquisition device is configured to be opposite to eyes of a user when the eye-wearable device is worn,
the method comprising:
acquiring an image captured by the image acquisition device, wherein the image comprises a first image recently captured by the image acquisition device and a second image captured by the image acquisition device before capturing the first image; and
determining the wearing state of the eye-wearable device according to the image, wherein the determining of the wearing state comprises
determining whether the eye-wearable device is in a moving state based on an image content difference between the first image and the second image; and
in response to determining that the eye-wearable device is in the moving state, outputting information prompting the user to wear the eye-wearable device.
15 . The storage medium according to claim 14 , wherein the method for determining a wearing state of an eye-wearable device further comprises:
in response to determining that the eye-wearable device is in a non-moving state, determining whether the eye-wearable device is worn on the eyes based on the first image.
16 . The storage medium according to claim 15 , wherein in the method for determining a wearing state of an eye-wearable device,
determining whether the eye-wearable device is worn on the eyes based on the first image comprises:
inputting the first image into a state classification model to determine a current state category of the eye-wearable device, wherein the current state category represents whether the eye-wearable device is worn on the eyes, and the state classification model is a model trained in advance based on sample images and corresponding state category labels.
17 . The storage medium according to claim 16 , wherein the method for determining a wearing state of an eye-wearable device further comprises:
in response to the current state category indicating that the eye-wearable device is not worn on a face, outputting information which instructs to control the eye-wearable device to be in a standby state;
in response to the current state category indicating that the eye-wearable device is worn on the face but not on the eyes, outputting information which instructs the user to wear the eye-wearable device at a preset accurate wearing position.
18 . The storage medium according to claim 16 , wherein the method for determining a wearing state of an eye-wearable device further comprises:
in response to the current state category indicating that the eye-wearable device is worn on the eyes, performing position identification on human eyes in the first image to obtain a current eye position of the included human eyes;
acquiring a preset standard eye position corresponding to the eye-wearable device, wherein the standard eye position is determined based on a condition that the eye-wearable device is at a preset accurate wearing position;
determining whether a wearing position of the eye-wearable device is accurate based on the current eye position and the standard eye position.