Method and apparatus for tracking position of capsule endoscope
View Patent ↗Provided is a method for tracking a position of a capsule endoscope including: receiving, by an apparatus for tracking a position of a capsule endoscope, an image captured by the capsule endoscope; distinguishing, by the apparatus for tracking a position of a capsule endoscope, a gastrointestinal tract junction from the image using a machine-learned classification model based on the gastrointestinal tract junctions; and tracking, by the apparatus for tracking a position of a capsule endoscope, the position of the capsule endoscope based on the distinguished gastrointestinal tract junctions.
1. A method for tracking a position of a capsule endoscope, the method comprising:
performing, by a communication unit included in an apparatus for tracking the position of the capsule endoscope, communication with the capsule endoscope from when the capsule endoscope is inserted through an oral cavity of a testee;
receiving, by the communication unit, a current image captured by the capsule endoscope;
obtaining, by an image analyzing unit included in the apparatus, a transition time from a metadata of the current image received by the communication unit;
determining, by the image analyzing unit, whether the current image corresponds to a gastrointestinal tract junction of the testee by applying the current image to a classification model which is a model learned by using a machine-learning algorithm based on images for gastrointestinal tract junctions received from a plurality of terminals;
determining, by the image analyzing unit, a position of the capsule endoscope based on the obtained transition time and whether the current image corresponds to the gastrointestinal tract junction;
determining, by an image information providing unit included in the apparatus, a retention of the capsule endoscope based on the obtained transition time and the determined position of the capsule endoscope; and
providing, by the image information providing unit, an alarm when it is determined that the capsule endoscope is retained,
wherein the determining of the retention of the capsule endoscope includes determining that the capsule endoscope is retained when the obtained transition time exceeds a predetermined threshold time for a gastrointestinal tract of the testee based on the determined position of the capsule endoscope, and
wherein the metadata stores a capturing time of the current image from when the capsule endoscope is inserted through the oral cavity of the testee.
2. The method for tracking the position of the capsule endoscope of claim 1 , wherein the determining of the retention of the capsule endoscope includes personalizing the threshold time for the gastrointestinal tract of the testee based on one or more of gender, age, height, and weight of the testee using the capsule endoscope.
3. The method for tracking the position of the capsule endoscope of claim 1 , where the gastrointestinal tract junction of the testee is one of a plurality of gastrointestinal tract junctions of the testee,
wherein the plurality of gastrointestinal tract junctions of the testee include a Z-line, a pyloric valve and an ileocecal valve, and
wherein the determining of the position of the capsule endoscope includes determining the position of the capsule endoscope as an esophagus of the testee before the Z-line is distinguished from the current image.
4. The method for tracking the position of the capsule endoscope of claim 1 , where the gastrointestinal tract junction of the testee is one of a plurality of gastrointestinal tract junctions of the testee,
wherein the plurality of gastrointestinal tract junctions of the testee include a Z-line, a pyloric valve and an ileocecal valve, and
wherein the determining of the position of the capsule endoscope includes determining the position of the capsule endoscope as a stomach of the testee before the pyloric valve is distinguished from the current image and after the Z-line is distinguished from the current image.
5. The method for tracking the position of the capsule endoscope of claim 1 , where the gastrointestinal tract junction of the testee is one of a plurality of gastrointestinal tract junctions of the testee,
wherein the plurality of gastrointestinal tract junctions of the testee include a Z-line, a pyloric valve and an ileocecal valve, and
wherein the determining of the position of the capsule endoscope includes determining the position of the capsule endoscope as a small intestine of the testee before the ileocecal valve is distinguished from the current image and after the pyloric valve is distinguished from the current image.
6. The method for tracking the position of the capsule endoscope of claim 1 , where the gastrointestinal tract junction of the testee is one of a plurality of gastrointestinal tract junctions of the testee,
wherein the plurality of gastrointestinal tract junctions of the testee include a Z-line, a pyloric valve and an ileocecal valve, and
wherein the determining of the position of the capsule endoscope includes determining the position of the capsule endoscope as a large intestine of the testee after the ileocecal valve is distinguished from the current image.
7. An apparatus for tracking a position of a capsule endoscope, the apparatus comprising:
a communication unit configured to perform communication with the capsule endoscope from when the capsule endoscope is inserted through an oral cavity of a testee and receive a current image captured by the capsule endoscope;
an image analyzing unit configured to obtain a transition time from a metadata of the current image received by the communication unit, determine whether the current image corresponds to a gastrointestinal tract junction of the testee by applying the current image to a classification model which is a model learned by using a machine-learning algorithm based on images for gastrointestinal tract junctions received from a plurality of terminals, determine a position of the capsule endoscope based on the obtained transition time and whether the current image corresponds to the gastrointestinal tract junction of the testee; and
an image information providing unit configured to determine a retention of the capsule endoscope based on the obtained transition time and the determined position of the capsule endoscope and provide an alarm when it is determined that the capsule endoscope is retained,
wherein the image analyzing unit determines that the capsule endoscope is retained when the obtained transition time exceeds a predetermined threshold time for a gastrointestinal tract of the testee based on the determined position of the capsule endoscope, and
wherein the metadata stores a capturing time of the current image from when the capsule endoscope is inserted through the oral cavity of the testee.