Granted Patent B2

US 12,223,715 · App. 17/826,173 · Granted Feb 11, 2025

Inventor: Sheng-Yang Pan (Taoyuan, TW)

Assignee: HTC Corporation

G06V20/20G06T7/70G06V10/761G06V40/10H04N7/183G06T2207/30196

Abstract

Claims (53)

1. An accessory pairing method, comprising:

determining a type of the accessory based on the identifying information of an accessory;

recognizing a type of a user body part according to an image;

in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment;

configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part;

defining a candidate area of the user body part corresponding to a user in the image;

defining a first reference point to indicate a first location of the user body part within the environment based on the candidate area;

defining a second reference point to indicate a second location of the accessory within the environment; and

wherein the configuring the accessory to pair the user body part further comprising:

comparing a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point.

2. The method according to claim 1 , wherein the step of determining the type of the accessory based on the identifying information comprises:

obtaining an accessory type information from the identifying information of the accessory, wherein the accessory type information indicates a function of the accessory; and

determining the type of the accessory based on the accessory type information.

3. The method according to claim 1 , wherein the step of recognizing the type of the user body part in the image comprises:

performing an image recognition on the image to recognize the type of the user body part in the image.

4. The method according to claim 1 , further comprises:

converting coordinates of the reference point in the image into the location of the user body part within the environment.

5. The method according to claim 1 , wherein the first position of the accessory comprises at least one of a location of the accessory and an orientation of the accessory, and the second position of the user body part comprises at least one of a location of the user body part and an orientation of the user body part.

6. The method according to claim 5 , wherein after the step of obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, further comprises:

calculating a distance between the location of the accessory and the location of the user body part.

7. The method according to claim 5 , wherein after the step of obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, further comprises:

calculating a relative angle between the orientation of the accessory and the orientation of the user body part between the accessory and the user body part.

8. A display system for accessory pairing, comprising:

a head-mounted display (HMD);

at least one accessory; and

a computing device, coupled to the HMD and the accessory,

wherein the computing device is configured to determine a type of the accessory based on the identifying information of the accessory,

the computing device is configured to recognize a type of a user body part according to an image,

in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, the computing device is configured to obtain a first position of the accessory within an environment and obtaining a second position of the user body part within the environment, and

the computing device is configured to:

configure the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part,

define a candidate area of the user body part corresponding to a user in the image,

define a first reference point to indicate a first location of the user body part within the environment based on the candidate area,

define a second reference point to indicate a second location of the accessory within the environment, and

compare a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point.

9. The display system according to claim 8 , wherein the computing device is configured to obtain an accessory type information from the identifying information of the accessory, wherein the accessory type information indicates a function of the accessory, and

the computing device is configured to determine the type of the accessory based on the accessory type information.

10. The display system according to claim 8 , wherein the computing device is configured to perform an image recognition on the image to recognize the type of the user body part in the image.

11. The display system according to claim 8 , wherein the computing device is configured to convert coordinates of the reference point in the image into the location of the user body part within the environment.

12. The display system according to claim 8 , wherein the display system further comprises an image capturing device, coupled to the computing device, wherein the image capturing is configured to capture the image and transmit the image to the computing device.

13. The display system according to claim 8 , wherein the first position of the accessory comprises at least one of a location of the accessory and an orientation of the accessory, and the second position of the user body part comprises at least one of a location of the user body part and an orientation of the user body part.

14. The display system according to claim 13 , wherein after obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, the computing device is further configured to calculate a distance between the location of the accessory and the location of the user body part.

15. The display system according to claim 13 , wherein after obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, the computing device is further configured to calculate a relative angle between the orientation of the accessory and the orientation of the user body part between the accessory and the user body part.

16. A non-transitory computer-readable recording medium, configured to record a program, wherein the program is loaded by a processor in a computing device to execute following steps:

determining a type of the accessory based on the identifying information of an accessory;

recognizing a type of a user body part according to an image;

in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment;

configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part;

defining a candidate area of the user body part corresponding to a user in the image;

defining a first reference point to indicate a first location of the user body part within the environment based on the candidate area;

defining a second reference point to indicate a second location of the accessory within the environment; and

wherein the configuring the accessory to pair the user body part further comprising:

comparing a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point.

Assignments (1)

Continuity (2)

References Cited (17)