Granted Patent B2

US 12,455,711 · App. 18/752,107 · Granted Oct 28, 2025

Inventors: Takumi Tsuchiya (Kanagawa, JP); Minoru Sakaida (Kanagawa, JP); Tsuyoshi Mima (Kanagawa, JP)

Assignee: Canon Kabushiki Kaisha

G06F3/14G06V10/24G06V40/28

Abstract

Claims (46)

1. An information processing device that is capable of causing a user to visually recognize a real space via a display, the information processing device comprising at least one processor capable of causing the information processing device to:

perform recognizing processing to recognize a particular hand gesture performed by the user,

perform display control processing to 1) display a first frame in accordance with the particular hand gesture on the display, and 2) continue displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized after the first frame is displayed, and

in a state where the first frame is displayed on the display, execute particular processing with regard to a range of the real space indicated by the first frame out of the real space,

wherein the display is included in a display device worn on a head of the user, and

wherein in the display control processing, in a state where the first frame is displayed, the first frame continues to be displayed such that the user perceives the first frame to be moving in the real space in accordance with change in orientation of the head.

2. The information processing device according to claim 1 , wherein the particular processing is processing of shooting the range of the real space indicated by the first frame.

3. The information processing device according to claim 1 , wherein in display control processing, a position, an orientation, and a shape of the first frame are edited, in accordance with an instruction from the user.

4. The information processing device according to claim 1 , wherein in the display control processing, in the state where the first frame is displayed, 1) the first frame continues to be displayed until a particular condition is satisfied, and 2) the first frame is hidden in a case where the particular condition is satisfied.

5. The information processing device according to claim 4 , wherein the particular condition being satisfied is for a particular instruction to be given by the user operating an operating member.

6. The information processing device according to claim 4 , wherein the particular condition being satisfied is for a particular instruction to be given by voice uttered by the user.

7. The information processing device according to claim 4 , wherein the particular condition being satisfied is for a particular instruction to be given by a hand gesture of the user.

8. The information processing device according to claim 4 , wherein the particular condition being satisfied is for a certain amount of time to elapse after display of the first frame is started.

9. The information processing device according to claim 1 , wherein in the display control processing, in a case where the particular hand gesture is recognized, the first frame is displayed at a position on the display corresponding to a position of the particular hand gesture that is recognized.

10. The information processing device according to claim 1 , wherein in the display control processing, in a case where the particular hand gesture is recognized, the first frame is displayed at a position determined by a method selected from a plurality of methods.

11. The information processing device according to claim 10 , wherein the plurality of methods include a method of displaying the first frame at a position that the user is viewing on the display.

12. The information processing device according to claim 10 , wherein the plurality of methods include a method of displaying the first frame at a position at a center of the display.

13. The information processing device according to claim 10 , wherein the plurality of methods include a method of displaying the first frame at a position that shows a particular subject in a field-of-view region of the user.

14. An information processing device that is capable of causing a user to visually recognize a real space via a display, the information processing device comprising at least one processor capable of causing the information processing device to:

perform recognizing processing to recognize a particular hand gesture performed by the user,

perform display control processing to 1) display a first frame in accordance with the particular hand gesture on the display, and 2) continue displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized after the first frame is displayed, and

in a state where the first frame is displayed on the display, execute particular processing with regard to a range of the real space indicated by the first frame out of the real space,

wherein, in the recognizing processing, the particular hand gestures performed a plurality of times by the user are recognized,

wherein, in the display control processing, a plurality of frames in accordance with the plurality of times of the particular hand gesture continue to be displayed on the display, for at least the predetermined amount of time after the plurality of times of the particular hand gesture are recognized, and

wherein, after the first frame is selected from out of the plurality of frames, the particular processing is executed with regard to the range of the real space indicated by the first frame out of the real space, in the state where the first frame is displayed on the display.

15. The information processing device according to claim 14 , wherein a parameter relating to the particular processing is determined, on a basis of the plurality of frames.

16. The information processing device according to claim 14 , wherein in the display control processing,

in a state where the first frame is displayed, the first frame continues to be displayed such that the user perceives the first frame to be fixed at a same position in the real space.

17. An information processing device that is capable of causing a user to visually recognize a real space via a display, the information processing device comprising at least one processor capable of causing the information processing device to

perform recognizing processing to recognize a particular hand gesture performed by the user,

perform display control processing to 1) display a first frame in accordance with the particular hand gesture on the display, and 2) continue displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized after the first frame is displayed, and

in a state where the first frame is displayed on the display, execute particular processing with regard to a range of the real space indicated by the first frame out of the real space,

wherein, in the display control processing, in a case where the particular hand gesture is recognized, the first frame is displayed at a position determined by a method selected from a plurality of methods, and

wherein the plurality of methods include a method of displaying the first frame at a position on the display that corresponds to a position in a direction of an angle, set in advance, from a position of the particular hand gesture.

18. An information processing method that is capable of causing a user to visually recognize a real space via a display, the information processing method comprising:

recognizing a particular hand gesture performed by the user;

performing display control of 1) displaying a first frame in accordance with the particular hand gesture on the display, and 2) continuing displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized in the recognizing after the first frame is displayed; and

performing processing of, in a state where the first frame is displayed on the display, executing particular processing with regard to a range of the real space indicated by the first frame out of the real space,

wherein the display is included in a display device worn on a head of the user, and

wherein, in the performing display control, in a state where the first frame is displayed, the first frame continues to be displayed such that the user perceives the first frame to be moving in the real space in accordance with change in orientation of the head.

19. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute an information processing method that is capable of causing a user to visually recognize a real space via a display, the information processing method comprising:

recognizing a particular hand gesture performed by the user;

performing display control of 1) displaying a first frame in accordance with the particular hand gesture on the display, and 2) continuing displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized in the recognizing after the first frame is displayed; and

performing processing of, in a state where the first frame is on the display, executing particular processing with regard to a range of the real space indicated by the first frame out of the real space,

wherein the display is included in a display device worn on a head of the user, and

wherein, in the performing display control, in a state where the first frame is displayed, the first frame continues to be displayed such that the user perceives the first frame to be moving in the real space in accordance with change in orientation of the head.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (10)