IP Library › Granted Patent US 10,747,370
Granted Patent B2
US 10,747,370 · App. 16/077,286 · Granted Aug 18, 2020

Information processing device, information processing method, and program for outputting a display information item about an operation object

Inventors: Osamu Shigeta (Chiba, JP); Kunihito Sawai (Kanagawa, JP); Masayuki Yamada (Tokyo, JP); Kentaro Ida (Tokyo, JP); Takuya Ikeda (Tokyo, JP); Yousuke Kawana (Tokyo, JP); Maki Imoto (Tokyo, JP); Akane Yano (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/0425G06F3/0484G06F3/0488G09G5/08G06F3/042G06F3/04812G06F3/04842G06F2203/04801G06F2203/04804G09G3/002G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,747,370
App. No.
16/077,286
Granted
Aug 18, 2020
Kind
B2
Abstract

An information processing device includes an output control unit that outputs a display information item about an operation object on the basis of a result of detection of a pointing operation with respect to the operation object by a user. The output control unit outputs the display information item about the operation object such that the operation object is displayed in at least either one of a first display mode and a second display mode different from the first display mode in accordance with an operating condition of the pointing operation.

Claims (48)

1. An information processing device, comprising

an output control unit that outputs a display information item about an operation object on a basis of a result of detection of a pointing operation with respect to the operation object by a user,

wherein the output control unit outputs the display information item about the operation object such that the operation object is displayed in at least either one of a first display mode and a second display mode different from the first display mode in accordance with an operating condition of the pointing operation,

wherein the output control unit renders, as the second display mode and on a basis of coordinate values generated by applying a predetermined stabilization filter to the detected input coordinate values, the display information item about the operation object at a position preceding a position of the detected pointing operation, and

wherein the output control unit is implemented via at least one processor.

2. The information processing device according to claim 1 , wherein

the output control unit uses, as the first display mode, a display mode that gives a priority to delay reduction with respect to the pointing operation, and uses, as the second display mode, a display mode that gives a priority to stability of the result of the detection.

3. The information processing device according to claim 1 , wherein

the output control unit switches the display information item about the operation object between the first display mode and the second display mode in accordance with the operating condition of the pointing operation.

4. The information processing device according to claim 1 , wherein

the output control unit makes, in accordance with the operating condition of the pointing operation, a switch between a process of outputting the display information item about the operation object in both the first display mode and the second display mode, and a process of outputting the display information item about the operation object in either one of the first display mode and the second display mode.

5. The information processing device according to claim 1 , wherein

the operating condition of the pointing operation includes any of a user information item about the user, a device information item about the information processing device, an environment information item about an environment where the information processing device is installed, and a content information item about a target of the pointing operation.

6. The information processing device according to claim 5 , wherein

the result of the detection includes an information item about input coordinate values of the pointing operation, and

the operation object is displayed at a position corresponding to the input coordinate values.

7. The information processing device according to claim 6 , wherein

the output control unit renders, as the first display mode, the display information item about the operation object on a basis of predictive values calculated from the detected input coordinate values.

8. The information processing device according to claim 7 , wherein

the output control unit renders, as the first display mode, the display information item about the operation object by using the predictive values and values arranged at random around the predictive values at a same time, and renders, as the second display mode, the display information item about the operation object while emphasizing the coordinate values generated by applying the stabilization filter.

9. The information processing device according to claim 8 , wherein

the output control unit renders, as the first display mode, the display information item about the operation object in a form of particles or dots, and renders, as the second display mode, the display information item about the operation object in a form of a cursor or focus.

10. The information processing device according to claim 8 , wherein

the pointing operation is an operation with a finger of the user, and

the output control unit renders, as the first display mode, the display information item about the operation object in a manner that the display information item about the operation object extends from an object as the target of the pointing operation toward the finger of the user while gradually narrowing and increasing in transparency, and renders, as the second display mode, the display information item about the operation object in a manner that the extended form contracts and converges on the object as the target of the pointing operation.

11. The information processing device according to claim 7 , wherein

the user information item includes a speed information item about a speed of the pointing operation, and

the output control unit uses the first display mode in a case where a value indicating the speed of the pointing operation included in the speed information item is equal to or larger than a predetermined threshold, and uses the second display mode in a case where the value indicating the speed is less than the predetermined threshold.

12. The information processing device according to claim 7 , wherein

the output control unit uses the first display mode in a case where the target of the pointing operation is a first object, and uses the second display mode in a case where the target of the pointing operation is a second object different from the first object.

13. The information processing device according to claim 7 , wherein

the user information item includes an operation-type information item about a type of the pointing operation, and

the output control unit uses the first display mode in a case where the pointing operation is an operation of moving an object, and uses the second display mode in a case where the pointing operation is not the operation of moving an object.

14. The information processing device according to claim 7 , wherein

the device information item includes an information item about a condition of a CPU or battery of the information processing device, and

the output control unit uses the first display mode in a case where the CPU or battery is in a first condition, and uses the second display mode in a case where the CPU or battery is in a second condition different from the first condition.

15. The information processing device according to claim 7 , wherein

the output control unit calculates interpolated values for predictive values at a first time on a basis of the predictive values at the first time and interpolated values for predictive values at a second time preceding the first time, and renders the display information item about the operation object at the first time on a basis of the calculated interpolated values.

16. The information processing device according to claim 1 , wherein the output control unit renders, as the first display mode, the display information item about the operation object at a position subsequent to the position of the detected pointing operation.

17. The information processing device according to claim 16 , wherein a delay between the position preceding the position of the detected pointing operation and the position of the detected pointing operation is a first value, and a delay between the position subsequent to the position of the detected pointing operation and the position of the detected pointing operation is a second value smaller than the first value.

18. An information processing method, comprising:

acquiring a result of detection of a pointing operation with respect to an operation object by a user; and

outputting, on a basis of the result of the detection, a display information item about the operation object such that the operation object is displayed in at least either one of a first display mode and a second display mode different from the first display mode in accordance with an operating condition of the pointing operation,

wherein the display information item about the operation object is rendered, as the second display mode and on a basis of coordinate values generated by applying a predetermined stabilization filter to the detected input coordinate values, at a position preceding a position of the detected pointing operation.

19. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:

acquiring a result of detection of a pointing operation with respect to an operation object by a user; and

outputting, on a basis of the result of the detection, a display information item about the operation object such that the operation object is displayed in at least either one of a first display mode and a second display mode different from the first display mode in accordance with an operating condition of the pointing operation,

wherein the display information item about the operation object is rendered, as the second display mode and on a basis of coordinate values generated by applying a predetermined stabilization filter to the detected input coordinate values, at a position preceding a position of the detected pointing operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2018
From: SHIGETA, OSAMU; SAWAI, KUNIHITO; YAMADA, MASAYUKI; IDA, KENTARO; IKEDA, TAKUYA; KAWANA, YOUSUKE; IMOTO, MAKI; YANO, AKANE
To: SONY CORPORATION
Reel/Frame 047470/0823 →
Priority Claims (1)
JP 2016-029082 · Feb 18, 2016 · national
Continuity (1)
Related Publication 20190050111A1 · Feb 14, 2019