IP Library Granted Patent US 12,141,357
Granted Patent B2
US 12,141,357 · App. 17/274,917 · Granted Nov 12, 2024

Information processor, information processing method, and program

Inventors: Osamu Ito (Tokyo, JP); Takeshi Ogita (Kanagawa, JP); Yohei Fukuma (Chiba, JP); Ikuo Yamano (Tokyo, JP); Ryo Yokoyama (Tokyo, JP); Takamoto Tsuda (Nagano, JP)
Assignee: SONY GROUP CORPORATION
G06F3/016A63F13/28A63F13/285A63F13/50A63F13/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,141,357
App. No.
17/274,917
Granted
Nov 12, 2024
Kind
B2
Abstract

An information processor ( 10 m ) includes a control unit ( 104 ). On a basis of position information indicating a perceptual position that causes a haptic stimulus to be perceived in a haptic presentation device ( 2 ) and on a basis of haptic stimulus type information specifying a type of the haptic stimulus, and in accordance with an arrangement of one or more haptic stimulus units provided in the haptic presentation device ( 2 ), the control unit ( 104 ) generates a haptic control signal to each of the haptic stimulus units for presentation of the haptic stimulus of the type specified at the perceptual position, and a script in which time information on a reproduction content and one or more of the generated haptic control signals are associated with each other.

Claims (53)

1. An information processor comprising:

a control unit,

wherein the control unit, based on position information indicating a perceptual position that causes a haptic stimulus to be perceived in a haptic presentation device, and based on haptic stimulus type information specifying a type of the haptic stimulus, is configured to

generate, in accordance with an arrangement of one or more haptic stimulus units provided in the haptic presentation device, a haptic control signal to each of the haptic stimulus units for presentation of the haptic stimulus of the type specified at the perceptual position, and

generate a script in which time information on a reproduction content and one or more of the generated haptic control signals are associated with each other,

display an arrangement display screen indicating an arrangement of one or more haptic stimulus units provided in the haptic presentation device, and accept specifying of a perceptual position by a user on the arrangement display screen, and

display a selection screen of the type of the haptic stimulus, and accept specifying of the type of the haptic stimulus presented at the specified perceptual position through the selection screen,

wherein the haptic stimulus type information comprises information specifying a type of a haptic data library prepared in advance or a type of generation haptic data generated from the reproduction content,

wherein the control unit generates the generation haptic data from audio data of a sound effect, a background music, or a dialogue included in the reproduction content,

wherein the control unit recommends a perceptual position and a perceptual intensity of the generated generation haptic data based on the audio data of the sound effect, the background music, or the dialogue included in the reproduction content, and

wherein the control unit is implemented via at least one processor.

2. The information processor according to claim 1 , wherein the control unit further considers specified perceptual intensity information to generate the haptic control signal to each of the haptic stimulus units.

3. The information processor according to claim 1 , wherein the haptic data library and the generation haptic data each comprise waveform data of a vibration presented in the haptic presentation device.

4. The information processor according to claim 1 , wherein the script further includes offset information for the time information on the reproduction content.

5. The information processor according to claim 4 , wherein the control unit sets the offset information in response to a processing delay amount that is assumed when executing the haptic control signal on reproduction side.

6. The information processor according to claim 1 , wherein the reproduction content comprises image data.

7. The information processor according to claim 1 , wherein the reproduction content comprises an action that occurs in a game, and time information on the action and the control command of the haptic presentation device are associated with each other for each action in the script.

8. The information processor according to claim 1 , wherein

the control unit further considers a profile of the haptic presentation device to generate the haptic control signal, and

the script further includes information indicating a type of the profile.

9. An information processing method comprising:

causing a processor to

generate, based on position information indicating a perceptual position that causes a haptic stimulus to be perceived in a haptic presentation device and based on haptic stimulus type information specifying a type of the haptic stimulus, and in accordance with an arrangement of one or more haptic stimulus units provided in the haptic presentation device, a haptic control signal to each of the haptic stimulus units for presentation of the haptic stimulus of the type specified at the perceptual position, and

generate a script in which time information on a reproduction content and one or more of the generated haptic control signals are associated with each other,

wherein an arrangement display screen is displayed to indicate an arrangement of one or more haptic stimulus units provided in the haptic presentation device, and specifying of a perceptual position is performed by a user on the arrangement display screen,

wherein a selection screen of the type of the haptic stimulus is displayed to accept specifying of the type of the haptic stimulus presented at the specified perceptual position through the selection screen,

wherein the haptic stimulus type information comprises information specifying a type of a haptic data library prepared in advance or a type of generation haptic data generated from the reproduction content,

wherein the generation haptic data is generated from audio data of a sound effect, a background music, or a dialogue included in the reproduction content, and

wherein a perceptual position and a perceptual intensity of the generated generation haptic data are recommended based on the audio data of the sound effect, the background music, or the dialogue included in the reproduction content.

10. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to function as a control unit execute a method, the method comprising:

generating, based on position information indicating a perceptual position that causes a haptic stimulus to be perceived in a haptic presentation device, and based on haptic stimulus type information specifying a type of the haptic stimulus, in accordance with an arrangement of one or more haptic stimulus units provided in the haptic presentation device, a haptic control signal to each of the haptic stimulus units for presentation of the haptic stimulus of the type specified at the perceptual position; and

generating a script in which time information on a reproduction content and one or more of the generated haptic control signals are associated with each other,

wherein an arrangement display screen is displayed to indicate an arrangement of one or more haptic stimulus units provided in the haptic presentation device, and specifying of a perceptual position is performed by a user on the arrangement display screen,

wherein a selection screen of the type of the haptic stimulus is displayed to accept specifying of the type of the haptic stimulus presented at the specified perceptual position through the selection screen,

wherein the haptic stimulus type information comprises information specifying a type of a haptic data library prepared in advance or a type of generation haptic data generated from the reproduction content,

wherein the generation haptic data is generated from audio data of a sound effect, a background music, or a dialogue included in the reproduction content, and

wherein a perceptual position and a perceptual intensity of the generated generation haptic data are recommended based on the audio data of the sound effect, the background music, or the dialogue included in the reproduction content.

11. An information processor comprising:

a control unit configured to

acquire a haptic control signal to be inputted to a haptic presentation device corresponding to a time code indicating a reproduction position of a reproduction content, based on a script in which time information on the reproduction content and information specifying the haptic control signal of the haptic presentation device are associated with each other,

output the haptic control signal to the haptic presentation device,

display an arrangement display screen indicating an arrangement of one or more haptic stimulus units provided in the haptic presentation device, and accept specifying of a perceptual position and a perceptual intensity by a user on the arrangement display screen, and

display a selection screen of the type of the haptic stimulus, and accept specifying of the type of the haptic stimulus presented at the specified perceptual position through the selection screen,

wherein the information specifying the haptic control signal comprises information specifying a type of a haptic data library prepared in advance or a type of generation haptic data generated from the reproduction content,

wherein the control unit outputs the haptic control signal from audio data of a sound effect, a background music, or a dialogue included in the reproduction content,

wherein the control unit recommends the perceptual position and the perceptual intensity of the output haptic control signal based on the audio data of the sound effect, the background music, or the dialogue included in the reproduction content, and

wherein the control unit is implemented via at least one processor.

12. The information processor according to claim 11 , wherein the control unit outputs the haptic control signal to the haptic presentation device at a timing corresponding to offset information included in the script.

13. The information processor according to claim 11 , wherein

the information processor comprises a storage unit that stores the haptic control signal generated in advance, and

the control unit refers to the script to output the haptic control signal to the haptic presentation device in response to the time code received from an external apparatus.

14. The information processor according to claim 11 , wherein the information processor receives the haptic control signal corresponding to the time code from an external apparatus.

15. The information processor according to claim 11 , wherein the control unit considers a profile of the haptic presentation device to correct the haptic control signal.

Assignments (2)
CHANGE OF NAME Recorded Jan 30, 2024
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 066523/0894 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2021
From: ITO, OSAMU; OGITA, TAKESHI; FUKUMA, YOHEI; YAMANO, IKUO; YOKOYAMA, RYO; TSUDA, TAKAMOTO
To: SONY CORPORATION
Reel/Frame 055548/0111 →
Priority Claims (1)
JP 2018-197172 · Oct 19, 2018 · national
Continuity (1)
Related Publication 20220057864A1 · Feb 24, 2022