IP Library › Granted Patent US 12,634,562
Granted Patent B2
US 12,634,562 · App. 18/683,599 · Granted May 19, 2026

Information processing apparatus, information processing method, and information processing system

Inventors: Ikuo Yamano (Tokyo, JP); Osamu Ito (Tokyo, JP); Ryo Yokoyama (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N21/8547G06F3/016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,634,562
App. No.
18/683,599
Granted
May 19, 2026
Kind
B2
Abstract

An information processing apparatus includes an estimation processing unit that estimates at least some of a video latency time from a reproduction instruction of a video signal to video presentation based on the video signal, an acoustic latency time from a reproduction instruction of an acoustic signal to acoustic presentation based on the acoustic signal, and a haptic sense latency time from a reproduction instruction of a haptic signal to haptic sense presentation based on the haptic signal, and a latency time determination unit that determines an additional latency time related to the haptic sense presentation on the basis of an estimation result of the estimation processing unit.

Claims (49)

1 . An information processing apparatus comprising:

circuitry configured to

estimate one or more of a video latency time from a reproduction instruction of a video signal to video presentation based on the video signal, an acoustic latency time from a reproduction instruction of an acoustic signal to acoustic presentation based on the acoustic signal, or a haptic sense latency time from a reproduction instruction of a haptic signal to haptic sense presentation based on the haptic signal, and

determine an additional latency time related to the haptic sense presentation based on the video latency time, the acoustic latency time, and the haptic sense latency time,

wherein the circuitry determines the additional latency time such that the haptic sense presentation based on the haptic signal is performed after at least one of the video presentation based on the video signal or the acoustic presentation based on the acoustic signal.

2 . The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to perform delay control of the haptic signal based on the additional latency time.

3 . The information processing apparatus according to claim 1 ,

wherein the acoustic latency time includes a communication latency time between an acoustic signal output device configured to output the acoustic signal and an acoustic presentation device configured to perform the acoustic presentation based on the acoustic signal.

4 . The information processing apparatus according to claim 1 ,

wherein the circuitry determines the additional latency time such that the haptic sense presentation based on the haptic signal is performed after the acoustic presentation based on the acoustic signal.

5 . The information processing apparatus according to claim 4 ,

wherein the circuitry determines the additional latency time such that the haptic sense presentation based on the haptic signal is performed before a first time elapses from the acoustic presentation based on the acoustic signal.

6 . The information processing apparatus according to claim 1 ,

wherein the circuitry determines the additional latency time such that the haptic sense presentation based on the haptic signal is performed before a second time elapses from the video presentation based on the video signal.

7 . The information processing apparatus according to claim 1 ,

wherein the circuitry estimates the acoustic latency time.

8 . The information processing apparatus according to claim 7 ,

wherein the circuitry estimates the acoustic latency time based on information regarding a codec used for the acoustic presentation.

9 . The information processing apparatus according to claim 7 ,

wherein the circuitry is further configured to specify specifies information regarding a codec based on information regarding a specification of an acoustic presentation device that performs the acoustic presentation based on the acoustic signal.

10 . The information processing apparatus according to claim 7 ,

wherein the circuitry estimates the acoustic latency time based on a configuration of circuitry configured to output the acoustic signal and perform the acoustic presentation based on the acoustic signal, and

wherein the circuitry determines the additional latency time based on a configuration of circuitry configured to output the haptic signal and perform the haptic sense presentation based on the haptic signal and the acoustic latency time.

11 . The information processing apparatus according to claim 10 ,

wherein the circuitry estimates the acoustic latency time in a case where the acoustic signal is transmitted from the circuitry configured to output the acoustic signal by wireless communication.

12 . The information processing apparatus according to claim 1 ,

wherein the circuitry estimates the video latency time.

13 . The information processing apparatus according to claim 12 ,

wherein the circuitry estimates the video latency time based on a configuration of circuitry configured to output the video signal and perform the video presentation based on the video signal.

14 . An information processing method, executed by a computer device, the method comprising:

estimating one or more of a video latency time from a reproduction instruction of a video signal to video presentation based on the video signal, an acoustic latency time from a reproduction instruction of an acoustic signal to acoustic presentation based on the acoustic signal, or a haptic sense latency time from a reproduction instruction of a haptic signal to haptic sense presentation based on the haptic signal; and

determining an additional latency time related to the haptic sense presentation based on the video latency time, the acoustic latency time, and the haptic sense latency time,

wherein the additional latency time is determined such that the haptic sense presentation based on the haptic signal is performed after at least one of the video presentation based on the video signal or the acoustic presentation based on the acoustic signal.

15 . An information processing system comprising:

a plurality of devices,

wherein a first device of the plurality of devices includes first circuitry configured to

estimate one or more of a video latency time from a reproduction instruction of a video signal to video presentation based on the video signal, an acoustic latency time from a reproduction instruction of an acoustic signal to acoustic presentation based on the acoustic signal, or a haptic sense latency time from a reproduction instruction of a haptic signal to haptic sense presentation based on the haptic signal,

determine an additional latency time related to the haptic sense presentation based on the video latency time, the acoustic latency time, and the haptic sense latency time, and

delay the haptic signal according to the additional latency time,

wherein a second device of the plurality of devices includes second circuitry configured to perform the acoustic presentation according to the acoustic signal, and

wherein the first circuitry determines the additional latency time such that the haptic sense presentation based on the haptic signal is performed after at least one of the video presentation based on the video signal or the acoustic presentation based on the acoustic signal.

16 . The information processing system according to claim 15 ,

wherein the first device functions as a video signal output device that outputs the video signal, a video presentation device that performs the video presentation based on the video signal, a haptic signal output device that outputs the haptic signal, a haptic sense presentation device that performs the haptic sense presentation based on the haptic signal, and an acoustic signal output device that outputs the acoustic signal, and

wherein the another second device functions as an acoustic presentation device that performs the acoustic presentation based on the acoustic signal.

17 . The information processing system according to claim 15 ,

wherein a third device of the plurality of devices functions as a video presentation device that performs the video presentation based on the video signal and an acoustic presentation device that performs the acoustic presentation based on the acoustic signal,

wherein the first device functions as a video signal output device that outputs the video signal, a haptic signal output device that outputs the haptic signal, and an acoustic signal output device that outputs the acoustic signal, and

wherein the second device functions as a haptic sense presentation device that performs the haptic sense presentation based on the haptic signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2024
From: YAMANO, IKUO; ITO, OSAMU; YOKOYAMA, RYO
To: SONY GROUP CORPORATION
Reel/Frame 066461/0010 →
Priority Claims (1)
JP 2021-140071 · Aug 30, 2021 · national
Continuity (1)
Related Publication 20240357215A1 · Oct 24, 2024
References Cited (14)
US 10609677B2 · Miller · 2020 [cited by examiner]
US 10782779B1 · Eubank · 2020 [cited by examiner]
US 12177911B2 · Xue · 2024 [cited by examiner]
US 20100039244A1 · Tschirhart · 2010 [cited by examiner]
US 20140143692A1 · Wigdor · 2014 [cited by examiner]
US 20170064154A1 · Tseng · 2017 [cited by examiner]
US 20190064924A1 · Nocon · 2019 [cited by examiner]
US 20190215349A1 · Adams · 2019 [cited by examiner]
US 20190227628A1 · Rand · 2019 [cited by examiner]
US 20210096656A1 · Gilg · 2021 [cited by examiner]
US 20240078076A1 · Lee · 2024 [cited by examiner]
JP 2018019393A · 2018 [cited by applicant]
JP 2021093578A · 2021 [cited by applicant]
WO WO2019013055A1 · 2019 [cited by applicant]