IP Library Granted Patent US 11,262,838
Granted Patent B2
US 11,262,838 · App. 16/962,384 · Granted Mar 1, 2022

Information processing device and information processing method

Inventors: Eisuke Fujinawa (Tokyo, JP); Tetsuo Ikeda (Tokyo, JP); Kensuke Kitamura (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/011G06T7/70G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,262,838
App. No.
16/962,384
Granted
Mar 1, 2022
Kind
B2
Abstract

Provided is an information processing device that provides feedback to a user. The information processing device includes: a recognition unit that recognizes a physical relation between a real object and a first virtual object positioned on an identical surface and a control unit that controls the behavior of the real object based on the physical relation.

Claims (42)

1. An information processing device, comprising:

a recognition unit configured to recognize a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein

the real object, the first virtual object, and the second virtual object are on an identical surface, and

the second virtual object corresponds to the real object; and

a control unit configured to:

control a behavior of the real object based on the first physical relation; and

control a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer than the first time.

2. The information processing device according to claim 1 , further comprising a video output unit configured to one of display or project the first virtual object on the identical surface.

3. The information processing device according to claim 2 , wherein the control unit is further configured to control one of a position of the real object or a physical quantity of the real object to control the behavior of the real object.

4. The information processing device according to claim 3 , wherein the physical quantity includes at least one of a speed, an acceleration, a mass, a density, a length, a friction coefficient, an elastic force, or a temperature.

5. The information processing device according to claim 2 , wherein the control unit is further configured to control the behavior of the real object based on the behavior of the second virtual object.

6. The information processing device according to claim 5 , wherein the control unit is further configured to control the behavior of the real object in accordance with the behavior of the second virtual object.

7. The information processing device according to claim 6 , wherein the control unit is further configured to:

predict the behavior of the real object based on the second virtual object; and

control the behavior of the real object based on a result of the prediction.

8. The information processing device according to claim 2 , wherein the control unit is further configured to control the second virtual object to stop on the identical surface at a stopping position of the real object.

9. The information processing device according to claim 2 , wherein the control unit is further configured to control the behavior of the real object based on one of an environment or a material represented by the first virtual object.

10. The information processing device according to claim 2 , wherein the control unit is further configured to control an external device, that acts on the real object, to control the behavior of the real object.

11. The information processing device according to claim 10 , further comprising a transmission unit, wherein

the control unit is further configured to:

generate control information; and

control the behavior of the real object based on the control information, and

the transmission unit is configured to transmit the control information to one of the real object or the external device.

12. The information processing device according to claim 10 , further comprising an emission unit, wherein

the control unit is further configured to:

generate control information; and

control the behavior of the real object based on the control information,

the emission unit is configured to emit light based on the control information, and

the light is emitted for the control of the behavior of the real object.

13. The information processing device according to claim 2 , wherein the recognition unit is further configured to recognize, as the first physical relation, at least one of a collision, a contact, or a position relation between the first virtual object and the real object.

14. An information processing method comprising:

recognizing a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein

the real object, the first virtual object, and the second virtual object are on an identical surface, and

the second virtual object corresponds to the real object;

controlling a behavior of the real object based on the first physical relation; and

controlling a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer that the first time.

15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

recognizing a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein

the real object, the first virtual object, and the second virtual object are positioned on an identical surface, and

the second virtual object corresponds to the real object;

controlling a behavior of the real object based on the first physical relation; and

controlling a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer that the first time.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 056976 FRAME: 0811. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 19, 2022
From: FUJINAWA, EISUKE; IKEDA, TETSUO; KITAMURA, KENSUKE
To: SONY CORPORATION
Reel/Frame 059261/0849 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2021
From: FUJINAWA, EISUKE; IKEDA, TETSUO; KITAMURA, KENSUKE
To: SONY GROUP CORPORATION
Reel/Frame 056976/0811 →
Priority Claims (1)
JP JP2018-013356 · Jan 30, 2018 · national
Continuity (1)
Related Publication 20210064122A1 · Mar 4, 2021
Cited By (1)
US 12,236,541