IP Library › Granted Patent US 11,523,246
Granted Patent B2
US 11,523,246 · App. 17/250,333 · Granted Dec 6, 2022

Information processing apparatus and information processing method

Inventors: Yasuyuki Koga (Tokyo, JP); Kei Nitta (Tokyo, JP)
Assignee: SONY CORPORATION
H04S7/304G02B27/0093H04S7/40H04S2400/01H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,523,246
App. No.
17/250,333
Granted
Dec 6, 2022
Kind
B2
Abstract

Provided is an information processing apparatus that includes a determination unit and a display control unit. The determination unit obtains a position of a virtual object relative to a display region and determines whether or not a correction allowable region set in a region different from the virtual object overlaps at least a part of the display region when the virtual object is located outside the display region. The display control unit causes at least a part of a display object showing the virtual object in the display region to be displayed in a case where the determination unit determines that the correction allowable region overlaps at least the part of the display region.

Claims (57)

1. An information processing apparatus, comprising:

a determination unit configured to:

obtain a first position of a virtual object relative to a display region of a display;

set a correction allowable region in a region, of the display, different from the first position of the virtual object; and

determine whether the correction allowable region overlaps at least a part of the display region when the first position of the virtual object is outside the display region; and

a display control unit configured to:

cause at least a part of a display object, showing the virtual object, in the display region to be displayed based on the determination that the set correction allowable region overlaps at least the part of the display region;

generate an enlarged image of the virtual object, which is centered at the virtual object; and

set a portion of the enlarged image, which is included in the display region, as the display object.

2. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to:

cause the virtual object to move to a contact position that is a second position at which the correction allowable region is in contact with the display region, and

set at least a part of the virtual object as the display object.

3. The information processing apparatus according to claim 2 , further comprising:

an acoustic processing unit configured to localize a virtual sound source at the virtual object, wherein

the acoustic processing unit is further configured to move, based on the movement of the virtual object to the contact position, the virtual sound source in accordance with the movement of the virtual object.

4. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to:

set a copy image of the virtual object as the display object, and

cause the copy image to be displayed at a second position in the display region,

the second position is at a first part of the display region, and

the first part is closest to the virtual object than remaining part of the display region.

5. The information processing apparatus according to claim 4 , wherein

the display control unit is further configured to cause the copy image to move to be superimposed on the virtual object when the virtual object moves into the display region.

6. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to cause the enlarged image to contract toward the virtual object when the virtual object moves into the display region.

7. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to generate an icon indicating a direction of the virtual object as the display object.

8. The information processing apparatus according to claim 1 , further comprising:

an acoustic processing unit configured to localize a virtual sound source at the virtual object, wherein

the determination unit is further configured to determine whether the correction allowable region and the display region overlap each other when the virtual object is not within the display region after a specific period of time elapses after sound is generated from the virtual sound source.

9. The information processing apparatus according to claim 1 , further comprising:

an acoustic processing unit configured to localize a virtual sound source at the virtual object, wherein

the determination unit is further configured to determine whether the correction allowable region and the display region overlap each other when a moving velocity of the display region relative to the virtual object is equal to or lower than a specific value after sound is generated from the virtual sound source.

10. A non-transitory computer-readable medium having stored thereon, computer executable-instructions that, when executed by a processor of an information processing apparatus, cause the processor to execute operations, the operations comprising:

obtaining a position of a virtual object relative to a display region of a display device;

setting a correction allowable region in a region, of the display device, different from the position of the virtual object;

determining whether the correction allowable region overlaps at least a part of the display region when the position of the virtual object is outside the display region;

causing at least a part of a display object, showing the virtual object, in the display region to be displayed based on the determination that the set correction allowable region overlaps at least the part of the display region;

generating an enlarged image of the virtual object, which is centered at the virtual object; and

setting a portion of the enlarged image, which is included in the display region, as the display object.

11. An information processing method, comprising:

in an information processing apparatus that includes, a determination unit and a display control unit:

obtaining, by the determination unit, a position of a virtual object relative to a display region of a display;

setting, by the determination unit, a correction allowable region in a region, of the display, different from the position of the virtual object;

determining, by the determination unit, whether the correction allowable region overlaps at least a part of the display region when the position of virtual object is outside the display region;

causing, by the display control unit, at least a part of a display object, showing the virtual object, in the display region to be displayed based on the determination that the set correction allowable region overlaps at least the part of the display region;

generating, by the display control unit, an enlarged image of the virtual object, which is centered at the virtual object; and

setting, by the display control unit, a portion of the enlarged image, which is included in the display region, as the display object.

12. An information processing apparatus, comprising:

an acoustic processing unit configured to localize a virtual sound source at virtual object;

a determination unit configured to:

obtain a first position of the virtual object relative to a display region of a display;

set a correction allowable region in a region, of the display, different from the first position of the virtual object; and

determine whether the correction allowable region and the display region overlap each other when a moving velocity of the display region relative to the virtual object is equal to or lower than a specific value after sound is generated from the virtual sound source; and

a display control unit configured to:

cause at least a part of a display object, showing the virtual object, in the display region to be displayed based on the determination that the set correction allowable region overlaps at least the part of the display region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2022
From: KOGA, YASUYUKI; NITTA, KEI
To: SONY CORPORATION
Reel/Frame 060813/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: KOGA, YASUYUKI; NITTA, KEI
To: SONY CORPORATION
Reel/Frame 057142/0464 →
Priority Claims (1)
JP JP2018-133742 · Jul 13, 2018 · national
Continuity (1)
Related Publication 20210281966A1 · Sep 9, 2021
Cited By (1)
US 12,633,071