IP Library › Granted Patent US 12,293,453
Granted Patent B2
US 12,293,453 · App. 17/916,397 · Granted May 6, 2025

Information processing apparatus, information processing method, and display apparatus for performing a collision avoidance process for avoiding a collision of a virtual camera against a target object

Inventor: Takayoshi Shimizu (Chiba, JP)
Assignee: SONY GROUP CORPORATION
G06T17/00G06F3/14G06T7/20G06V10/761
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,453
App. No.
17/916,397
Granted
May 6, 2025
Kind
B2
Abstract

An information processing apparatus according to an embodiment of the present technology includes an image capture control unit. The image capture control unit performs, depending on a positional relationship between a target object that moves in a virtual space and a virtual camera that moves in the virtual space and captures an image of a target object, a collision avoidance process for avoiding a collision of the virtual camera against the target object.

Claims (54)

1. An information processing apparatus, comprising:

circuitry configured to

detect, based on a positional relationship between a target object that moves in a virtual space and a virtual camera that moves in the virtual space and images the target object, a proximity state of the target object and the virtual camera, and

perform, depending on the positional relationship between the target object and the virtual camera indicating that the proximity state has been detected, a collision avoidance process for avoiding a collision of the virtual camera against the target object,

wherein the collision avoidance process changes an image capture path of the virtual camera,

wherein the virtual camera initially images the target object along a preset image capture path,

wherein the circuitry performs the collision avoidance process by changing to a different image capture path from the preset image capture path in a case where the proximity state has been detected, and

wherein each image capture path is a path set so that the virtual camera passes through a plurality of relay points in order.

2. The information processing apparatus according to claim 1 ,

wherein the circuitry detects the proximity state as a state in which a relative distance between the target object and the virtual camera is equal to or smaller than a predetermined threshold.

3. The information processing apparatus according to claim 2 ,

wherein the relative distance includes a current value or a predicted value.

4. The information processing apparatus according to claim 1 ,

wherein the circuitry changes the image capture path by changing, in the case where the proximity state has been detected, a relay point that is a movement destination of the virtual camera so that the collision between the target object and the virtual camera is avoided.

5. The information processing apparatus according to claim 4 ,

wherein the circuitry is further configured to set the movement destination of the virtual camera to be a relay point smallest in the order that enables the collision between the target object and the virtual camera to be avoided.

6. The information processing apparatus according to claim 4 ,

wherein the circuitry changes, in a case where the proximity state has been detected, at least a part of a path up to the relay point that is the movement destination of the virtual camera so that the collision between the target object and the virtual camera is avoided.

7. The information processing apparatus according to claim 6 ,

wherein the circuitry changes the image capture path by moving the virtual camera along an alternative path to make a detour around the target object from a point at which the proximity state has been detected.

8. The information processing apparatus according to claim 7 ,

wherein the alternative path is a path that keeps a relative distance between the target object and the virtual camera constant.

9. The information processing apparatus according to claim 1 ,

wherein each image capture path is a path to which a time of passage of the virtual camera is set for each of the plurality of relay points, and

wherein the circuitry performs the collision avoidance process by adjusting, on a basis of the time of passage set for the relay point, a movement velocity of the virtual camera that moves the changed image capture path.

10. The information processing apparatus according to claim 9 ,

wherein the plurality of relay points includes at least one key relay point, and

wherein the circuitry adjusts the movement velocity of the virtual camera in a manner that depends on a time of passage through the key relay point included in the changed image capture path.

11. The information processing apparatus according to claim 1 ,

wherein the circuitry performs the collision avoidance process by switching, in a case where the proximity state has been detected, a display image for displaying the target object from the image captured by the virtual camera to an image captured by another virtual camera.

12. The information processing apparatus according to claim 1 ,

wherein the circuitry performs the collision avoidance process by moving the virtual camera so that a relative distance between the target object and the virtual camera is constant.

13. The information processing apparatus according to claim 12 ,

wherein the circuitry is further configured to retard a timing of velocity change of the virtual camera with respect to a timing of velocity change of the target object so that the relative distance falls within a predetermined range.

14. The information processing apparatus according to claim 1 ,

wherein the target object includes a three-dimensional actually photographed model of a performer.

15. The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to stream the image captured by the virtual camera in real time.

16. An information processing method, comprising by a computer system:

detecting, based on a positional relationship between a target object that moves in a virtual space and a virtual camera that moves in the virtual space and images the target object, a proximity state of the target object and the virtual camera; and

performing, depending on the positional relationship between the target object and the virtual camera indicating that the proximity state has been detected, a collision avoidance process for avoiding a collision of the virtual camera against the target object,

wherein the collision avoidance process changes an image capture path of the virtual camera,

wherein the virtual camera initially images the target object along a preset image capture path,

wherein the collision avoidance process is performed by changing to a different image capture path from the preset image capture path in a case where the proximity state has been detected, and

wherein each image capture path is a path set so that the virtual camera passes through a plurality of relay points in order.

17. A display apparatus, comprising:

circuitry configured to acquire an image captured by a virtual camera that operates in accordance with a collision avoidance process for avoiding a collision of the virtual camera against a target object, the collision avoidance process being performed depending on a positional relationship between the target object that moves in a virtual space and the virtual camera that moves in the virtual space and captures an image of the target object; and

a display configured to display the image captured by the virtual camera,

wherein the positional relationship is used to detect a proximity state of the target object and the virtual camera,

wherein the collision avoidance process is performed when the positional relationship indicates that the proximity state has been detected,

wherein the collision avoidance process changes an image capture path of the virtual camera,

wherein the virtual camera initially images the target object along a preset image capture path,

wherein the circuitry performs the collision avoidance process by changing to a different image capture path from the preset image capture path in a case where the proximity state has been detected, and

wherein each image capture path is a path set so that the virtual camera passes through a plurality of relay points in order.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2022
From: SHIMIZU, TAKAYOSHI
To: SONY GROUP CORPORATION
Reel/Frame 061275/0071 →
Priority Claims (1)
JP 2020-084404 · May 13, 2020 · national
Continuity (1)
Related Publication 20230154106A1 · May 18, 2023
References Cited (27)
US 6226008B1 · Watanabe · 2001 [cited by examiner]
US 20020158873A1 · Williamson · 2002 [cited by examiner]
US 20040224761A1 · Nishimura · 2004 [cited by applicant]
US 20090092286A1 · Saneshige · 2009 [cited by examiner]
US 20100060661A1 · Avent · 2010 [cited by examiner]
US 20110102424A1 · Hibbert · 2011 [cited by examiner]
US 20120127170A1 · Varadhan · 2012 [cited by examiner]
US 20130225289A1 · Yoshimitsu · 2013 [cited by examiner]
US 20140354687A1 · Kiuchi · 2014 [cited by examiner]
US 20170113138A1 · Makino · 2017 [cited by examiner]
US 20180197334A1 · Kitazono · 2018 [cited by examiner]
US 20180276874A1 · Myhill · 2018 [cited by examiner]
US 20190070505A1 · Ratelle · 2019 [cited by examiner]
US 20190244419A1 · Bell · 2019 [cited by examiner]
US 20190287302A1 · Bhuruth · 2019 [cited by applicant]
US 20190356906A1 · Handa · 2019 [cited by examiner]
US 20210241518A1 · Tong · 2021 [cited by examiner]
US 20220295034A1 · Bouazizi · 2022 [cited by examiner]
JP 2004329463A · 2004 [cited by applicant]
JP 2017211912A · 2017 [cited by applicant]
JP 6276882B1 · 2018 [cited by applicant]
JP 2018171309A · 2018 [cited by applicant]
JP 6556301B1 · 2019 [cited by applicant]
JP 2019160318A · 2019 [cited by applicant]
Stop the Camera, Put in a Bleep! “Not for Broadcast” the Workplace Simulator Indie Game Where You Struggle as a News Program Switcher to keep a Nationwide Broadcast from Falling Apart, Famitsu.com, Nov. 13, 2019, retrie… [cited by applicant]
Jun. 15, 2021, International Search Report issued for related PCT application No. PCT/JP2021/016797. [cited by applicant]
Anonymous: “Cinemachine Collider”, Unity Manual, Mar. 7, 2020 (Mar. 7, 2020), XP093050075, Retrieved from the Internet: URL:https://web.archive.org/web/20200307183114/https://docs.unity3d.com/Packages/com.unity.cinemach… [cited by applicant]