IP Library Granted Patent US 11,941,766
Granted Patent B2
US 11,941,766 · App. 17/938,957 · Granted Mar 26, 2024

Image processing apparatus, image processing method, and program

Inventors: Akihiko Kaino (Kanagawa, JP); Masaki Fukuchi (Tokyo, JP); Tatsuki Kashitani (Tokyo, JP); Kenichiro Ooi (Kanagawa, JP); Jingjing Guo (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06T19/006G06T7/70G06T7/73G06T19/20H04N7/183G06T2207/10021G06T2207/30244G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,941,766
App. No.
17/938,957
Granted
Mar 26, 2024
Kind
B2
Abstract

An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.

Claims (49)

1. An information processing apparatus, comprising:

at least one sensor;

at least one imaging device;

a display;

a memory; and

circuitry configured to

capture an image including a real object;

detect at least one of a three-dimensional position information and a posture information;

control the display of an appearance of an augmented reality (AR) object based on the detected information; and

control the display of the information processing apparatus to continue displaying, on the display of the information processing apparatus, the AR object associated with the real object when the object is no longer detected on the display of the information processing apparatus.

2. The information processing apparatus of claim 1 , wherein the circuitry is further configured to detect a status of the information processing apparatus.

3. The information processing apparatus of claim 1 , wherein the circuitry is further configured to control an appearance of the AR object based on the status of the information processing apparatus.

4. The information processing apparatus of claim 1 , wherein the circuitry is further configured to control a movement of the AR object based on the status of the information processing apparatus.

5. The information processing apparatus of claim 1 , wherein the AR object appears in response to a condition being satisfied.

6. The information processing apparatus of claim 5 , wherein the condition is determined based on a three-dimensional position and a posture of the at least one imaging device relative to the detected three-dimensional position information and the posture information.

7. The information processing apparatus of claim 1 , wherein the at least one sensor includes one or more of a positioning sensor, an acceleration sensor, and a gyro sensor.

8. The information processing apparatus of claim 1 , wherein the circuitry is further configured to

control the display to continue displaying the AR object associated with the real object when the object is partially observable in acquired imaging data.

9. A method, comprising:

capturing, by an imaging device, an image including a real object;

detecting, by processing circuitry, at least one of a three-dimensional position information and a posture information;

controlling, by the processing circuitry, a display of an appearance of an augmented reality (AR) object based on the detected information; and

controlling, by the processing circuitry, a display to continue displaying, on the display, the AR object associated with the real object when the object is no longer detected on the display.

10. The method of claim 9 , further comprising:

detecting a status of an information processing apparatus.

11. The method of claim 10 , further comprising:

controlling an appearance of the AR object based on the status of the information processing apparatus.

12. The method of claim 10 , further comprising:

controlling a movement of the AR object based on the status of the information processing apparatus.

13. The method of claim 9 , further comprising:

displaying the AR object in response to a condition being satisfied.

14. The method of claim 13 , further comprising:

determining the condition based on a three-dimensional position and a posture of an imaging device relative to the detected three-dimensional position information and the posture information.

15. The method of claim 9 , controlling the display to continue displaying the AR object associated with the real object when the object is partially observable in acquired imaging data.

16. A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising:

capturing, by an imaging device, an image including a real object;

detecting, by processing circuitry, at least one of a three-dimensional position information and a posture information;

controlling, by the processing circuitry, a display of an appearance of an augmented reality (AR) object based on the detected information; and

controlling, by the processing circuitry, the display to continue displaying, on the display, the AR object associated with the real object when the object is no longer detected on the display.

17. The non-transitory computer-readable storage medium of claim 16 , further comprising:

detecting a status of an information processing apparatus;

controlling an appearance of the AR object based on the status of the information processing apparatus; and

controlling a movement of the AR object based on the status of the information processing apparatus.

18. The non-transitory computer-readable storage medium of claim 17 , further comprising:

displaying the AR object in response to a condition being satisfied.

19. The non-transitory computer-readable storage medium of claim 18 , further comprising:

determining the condition based on a three-dimensional position and a posture of an imaging device relative to the detected three-dimensional position information and the posture information.

20. The non-transitory computer-readable storage medium of claim 16 , further comprising:

controlling the display to continue displaying the AR object associated with the real object when the object is partially observable in acquired imaging data.

Assignments (1)
CHANGE OF NAME Recorded Sep 7, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 061623/0724 →
Priority Claims (1)
JP 2011-235749 · Oct 27, 2011 · national
Continuity (7)
Continuation 17140144 · Jan 4, 2021
Continuation 16587070 · Sep 30, 2019
Continuation 16051893 · Aug 1, 2018
Continuation 15459711 · Mar 15, 2017
Continuation 14994950 · Jan 13, 2016
Continuation 13824140
Related Publication 20230005226A1 · Jan 5, 2023
Cited By (1)
US 12,327,324