IP Library › Granted Patent US 11,645,840
Granted Patent B2
US 11,645,840 · App. 16/640,727 · Granted May 9, 2023

Information processing apparatus, information processing method, program, and moving body

Inventors: Kazuto Mugura (Tokyo, JP); Ayaka Satoh (Kanagawa, JP); Satoshi Akagawa (Tokyo, JP); Shoji Watanabe (Kanagawa, JP)
Assignee: SONY CORPORATION
G06V20/20G01C21/20G06V20/56G06V20/59H04N5/23212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,840
App. No.
16/640,727
Filed
Feb 21, 2020
Granted
May 9, 2023
Kind
B2
Art Unit
2619
USPC
345/633
Abstract

The present technique relates to an information processing apparatus, an information processing method, a program, and a moving body that can appropriately display content on top of a scene viewed by a user. An aspect of the present technique provides an information processing apparatus that sets a frame as a superimposition location of content in a region corresponding to a surface of an object on the basis of a movement state of a user and generates visual information for displaying the content in the region corresponding to the set frame. The present technique can be applied to an apparatus that performs AR display of content.

Claims (57)

1. An information processing apparatus comprising:

circuitry configured to:

track an angular velocity of a visual field of a user relative to a surface of an object;

set a frame as a superimposition location of content in a region corresponding to the surface of the object on a basis of a movement state of a moving body on which the user rides and on a basis of the angular velocity of the visual field of the user relative to the surface of the object being within a predetermined range; and

generate visual information for displaying the content in the region corresponding to the set frame.

2. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

predict the movement state including a traveling route and a traveling speed of the moving body on which the user rides.

3. The information processing apparatus according to claim 1 , further comprising:

a detector that detects the object by analyzing an image obtained by imaging a scene in a traveling direction.

4. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

set the frame on a basis of angles toward the surface of the object from respective positions including a first position on a movement route and a second position after a lapse of predetermined time.

5. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

set the frame on a basis of an angle of the surface of the object with respect to a traveling direction.

6. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

set the frame on a basis of an exposed area of the surface of the object in a case where the surface of the object is blocked by another object in front.

7. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

set the frame on a basis of time that the surface of the object is included in a visual field of the user obtained on a basis of the movement state.

8. The information processing apparatus according to claim 1 , further comprising:

a light state detector that detects a state of light on the surface of the object, wherein

the circuitry sets the frame on a basis of the state of light.

9. The information processing apparatus according to claim 1 , wherein the circuitry is configured to:

calculate fitness of each content and each frame on a basis of information regarding specifications required for displaying the content, and

generate the visual information for displaying each content in the region corresponding to the frame selected on a basis of the fitness.

10. The information processing apparatus according to claim 9 , wherein

the circuitry is configured to calculate the fitness on a basis of an element that varies according to a type of the content.

11. The information processing apparatus according to claim 10 , wherein

in a case where the content is an image, the circuitry calculates the fitness on a basis of a relationship between an aspect ratio of the image and an aspect ratio of the frame.

12. The information processing apparatus according to claim 11 , wherein

in a case where the content is a moving image, the circuitry calculates the fitness also on the basis of a relationship between reproduction time of the moving image and time that the frame is included in a visual field of the user.

13. The information processing apparatus according to claim 10 , wherein

in a case where the content includes characters, the circuitry calculates the fitness on a basis of at least any one of a relationship between an aspect ratio of a display range of the characters and an aspect ratio of the frame and a relationship between viewing time defined by the number of characters and the time that the frame is included in a visual field of the user.

14. The information processing apparatus according to claim 1 , wherein

the circuitry is configured to apply a defocusing process to the visual information that is generated in the region corresponding to the set frame and is for displaying the content on a basis of a visual point position of the user riding on a moving body.

15. The information processing apparatus according to claim 14 , further comprising:

an imager that images the user riding on the moving body; and

the circuitry is configured to set a defocus range according to a distance between the specified visual point position of the user and each position of the region corresponding to the frame on a basis of an image taken by the imager wherein

the circuitry is configured to apply, according to the defocus range, the defocusing process to the visual information that is generated in the region corresponding to the set frame and is for displaying the content on a basis of the visual point position of the user riding on the moving body.

16. The information processing apparatus according to claim 15 , wherein

the closer the distance between each position of the region corresponding to the frame and the visual point position of the user is, the smaller the defocus range set by the circuitry is, the farther the distance between each position of the region corresponding to the frame and the visual point position of the user is, the larger the defocus range set by the circuitry is, and

the smaller the defocus range is, the higher a degree of focus in the defocusing process of the circuitry applied to the visual information that is generated in the region corresponding to the set frame and is for displaying the content on a basis of the visual point position of the user riding on the moving body is, the larger the defocus range is, the higher a degree of defocus in the defocusing process of the circuitry is.

17. The information processing apparatus according to claim 14 , wherein the circuitry is configured to

set for each of a plurality of the users, the frame as the superimposition location of the content in the region corresponding to the surface of the corresponding object on a basis of the movement state of the user, and

apply the defocusing process to the visual information that is generated in the region corresponding to the frame set for each of the plurality of the users and is for displaying the content.

18. An information processing method executed by an information processing apparatus, the method comprising:

tracking an angular velocity of a visual field of a user relative to a surface of an object;

setting a frame as a superimposition location of content in a region corresponding to the surface of the object on the basis of a movement state of a moving body on which the user rides and on a basis of the angular velocity of the visual field of the user relative to the surface of the object being within a predetermined range; and

generating visual information for displaying the content in the region corresponding to the set frame.

19. A non-transitory computer-readable medium storing executable instructions which when executed by circuitry cause the circuitry to perform a method, the method comprising:

tracking an angular velocity of a visual field of a user relative to a surface of an object;

setting a frame as a superimposition location of content in a region corresponding to the surface of the object on the basis of a movement state of a moving body on which the user rides and on a basis of the angular velocity of the visual field of the user relative to the surface of the object being within a predetermined range; and

generating visual information for displaying the content in the region corresponding to the set frame.

20. A moving body comprising:

circuitry configured to:

track an angular velocity of a visual field of a user relative to a surface of an object;

set a frame as a superimposition location of content in a region corresponding to the surface of the object on a basis of a movement state of the moving body on which the user rides and on a basis of the angular velocity of the visual field of the user relative to the surface of the object being within a predetermined range;

generate visual information for displaying the content in the region corresponding to the set frame; and

display the visual information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2021
From: MUGURA, KAZUTO; SATOH, AYAKA; AKAGAWA, SATOSHI; WATANABE, SHOJI
To: SONY CORPORATION
Reel/Frame 055608/0951 →
Priority Claims (2)
JP JP2017-166871 · Aug 31, 2017 · national
JP JP2018-069055 · Mar 30, 2018 · national
Continuity (1)
Related Publication 20200184219A1 · Jun 11, 2020