IP Library › Granted Patent US 11,107,436
Granted Patent B2
US 11,107,436 · App. 16/093,212 · Granted Aug 31, 2021

Image processing device and image processing method

Inventor: Yasushi Okumura (Tokyo, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G09G5/003G02B27/02G06F3/011G06F3/147G09G3/003G09G5/00G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,107,436
App. No.
16/093,212
Granted
Aug 31, 2021
Kind
B2
Abstract

A motion detection section 720 detects a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a head-mounted display 100 . A field-of-view restriction processing section 750 restricts a field of view for observing the wide-viewing-angle image in a case in which the motion exceeding the permissible limit has been detected in the wide-viewing-angle image. An image provision section 760 provides, for the head-mounted display 100 , the wide-viewing-angle image in which the field of view has been restricted.

Claims (43)

1. An image processing device comprising:

a motion detection section configured to detect a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a wearable display device;

a field-of-view restriction processing section configured to restrict a field of view for observing the wide-viewing-angle image when the motion exceeding the permissible limit is detected in the wide-viewing-angle image; and

an image provision section configured to provide the wide-viewing-angle image in which the field of view is restricted for the wearable display device,

wherein the field-of-view restriction processing section restricts the field of view for observing the wide-viewing-angle image by using processing for masking a peripheral area of the wide-viewing-angle image,

wherein transmittance of the masking is decreased from 100% to 0% over a predetermined time period,

wherein, when receiving an operation instruction to zoom in or zoom out the wide-viewing-angle image beyond a predetermined scale factor, the motion detection section determines that the motion exceeding the permissible limit is detected and the field of view is restricted for a duration of the operation instruction, and

wherein, when a motion that does not depend on a physical motion of a user is detected in the wide-viewing-angle image, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked.

2. The image processing device according to claim 1 , wherein

when receiving an operation instruction to move a viewpoint position in a virtual space displayed on the wearable display device beyond a predetermined speed, the motion detection section determines that the motion exceeding the permissible limit is detected,

wherein the operation instruction is received using a handheld controller.

3. The image processing device according to claim 1 , wherein

when a change amount in a point-of-view position exceeds a first predetermined threshold and a frame rate is below a second predetermined threshold, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked.

4. An image processing method comprising:

detecting a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a wearable display device;

restricting a field of view for observing the wide-viewing-angle image when receiving an operation instruction to zoom in or zoom out the wide-viewing-angle image beyond a predetermined scale factor for a duration of the operation instruction; and

providing the wide-viewing-angle image in which the field of view is restricted for the wearable display device,

wherein the masking includes making the peripheral area black and transparency of the masking is increased towards a center of the wide-viewing-angle image; and

when receiving an operation instruction to zoom in or zoom out the wide-viewing-angle image beyond a predetermined scale factor from a fixed viewpoint, the motion detection section determines that the motion exceeding the permissible limit is detected and the field of view is restricted for a duration of the operation instruction, and

when a motion that does not depend on a physical motion of a user is detected in the wide-viewing-angle image, it is determined that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked.

5. A non-transitory computer readable medium having stored thereon a program for a computer, the program comprising:

by a motion detection section, detecting a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a wearable display device;

by a field-of-view restriction processing section, restricting a field of view for observing the wide-viewing-angle image when receiving an operation instruction to zoom in or zoom out the wide-viewing-angle image beyond a predetermined scale factor for a duration of the operation instruction; and

by an image provision section, providing the wide-viewing-angle image in which the field of view is restricted for the wearable display device,

wherein the masking includes making the peripheral area black and transparency of the masking is increased towards a center of the wide-viewing-angle image, and

wherein, when a motion that does not depend on a physical motion of a user is detected in the wide-viewing-angle image, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked.

6. An image processing device comprising:

a motion detection section configured to detect a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a wearable display device;

a field-of-view restriction processing section configured to restrict a field of view for observing the wide-viewing-angle image when the motion exceeding the permissible limit is detected in the wide-viewing-angle image; and

an image provision section configured to provide the wide-viewing-angle image in which the field of view is restricted for the wearable display device,

wherein the field-of-view restriction processing section restricts the field of view for observing the wide-viewing-angle image by using processing for masking a peripheral area of the wide-viewing-angle image,

wherein transmittance of the masking is decreased from 100% to 0% over a predetermined time period,

wherein, when receiving an operation instruction to move a viewpoint position in a virtual space displayed on the wearable display device beyond a predetermined speed, the motion detection section determines that the motion exceeding the permissible limit is detected and the field-of-view restriction processing section,

wherein, when a motion that does not depend on a physical motion of a user is detected in the wide-viewing-angle image, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked, and

wherein the operation instruction is received using a handheld controller.

7. An image processing device comprising:

a motion detection section configured to detect a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a wearable display device;

a field-of-view restriction processing section configured to restrict a field of view for observing the wide-viewing-angle image when the motion exceeding the permissible limit is detected in the wide-viewing-angle image; and

an image provision section configured to provide the wide-viewing-angle image in which the field of view is restricted for the wearable display device,

wherein the field-of-view restriction processing section restricts the field of view for observing the wide-viewing-angle image by using processing for masking a peripheral area of the wide-viewing-angle image,

wherein transmittance of the masking is decreased from 100% to 0% over a predetermined time period,

wherein, when a change amount in a point-of-view position exceeds a first predetermined threshold and a frame rate is below a second predetermined, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked, and

wherein, when a motion that does not depend on a physical motion of a user is detected in the wide-viewing-angle image, the motion detection section determines that the motion exceeding the permissible limit is detected and the wide-viewing-angle image is masked.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2018
From: OKUMURA, YASUSHI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 047219/0740 →
Priority Claims (1)
JP JP2016-085545 · Apr 21, 2016 · national
Continuity (1)
Related Publication 20190172410A1 · Jun 6, 2019