IP Library Granted Patent US 12,685,928
Granted Patent B2
US 12,685,928 · App. 18/323,038 · Granted Jul 21, 2026

Information processing apparatus and warning presentation method

Inventors: Shoichi Ikenoue (Chiba, JP); Yuji Nakamura (Tokyo, JP); Yoshihiko Suwa (Kanagawa, JP)
Assignee: Sony Interactive Entertainment Inc.
A63F13/213A63F13/25A63F13/53A63F13/533A63F13/655G02B27/00G02B27/01G06F3/0481G06T7/70G06T19/006A63F2300/69A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,685,928
App. No.
18/323,038
Filed
May 24, 2023
Granted
Jul 21, 2026
Kind
B2
Art Unit
3715
USPC
463/31
Abstract

Methods and apparatus provide for: performing information processing on the basis of data received from a device that detects a user position; generating an image to be displayed as a result of the information processing; determining that the user needs to be warned when the user position indicates that the user moves out of a play area set in an object space in reference to a detection field of the device, and to cause the image generating section to superpose a warning image on the image to be displayed; and transmitting data of the image generated by the image generating section to a display device, where the transmitting includes outputting, to the display device, a confirmation screen prompting the user to confirm that there is an obstacle, prior to outputting the data of the image.

Claims (34)

1 . An information processing apparatus, comprising:

an information processing section configured to perform information processing on a basis of data received from a device that detects a user position, wherein the user position is determined based on a captured image;

an image generating section configured to generate an image to be displayed as a result of the information processing, wherein a user wears a head mounted display and the image displayed obstructs the user's vision;

a warning state determining section configured to determine that the user needs to be warned when the user position indicates that the user moves out of a play area set in an object space in reference to a detection field of the device, and to cause the image generating section to superpose a warning image on the image to be displayed; and

an output data transmitting section configured to transmit data of the image generated by the image generating section to the head mounted display,

wherein the output data transmitting section outputs, to the head mounted display, a confirmation screen prompting the user to confirm that there is an obstacle, prior to outputting the data of the image,

wherein the warning state determining section determines that the user needs to be warned when the user position does not match a predetermined range and the play area; and

the warning state determining section is further configured to change at least one of the predetermined range and the play area based on the user position.

2 . The information processing apparatus of claim 1 , wherein the image generating section generates an image of virtual world.

3 . The information processing apparatus of claim 1 , wherein the play area is selected from setting information which is stored in an area setting information storing section.

4 . The information processing apparatus of claim 1 , wherein the information processing section starts the process of determining a necessity of a warning after the user inputs a confirmation for the obstacle.

5 . The information processing apparatus of claim 1 , wherein the warning state determining section starts detecting the user position.

6 . The information processing apparatus of claim 1 , wherein the warning state determining section sets positions of boundary surfaces of the play area with respect to the detection field of the device within a predetermined range from the user.

7 . The information processing apparatus of claim 1 , wherein the warning state determining section changes play area rules, which serve to establish the play area, depending on a distance between the user position and the device.

8 . The information processing apparatus of claim 1 , wherein the warning state determining section sets play area shapes of the play area different in a horizontal direction of a real space in which the user is located as compared to in a vertical direction of the real space.

9 . The information processing apparatus of claim 1 , wherein the warning image includes at least one of an object shape or a mark as at least part of the warning image.

10 . The information processing apparatus of claim 1 , wherein the warning state determining section softens contours of the warning image.

11 . The information processing apparatus of claim 1 , wherein the warning state determining section locates the warning image for display based on a line of sight of the user.

12 . The information processing apparatus of claim 1 , further comprising an input device that receives a user operation to start the information processing.

13 . The information processing apparatus of claim 1 , wherein the information processing section detects the user position by measuring reflected light from the user resulting from reference light incident on the user.

14 . The information processing apparatus of claim 1 , wherein the device produces an image of the real space and the user, and the information processing section detects the user position by performing information processing on the image.

15 . A method, comprising:

performing information processing on a basis of data received from a device that detects a user position, wherein the user position is determined based on a captured image;

generating an image to be displayed as a result of the information processing, where a user wears a head mounted display and the image displayed obstructs the user's vision;

determining that the user needs to be warned when the user position indicates that the user moves out of a play area set in an object space in reference to a detection field of the device, and to cause the image generating section to superpose a warning image on the image to be displayed; and

transmitting data of the image generated by the image generating section to the head mounted display, where the transmitting includes outputting, to the head mounted display, a confirmation screen prompting the user to confirm that there is an obstacle, prior to outputting the data of the image, wherein the determining includes determining that the user needs to be warned when the user position does not match a predetermined range and play area and the determining further includes changing at least one of the predetermined range and play area based on the user position.

16 . A non-transitory, computer readable storage medium containing a computer program, which when executed by a computer system, causes the computer system to carry out actions, comprising:

performing information processing on a basis of data received from a device that detects a user position, wherein the user position is determined based on a captured image;

generating an image to be displayed as a result of the information processing, where a user wears a head mounted display and the image displayed obstructs the user's vision;

determining that the user needs to be warned when the user position indicates that the user moves out of a play area set in an object space in reference to a detection field of the device, and to cause the image generating section to superpose a warning image on the image to be displayed; and

transmitting data of the image generated by the image generating section to the head mounted display, where the transmitting includes outputting, to the head mounted display, a confirmation screen prompting the user to confirm that there is an obstacle, prior to outputting the data of the image, wherein the determining includes determining that the user needs to be warned when the user position does not match a predetermined range and play area, and the determining further includes changing at least one of the predetermined range and play area based on the user position.

17 . The information processing apparatus of claim 1 , wherein the warning state determining section is further configured to cause the warning image to be translucent to enhance an affinity of the warning image with a virtual world.

18 . The method of claim 15 , wherein the warning state determining section is further configured to cause the warning image to be translucent to enhance an affinity of the warning image with a virtual world.

19 . The non-transitory, computer readable storage medium of claim 16 , wherein the warning state determining section is further configured to cause the warning image to be translucent to enhance an affinity of the warning image with a virtual world.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2026
From: IKENOUE, SHOICHI; NAKAMURA, YUJI; SUWA, YOSHIHIKO
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 074204/0622 →
Priority Claims (1)
JP 2015-243593 · Dec 14, 2015 · national
Continuity (4)
Continuation 17114539 · Dec 8, 2020
Continuation 16655501 · Oct 17, 2019
Continuation 15773447 · Dec 7, 2016
Related Publication 20230293980A1 · Sep 21, 2023
References Cited (77)
US 6204916B1 · Norita · 2001 [cited by examiner]
US 7330197B2 · Kobayashi · 2008 [cited by applicant]
US 9092125B2 · Michaelis · 2015 [cited by applicant]
US 9599818B2 · Yamagishi · 2017 [cited by applicant]
US 9690371B2 · Saito · 2017 [cited by applicant]
US 10192360B2 · Osawa · 2019 [cited by applicant]
US 10486062B2 · Ikenoue · 2019 [cited by examiner]
US 10888772B2 · Ikenoue · 2021 [cited by examiner]
US 11697062B2 · Ikenoue · 2023 [cited by examiner]
US 20040110565A1 · Levesque · 2004 [cited by applicant]
US 20050123171A1 · Kobayashi · 2005 [cited by applicant]
US 20070173265A1 · Gum · 2007 [cited by examiner]
US 20080043022A1 · Ishihara · 2008 [cited by applicant]
US 20090315978A1 · Wurmlin · 2009 [cited by examiner]
US 20110248927A1 · Michaelis · 2011 [cited by applicant]
US 20120086631A1 · Osman · 2012 [cited by examiner]
US 20120212508A1 · Kimball · 2012 [cited by examiner]
US 20130141419A1 · Mount · 2013 [cited by examiner]
US 20130142384A1 · Ofek · 2013 [cited by examiner]
US 20130169425A1 · Victor · 2013 [cited by applicant]
US 20130328928A1 · Yamagishi · 2013 [cited by applicant]
US 20150062000A1 · Saito · 2015 [cited by applicant]
US 20150094142A1 · Stafford · 2015 [cited by applicant]
US 20150154849A1 · Matsui · 2015 [cited by examiner]
US 20150248772A1 · Gove · 2015 [cited by applicant]
US 20150265920A1 · Kim · 2015 [cited by applicant]
US 20150288883A1 · Shigeta · 2015 [cited by applicant]
US 20170053440A1 · Yoon · 2017 [cited by examiner]
US 20170182412A1 · Osawa · 2017 [cited by applicant]
US 20170214905A1 · Wu · 2017 [cited by examiner]
US 20170262047A1 · Saito · 2017 [cited by applicant]
US 20180318704A1 · Ikegami · 2018 [cited by applicant]
CN 101064773A · 2007 [cited by applicant]
CN 101636207A · 2010 [cited by applicant]
CN 102214040A · 2011 [cited by applicant]
CN 102712285A · 2012 [cited by applicant]
CN 102968353A · 2013 [cited by applicant]
CN 203233507U · 2013 [cited by applicant]
CN 104071119A · 2014 [cited by applicant]
CN 104680557A · 2015 [cited by applicant]
CN 104991340A · 2015 [cited by applicant]
GB 201404850 · 2014 [cited by applicant]
JP 2005165848A · 2005 [cited by applicant]
JP 2006301924A · 2006 [cited by applicant]
JP 2007156561A · 2007 [cited by applicant]
JP 2010528716A · 2010 [cited by applicant]
JP 2011189066A · 2011 [cited by applicant]
JP 2012178061A · 2012 [cited by applicant]
JP 2013164737A · 2013 [cited by applicant]
JP 2013539377A · 2013 [cited by applicant]
JP 2013257716A · 2013 [cited by applicant]
JP 2013257762A · 2013 [cited by applicant]
JP 2014119786A · 2014 [cited by applicant]
JP 5580855B2 · 2014 [cited by applicant]
JP 2014157433A · 2014 [cited by applicant]
JP 2014203176A · 2014 [cited by applicant]
JP 2015045805A · 2015 [cited by applicant]
JP 2015116336A · 2015 [cited by applicant]
JP 2015156131A · 2015 [cited by applicant]
JP 6363587B2 · 2018 [cited by applicant]
WO 2015047775A1 · 2015 [cited by applicant]
Notice of Reasons for Refusal for corresponding JP Application No. 2022-084313, 12 pages, dated Jun. 30, 2023. [cited by applicant]
“Different experiences” Hatena Blog , Japan, 5 pages https://wapa.hatenablog.jp/entry/20061210/p1, dated Dec. 10, 2006 (For relevancy see Non-Pat. Lit. #1). [cited by applicant]
International Search Report for corresponding PCT Application No. PCT/JP2016/086444, 3 pages, dated Jan. 10, 2017. [cited by applicant]
Notification of Reason for Refusal for corresponding JP Application No. 2015243593, 5 pages, dated Feb. 27, 2018. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion for corresponding PCT Application No. PCT/ JP2016/086444, 13 pages, dated Jul. 20, 2017. [cited by applicant]
Extended European Search Report for corresponding EP Application No. 16875495.0, 7 pages, dated Nov. 6, 2018. [cited by applicant]
Notification of Reasons for Refusal for corresponding JP Application No. 2018-122892, 14 pages, dated Aug. 20, 2019. [cited by applicant]
Notice of Reasons for Refusal for corresponding JP Application No. 2019214957, 5 pages, dated Oct. 19, 2020. [cited by applicant]
The First Office Action for corresponding CN Application No. 201680071684.1, 12 pages, dated Mar. 17, 2021. [cited by applicant]
Notification of Reasons for Refusal for corresponding JP Application No. 2021065802, 7 pages, dated Jan. 31, 2022. [cited by applicant]
Wapa 2, “Back Technology,” Hatena Blog , Internet < URL:https://wapa.hatenablog.jp/entry/20061210/p1 > Wii Sports, 5 pages, Dec. 10, 2006 (for relevancy see Non-Pat. Lit. #8). [cited by applicant]
Notice of Reasons for Refusal for corresponding JP Application No. 2024-033525, 25 pages, dated Oct. 23, 2024. [cited by applicant]
Application No. CN202111330150.5, Office Action, Mailed On Nov. 28, 2025, 5 pages. [cited by applicant]
Application No. CN202111330150.5, Office Action, Mailed On Jan. 28, 2026, 5 pages. [cited by applicant]
EP Communication pursuant to Article 94(3) for corresponding EP Application No. EP23195695.4, May 28, 2025, 4 pages. [cited by applicant]
Office Action for corresponding application CN202111330150.5,, Sep. 27, 2025, 7 pages. [cited by applicant]