IP Library › Granted Patent US 10,628,114
Granted Patent B2
US 10,628,114 · App. 15/761,635 · Granted Apr 21, 2020

Displaying images with integrated information

Inventors: Shunichi Kasahara (Kanagawa, JP); Junichi Rekimoto (Kanagawa, JP)
Assignee: Sony Corporation
G06F3/1454G06F1/1686G06F3/011G06F3/017G06T11/60H04N5/225H04N7/147H04N7/15H04N7/152H04N7/18H04N7/185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,114
App. No.
15/761,635
Granted
Apr 21, 2020
Kind
B2
Abstract

To provide an information processing system and information processing method that control display of information input with a receiver of a captured image. In a case where a first Ghost and a second Ghost receive an image (first person view) captured by a Body and first information generated in accordance with input to the first Ghost and second information generated in accordance with input to the second Ghost are transmitted to the Body, a control unit 509 performs control such that an integrated image obtained by integrating the first information and the second information is displayed and output to a display unit 503.

Claims (51)

1. An information processing system comprising:

at least one processor configured to:

send an image captured by a camera of a mobile terminal to a first system and a second system;

integrate first text information generated by the first system and second text information generated by the second system by extracting at least one of a common word or a frequently-appearing word from the first text information and the second text information, wherein the first text information and the second text information are related to the captured image; and

control a display device of the mobile terminal to display the at least one of the extracted common word or the extracted frequently-appearing word.

2. The information processing system according to claim 1 , wherein

the first text information is based on audio information received by the first system, and

the second text information is based on audio information received by the second system.

3. The information processing system according to claim 1 , wherein

the at least one processor is configured to control the display device to change the at least one of the extracted common word or the extracted frequently-appearing word in accordance a change of a volume of audio information received by at least one of the first system or the second system.

4. The information processing system according to claim 1 , wherein

the at least one processor is configured to control the display device to display a heat map image showing a distribution of locations indicated by a plurality of systems that include the first system and the second system.

5. The information processing system according to claim 1 , wherein

the at least one processor is configured to control the display device to display the at least one of the extracted common words or the extracted frequently-appearing word in a form of a tag cloud.

6. The information processing system according to claim 1 , wherein

the information processing system is the mobile terminal.

7. The information processing system according to claim 6 , wherein

the mobile terminal is a head mounted display, and

the at least one processor is configured to control the head mounted display to superimpose the at least one of the extracted common word or the extracted frequently-appearing word on a scene of a real world.

8. The information processing system according to claim 1 , wherein

the information processing system is a server that wirelessly connects to the first system and the second system.

9. An information processing method comprising:

sending, via an information processing server, an image captured by a camera of a mobile terminal to a first system and a second system;

integrating first text information generated by the first system and second text information generated by the second system by extracting at least one of a common word or a frequently-appearing word from the first text information and the second text information, wherein the first text information and the second text information are related to the captured image; and

controlling a display device of the mobile terminal to display the at least one of the extracted common word or the extracted frequently-appearing word.

10. An information processing system comprising:

at least one processor configured to:

send an image captured by a camera of a mobile terminal to a first system and a second system;

integrate first text information generated by the first system and second text information generated by the second system by summarizing the first text information and the second text information, wherein the first text information and the second text information are related to the captured image; and

control a display device of the mobile terminal to display the summarized text information.

11. The information processing system according to claim 10 , wherein

the first text information is based on audio information received by the first system, and

the second text information is based on audio information received by the second system.

12. The information processing system according to claim 11 , wherein

the at least one processor is configured to control the display device to change the summarized text information in accordance a change of a volume of audio information received by at least one of the first system or the second system.

13. The information processing system according to claim 11 , wherein

the at least one processor is configured to control the display device to display a heat map image showing a distribution of locations indicated by a plurality of systems that include the first system and the second system.

14. The information processing system according to claim 11 , wherein

the at least one processor is configured to control the display device to display the summarized text information in a form of a tag cloud.

15. The information processing system according to claim 11 , wherein

the information processing system is the mobile terminal.

16. The information processing system according to claim 15 , wherein

the mobile terminal is a head mounted display, and

the at least one processor is configured to control the head mounted display to superimpose the summarized text information on a scene of a real world.

17. The information processing system according to claim 10 , wherein

the information processing system is a server that wirelessly connects to the first system and the second system.

18. An information processing method comprising:

sending, via an information processing server, an image captured by a camera of a mobile terminal to a first system and a second system;

integrating first text information generated by the first system and second text information generated by the second system by summarizing the first text information and

the second text information, wherein the first text information and the second text information are related to the captured image; and

controlling a display device of the mobile terminal to display the summarized text information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2018
From: KASAHARA, SHUNICHI; REKIMOTO, JUNICHI
To: SONY CORPORATION
Reel/Frame 045665/0481 →
Priority Claims (1)
JP 2015-195059 · Sep 30, 2015 · national
Continuity (1)
Related Publication 20180349083A1 · Dec 6, 2018