IP Library › Granted Patent US 12,300,246
Granted Patent B2
US 12,300,246 · App. 18/414,577 · Granted May 13, 2025

Apparatus, system, and method of display control, and recording medium

Inventor: Takuro Mano (Kanagawa, JP)
Assignee: RICOH COMPANY, LTD.
G10L15/26G06F3/167G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,300,246
App. No.
18/414,577
Granted
May 13, 2025
Kind
B2
Abstract

A system includes: a server including first circuitry and a memory that stores, for each event, voice data recorded during the event, text data converted from the voice data, and time information indicating a time when the text data was generated; and a display control apparatus communicably connected with the server, including second circuitry to based on information on the event stored in the memory, control a display to display text data in an order according to the time when the text data was generated, and a graphical control region that sets playback position in a total playback time of the voice data, and in response to selection of particular text data from the text data being displayed, control the display to display the graphical control region at a location determined based on a time when the particular text data was generated.

Claims (55)

1. A display control apparatus terminal, comprising:

circuitry configured to:

receive, from a management server that manages text data converted from audio data generated during an event, the text data and time information related to the text data;

control a display to display a first display area and a second display area, wherein the first display area includes the text data in an order according to the time information and the second display area includes a plurality of images corresponding to different times during a total playback time of the audio data;

receive selection of a particular image of the plurality of images in the second display area, the particular image corresponding to a particular time; and

control the display to display, in the first display area, text data corresponding to the particular time.

2. The display terminal of claim 1 , wherein the circuitry is configured to further display a third display area including a first image indicating a playback time of the total playback time of the audio data.

3. The display terminal of claim 2 , wherein the circuitry is further configured to:

receive selection of particular text data from among the text data displayed in the first display area; and

control the display to display the first image at a location in the third display area, the location based on a time indicated by the time information corresponding to the particular text data.

4. The display terminal of claim 3 , wherein the circuitry is further configured to:

playback the audio data related to the time indicated by the time information corresponding to the particular text data; and

control the display to display, as the first image, a playback time of the audio data.

5. The display terminal of claim 4 , wherein the time indicated by the time information corresponding to the particular text data is a playback start time of the audio data.

6. The display terminal of claim 5 , wherein

the circuitry is further configured to control the display to display a second image representing a playback progress of the audio data, and

the second image includes the first image.

7. The display terminal of claim 6 , wherein the second image is a seek bar for receiving designation on a playback start time of the audio data.

8. A system, comprising:

a management server that manages text data converted from audio data generated during an event; and

a display terminal communicably connected with the management server, wherein

the management server includes server circuitry configured to transmit the text data and time information related to the text data to the display terminal, and

the display terminal includes terminal circuitry configured to:

receive the text data and the time information from the management server;

control a display to display a first display area and a second display area, wherein the first display area includes the text data in an order according to the time information and the second display area includes a plurality of images corresponding to different times during a total playback time of the audio data;

receive selection of a particular image of the plurality of images in the second display area, the particular image corresponding to a particular time; and

control the display to display, in the first display area, text data corresponding to the particular time.

9. The system of claim 8 , wherein the terminal circuitry is configured to further display a third display area including a first image indicating a playback time of the total playback time of the audio data.

10. The system of claim 9 , wherein the terminal circuitry is further configured to:

receive selection of particular text data from among the text data displayed in the first display area; and

control the display to display the first image at a location in the third display area, the location based on a time indicated by the time information corresponding to the particular text data.

11. The system of claim 10 , wherein the terminal circuitry is further configured to:

playback the audio data related to the time indicated by the time information corresponding to the particular text data; and

control the display to display, as the first image, a playback time of the audio data.

12. The system of claim 11 , wherein the time indicated by the time information corresponding to the particular text data is a playback start time of the audio data.

13. The system of claim 9 , wherein

the terminal circuitry is further configured to control the display to display a second image representing a playback progress of the audio data, and

the second image includes the first image.

14. The system of claim 13 , wherein the second image is a seek bar for receiving designation on a playback start time of the audio data.

15. A display control method, comprising:

receiving, from a management server that manages text data converted from audio data generated during an event, the text data and time information related to the text data;

controlling a display to display a first display area and a second display area, wherein the first display area includes the text data in an order according to the time information and the second display area includes a plurality of images corresponding to different times during a total playback time of the audio data;

receiving selection of a particular image of the plurality of images in the second display area, the particular image corresponding to a particular time; and

controlling the display to display, in the first display area, text data corresponding to the particular time.

16. The display control method of claim 15 , further comprising controlling the display to display a third display area including a first image indicating a playback time of the total playback time of the audio data.

17. The display control method of claim 16 , further comprising:

receiving selection of particular text data from among the text data displayed in the first display area; and

controlling the display to display the first image at a location in the third display area, the location based on a time indicated by the time information corresponding to the particular text data.

18. The display control method of claim 17 , further comprising:

playing back the audio data related to the time indicated by the time information corresponding to the particular text data; and

controlling the display to display, as the first image, a playback time of the audio data.

19. The display control method of claim 18 , wherein the time indicated by the time information corresponding to the particular text data is a playback start time of the audio data.

20. The display control method of claim 16 , further comprising:

controlling the display to display a second image representing a playback progress of the audio data, wherein

the second image includes the first image.

Priority Claims (2)
JP 2018-223360 · Nov 29, 2018 · national
JP 2019-178481 · Sep 30, 2019 · national
Continuity (3)
Continuation 17693448 · Mar 14, 2022
Continuation 16697190 · Nov 27, 2019
Related Publication 20240153506A1 · May 9, 2024
References Cited (111)
US 6177928B1 · Basso · 2001 [cited by examiner]
US 6374225B1 · Hejna, Jr. · 2002 [cited by examiner]
US 6453281B1 · Walters · 2002 [cited by examiner]
US 6664990B1 · Bates et al. · 2003 [cited by applicant]
US 6883146B2 · Prabhu et al. · 2005 [cited by applicant]
US 7010744B1 · Torgerson · 2006 [cited by applicant]
US 7237207B2 · Panditharadhya et al. · 2007 [cited by applicant]
US 7389268B1 · Kemp, II et al. · 2008 [cited by applicant]
US 7610079B2 · Schwarze et al. · 2009 [cited by applicant]
US 7676756B2 · Vedula et al. · 2010 [cited by applicant]
US 7856248B1 · Fujisaki · 2010 [cited by examiner]
US 8050586B2 · Hoshino et al. · 2011 [cited by applicant]
US 8312660B1 · Fujisaki · 2012 [cited by examiner]
US 8385588B2 · Jacoby · 2013 [cited by examiner]
US 8411830B2 · Gilbert · 2013 [cited by examiner]
US 8428421B2 · Bhogal et al. · 2013 [cited by applicant]
US 8447285B1 · Bladon · 2013 [cited by examiner]
US 8639214B1 · Fujisaki · 2014 [cited by examiner]
US 8676273B1 · Fujisaki · 2014 [cited by examiner]
US 8787618B2 · Tokutake · 2014 [cited by examiner]
US 9009033B2 · Hon-Anderson · 2015 [cited by examiner]
US 9053222B2 · Lynn et al. · 2015 [cited by applicant]
US 9201558B1 · Dingman et al. · 2015 [cited by applicant]
US 9430114B1 · Dingman et al. · 2016 [cited by applicant]
US 9639251B2 · Lee · 2017 [cited by examiner]
US 9794710B1 · Sheen · 2017 [cited by applicant]
US 9860670B1 · Sheen · 2018 [cited by applicant]
US 10048854B2 · Zhang et al. · 2018 [cited by applicant]
US 10296188B2 · Kodisoja et al. · 2019 [cited by applicant]
US 10325394B2 · Wang et al. · 2019 [cited by applicant]
US 10347296B2 · An · 2019 [cited by applicant]
US 10404923B1 · Pena et al. · 2019 [cited by applicant]
US 10732244B2 · Rasche et al. · 2020 [cited by applicant]
US 10742939B1 · Sommerlatt · 2020 [cited by applicant]
US 11289093B2 · Mano · 2022 [cited by examiner]
US 11651149B1 · Miller et al. · 2023 [cited by applicant]
US 11915703B2 · Mano · 2024 [cited by examiner]
US 20020163547A1 · Abramson · 2002 [cited by examiner]
US 20030046080A1 · Hejna, Jr. · 2003 [cited by applicant]
US 20040030249A1 · Willis · 2004 [cited by applicant]
US 20040193592A1 · Ozaki · 2004 [cited by examiner]
US 20050060175A1 · Farber et al. · 2005 [cited by applicant]
US 20050108775A1 · Bachar et al. · 2005 [cited by applicant]
US 20050252296A1 · Hock et al. · 2005 [cited by applicant]
US 20070196075A1 · Yanagita · 2007 [cited by applicant]
US 20090089837A1 · Momosaki · 2009 [cited by examiner]
US 20090140855A1 · Shemesh et al. · 2009 [cited by applicant]
US 20090216531A1 · Yanagihara · 2009 [cited by applicant]
US 20100003013A1 · Kim · 2010 [cited by examiner]
US 20120089470A1 · Barnes, Jr. · 2012 [cited by examiner]
US 20120096490A1 · Barnes, Jr. · 2012 [cited by examiner]
US 20120310649A1 · Cannistraro et al. · 2012 [cited by applicant]
US 20130086051A1 · Brahms et al. · 2013 [cited by applicant]
US 20130191211A1 · Nichols · 2013 [cited by examiner]
US 20140109016A1 · Ouyang et al. · 2014 [cited by applicant]
US 20140282004A1 · Birmingham · 2014 [cited by applicant]
US 20140324426A1 · Lu et al. · 2014 [cited by applicant]
US 20140358536A1 · Choi · 2014 [cited by examiner]
US 20150019969A1 · Lee et al. · 2015 [cited by applicant]
US 20150039991A1 · Cameron et al. · 2015 [cited by applicant]
US 20150058007A1 · Kim et al. · 2015 [cited by applicant]
US 20150169279A1 · Duga · 2015 [cited by applicant]
US 20160019894A1 · Tsujikawa et al. · 2016 [cited by applicant]
US 20160070533A1 · Foster · 2016 [cited by applicant]
US 20170004859A1 · Charumilind · 2017 [cited by examiner]
US 20170249294A1 · Emori · 2017 [cited by applicant]
US 20170300291A1 · Lee et al. · 2017 [cited by applicant]
US 20170301073A1 · Gao · 2017 [cited by applicant]
US 20180007448A1 · Gupta · 2018 [cited by examiner]
US 20180032305A1 · Cameron et al. · 2018 [cited by applicant]
US 20180063332A1 · Ishiyama · 2018 [cited by examiner]
US 20180239822A1 · Reshef et al. · 2018 [cited by applicant]
US 20180268819A1 · Nakashima · 2018 [cited by examiner]
US 20180268822A1 · Mano · 2018 [cited by applicant]
US 20190026260A1 · Schubert et al. · 2019 [cited by applicant]
US 20190096407A1 · Lambourne · 2019 [cited by examiner]
US 20190114477A1 · Mano · 2019 [cited by applicant]
US 20190132372A1 · Litsyn et al. · 2019 [cited by applicant]
US 20190205468A1 · Barnes, Jr. · 2019 [cited by examiner]
US 20190324963A1 · Mano · 2019 [cited by examiner]
US 20190341050A1 · Diamant et al. · 2019 [cited by applicant]
US 20200138320A1 · Parvizi et al. · 2020 [cited by applicant]
US 20200159549A1 · Chen et al. · 2020 [cited by applicant]
US 20200175991A1 · Mano · 2020 [cited by examiner]
US 20200183971A1 · Klein et al. · 2020 [cited by applicant]
US 20200186728A1 · Pena et al. · 2020 [cited by applicant]
US 20200294487A1 · Donohoe et al. · 2020 [cited by applicant]
US 20200348903A1 · Kotelly et al. · 2020 [cited by applicant]
US 20200356722A1 · Mano · 2020 [cited by examiner]
US 20200409548A1 · Irvine · 2020 [cited by applicant]
US 20210104082A1 · Brochier et al. · 2021 [cited by applicant]
US 20210160435A1 · Pena et al. · 2021 [cited by applicant]
US 20210204012A1 · Ng et al. · 2021 [cited by applicant]
US 20220199089A1 · Mano · 2022 [cited by examiner]
US 20230030429A1 · Mano · 2023 [cited by examiner]
US 20240153506A1 · Mano · 2024 [cited by examiner]
EP 3197139A1 · 2017 [cited by applicant]
JP 2006080916A · 2006 [cited by applicant]
JP 2014222290A · 2014 [cited by applicant]
JP 2015028625A · 2015 [cited by applicant]
JP 2016105241A · 2016 [cited by applicant]
JP 2017117161A · 2017 [cited by applicant]
JP 2017129720A · 2017 [cited by applicant]
JP 2017167860A · 2017 [cited by applicant]
JP 2017173768A · 2017 [cited by applicant]
WO 2017157428A1 · 2017 [cited by applicant]
WO 2017159642A1 · 2017 [cited by applicant]
Extended European Search Report dated Apr. 29, 2020, issued in corresponding European Patent Application No. 19211463.5, 7 pages. [cited by applicant]
Office Action issued Apr. 4, 2023 in Japanese Patent Application No. 2019-178481, 7 pages. [cited by applicant]
Decision of refusal issued Feb. 13, 2024 in Japanese Patent Application No. 2019-178481, 4 pages. [cited by applicant]
Office Action issued Mar. 4, 2025 in Japanese Patent Application No. 2024-078287, 5 pages. [cited by applicant]