IP Library › Granted Patent US 12,243,437
Granted Patent B2
US 12,243,437 · App. 17/561,772 · Granted Mar 4, 2025

Crowd-based device configuration selection of a music teaching system

Inventors: Eran Aharonson (Tel Aviv, IL); Oded Zewi (Tel Aviv, IL); Yoav Biderman (Tel Aviv, IL); Yariv Bandiel (Tel Aviv, IL); Yuval Kaminka (Tel Aviv, IL); Saggi David Messer (Tel Aviv, IL); Or Yotvat Gafni (Tel Aviv, IL); Anatoli Tsinovoy (Tel Aviv, IL)
Assignee: Simply Ltd.
G09B15/00G10L25/51G10L25/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,437
App. No.
17/561,772
Granted
Mar 4, 2025
Kind
B2
Abstract

Aspects of embodiments pertain to a method for determining an Input/Output (I/O) device configuration for a music teaching system. The method may comprise receiving a plurality of I/O device configurations of a music teaching system; receiving, for a given I/O device of the music teaching system, an initial I/O device configuration; and determining an updated I/O device configuration for the given I/O Device, based on the initial I/O device configuration of the given I/O Device and at least one of the plurality of received I/O device configurations. The determining is performed such that the updated I/O device configuration has improved device performance compared to the initial I/O device configuration.

Claims (84)

1. A method for determining an Input/Output (I/O) device configuration of an I/O device, the configuration comprising microphone configuration, speaker configuration, or both, for use with a music teaching system, the method comprising:

a) receiving model information about a given I/O device;

b) receiving an initial I/O device configuration of the given I/O device, the device configuration comprising at least microphone configuration, speaker configuration, or both; and

c) receiving system usage characteristics of the given I/O device for the initial I/O device sound capturing configuration;

d) receiving, information about a plurality of I/O devices of the same model as the given I/O device, wherein the received information comprises respective I/O device sound capturing configurations, associated system usage characteristics and scores;

e) receiving an input indicative of background music (BGM) to be output by the I/O device;

f) while providing the BGM output: capturing through at least one microphone of the I/O device, sound of an instrument played by a user;

g) processing sound data relating to the captured sound;

determining, based on the received information about the plurality of I/O devices, and further based on the selected background music (BGM) and the processing of the sound data, whether the initial I/O device configuration for the given I/O Device is to be updated to obtain an updated I/O device configuration,

wherein for the updated configuration, one of the following is improved:

instrument sound recognition by the I/O device; or

composite sound quality comprising the BGM output and the instrument sound;

or both.

2. The method of claim 1 , further comprising updating the initial configuration of the given I/O device to obtain the updated configuration.

3. The method of claim 1 , wherein the updated I/O device configuration improves a performance score of one or more performance parameter values.

4. A method for determining an Input/Output (I/O) device configuration for a music teaching system, wherein the I/O device configuration comprises a speaker configuration, a microphone configuration, or both, the method comprising;

receiving from at least one first music teaching system used by at least one first user for at least one first environmental parameter:

at least one first sound capturing-configuration for I/O devices of the at least one first music teaching system;

at least one first score indicative of at least one first user experience and information about the at least one first environmental parameter; and

information about the at least one first environmental parameter;

receiving from at least one second music teaching system used by at least one second user in a at least one second environmental parameter:

at least one second configuration for I/O devices of the at least one second music teaching system;

at least one second score indicative of at least one second user experience and information about the at least one second environmental parameter; and

information about the at least one second environmental parameter; and

upon at least one third user initiating a music learning session with at least one third music teaching system having an initial configuration in at least one third environmental parameter:

receiving a third input indicative of a third background music (BGM) to be output by the I/O device and, while providing the third BGM output:

capturing through at least one microphone of the I/O device, a third sound of a third instrument played by the third user; and

processing third sound data relating to the third captured sound

determining, based on the at least one first score and the at least one second score and further based on the third BGM and the processing of the third sound data, at least one third configuration to be applied to the at least one third music teaching system for at least one third environmental parameter;

wherein for the at least one third configuration of the music teaching system, under the at least one third environmental parameter, the following is improved:

instrument sound recognition by the I/O device; or

composite sound quality comprising the BGM output and the instrument sound;

or both; and

transmitting the at least one third configuration to the at least one third music teaching system, such that the at least one third music teaching system can apply the at least one third configuration.

5. The method of claim 4 , further comprising providing the at least one first configuration to the at least one second music teaching system, and wherein the second configuration is updated by the at least one second music teaching system using the at least one first configuration as an initial configuration.

6. The method of claim 5 , further comprising introducing changes to the at least one first configuration by the at least one second music teaching system, thereby obtaining the at least one second configuration.

7. The method of claim 6 , wherein the at least one second configuration is determined using A/B testing.

8. The method of claim 4 , wherein the at least one first configuration or the at least one second configuration is determined in accordance with a score calculated upon a parameter relating to one or more of the following:

signal to noise ratio of a captured audio signal;

signal to noise ratio of the captured audio signal in certain frequencies or frequency ranges;

recognition rate of the audio signal captured during the at least one first user or the at least one second user playing a piece of music;

sound quality of the captured audio signal;

success rate of the at least one first user or the at least one second user in playing the piece of music;

time required for the at least one first user or the at least one second user to complete a playing task relative to a duration of the piece of music;

a monetary event taken by a user consequent playing the piece of music; and

user rate.

9. A system configured to determine an Input/Output (I/O) device configuration for a music teaching system, wherein the I/O device configuration comprises a speaker configuration, a microphone configuration, or both, the method comprising:

a memory configured to store data and software instructions, and

a processor which, when executing the software instructions, allows the execution of the following steps:

receiving model information about the given I/O device;

receiving an initial I/O device configuration of the given I/O device;

receiving system usage characteristics of the given I/O device for the initial I/O device configuration,

receiving an input indicative of background music (BGM) to be output by the given I/O device;

while providing the BGM output: capturing through at least one microphone of the given I/O device, sound of an instrument played by a user;

processing sound data relating to the captured sound; and

receiving, information about a plurality of I/O devices of the same model as the given I/O device, wherein the received information comprises respective I/O device configurations, associated system usage characteristics and scores;

determining, based on the received information about the plurality of I/O devices, and further based on the selected background music (BGM) and the processing of the sound data, whether the initial I/O device configuration of the given I/O Device is to be updated to obtain an updated I/O device configuration

wherein for the updated configuration, one of the following is improved:

instrument sound recognition by the I/O device; or

composite sound quality comprising the BGM output and the instrument sound;

or both.

10. The system of claim 9 , wherein the device configuration pertains to signal processing performed by the device.

11. The system of claim 9 , wherein the initial I/O device configuration are default I/O device sound capturing-configurations.

12. The system of claim 9 , wherein the updated I/O device configuration improves a performance score of one or more performance parameter values.

13. The system of claim 9 , wherein the determining of the updated I/O device configuration is executed such to improve device performance in accordance with a performance target function.

14. The system of claim 9 , wherein at least one user associates a performance score to at least two of the plurality of received I/O device configurations.

15. The system of claim 9 , wherein a performance score is assigned automatically to at least two of the plurality of received I/O device configurations based on a target function.

16. The system of claim 15 , wherein the updated I/O device configuration is determined based on the score associated to the at least two of the plurality of received I/O device configurations.

17. A system for determining an Input/Output (I/O) device configuration for use with a music teaching system, wherein the I/O device configuration comprises a speaker configuration, a microphone configuration, or both, the method comprising

a memory configured to store data and software instructions, and

a processor which, when executing the software instructions, causes the execution of the following steps:

receiving from at least one first music teaching system used by at least one first user in at least one first environmental parameter, at least one first configuration for I/O devices of the at least one first music teaching system along with at least one first score indicative of at least one first user experience;

receiving from at least one second music teaching system used by at least one second user in a second environmental parameter, at least one second configuration for I/O devices of the at least one second music teaching system;

upon at least one third user initiating a music learning session with at least one third music teaching system having an initial sound configuration:

receiving an input indicative of background music (BGM) to be output by a selected I/O device;

while providing the BGM output: capturing through at least one microphone of the selected I/O device, sound of an instrument played by a user;

processing sound data relating to the captured sound; and

determining, based on the at least one first and the at least one second score and further based on the selected background music (BGM) and the processing of the sound data, at least one third configuration to be applied to the at least one third music teaching system; and

transmitting the at least one third configuration to the at least one third music teaching system, such that the at least one third music teaching system can apply the at least one third configuration to the selected I/O device, wherein for the at least one third configuration of the music teaching system

one of the following is achieved for the selected I/O device:

improved instrument sound recognition by the selected I/O device; or

improved composite sound quality comprising the BGM output and the instrument sound;

or both

wherein a device configuration comprises at least microphone configuration, speaker configuration, or both.

Assignments (2)
CHANGE OF NAME Recorded Nov 20, 2024
From: JOYTUNES LTD.
To: SIMPLY LTD.
Reel/Frame 069396/0618 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2022
From: AHARONSON, ERAN; ZEWI, ODED; BIDERMAN, YOAV; BANDIEL, YARIV; KAMINKA, YUVAL; MESSER, SAGGI DAVID; GAFNI, OR YOTVAT; TSINOVOY, ANATOLI
To: JOYTUNES LTD
Reel/Frame 059072/0019 →
Continuity (6)
Continuation In Part 17467228 · Sep 5, 2021
Continuation In Part 17388050 · Jul 29, 2021
Provisional Application 63162823 · Mar 18, 2021
Provisional Application 63120434 · Dec 2, 2020
Related Publication 20220180767A1 · Jun 9, 2022
Related Publication 20240054911A2 · Feb 15, 2024
References Cited (177)
US 4248123A · Bunger et al. · 1981 [cited by applicant]
US 4496149A · Schwartzberg · 1985 [cited by applicant]
US 4516260A · Breedlove et al. · 1985 [cited by applicant]
US 4796891A · Milner · 1989 [cited by applicant]
US 4840602A · Rose · 1989 [cited by applicant]
US 4968255A · Lee et al. · 1990 [cited by applicant]
US 5167816A · Kruger et al. · 1992 [cited by applicant]
US 5214231A · Ernst et al. · 1993 [cited by applicant]
US 5349129A · Wisniewski et al. · 1994 [cited by applicant]
US 5521323A · Paulson et al. · 1996 [cited by applicant]
US 5544562A · Jeon · 1996 [cited by applicant]
US 5739759A · Nakazawa et al. · 1998 [cited by applicant]
US 5889224A · Tanaka · 1999 [cited by applicant]
US 6066791A · Renard et al. · 2000 [cited by applicant]
US 6069310A · James · 2000 [cited by examiner]
US 6084168A · Sitrick · 2000 [cited by applicant]
US 6132281A · Klitsner et al. · 2000 [cited by applicant]
US 6143973A · Kikuchi · 2000 [cited by examiner]
US 6166314A · Weinstock et al. · 2000 [cited by applicant]
US 6527611B2 · Cummings · 2003 [cited by applicant]
US 6912386B1 · Himberg et al. · 2005 [cited by applicant]
US 7030307B2 · Wedel · 2006 [cited by applicant]
US 7050462B2 · Tsunoda · 2006 [cited by examiner]
US 7129408B2 · Uehara · 2006 [cited by examiner]
US 7157638B1 · Sitrick · 2007 [cited by applicant]
US 7162041B2 · Haapapuro et al. · 2007 [cited by applicant]
US 7174510B2 · Salter · 2007 [cited by applicant]
US 7199298B2 · Funaki · 2007 [cited by applicant]
US 7248708B2 · Vaudrey et al. · 2007 [cited by applicant]
US 7271329B2 · Franzblau · 2007 [cited by applicant]
US 7297856B2 · Sitrick · 2007 [cited by applicant]
US 7297858B2 · Paepcke · 2007 [cited by examiner]
US 7405355B2 · Both · 2008 [cited by examiner]
US 7414186B2 · Scarpa et al. · 2008 [cited by applicant]
US 7423213B2 · Sitrick · 2008 [cited by applicant]
US 7482529B1 · Flamini et al. · 2009 [cited by applicant]
US 7511215B2 · Bicker · 2009 [cited by examiner]
US 7576280B2 · Lauffer · 2009 [cited by applicant]
US 7714222B2 · Taub · 2010 [cited by examiner]
US 7754955B2 · Egan · 2010 [cited by applicant]
US 7853342B2 · Redmann · 2010 [cited by examiner]
US 7893337B2 · Lenz · 2011 [cited by applicant]
US 8106281B2 · Minamitaka · 2012 [cited by applicant]
US 8183454B2 · Luedecke et al. · 2012 [cited by applicant]
US 8199934B2 · Osborne · 2012 [cited by applicant]
US 8338684B2 · Pillhofer et al. · 2012 [cited by applicant]
US 8481839B2 · Shaffer et al. · 2013 [cited by applicant]
US 8515093B2 · Bhandari et al. · 2013 [cited by applicant]
US 8525013B2 · Bicker · 2013 [cited by examiner]
US 8559656B2 · Shu et al. · 2013 [cited by applicant]
US 8629342B2 · Lee et al. · 2014 [cited by applicant]
US 8642871B2 · Feidner · 2014 [cited by applicant]
US 8660678B1 · Lavi et al. · 2014 [cited by applicant]
US 8697972B2 · Dripps et al. · 2014 [cited by applicant]
US 8826355B2 · DeLorme, Sr. · 2014 [cited by examiner]
US 8907193B2 · Cross et al. · 2014 [cited by applicant]
US 8986090B2 · Epstein · 2015 [cited by applicant]
US 8987572B2 · Shimizu et al. · 2015 [cited by applicant]
US 9029678B2 · Ye · 2015 [cited by applicant]
US 9082380B1 · Hamilton et al. · 2015 [cited by applicant]
US 9106790B2 · Bicker · 2015 [cited by examiner]
US 9120016B2 · Epstein · 2015 [cited by applicant]
US 9218705B2 · Taylor · 2015 [cited by applicant]
US 9218748B2 · Kaipainen et al. · 2015 [cited by applicant]
US 9333418B2 · Lee et al. · 2016 [cited by applicant]
US 9478201B1 · Begelfor et al. · 2016 [cited by applicant]
US 9492756B2 · Izkovsky et al. · 2016 [cited by applicant]
US 9576564B2 · Yamauchi et al. · 2017 [cited by applicant]
US 9578413B2 · Sawa et al. · 2017 [cited by applicant]
US 9672799B1 · Kim et al. · 2017 [cited by applicant]
US 9699414B2 · Kitazawa et al. · 2017 [cited by applicant]
US 9711121B1 · Ahmaniemi · 2017 [cited by applicant]
US 9721479B2 · Citron et al. · 2017 [cited by applicant]
US 9767705B1 · Klapuri et al. · 2017 [cited by applicant]
US 9807491B2 · Kim · 2017 [cited by applicant]
US 9839852B2 · Epstein · 2017 [cited by applicant]
US 9860635B2 · Fukuda et al. · 2018 [cited by applicant]
US 9866731B2 · Godfrey · 2018 [cited by examiner]
US 10008190B1 · Elson · 2018 [cited by examiner]
US 10026416B2 · Takasu et al. · 2018 [cited by applicant]
US 10032443B2 · Braasch et al. · 2018 [cited by applicant]
US 10034083B2 · Bostick · 2018 [cited by examiner]
US 10068558B2 · Polak · 2018 [cited by applicant]
US 10182093B1 · Klapuri · 2019 [cited by examiner]
US 10207192B2 · Cross et al. · 2019 [cited by applicant]
US 10235898B1 · Ryynanen et al. · 2019 [cited by applicant]
US 10311843B2 · Joshi · 2019 [cited by applicant]
US 10410614B2 · Elson · 2019 [cited by examiner]
US 10418008B2 · Bencar et al. · 2019 [cited by applicant]
US 10425718B2 · Cha et al. · 2019 [cited by applicant]
US 10482862B2 · Hamalainen et al. · 2019 [cited by applicant]
US 10490096B2 · Sorenson et al. · 2019 [cited by applicant]
US 10504498B2 · Ryynanen et al. · 2019 [cited by applicant]
US 10614786B2 · Barry · 2020 [cited by applicant]
US 10795638B2 · Sabin et al. · 2020 [cited by applicant]
US 10854181B2 · Joshi · 2020 [cited by applicant]
US 10964298B2 · Elson · 2021 [cited by examiner]
US 10991367B2 · Aoki · 2021 [cited by applicant]
US 11086597B2 · Yuan et al. · 2021 [cited by applicant]
US 11288975B2 · Jancsy · 2022 [cited by applicant]
US 11310538B2 · Holmberg · 2022 [cited by examiner]
US 11348561B2 · Maezawa · 2022 [cited by applicant]
US 11792557B1 · Lazarus · 2023 [cited by examiner]
US 20050081702A1 · Jung · 2005 [cited by applicant]
US 20050120866A1 · Brinkman · 2005 [cited by examiner]
US 20060123976A1 · Both · 2006 [cited by examiner]
US 20070039449A1 · Redmann · 2007 [cited by examiner]
US 20080302233A1 · Ding et al. · 2008 [cited by applicant]
US 20090173213A1 · Jiang et al. · 2009 [cited by applicant]
US 20100000040A1 · Shaw et al. · 2010 [cited by applicant]
US 20100137049A1 · Epstein · 2010 [cited by applicant]
US 20110036231A1 · Nakadai et al. · 2011 [cited by applicant]
US 20110087975A1 · Karsten · 2011 [cited by examiner]
US 20110207513A1 · Cross et al. · 2011 [cited by applicant]
US 20120295679A1 · Izkovsky et al. · 2012 [cited by applicant]
US 20150013381A1 · Duffy · 2015 [cited by applicant]
US 20150310841A1 · Semenzato · 2015 [cited by applicant]
US 20160284228A1 · McCarthy et al. · 2016 [cited by applicant]
US 20170116870A1 · Brem et al. · 2017 [cited by applicant]
US 20170221377A1 · Uemura et al. · 2017 [cited by applicant]
US 20180122260A1 · Walder et al. · 2018 [cited by applicant]
US 20180308382A1 · Koren et al. · 2018 [cited by applicant]
US 20190156807A1 · Ryynänen · 2019 [cited by examiner]
US 20200052667A1 · Jeon et al. · 2020 [cited by applicant]
US 20200074876A1 · Jancsy · 2020 [cited by applicant]
US 20200227013A1 · Elson · 2020 [cited by examiner]
US 20200372419A1 · Knickrehm et al. · 2020 [cited by applicant]
US 20210104169A1 · Si · 2021 [cited by examiner]
US 20210151017A1 · La · 2021 [cited by applicant]
US 20220172638A1 · Aharonson et al. · 2022 [cited by applicant]
US 20220172640A1 · Aharonson et al. · 2022 [cited by applicant]
US 20220180766A1 · Aharonson · 2022 [cited by examiner]
US 20230087817A1 · Settles et al. · 2023 [cited by applicant]
US 20240054911A2 · Aharonson · 2024 [cited by examiner]
US 20240112592A1 · Thür et al. · 2024 [cited by applicant]
US 20240112593A1 · Thür et al. · 2024 [cited by applicant]
CN 109493686A · 2019 [cited by applicant]
CN 109493686B · 2021 [cited by applicant]
EP 3236449A1 · 2017 [cited by applicant]
KR 20170138135A · 2017 [cited by applicant]
WO 2009156901A2 · 2009 [cited by applicant]
WO 2009156901A3 · 2010 [cited by applicant]
WO 2015113360A1 · 2015 [cited by applicant]
WO 2017037342A1 · 2017 [cited by applicant]
Non-Final Office Action mailed Jan. 18, 2023 on for U.S. Appl. No. 17/467,228, filed Sep. 5, 2021, 12 pages. [cited by applicant]
Notice of Allowance mailed on Jan. 12, 2023, for U.S. Appl. No. 17/388,050, filed Jul. 29, 2021, 4 pages. [cited by applicant]
Notice of Allowance mailed on Jan. 5, 2023, for U.S. Appl. No. 17/388,050, filed Jul. 29, 2021, 4 pages. [cited by applicant]
“A. P. Klapuri, “Multiple fundamental frequency estimation based on harmonicity and spectral smoothness,” IEEE Trans. Speech and Audio Proc., 11(6), 804-816, 2003.”. [cited by applicant]
“Anne-Mar ie Burns et al., “Visual Methods for t he Retrieval of Guitarist Fingering”, Proceedings of the 2006 International Conference on New Interfaces for Musical Expression, NIME06, Jun. 4-8, 2006, Paris, France Par… [cited by applicant]
“Sébastien, V., Ralambondrainy, H., Sébastien, O., & Conruyt, N. (Oct. 2012). Score analyzer: Automatically determining scores difficulty level for instrumental e-learning. In 13th International Society for Music Inform… [cited by applicant]
“Chiu et al., “Automatic System for the Arrangement of Piano Reductions”, Conference Paper—Jan. 2009, DOI: 10.1109/ISM.2009.105 ⋅ Source: DBLP”. [cited by applicant]
“Schulz, D. (2016), “Pianote: a sight-reading program that algorithmically generates music based on human performance”, A Thesis presented to the Faculty of California Polytechnic State University, San Luis Obispo. DOI:… [cited by applicant]
“Ethan G. Holder, “Musiplectics: Computational Assessment of the Complexity of Music Scores”, Thesis submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requ… [cited by applicant]
“Shih-Chuan Chiu et al. “A Study on Difficulty Level Recognition of Piano Sheet Music” dia 978-0-7695-4875-3/12 $26.00 © 2012 IEEE DOI 10.1109/ISM.2012.11 17 2012 IEEE International Symposium on Multimedia 978-0-7695-48… [cited by applicant]
“Huang et al., “Towards an Automatic Music Arrangement Framework Using Score Reduction”, ACM Transactions on Multimedia Computing, Communications and Applications, vol. 8, No. 1, Article 8, Publication date: Jan. 2012.”. [cited by applicant]
Jean-Marc Valin, “Speex: A Free Codec for Free Speech” CSIRO ICT Centre, Cnr Vimiera & Pembroke Roads, Marsfield NSW 2122, Australia Xiph.Org Foundation. [cited by applicant]
“Jiang et al., “Analyzing Chroma Feature Types for Automated Chord Recognition”, AES 42nd International Conference, Ilmenau, Germany, Jul. 22-24, 2011”. [cited by applicant]
“Klapuri, A. (Oct. 2006). Multiple fundamental frequency estimation by summing harmonic amplitudes. In ISMIR (pp. 216-221)”. [cited by applicant]
“Korzeniowski, F., & Widmer, G. (2018) “Improved chord recognition by combining duration and harmonic language models”, arXiv:1808.05335v1 [cs.SD] Aug. 16, 2018”. [cited by applicant]
“Lee, K. (Nov. 2006). Automatic chord recognition from audio using enhanced pitch class profile. In ICMC”. [cited by applicant]
“Lees, Kim and MacNamara, “Non-Invasive Determination of Core Temperature During Anesthesia”, South Med J . Oct. 1980;73(10):1322-4. doi: 10.1097/00007611-198010000-00010.”. [cited by applicant]
“Muller et al., “Chroma Toolbox: Matlab Implementations for Extracting Variants of Chroma-Based Audio Features”, Proceedings of the International Society for Music Information Retrieval Conference: 215-220”. [cited by applicant]
“Nakamura et al. “Statistical piano reduction controlling performance difficulty”, SIP (2018), vol. 7, e13, p. 1 of 12 © The Authors, 2018.”. [cited by applicant]
“Song, Y. E., & Lee, Y. K. (2016). A Method for Measuring the Difficulty of Music Scores. Journal of the Korea Society of Computer and Information, 21(4), 39-46”. [cited by applicant]
“Pritish Chandna et al, “Monoaural Audio Source Separation Using Deep Convolutional Neural Networks”, Music Technology Group, Universitat Pompeu Fabra, Barcelona”. [cited by applicant]
Uhlich et al. “Improving Music Source Separation Based on Deep Neural Networks Through Data Augmentation and Network Blending”, Conference Paper ⋅ Mar. 2017, DOI: 10.1109/ICASSP.2017.7952158. [cited by applicant]
“Yuksel, B. F., Oleson, K. B., Harrison, L., Peck, E. M., Afergan, D., Chang, R., & Jacob, R. J. (May 2016). Learn piano with BACh: An adaptive learning interface that adjusts task difficulty based on brain state. In Pr… [cited by applicant]
Non-Final Office Action mailed Feb. 2, 2023 on for U.S. Appl. No. 17/529,704, filed Nov. 18, 2021, 13 pages. [cited by applicant]
Non-Final Office Action mailed Dec. 27, 2022 on for U.S. Appl. No. 17/467,224, filed Sep. 5, 2021, 12 pages. [cited by applicant]
Notice of Allowance mailed on Dec. 29, 2022, for U.S. Appl. No. 17/388,050, filed Jul. 29, 2021, 10 pages. [cited by applicant]
Gallo A., “A Refresher of A/B Testing,” Harvard Business Review, Jun. 28, 2017. [cited by applicant]
Non Final Office Action mailed Jul. 11, 2023 on for U.S. Appl. No. 17/529,704, filed Nov. 18, 2021, 15 pages. [cited by applicant]
Notice of Allowance mailed on Jun. 9, 2023, for U.S. Appl. No. 17/467,224, filed Sep. 5, 2021, 11 pages. [cited by applicant]
Notice of Allowance mailed on Jul. 14, 2023, for U.S. Appl. No. 17/467,228, filed Sep. 5, 2021, 11 pages. [cited by applicant]
Notice of Allowance mailed on Mar. 28, 2023, for U.S. Appl. No. 17/388,050, filed Jul. 29, 2021, 7 pages. [cited by applicant]
Notice of Allowance mailed on Aug. 7, 2023, for U.S. Appl. No. 17/467,228, filed Sep. 5, 2021, 9 pages. [cited by applicant]
U.S. Appl. No. 16/074,230 Final office action dated May 4, 2023. [cited by applicant]