IP Library Granted Patent US 9,348,818
Granted Patent B2
US 9,348,818 · App. 14/221,142 · Granted May 24, 2016

Systems and methods for incentivizing user feedback for translation processing

Inventors: Gabriel Leydon (Redwood City, CA); Francois Orsini (San Francisco, CA); Nikhil Bojja (Mountain View, CA)
Assignee: Machine Zone, Inc.
G06F17/28G06F17/2854G06Q30/0217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,348,818
App. No.
14/221,142
Granted
May 24, 2016
Kind
B2
Abstract

Systems and methods of various embodiments may enable or refine translation of text between a first language and a second language. In particular, systems and methods may enable or refine a text translation by soliciting and/or receiving feedback for: translation of a first word or phrase from a first language to a second language; transformation of the first word or phrase (in the first language) to a second word or phrase in the first language; or transformation of the first word or phrase (in the first language) to a second word or phrase in the second language. The systems and methods of various embodiments may incentivize user feedback for failed translations in order to encourage user feedback, improve the quality of user feedback received, and to permit development of translation corpora that can evolve with time.

Claims (36)

1. A computer-implemented method comprising using one or more computers to perform operations comprising: selecting, by at least one processor, from a data store a word or phrase associated with a failure to translate a message containing the word or phrase from a first language to a second language; selecting, by the at least one processor, a user from which to solicit user feedback for the translation failure; sending, by the at least one processor, a request for the feedback to a computing device of the selected user; receiving, by the at least one processor, the user feedback from the computing device wherein the user feedback comprises a respective word or phrase in the first or second language; determining, by the at least one processor, that the user feedback is approved; and based on the approval, crediting an account of the user, by the at least one processor, wherein crediting the account comprises determining a credit based on a complexity of the word or phrase or an importance of the word or phrase.

2. The method of claim 1 , wherein the failure is due to an actual failure to translate the message.

3. The method of claim 1 wherein the failure is due to a user flagging the message as potentially incorrect.

4. The method of claim 1 wherein selecting the user is based on a confidence measure of the user, a quota associated with the user, a previous credit to the account of the user, a preference of the user, or a language ability of the user.

5. The method of claim 1 , wherein the word or phrase comprises chatspeak in the first language.

6. The method of claim 1 , wherein the user feedback comprises chatspeak in the second language.

7. The method of claim 1 , wherein the request comprises a field configured to receive a text-based value.

8. The method of claim 1 , wherein the request comprises a set of preselected definitions from which the user can choose a definition for the word or phrase.

9. The method of claim 8 wherein the set of preselected definitions comprises at least one definition provided by another user in response to another request, the other request being previously generated to obtain previous user feedback for the word or phrase from the other user.

10. The method of claim 9 wherein the other request comprised another set of preselected definitions from which the other user chose the definition.

11. The method of claim 1 , further comprising evaluating the user feedback to determine a most popular response.

12. The method of claim 1 , further comprising determining a competency of the user based on the user feedback.

13. The method of claim 1 , further comprising updating a transformation or translation of the word or phrase from the first language to the second language based on the user feedback.

14. The method of claim 1 wherein determining that the user feedback is approved comprises one or more of: determining that the user feedback is not fraudulent, and determining that the user feedback is accurate.

15. The method of claim 1 wherein determining that the user feedback is approved comprises comparing the user feedback to at least one previous user feedback provided by another user in response to another request, the other request being previously generated to obtain feedback for the word or phrase from the other user.

16. The method of claim 1 wherein crediting the account comprises crediting the account with in-game currency or an in-game item.

17. A manufacture comprising:

non-transitory computer readable media comprising executable instructions, the executable instructions being executable by one or more processors to perform operations comprising:

selecting from a data store a word or phrase associated with a failure to translate a message containing the word or phrase from a first language to a second language;

selecting a user from which to solicit user feedback for the translation failure;

sending a request for the feedback to a computing device of the selected user;

receiving the user feedback from the computing device wherein the user feedback comprises a respective word or phrase in the first or second language;

determining that the user feedback is approved; and based on the approval, crediting an account of the user, wherein crediting the account comprises determining a credit based on a complexity of the word or phrase or an importance of the word or phrase.

18. A system comprising: one or more computers programed to perform operations comprising: selecting from a data store a word or phrase associated with a failure to translate a message containing the word or phrase from a first language to a second language; selecting a user from which to solicit user feedback for the translation failure; sending a request for the feedback to a computing device of the selected user; receiving the user feedback from the computing device wherein the user feedback comprises a respective word or phrase in the first or second language; determining that the user feedback is approved; and based on the approval, crediting an account of the user, wherein crediting the account comprises determining a credit based on a complexity of the word or phrase or an importance of the word or phrase.

19. The system of claim 18 , wherein the failure is due to an actual failure to translate the message.

20. The system of claim 18 wherein the failure is due to a user flagging the message as potentially incorrect.

21. The system of claim 18 wherein selecting the user is based on a confidence measure of the user, a quota associated with the user, a previous credit to the account of the user, a preference of the user, or a language ability of the user.

22. The system of claim 18 , wherein the word or phrase comprises chatspeak in the first language.

23. The system of claim 18 , wherein the user feedback comprises chatspeak in the second language.

24. The system of claim 18 , wherein the request comprises a field configured to receive a text-based value.

25. The system of claim 18 , wherein the request comprises a set of preselected definitions from which the user can choose a definition for the word or phrase.

26. The system of claim 25 wherein the set of preselected definitions comprises at least one definition provided by another user in response to another request, the other request being previously generated to obtain previous user feedback for the word or phrase from the other user.

27. The system of claim 26 wherein the other request comprised another set of preselected definitions from which the other user chose the definition.

28. The system of claim 18 , wherein the operations further comprise evaluating the user feedback to determine a most popular response.

29. The system of claim 18 , wherein the operations further comprise determining a competency of the user based on the user feedback.

30. The system of claim 18 wherein determining that the user feedback is approved comprises one or more of: determining that the user feedback is not fraudulent, and determining that the user feedback is accurate.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded May 19, 2020
From: COMERICA BANK
To: MZ IP HOLDINGS, LLC
Reel/Frame 052706/0899 →
RELEASE OF SECURITY INTEREST Recorded May 19, 2020
From: MGG INVESTMENT GROUP LP, AS COLLATERAL AGENT
To: MACHINE ZONE, INC.; SATORI WORLDWIDE, LLC; COGNANT LLC
Reel/Frame 052706/0917 →
SECURITY INTEREST Recorded May 22, 2018
From: MZ IP HOLDINGS, LLC
To: COMERICA BANK
Reel/Frame 046215/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2018
From: MACHINE ZONE, INC.
To: MZ IP HOLDINGS, LLC
Reel/Frame 045786/0179 →
NOTICE OF SECURITY INTEREST -- PATENTS Recorded Feb 2, 2018
From: MACHINE ZONE, INC.; SATORI WORLDWIDE, LLC; COGNANT LLC
To: MGG INVESTMENT GROUP LP, AS COLLATERAL AGENT
Reel/Frame 045237/0861 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2014
From: LEYDON, GABRIEL; ORSINI, FRANCOIS; BOJJA, NIKHIL; KARUR, SHAILEN
To: MACHINE ZONE, INC.
Reel/Frame 033434/0191 →
Continuity (4)
Continuation 13908979 · Jun 3, 2013
Continuation In Part 13763565 · Feb 8, 2013
Provisional Application 61778282 · Mar 12, 2013
Related Publication 20140229157A1 · Aug 14, 2014