User Tools

Site Tools


isaac_project:en:long_context:long_context_acceptability

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
isaac_project:en:long_context:long_context_acceptability [2025/03/26 13:19]
sergio
isaac_project:en:long_context:long_context_acceptability [2025/05/12 09:14] (current)
karma ↷ Links adapted because of a move operation
Line 1: Line 1:
 ==== Long Context Acceptability ==== ==== Long Context Acceptability ====
  
-**Please read the Guideline ​and Finish ​the Quiz before start the task**\\+ 
 +**Please read the guidelines (ask your Project Manager to send you a full guideline) ​and finish ​the quiz before start the task**\\
  
 ** Task Description:​** \\ ** Task Description:​** \\
Line 13: Line 14:
 ** UI Display**: \\ ** UI Display**: \\
  
-Login on OneForma and find below ''​Long_Context_Acceptability_JapaneseToFrench''​ webapp. Click ''"​Actions"''​ to get started. \\+Login on OneForma and find below e.g. ''​Long_Context_Acceptability_JapaneseToFrench''​ webapp. Click ''"​Actions"''​ to get started. \\
  
 {{:​isaac_project:​en:​long_context_acceptability_1.jpg|}} {{:​isaac_project:​en:​long_context_acceptability_1.jpg|}}
Line 28: Line 29:
  
 If you don’t want to annotate, please click ''​“Skip Hit”''​ , select corresponding reason, and then move to next one.\\ If you don’t want to annotate, please click ''​“Skip Hit”''​ , select corresponding reason, and then move to next one.\\
 +
 +{{:​isaac_project:​en:​long_context_acceptability_4.jpg|}}
 +
 +Then you can start annotating as the guide instructed. **Be sure you have read the guide very carefully, as this task requires really careful and detailed work. **\\
 +
 +Points to emphasize: \\
 +
 +
 +1. Do not annotate the "<​human>"​ "<​bot>"​ tags.
 +{{:​isaac_project:​en:​thumb-bot.png|}}
 +
 +2. There are hits with the same source but different translation. **Please pay attention, and do not take them as repeated hits.** ​
 +
 +3.The errors can be sorted out as "​Major"​("​Severe"​) and "​non-Major"​("​Minor"​) error. **Slide ON for Severe, slide OFF for minor:​** ​
 +
 +{{:​isaac_project:​en:​long_context_acceptability_5.png|}}
 +{{:​isaac_project:​en:​long_context_acceptability_6.png|}}
 +
 +{{:​isaac_project:​en:​long_context_acceptability_7.png|}}
 +
 +4.There might be cases where the lines/ paragraphs of source and translation cannot totally match, refer to below. For such cases, **please do the judgement by taking all the lines/​paragraphs as a single entity.** ​
 +
 +{{:​isaac_project:​en:​long_context_acceptability_8.png|}}
 +
 +For more details, please refer to the attached guide. Making sure you have fully understood everything in the guide before starting. \\
 +
 +About cheating behavior:\\
 +
 +This is to emphasize that any cheating behavior is not allowed in ISAAC project.\\
 +For LCA tasks, the cheating behavior includes but not limit to below cases:\\
 + 1) don’t check source but just casually make annotation on target text;\\
 + 2) just check and annotate a part of content; \\
 + 3) just annotate one error but not conduct a thorough inspection; \\
 + 4) Not adhering to the requirements listed in the guidelines, but just simplistically marking an entire sentence as incorrect, results in an inability to determine which specific part is wrong. \\
 + 5) Any abnormal behavior inspected by PM or QAer.\\
 +No MT is allowed in Isaac project, otherwise it will be judged as cheating behavior.\\
 +**If any cheating is detected, we will refuse to pay all the work of the cheaters.**\\
 +
 +Work report \\
 +
 +Check your work report as screenshot. \\
 +
 +{{:​isaac_project:​en:​long_context_acceptability_9.png|}}
 +
  
  
  
 +BACK TO => [[isaac_project:​en:​long_context:​about|LONG CONTEXT PROJECT]]
isaac_project/en/long_context/long_context_acceptability.1742995147.txt.gz · Last modified: 2025/03/26 13:19 by sergio