This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
isaac_project:en:long_context:long_context_acceptability [2025/03/26 13:19] sergio |
isaac_project:en:long_context:long_context_acceptability [2025/05/12 09:14] (current) karma ↷ Links adapted because of a move operation |
||
---|---|---|---|
Line 1: | Line 1: | ||
==== Long Context Acceptability ==== | ==== Long Context Acceptability ==== | ||
- | **Please read the Guideline and Finish the Quiz before start the task**\\ | + | |
+ | **Please read the guidelines (ask your Project Manager to send you a full guideline) and finish the quiz before start the task**\\ | ||
** Task Description:** \\ | ** Task Description:** \\ | ||
Line 13: | Line 14: | ||
** UI Display**: \\ | ** UI Display**: \\ | ||
- | Login on OneForma and find below ''Long_Context_Acceptability_JapaneseToFrench'' webapp. Click ''"Actions"'' to get started. \\ | + | Login on OneForma and find below e.g. ''Long_Context_Acceptability_JapaneseToFrench'' webapp. Click ''"Actions"'' to get started. \\ |
{{:isaac_project:en:long_context_acceptability_1.jpg|}} | {{:isaac_project:en:long_context_acceptability_1.jpg|}} | ||
Line 28: | Line 29: | ||
If you don’t want to annotate, please click ''“Skip Hit”'' , select corresponding reason, and then move to next one.\\ | If you don’t want to annotate, please click ''“Skip Hit”'' , select corresponding reason, and then move to next one.\\ | ||
+ | |||
+ | {{:isaac_project:en:long_context_acceptability_4.jpg|}} | ||
+ | |||
+ | Then you can start annotating as the guide instructed. **Be sure you have read the guide very carefully, as this task requires really careful and detailed work. **\\ | ||
+ | |||
+ | Points to emphasize: \\ | ||
+ | |||
+ | |||
+ | 1. Do not annotate the "<human>" "<bot>" tags. | ||
+ | {{:isaac_project:en:thumb-bot.png|}} | ||
+ | |||
+ | 2. There are hits with the same source but different translation. **Please pay attention, and do not take them as repeated hits.** | ||
+ | |||
+ | 3.The errors can be sorted out as "Major"("Severe") and "non-Major"("Minor") error. **Slide ON for Severe, slide OFF for minor:** | ||
+ | |||
+ | {{:isaac_project:en:long_context_acceptability_5.png|}} | ||
+ | {{:isaac_project:en:long_context_acceptability_6.png|}} | ||
+ | |||
+ | {{:isaac_project:en:long_context_acceptability_7.png|}} | ||
+ | |||
+ | 4.There might be cases where the lines/ paragraphs of source and translation cannot totally match, refer to below. For such cases, **please do the judgement by taking all the lines/paragraphs as a single entity.** | ||
+ | |||
+ | {{:isaac_project:en:long_context_acceptability_8.png|}} | ||
+ | |||
+ | For more details, please refer to the attached guide. Making sure you have fully understood everything in the guide before starting. \\ | ||
+ | |||
+ | About cheating behavior:\\ | ||
+ | |||
+ | This is to emphasize that any cheating behavior is not allowed in ISAAC project.\\ | ||
+ | For LCA tasks, the cheating behavior includes but not limit to below cases:\\ | ||
+ | 1) don’t check source but just casually make annotation on target text;\\ | ||
+ | 2) just check and annotate a part of content; \\ | ||
+ | 3) just annotate one error but not conduct a thorough inspection; \\ | ||
+ | 4) Not adhering to the requirements listed in the guidelines, but just simplistically marking an entire sentence as incorrect, results in an inability to determine which specific part is wrong. \\ | ||
+ | 5) Any abnormal behavior inspected by PM or QAer.\\ | ||
+ | No MT is allowed in Isaac project, otherwise it will be judged as cheating behavior.\\ | ||
+ | **If any cheating is detected, we will refuse to pay all the work of the cheaters.**\\ | ||
+ | |||
+ | Work report \\ | ||
+ | |||
+ | Check your work report as screenshot. \\ | ||
+ | |||
+ | {{:isaac_project:en:long_context_acceptability_9.png|}} | ||
+ | |||
+ | BACK TO => [[isaac_project:en:long_context:about|LONG CONTEXT PROJECT]] |