This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
isaac_project:en:long_context:long_context_acceptability [2025/03/26 13:19] sergio |
isaac_project:en:long_context:long_context_acceptability [2025/05/12 09:14] (current) karma ↷ Links adapted because of a move operation |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ==== Long Context Acceptability ==== | ==== Long Context Acceptability ==== | ||
| - | **Please read the Guideline and Finish the Quiz before start the task**\\ | + | |
| + | **Please read the guidelines (ask your Project Manager to send you a full guideline) and finish the quiz before start the task**\\ | ||
| ** Task Description:** \\ | ** Task Description:** \\ | ||
| Line 13: | Line 14: | ||
| ** UI Display**: \\ | ** UI Display**: \\ | ||
| - | Login on OneForma and find below ''Long_Context_Acceptability_JapaneseToFrench'' webapp. Click ''"Actions"'' to get started. \\ | + | Login on OneForma and find below e.g. ''Long_Context_Acceptability_JapaneseToFrench'' webapp. Click ''"Actions"'' to get started. \\ |
| {{:isaac_project:en:long_context_acceptability_1.jpg|}} | {{:isaac_project:en:long_context_acceptability_1.jpg|}} | ||
| Line 28: | Line 29: | ||
| If you don’t want to annotate, please click ''“Skip Hit”'' , select corresponding reason, and then move to next one.\\ | If you don’t want to annotate, please click ''“Skip Hit”'' , select corresponding reason, and then move to next one.\\ | ||
| + | |||
| + | {{:isaac_project:en:long_context_acceptability_4.jpg|}} | ||
| + | |||
| + | Then you can start annotating as the guide instructed. **Be sure you have read the guide very carefully, as this task requires really careful and detailed work. **\\ | ||
| + | |||
| + | Points to emphasize: \\ | ||
| + | |||
| + | |||
| + | 1. Do not annotate the "<human>" "<bot>" tags. | ||
| + | {{:isaac_project:en:thumb-bot.png|}} | ||
| + | |||
| + | 2. There are hits with the same source but different translation. **Please pay attention, and do not take them as repeated hits.** | ||
| + | |||
| + | 3.The errors can be sorted out as "Major"("Severe") and "non-Major"("Minor") error. **Slide ON for Severe, slide OFF for minor:** | ||
| + | |||
| + | {{:isaac_project:en:long_context_acceptability_5.png|}} | ||
| + | {{:isaac_project:en:long_context_acceptability_6.png|}} | ||
| + | |||
| + | {{:isaac_project:en:long_context_acceptability_7.png|}} | ||
| + | |||
| + | 4.There might be cases where the lines/ paragraphs of source and translation cannot totally match, refer to below. For such cases, **please do the judgement by taking all the lines/paragraphs as a single entity.** | ||
| + | |||
| + | {{:isaac_project:en:long_context_acceptability_8.png|}} | ||
| + | |||
| + | For more details, please refer to the attached guide. Making sure you have fully understood everything in the guide before starting. \\ | ||
| + | |||
| + | About cheating behavior:\\ | ||
| + | |||
| + | This is to emphasize that any cheating behavior is not allowed in ISAAC project.\\ | ||
| + | For LCA tasks, the cheating behavior includes but not limit to below cases:\\ | ||
| + | 1) don’t check source but just casually make annotation on target text;\\ | ||
| + | 2) just check and annotate a part of content; \\ | ||
| + | 3) just annotate one error but not conduct a thorough inspection; \\ | ||
| + | 4) Not adhering to the requirements listed in the guidelines, but just simplistically marking an entire sentence as incorrect, results in an inability to determine which specific part is wrong. \\ | ||
| + | 5) Any abnormal behavior inspected by PM or QAer.\\ | ||
| + | No MT is allowed in Isaac project, otherwise it will be judged as cheating behavior.\\ | ||
| + | **If any cheating is detected, we will refuse to pay all the work of the cheaters.**\\ | ||
| + | |||
| + | Work report \\ | ||
| + | |||
| + | Check your work report as screenshot. \\ | ||
| + | |||
| + | {{:isaac_project:en:long_context_acceptability_9.png|}} | ||
| + | |||
| + | BACK TO => [[isaac_project:en:long_context:about|LONG CONTEXT PROJECT]] | ||