User Tools
lighthouse_project:about
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
lighthouse_project:about [2024/11/29 13:00] karma [Summarization (CYU)] |
lighthouse_project:about [2025/03/28 13:51] (current) sergio |
||
|---|---|---|---|
| Line 2: | Line 2: | ||
| Ahoy! Welcome to the Lighthouse! | Ahoy! Welcome to the Lighthouse! | ||
| + | |||
| + | [[lighthouse_project:about:lighthouse2|Welcome to Lighthouse 2.0—an exciting new adventure!]] | ||
| The Lighthouse project encompasses four different specific workflows: **Summarization (CYU), Text Composition (TA/TC), Visual Content Generation (VCG), and DE (Device Expert)**. | The Lighthouse project encompasses four different specific workflows: **Summarization (CYU), Text Composition (TA/TC), Visual Content Generation (VCG), and DE (Device Expert)**. | ||
| Line 7: | Line 9: | ||
| While they share some points in common, each of these workflows should be considered separately and studied independently. Make sure to visit the Guidelines links banner at the top of the page when working on a specific workflow! | While they share some points in common, each of these workflows should be considered separately and studied independently. Make sure to visit the Guidelines links banner at the top of the page when working on a specific workflow! | ||
| - | **IMPORTANT** => [[lighthouse_project:light_prod_guid_upd| Lighthouse Production Guidelines and Updates]] | ||
| + | **NOTE** => [[lighthouse_project:about:lighthouse2_2stepverification|How to add the 2 Step Verification on your Apple account for Lighthouse 2 project]] | ||
| + | |||
| + | **IMPORTANT** => [[lighthouse_project:light_prod_guid_upd| Lighthouse Production Guidelines and Updates]]\\ | ||
| + | |||
| + | |||
| + | **Lighthouse Feedback** => [[https://nm.oho2.com/s/HdHakfki9Ygsyoz|Lighthouse Feedback Summary_Feb'25.pdf]] \\ | ||
| + | |||
| + | **Payment information** : [[:payment_terms_trs|Payment information for translators]] | ||
| + | | ||
| **IMPORTANT**: | **IMPORTANT**: | ||
| * For CYU and TC, it is important that you also read the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**, as these explain the general approach. However, please note that it is essential that you go over the guidelines for the workflows you are working on (CYU, TC, VCG and DE).\\ | * For CYU and TC, it is important that you also read the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**, as these explain the general approach. However, please note that it is essential that you go over the guidelines for the workflows you are working on (CYU, TC, VCG and DE).\\ | ||
| Line 18: | Line 28: | ||
| * 1 hour | * 1 hour | ||
| * Confirms that you’re a native speaker | * Confirms that you’re a native speaker | ||
| - | * Mandatory for participating in any of 4 sub-projects/workflows | + | * Mandatory for participating in **any** of 4 sub-projects/workflows |
| - **CYU and TA/TC (Summarization and Text Composition)** | - **CYU and TA/TC (Summarization and Text Composition)** | ||
| * 1.5 hours each | * 1.5 hours each | ||
| - | * Mandatory to participate in production for CYU or TA/TC workflow | + | * Mandatory to participate in production for CYU or TA/TC workflow and for participating in VCG or DE sub-projects |
| - **VCG (Visual Content Generation)** | - **VCG (Visual Content Generation)** | ||
| * 1 hour | * 1 hour | ||
| * Mandatory to participate in production for VCG workflow | * Mandatory to participate in production for VCG workflow | ||
| - **DE (Device Expert)** | - **DE (Device Expert)** | ||
| - | * 1 hour | + | * 3 hour |
| * Mandatory to participate in production for DE workflow | * Mandatory to participate in production for DE workflow | ||
| Line 32: | Line 42: | ||
| * For each certification, the client is providing training and preparation material | * For each certification, the client is providing training and preparation material | ||
| * For all certifications, you have 2 attempts. | * For all certifications, you have 2 attempts. | ||
| - | * For CYU, TA/TC, VCG and DE certs – there are practice tasks before moving on to cert | + | * For CYU, TA/TC, VCG and DE certs – there are practice tasks before moving on to cert. |
| + | * Each certification is **paid if you do at least 20 production hours** during the first month. | ||
| Please find below an overview of each workflow:\\ | Please find below an overview of each workflow:\\ | ||
| Line 38: | Line 49: | ||
| ===== Localization (LE) ===== | ===== Localization (LE) ===== | ||
| - | LE Certification is the main pre-requisite for the project and should be done first, since they cannot qualify for production of any of the sub-projects if they don’t pass it. If they fail it twice, they are automatically disqualified from the project. | + | LE Certification is the main pre-requisite for the project and should be done first, since they cannot qualify for production of any of the sub-projects if they don’t pass it. If they fail it twice, they are automatically disqualified from the project.\\ |
| **LE Certification** => [[lighthouse_project:le_certification|LE Certification]]\\ | **LE Certification** => [[lighthouse_project:le_certification|LE Certification]]\\ | ||
| Line 45: | Line 56: | ||
| The task involves evaluating summarization responses generated by a virtual assistant. The process consists of examining instructions and original input text (which could be emails, chat messages, or other forms of text) and then evaluating the assistant's summary based on specific criteria.\\ | The task involves evaluating summarization responses generated by a virtual assistant. The process consists of examining instructions and original input text (which could be emails, chat messages, or other forms of text) and then evaluating the assistant's summary based on specific criteria.\\ | ||
| - | **CYU Certification** => [[https://nm.oho2.com/s/C6bC7cZLsfbHacW|CYU Certification]]\\ | + | **CYU Certification** => [[lighthouse_project:cyu_certification|CYU Certification]]\\ |
| Line 52: | Line 63: | ||
| The Text Composition tasks involve generating or evaluating various text types, such as replies, rewrites, tone adjustments, and text-to-list or table transformations. These tasks focus on ensuring the text follows instructions, remains grounded in the input, is comprehensive, and maintains proper tone, style, and grammar. | The Text Composition tasks involve generating or evaluating various text types, such as replies, rewrites, tone adjustments, and text-to-list or table transformations. These tasks focus on ensuring the text follows instructions, remains grounded in the input, is comprehensive, and maintains proper tone, style, and grammar. | ||
| The TC workflow involves several task types (e.g., Tone Adjust, List Transform, Key Points Transform, etc.), each with individual guidelines. Please make sure you are following the guidelines for the appropriate workflow!\\ | The TC workflow involves several task types (e.g., Tone Adjust, List Transform, Key Points Transform, etc.), each with individual guidelines. Please make sure you are following the guidelines for the appropriate workflow!\\ | ||
| - | Visit the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**\\ | ||
| **TA/TC Certification** => [[lighthouse_project:ta-tc_certification|TA/TC Certification]]\\ | **TA/TC Certification** => [[lighthouse_project:ta-tc_certification|TA/TC Certification]]\\ | ||
| Line 59: | Line 69: | ||
| This task involves evaluating the quality of machine-generated images based on prompts that may include text, sketches, or emojis. Evaluators review each output image across key dimensions: **Structural Integrity** and **Input/Output Alignment**. Structural Integrity ensures that images depict anatomically and visually correct subjects (e.g., humans, animals, objects) without distortions, artifacts, or missing features. Input/Output Alignment assesses how well the image reflects the prompt's specified elements, mood, and spatial layout.\\ | This task involves evaluating the quality of machine-generated images based on prompts that may include text, sketches, or emojis. Evaluators review each output image across key dimensions: **Structural Integrity** and **Input/Output Alignment**. Structural Integrity ensures that images depict anatomically and visually correct subjects (e.g., humans, animals, objects) without distortions, artifacts, or missing features. Input/Output Alignment assesses how well the image reflects the prompt's specified elements, mood, and spatial layout.\\ | ||
| - | Visit the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**\\ | + | **VCG Certification** => [[lighthouse_project:vcg_certification|VCG Certification]]\\ |
| - | Visit the **VCG guidelines** :\\ | + | |
| - | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|VCG Image Evaluation Guidelines ]]**\\ | + | |
| - | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Emoji Evaluation Design]]**\\ | + | |
| - | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Handwriting Synthesis and Refinement SBS Guidelines]]**\\ | + | |
| - | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Image-to-Image Eval]]**\\ | + | |
| - | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|VCG - Overview November 14 2024]]**\\ | + | |
| ===== Device Expert (DE) ===== | ===== Device Expert (DE) ===== | ||
| - | Adding info... | + | The goal of this sub-project is to evaluate the quality of a machine-generated answer in response to a user's question about their product(s). The answer should deliver the relevant information as clearly and concisely as possible.\\ |
| + | **DE Certification** => [[lighthouse_project:de_certification|DE Certification]] | ||
| + | |||
| + | ---- | ||
| ==== Safety and Harmlessness ==== | ==== Safety and Harmlessness ==== | ||
| Line 90: | Line 97: | ||
| This is generally known as **Preference Ranking**.\\ | This is generally known as **Preference Ranking**.\\ | ||
| + | |||
| + | **Preference Ranking**: [[https://nm.oho2.com/s/sToy3TRKr78PkRM|Preference Ranking_V3.3_Vendor]]\\ | ||
| Line 97: | Line 106: | ||
| **HAPPY RANKING!**\\ | **HAPPY RANKING!**\\ | ||
| - | NEXT => [[lighthouse_project:ta-tc_certification|TA/TC Certification]] | + | NEXT => [[lighthouse_project:le_certification|LE Certification]] |
lighthouse_project/about.1732885252.txt.gz · Last modified: 2024/11/29 13:00 by karma
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
