This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
lighthouse_project:about [2024/11/29 13:08] karma [Summarization (CYU)] |
lighthouse_project:about [2025/03/28 13:51] (current) sergio |
||
---|---|---|---|
Line 2: | Line 2: | ||
Ahoy! Welcome to the Lighthouse! | Ahoy! Welcome to the Lighthouse! | ||
+ | |||
+ | [[lighthouse_project:about:lighthouse2|Welcome to Lighthouse 2.0—an exciting new adventure!]] | ||
The Lighthouse project encompasses four different specific workflows: **Summarization (CYU), Text Composition (TA/TC), Visual Content Generation (VCG), and DE (Device Expert)**. | The Lighthouse project encompasses four different specific workflows: **Summarization (CYU), Text Composition (TA/TC), Visual Content Generation (VCG), and DE (Device Expert)**. | ||
Line 7: | Line 9: | ||
While they share some points in common, each of these workflows should be considered separately and studied independently. Make sure to visit the Guidelines links banner at the top of the page when working on a specific workflow! | While they share some points in common, each of these workflows should be considered separately and studied independently. Make sure to visit the Guidelines links banner at the top of the page when working on a specific workflow! | ||
- | **IMPORTANT** => [[lighthouse_project:light_prod_guid_upd| Lighthouse Production Guidelines and Updates]] | ||
+ | **NOTE** => [[lighthouse_project:about:lighthouse2_2stepverification|How to add the 2 Step Verification on your Apple account for Lighthouse 2 project]] | ||
+ | |||
+ | **IMPORTANT** => [[lighthouse_project:light_prod_guid_upd| Lighthouse Production Guidelines and Updates]]\\ | ||
+ | |||
+ | |||
+ | **Lighthouse Feedback** => [[https://nm.oho2.com/s/HdHakfki9Ygsyoz|Lighthouse Feedback Summary_Feb'25.pdf]] \\ | ||
+ | |||
+ | **Payment information** : [[:payment_terms_trs|Payment information for translators]] | ||
+ | | ||
**IMPORTANT**: | **IMPORTANT**: | ||
* For CYU and TC, it is important that you also read the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**, as these explain the general approach. However, please note that it is essential that you go over the guidelines for the workflows you are working on (CYU, TC, VCG and DE).\\ | * For CYU and TC, it is important that you also read the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**, as these explain the general approach. However, please note that it is essential that you go over the guidelines for the workflows you are working on (CYU, TC, VCG and DE).\\ | ||
Line 18: | Line 28: | ||
* 1 hour | * 1 hour | ||
* Confirms that you’re a native speaker | * Confirms that you’re a native speaker | ||
- | * Mandatory for participating in any of 4 sub-projects/workflows | + | * Mandatory for participating in **any** of 4 sub-projects/workflows |
- **CYU and TA/TC (Summarization and Text Composition)** | - **CYU and TA/TC (Summarization and Text Composition)** | ||
* 1.5 hours each | * 1.5 hours each | ||
- | * Mandatory to participate in production for CYU or TA/TC workflow | + | * Mandatory to participate in production for CYU or TA/TC workflow and for participating in VCG or DE sub-projects |
- **VCG (Visual Content Generation)** | - **VCG (Visual Content Generation)** | ||
* 1 hour | * 1 hour | ||
* Mandatory to participate in production for VCG workflow | * Mandatory to participate in production for VCG workflow | ||
- **DE (Device Expert)** | - **DE (Device Expert)** | ||
- | * 1 hour | + | * 3 hour |
* Mandatory to participate in production for DE workflow | * Mandatory to participate in production for DE workflow | ||
Line 32: | Line 42: | ||
* For each certification, the client is providing training and preparation material | * For each certification, the client is providing training and preparation material | ||
* For all certifications, you have 2 attempts. | * For all certifications, you have 2 attempts. | ||
- | * For CYU, TA/TC, VCG and DE certs – there are practice tasks before moving on to cert | + | * For CYU, TA/TC, VCG and DE certs – there are practice tasks before moving on to cert. |
+ | * Each certification is **paid if you do at least 20 production hours** during the first month. | ||
Please find below an overview of each workflow:\\ | Please find below an overview of each workflow:\\ | ||
Line 58: | Line 69: | ||
This task involves evaluating the quality of machine-generated images based on prompts that may include text, sketches, or emojis. Evaluators review each output image across key dimensions: **Structural Integrity** and **Input/Output Alignment**. Structural Integrity ensures that images depict anatomically and visually correct subjects (e.g., humans, animals, objects) without distortions, artifacts, or missing features. Input/Output Alignment assesses how well the image reflects the prompt's specified elements, mood, and spatial layout.\\ | This task involves evaluating the quality of machine-generated images based on prompts that may include text, sketches, or emojis. Evaluators review each output image across key dimensions: **Structural Integrity** and **Input/Output Alignment**. Structural Integrity ensures that images depict anatomically and visually correct subjects (e.g., humans, animals, objects) without distortions, artifacts, or missing features. Input/Output Alignment assesses how well the image reflects the prompt's specified elements, mood, and spatial layout.\\ | ||
- | Visit the **[[https://nm.oho2.com/s/ringwi99xsyWS3J|General Guidelines]]**\\ | + | **VCG Certification** => [[lighthouse_project:vcg_certification|VCG Certification]]\\ |
- | Visit the **VCG guidelines** :\\ | + | |
- | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|VCG Image Evaluation Guidelines ]]**\\ | + | |
- | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Emoji Evaluation Design]]**\\ | + | |
- | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Handwriting Synthesis and Refinement SBS Guidelines]]**\\ | + | |
- | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|Image-to-Image Eval]]**\\ | + | |
- | **[[https://nm.oho2.com/s/FpqbmQkWLPN9ddw|VCG - Overview November 14 2024]]**\\ | + | |
===== Device Expert (DE) ===== | ===== Device Expert (DE) ===== | ||
The goal of this sub-project is to evaluate the quality of a machine-generated answer in response to a user's question about their product(s). The answer should deliver the relevant information as clearly and concisely as possible.\\ | The goal of this sub-project is to evaluate the quality of a machine-generated answer in response to a user's question about their product(s). The answer should deliver the relevant information as clearly and concisely as possible.\\ | ||
- | **DE Certification** => [[lighthouse_project:de_certification|DE Certification]] *page is under development... | + | **DE Certification** => [[lighthouse_project:de_certification|DE Certification]] |
+ | |||
+ | ---- | ||
==== Safety and Harmlessness ==== | ==== Safety and Harmlessness ==== | ||
Line 90: | Line 97: | ||
This is generally known as **Preference Ranking**.\\ | This is generally known as **Preference Ranking**.\\ | ||
+ | |||
+ | **Preference Ranking**: [[https://nm.oho2.com/s/sToy3TRKr78PkRM|Preference Ranking_V3.3_Vendor]]\\ | ||
Line 97: | Line 106: | ||
**HAPPY RANKING!**\\ | **HAPPY RANKING!**\\ | ||
- | NEXT => [[lighthouse_project:ta-tc_certification|TA/TC Certification]] | + | NEXT => [[lighthouse_project:le_certification|LE Certification]] |