Visual Content Generation

Hi Lighthouse Annotator,

If you are reading these instructions, it means you have already taken the LE Certification and TA/TC or CYU Certification, and now it is time for you to take the VCG Certification.

Disclaimer: If you still haven’t taken the LE + TA/TC or GYU Certification, please, take the LE first and then TA/TC or CYU before moving on to VCG Certification.

IMPORTANT: Make sure NOT to skip tasks in certifications because the skipped tasks are automatically calculated as incorrect

Below you can find information about the additional preparation materials for VCG Certification:

VCG Certification

PREPARATION

Before moving on to taking the certification, please make sure to go through the learning materials provided below:
Visit the General Guidelines
VCG guidelines :

• VCG Image Evaluation Guidelines
  
• Emoji Evaluation Design
  
• Handwriting Synthesis and Refinement SBS Guidelines
  
• Image-to-Image Eval
  
• VCG - Overview November 14 2024
  
• Lighthouse_Pending Queries_VGC_March18
  
• ADM Multi-Side Grading
  

Training recording ⇒

Lighthouse 2.0 - VCG Training Session-2025.03.25-Meeting Recording.mp4

Orientation Module:

Orientation Module

FEEDBACK based on common mistakes:

VCG Feedback 13-Feb

1. First and foremost, a significant number of people are getting the first question wrong (i.e. Human presence or anthropomorphism detection). This is the easiest question to answer in the entire task. Please make sure you read the guidelines and examples carefully before attempting the re-cert. Clearly visible human silhouettes were marked as “no human presence”, amongst other wrong judgments. This should be a question where the pass rate should be over 90% and yet that’s not the case.

2. Structural integrity is where most people have gotten things wrong. Here are a few things to keep in mind:

• a. Make sure you understand all the details from the table on page 19 in the guidelines and keep them handy when performing the task.
  
• b. Pay attention to the distortions compared to the expected anatomical structure of a subject/object.
  
• c. Pay attention that there are no artifacts for images that are clearly detailed and whose features are known.
  
• d. Make sure to research the element if you’re not familiar with it, both definition and image search and in combination with the context, to understand the expected appearance, anatomical consistency and details.
  
• e. Also, do not evaluate “rainforest, love” based on the demo from the call. Look at all the images carefully and determine if there are anatomical inconsistencies or details out of place that would render the image as not having good structural integrity.
  

3. For input/output alignment the results were better but some still struggled to understand the required elements and how to evaluate them. Keep in mind:

• a. These are just keywords, not long descriptive text or images (as you might expect in production, which might have more elements to consider). Each keyword will be an element to look for in the output image. However ↓
  
• b. Do not assume. Understand what element is being asked for. A football is not the same as a basketball, goalball or tennis ball. Understand what the exact element is that the user is looking for and whether that element is represented in the output image as expected. Eg. what is a plate guard and what does it look like?
  
• c. Understand the specific input requirement. Most examples are quite obvious elements but some might be more broad/vague in the context, like love, shy. Think about what would you expect to see or get out of such prompts.
  
• d. You can use chatgpt or copilot to generate images using these keywords, for reference only. Just to get some ideas or inspiration for the vague cases. It might help to understand them a little bit better. Of course, do not automatically assume chatgpt/copilot will render the perfect image for that input prompt. You still have to
• use your best judgment and reasoning, based on the guidelines expectations, to evaluate the output image given in the task.
  

IMPORTANT NOTES FOR CERTIFICATION AND RE-CERTIFICATION

1. Scope: There should be 25 tasks. You will receive a notification “No more tasks available” once you complete the certification/re-certification. The certification/re-certification will be considered completed and sent to review only after you submit all tasks and reach notification “No more tasks available”.
2. Deadline: Please, do your best to complete the VCG Certification or VCG Re-certification in the next 24 hours so that you can move on to other certifications ASAP.
3. After you complete the certification/re-certification, we will receive the score. Having a passing score is a prerequisite to participate in VCG production. Therefore, please make sure that each submission is in line with the guidelines. Take your time to go through each step of the task and double check everything before submitting – once you submit the task, you cannot go back to it.
4. IMPORTANT: Do NOT skip tasks while taking the certifications. Skipping tasks will result in automatic fail.

TAKING CERTIFICATION OR RE-CERTIFICATION

Here’s the link to access the VCG certification:

https://starshot.scilliance.com/?broker=true&ref=6d0e353a-0525-48b7-8f55-514dec5a900b

Please use the following link to take the VCG Re-Certification:

https://starshot.scilliance.com/?broker=true&ref=cc2643aa-c86d-4666-83fd-1388dd0b4345

IMPORTANT NOTES FOR CERTIFICATION:

1. Scope: You will receive a notification “No more tasks available” once you complete the certification. The certification will be considered completed and sent to review only after you submit all tasks and reach notification “No more tasks available”.
   
2. Deadline: Please, do your best to complete the certification as soon as you can.
   
3. The purpose of Certification is to check your understanding of the guidelines. It will be reviewed, and we will receive scores. Having a passing score is a prerequisite to participate in project production for DE sub-project. Therefore, please make sure that each submission is in line with the guidelines. Take your time to go through each step of the task and double check everything before submitting – once you submit the task, you cannot go back to it.
   

Thank you!

NEXT ⇒ DE Certification

BACK TO ⇒ LIGHTHOUSE PROJECT