Project Beid - Korean E-commerce Product Matching Annotation Reviewer
EmployerweloglobalRemote - United States +3Posted 2026-11-20
- This listing's locations
Remote - United States +3 show all 4
- Remote - United States
- Australia
- China
- Canada
- Employment
- Freelance-remote
Checking access…
Role description
Responsibilities
- Review annotators’ ACCEPT/REJECT decisions and reject reason codes, with a focus on preventing false matches and false rejects.
- Sample-check or fully review high-risk rows (multiple codes, OTHERS, rows with uncertainty notes).
- Correct errors, give feedback to annotators, and identify recurring error patterns to keep rule interpretation consistent.
- Compile questions for the client where rules are ambiguous, and maintain a clarification log.
- Validate structural compliance of deliverables: every input row returned exactly once and unchanged, timestamps, exact decision and code spelling, correct separators, valid CSV, identifiers preserved as text.
- Track and report accuracy, review coverage, known limitations, and unresolved rows to support the summary report.
- Monitor progress to ensure on-time delivery.
Requirements
- At native proficiency level of Korean.
- 1+ years of experience in data annotation, content moderation, or QA; team lead or training experience preferred.
- Strong judgment on edge cases, with the ability to explain decisions clearly.
- Clear communication and the ability to give constructive feedback.
Nice to have
- Experience building evaluation sets, analyzing accuracy, or managing annotation quality.
- Understanding of AI-assisted annotation workflows and associated risk controls.
VPN and Location Verification: What You Need to Know
- Application and onboarding: no VPN. Please do not use a VPN when you apply or go through onboarding.
- Production: VPN required. Once production starts, you will need to use a VPN. Opera browser is recommended. (Opera is a free built-in VPN and needs no extra installation.) We will send you setup instructions before production begins.
- Which VPNs are allowed. Standard consumer VPNs are fine. High-risk proxies are not permitted.
- Periodic checks in Production. For administrative reasons, we may occasionally ask you to access AI Trainer platform without your VPN so we can check your unmasked IP.