Manual Transcript Reviewer

Manual Transcript Reviewer: 26-01263

Remote, CA 95100
Contract Type: W2/C2C only
Duration: 6+ Months Contract (High possibility of extension)
Location: 100% #LI-Remote
Pay Range: $28 - $33 Per Hour on W2
Part time Role (20 hours per week)

Job Summary:
We are seeking evaluators to assess AI-generated marketing conversations, specifically focusing on the quality and effectiveness of interactions between advertisers and a marketing advisor AI agent. Candidates should possess a deep understanding Ads and its campaign management, including conversion tracking and troubleshooting. This remote position requires a commitment of 20 hours per week.

Key Responsibilities:

  • Evaluate conversation transcripts against defined rubrics.
  • Assess key metrics such as helpfulness and accuracy.
  • Compare evaluations between raters to validate auto-rater performance.
  • Conduct supplemental spot-checking of transcripts to identify emerging trends.
  • Participate in weekly alignment meetings to reach agreement on ratings

Must-Have Skills:

  • Extensive experience with Ads or similar advertising platforms.
  • Experience Reviewing AI Transcripts and evaluating the quality and Rubrics
  • Excellent communication skills for articulating findings and trends.
  • Prior experience in advertising and marketing is required, especially with Ads.
Back to blog