We’re seeking an experienced Content Strategist III to develop content evaluation guidelines that empower content reviewers to assess content quality, consistency, and policy alignment at scale. As part of the Product Data Operations team, you’ll play a critical role in bridging product strategy with human annotation workflows, enabling high-quality data that powers AI products and experiences.
The ideal candidate has a strong content strategy background, experience in creating human labeling guidelines, and a deep understanding of content evaluation methodologies. Experience working with UX Research teams to design, test, and refine survey questions is highly preferred. If you’re passionate about shaping scalable systems that improve content quality and have a knack for turning ambiguous policies into actionable frameworks, we’d love to hear from you.
Job Responsibilities:
Develop Content Evaluation Guidelines
- Translate product strategy, content policies, and research insights into structured content labeling guidelines for human annotators.
- Collaborate with Product, UX Research, and Product Data Operations (PDO) teams to identify content quality issues and define labeling requirements.
- Write clear, comprehensive guidelines that enable consistent content evaluation across large-scale annotation pipelines.
Define Evaluation Criteria
- Establish clear, objective, and measurable evaluation criteria aligned with product goals, brand voice, and quality standards.
- Design labeling decision tree questions that are concise, comprehensive, unbiased, and enable reviewers to conduct data annotation accurately & timely
- Iterate on evaluation frameworks based on reviewer feedback, reviewer performance data, and stakeholder input.
Stakeholder Collaboration
- Work closely with content reviewers, product, and product data operations teams to ensure guidelines meet their needs.
- Provide training and support to content reviewers on the evaluation guidelines.
- Gather feedback from stakeholders to iterate on and improve the guidelines.
Data Analysis & Reporting
- Develop metrics to measure content quality and consistency.
- Analyze content evaluation data to identify trends, bottlenecks, and areas for guideline improvement.
- Build reporting frameworks to communicate performance insights and guideline effectiveness to stakeholders.
Continuous Improvement
- Stay informed on emerging content moderation trends, AI advancements, and UXR best practices.
- Design research studies that measure how guideline changes impact reviewer accuracy and content quality outcomes.
- Advocate for inclusive and culturally sensitive evaluation criteria across global content pipelines.
Required Skills:
- 3+ years of experience in content strategy, content operations, or a related field.
- Proven track record of developing and implementing content evaluation guidelines.
- Excellent communication, collaboration, and project management skills.
- Strong analytical and problem-solving skills with Excel.
- Ability to work in a fast-paced environment and adapt to changing priorities.
- Experience with content management systems (CMS)
- Bachelor’s degree in English, Communications, Journalism, or a related field.
Preferred Skills:
- Experience with generative AI tools and applications.
- Knowledge of SEO principles and how they impact content evaluation.
- Certification in content strategy or a related field.
- Experience working with global teams and adapting guidelines for different regions and cultures.
The target hiring compensation range for this role is $55.51 to $61.68 an hour. Compensation is based on several factors including, but not limited to education, relevant work experience, relevant certifications, and location.
About Aquent Talent:
Aquent Talent connects the best talent in marketing, creative, and design with the world’s biggest brands.
Our eligible talent get access to amazing benefits like subsidized health, vision, and dental plans, paid sick leave, and retirement plans with a match. We also offer free online training through Aquent Gymnasium. More information on our awesome benefits!
Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. We’re about creating an inclusive environment—one where different backgrounds, experiences, and perspectives are valued, and everyone can contribute, grow their careers, and thrive.
Client DescriptionBased in Menlo Park, California, this top social media company builds technologies that help people connect. Their mission is to give people the power to build community and bring the world closer together.
With a culture of constantly iterating, solving problems and working together to connect people all over the world, it’s important that their workforce reflects the diversity of the people they serve. Hiring people with different backgrounds and points of view helps make better decisions, build better products and create better experiences for everyone.
Working here, you’ll:
• Be part of their mission of community building
• Work on the most visible apps and services in the social media industry
• Work in an Agile environment, in constant iteration and problem-solving mode
• Have a hand in developing products that empower more than 3 billion people around the world to share ideas, offer support and make a difference
Why work with AQUENT? Check out our awesome benefits: https://aquent.com/talent/talent-benefits
Aquent is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.
#LI-Remote
