Project overview

Join a community of specialists helping improve the next generation of AI systems. In this consultant role, you will review data, judge AI outputs, and help strengthen the accuracy and reliability of large language models.

This opportunity is for an experienced Marketing & Content Specialist working as an expert project consultant on a contract basis. It is not a full-time position.

Project summary

The work supports an AI benchmarking framework created to test how well AI systems handle practical, economically valuable knowledge work. The benchmark focuses on tasks typically performed by professionals in marketing, content, communications, brand, growth, and digital marketing across different industries.

You will produce benchmark examples, set evaluation standards, and review AI-generated work across many marketing and content situations. Typical scenarios may involve campaign planning, content writing, messaging systems, audience segmentation, brand positioning, SEO content planning, email marketing, social media strategy, performance marketing analysis, editorial review, and go-to-market communications. The objective is to build expert-led standards for measuring AI performance on real marketing workflows.

Engagement terms

This is a project-based consulting engagement. Payment is made per project, and any hourly figure reflects the expected time to complete the work. Consultants manage their own schedules, use their own tools, and may also work with other vendors or employers if those agreements allow it.

Responsibilities

• Write expert benchmark answers for business scenarios related to marketing and content
• Design scoring rubrics that define strong strategy, quality content, and sound professional judgment
• Review AI-generated marketing plans, written assets, campaign suggestions, and strategic analyses against the benchmark criteria
• Judge outputs for accuracy, effectiveness, audience fit, clarity, originality, and business value
• Evaluate material tied to brand messaging, content strategy, digital marketing, customer acquisition, audience engagement, and campaign delivery
• Spot incorrect facts, poor positioning, weak messaging, unsupported recommendations, and strategic omissions
• Use professional judgment to decide whether the work meets real-world marketing standards
• Provide clear written explanations for ratings and evaluation outcomes
• Take part in calibration sessions and quality checks when needed

Expected outcomes

• Benchmark responses that reflect professional marketing and content practice
• Evaluation rubrics that are clear, defensible, and tied to business goals
• Consistent assessment of AI-generated marketing and content work
• Visible strengths, weaknesses, and performance gaps in model output
• Expert reviews that help measure AI systems on commercially valuable marketing tasks
• Documentation that supports repeatable and scalable model evaluation

Qualifications

• At least 5 years of professional experience in one or more of these areas: content marketing, digital marketing, brand marketing, growth marketing, product marketing, content strategy, corporate communications, demand generation, social media marketing, SEO/content optimization, editorial content, or marketing operations
• Solid understanding of marketing strategy, audience targeting, customer journeys, content development, and campaign performance measurement
• Hands-on experience creating, reviewing, or improving professional marketing assets and content deliverables
• Ability to assess marketing effectiveness and explain strategic reasoning clearly in writing
• Experience with campaign planning, messaging frameworks, content calendars, performance metrics, analytics, or go-to-market initiatives
• Strong attention to detail with the ability to identify weaknesses in positioning, messaging, audience alignment, and execution quality
• Background in B2B, B2C, agency, in-house marketing, media, or communications environments is preferred
• Relevant certifications are preferred where applicable, such as Google Analytics, Google Ads, HubSpot, Meta, SEMrush, Content Marketing Institute, AMA certifications, or similar credentials
• Must be based in the United States

Additional information

Consultants are expected to provide their own tools and work independently. The role is part-time, project-based expert evaluation work and remote.

Responsibilities

• Write expert benchmark answers for business scenarios related to marketing and content
• Design scoring rubrics that define strong strategy, quality content, and sound professional judgment
• Review AI-generated marketing plans, written assets, campaign suggestions, and strategic analyses against the benchmark criteria
• Judge outputs for accuracy, effectiveness, audience fit, clarity, originality, and business value
• Evaluate material tied to brand messaging, content strategy, digital marketing, customer acquisition, audience engagement, and campaign delivery
• Spot incorrect facts, poor positioning, weak messaging, unsupported recommendations, and strategic omissions
• Use professional judgment to decide whether the work meets real-world marketing standards
• Provide clear written explanations for ratings and evaluation outcomes
• Take part in calibration sessions and quality checks when needed

Requirements

• At least 5 years of professional experience in one or more of these areas: content marketing, digital marketing, brand marketing, growth marketing, product marketing, content strategy, corporate communications, demand generation, social media marketing, SEO/content optimization, editorial content, or marketing operations
• Solid understanding of marketing strategy, audience targeting, customer journeys, content development, and campaign performance measurement
• Hands-on experience creating, reviewing, or improving professional marketing assets and content deliverables
• Ability to assess marketing effectiveness and explain strategic reasoning clearly in writing
• Experience with campaign planning, messaging frameworks, content calendars, performance metrics, analytics, or go-to-market initiatives
• Strong attention to detail with the ability to identify weaknesses in positioning, messaging, audience alignment, and execution quality
• Background in B2B, B2C, agency, in-house marketing, media, or communications environments is preferred
• Relevant certifications are preferred where applicable, such as Google Analytics, Google Ads, HubSpot, Meta, SEMrush, Content Marketing Institute, AMA certifications, or similar credentials
• Must be based in the United States