Job Description
<h3><strong>Project Overview</strong></h3>
<p>We are sourcing independent Real Estate, Rental, and Leasing Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade property valuations, lease agreements, and real estate market analyses, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.</p>
<h3><strong>Project Deliverables & Scope</strong></h3>
<p>Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:</p>
<ul>
<li><strong>Task & Prompt Creation:</strong> Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to real estate transactions, property management, and leasing agreements.</li>
<li><strong>Rubric Development:</strong> Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score.</li>
<li><strong>Benchmark Evaluation Data Generation:</strong> Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex real estate and property management tasks.</li>
<li><strong>Quality Assurance & Fact-Checking:</strong> Ensuring all generated tasks and scoring criteria reflect strict, real-world real estate market standards, leasing regulations, and property valuation methodologies.</li>
</ul>
<h3><strong>Required Expertise</strong></h3>
<p>To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.</p>
<p><strong>Core skillset includes:</strong></p>
<ul>
<li>Demonstrable professional expertise within the real estate, property management, or leasing sectors, with a deep understanding of industry standards, legal terminology, and property market deliverables.</li>
<li>Strong writing and prompt generation skills, with the ability to design highly realistic, complex real estate task scenarios for AI evaluation.</li>
<li>Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.</li>
<li>A meticulous, detail-oriented approach to fact-checking lease contracts, property appraisals, zoning regulations, and market data to generate reliable data for system benchmarking.</li>
</ul>
<p>We offer a pay range of $10-to-$30 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.</p>
<p><strong>Engagement Type:</strong> Freelance / Independent Contractor</p>
<p><strong>Workplace Type:</strong> Remote</p>
About Agency

Agency
agency.ai
QaOn-site
Want AI-powered job matching?
Upload your resume and get every job scored, your resume tailored, and hiring manager emails found - automatically.
Get Started Free