About this role
Freelance role building specialized data scraping workflows for AI training data. You'll extract, clean, and validate structured datasets from complex dynamic websites using Python, modern scraping tools, and LLM frameworks. Part-time remote position requiring 5+ years of experience.
Must have
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
Strong experience in Python web scraping including dynamic content and APIs via proxies
Proven ability to extract data from complex structures like hierarchies and inconsistent HTML
Solid background in data cleaning, normalization, and validation
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure AWS or equivalent and containerization Docker
Hands-on experience with LLM frameworks LangChain, OpenRouter, or similar
English proficiency Upper-intermediate B2 or above
Self-directed work ethic with ability to troubleshoot independently
Technologies
Responsibilities
Own end-to-end data extraction workflows across complex websites ensuring complete coverage and accuracy
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution
Ensure reliable extraction from dynamic and interactive web sources adapting approaches as needed
Enforce data quality standards through validation checks and cross-source consistency controls
Scale scraping operations for large datasets using efficient batching or parallelization
Benefits
Recruitment process
Part-time freelance role for Tendem project on Mindrift platform
Tasks estimated at 10-20 hours per week during active phases
Compensation up to $45 per hour equivalent depending on level and pace
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related fields is a plus
A link to GitHub is a plus
Similar offers
Product Manager
115,000 – 160,000 CAD
/ year
CRM Architect
95,720 – 150,417 CAD
/ year
Technical Project Manager
115,000 – 147,000 CAD
/ year
Contract Senior Website Content Strategist & Copywriter
104,000 – 145,600 CAD
/ year
UX Lead, Public Website and CMS Migration (credit unions)
145,600 – 208,000 CAD
/ year