About this role
Freelance role building specialized data scraping workflows for AI technology projects. You'll extract, process, and validate data from complex web sources using Python, modern scraping tools, and LLM frameworks. Part-time remote position requiring 10-20 hours weekly during active phases.
Must have
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
Strong experience in Python web scraping including dynamic content and APIs via proxies
Proven ability to extract data from complex structures like hierarchies and inconsistent HTML
Solid background in data cleaning normalization and validation
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure AWS or equivalent and containerization Docker
Hands-on experience with LLM frameworks LangChain OpenRouter or similar
English proficiency Upper-intermediate B2 or above
Technologies
Responsibilities
Own end-to-end data extraction workflows across complex websites ensuring complete coverage and accuracy
Leverage available tools and custom workflows to accelerate data collection validation and task execution
Ensure reliable extraction from dynamic and interactive web sources adapting approaches as needed
Enforce data quality standards through validation checks and cross-source consistency controls
Scale scraping operations for large datasets using efficient batching or parallelization
Benefits
Recruitment process
Part-time freelance role for Tendem project on Mindrift platform
Tasks estimated at 10-20 hours per week during active phases
Compensation up to 45 dollars per hour equivalent depending on level and pace
Bachelor's or Master's Degree in Engineering Applied Mathematics Computer Science or related fields is a plus
GitHub portfolio link is a plus
Similar offers
Research Scientist, Generalist Embodied Agent Research - PhD New College Grad 20
168,000 ā 304,750 USD
/ year
AI and FSI Developer Technology Engineer - New College Grad 2026
124,000 ā 195,500 USD
/ year
Sr. Security Engineer I - Enterprise Security
135,482 ā 227,700 USD
/ year
Senior GPU Raytracing Engineer
184,000 ā 356,500 USD
/ year
Staff Software Engineer
170,000 ā 190,000 USD
/ year