← Back to all jobs
28d 8h left to apply
M

Senior Python Data Scraping Engineer (Freelance)

Mindriftā€¢šŸŒ Remote Worldwide•Estimated: $80,000 - $120,000

✨ AI Insights & Summary

This part-time, remote role at Mindrift offers a compelling blend of AI collaboration and specialized data engineering within the innovative Tendem project. As an "AI Pilot," you'll leverage your Python data scraping expertise to enhance AI-driven workflows, bridging the gap between human critical thinking and automated tasks. This is an exceptional chance for experienced engineers to contribute to cutting-edge AI development, work with major tech innovators, and gain valuable experience in a flexible, freelance capacity.

About Mindrift

Mindrift connects specialists with AI projects from major tech innovators, aiming to unlock the potential of Generative AI by leveraging global real-world expertise.

The Role: Senior Python Data Scraping Engineer (AI Pilot)

This is a freelance, part-time remote role for the Tendem project. As an AI Pilot, you will collaborate with AI agents, providing critical thinking, domain expertise, and quality control for specialized data scraping workflows. You'll handle data extraction tasks requiring technical precision, utilizing tools like Apify and OpenRouter, alongside your own resourceful methods.

Key Responsibilities:

  • Manage end-to-end data extraction workflows for complex websites, ensuring comprehensive coverage, accuracy, and reliable delivery of structured datasets.
  • Utilize internal tools (Apify, OpenRouter) and custom workflows to expedite data collection, validation, and task execution according to defined requirements.
  • Ensure reliable extraction from dynamic and interactive web sources, adapting strategies for JavaScript-rendered content and evolving site structures.
  • Uphold data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification.
  • Scale scraping operations for large datasets using efficient batching or parallelization, monitor for failures, and maintain stability against minor site changes.

Requirements:

  • Minimum 5 years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Proficiency in solving complex problems, working confidently with LLMs, and systematically collecting, structuring, and validating data.
  • Methodical, detail-oriented approach and ability to work independently.
  • Strong experience in Python web scraping (e.g., BeautifulSoup, Selenium) and handling dynamic content (JS, AJAX, infinite scroll) and APIs via proxies.
  • Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML).
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets).
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) in real-world workflows.
  • Hands-on experience with LLM frameworks (e.g., LangChain, OpenRouter) applied to automation tasks.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • GitHub profile link is a plus.
  • English proficiency: Upper-intermediate (B2) or above.

Project Time Expectations:

  • Estimated 10–20 hours per week during active project phases.
  • This is an estimate and applies only while the project is active.

Compensation:

  • Up to $25 per hour equivalent, depending on level and pace of contribution.
  • Compensation varies by project scope, complexity, and required expertise.

Apply Now

This job is active but will expire soon. Click below to apply on the company's website.

Apply for this role ↗

Share Job

Know someone who would be a perfect fit? Share this opportunity.

Job Overview

Posted6/19/2026
CategoryFullstack Development
SourceJobsCollider

FAQ

Is this position remote?

The Senior Python Data Scraping Engineer (Freelance) role is a hybrid opportunity. The location specified is Remote Worldwide.

What is the salary?

The salary is not explicitly stated, but is competitive and based on experience.

How do I apply?

You can apply by clicking the "Apply for this role" button above to submit your application on the hiring website.

Similar Opportunities

National Veterinary Associates

Veterinary Assistant

National Veterinary Associates•USAā€¢šŸ  Remote
Competitive
Fullstack Development
View Job →
S

Werkstudent (m/w/d) Power BI & Power Apps

S01 Projektmanagement GmbH•Eschbornā€¢šŸ  Remote
Competitive
Fullstack Development
View Job →
O

Litigation & Appraisal Adjuster (Remote, US)

Openly•Remote Worldwideā€¢šŸ”„ Hybrid
Competitive
Fullstack Development
View Job →