Senior Python Data Engineer

We are looking for a Senior Python Data Engineer to join an innovative AI-driven migration program aimed at modernizing legacy data processing applications through intelligent automation.

In this role, you will combine strong software engineering expertise with modern AI-assisted development practices to help industrialize an AI-powered migration factory. You will actively contribute to the development of high-quality Python data pipelines while improving the orchestration of AI agents responsible for automating large parts of the migration lifecycle.

This position is ideal for someone who enjoys solving complex data engineering challenges while shaping the future of AI-assisted software development

Key Responsibilities

Python Data Engineering

• Design, develop, and optimize Python-based data transformation solutions.
• Review, validate, and improve AI-generated Python code to ensure production readiness.
• Ensure high standards of code quality, performance, maintainability, and operational reliability.
• Support complex migration scenarios requiring manual refinement beyond automated code generation.
• Develop and optimize modern data processing pipelines.
• Contribute to data quality, schema evolution, metadata management, and Parquet optimization.
• Support distributed data processing using PySpark when appropriate.

AI-Assisted Development & Agent Engineering

• Act as a key contributor to an AI-assisted software migration platform.
• Improve the orchestration framework responsible for coordinating multiple specialized AI agents.
• Enhance collaboration between AI agents responsible for:
  • Legacy SAS code analysis
  • Functional analysis generation
  • Technical design generation
  • Python code generation
  • Automated validation and testing
• Improve workflow orchestration, traceability, scalability, and reliability.
• Strengthen human-in-the-loop validation processes and feedback mechanisms.
• Identify opportunities to increase automation while maintaining software quality and governance.
• Contribute to the continuous evolution of AI-assisted development practices and engineering standards.

Required Skills & Experience

Python & Data Engineering

• Minimum 5 years of professional experience developing Python applications.
• Strong expertise in:
  • Python
  • Pandas
  • Polars
  • PyArrow
  • Parquet
  • Unit and integration testing frameworks
• Proven experience building and maintaining:
  • Data engineering solutions
  • ETL / ELT pipelines
  • Data transformation workflows
  • Data quality controls
  • Schema management
• Experience with PySpark is considered a strong advantage.

AI-Assisted Development

Experience working with modern AI-assisted software engineering tools and workflows, including:

• GitHub Copilot or equivalent AI coding assistants
• AI-assisted software development
• Multi-agent systems
• Agentic workflows
• Agent orchestration frameworks
• Human-in-the-loop validation processes
• Workflow automation and optimization