Senior Python Developer - Data Engineering

About the Role

Our client is seeking a highly skilled Senior Python Developer with a specialization in Data Engineering to join their team in Cardiff . This is an on-site position where you will play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure. You will work with vast datasets, applying your expertise to extract, transform, and load data efficiently, enabling advanced analytics and machine learning initiatives. This role is ideal for a developer who is passionate about data, excels in Python development, and thrives in a collaborative, office-based environment committed to delivering high-quality data solutions and driving business insights. You will be part of a team dedicated to innovation in data processing and analysis.

Key Responsibilities

• Design, develop, and optimize complex ETL/ELT data pipelines using Python and relevant data processing frameworks.
• Build and maintain robust data warehousing solutions and data lakes, ensuring data integrity and accessibility.
• Implement data quality checks and monitoring systems to ensure the accuracy and reliability of data.
• Collaborate with data scientists and analysts to understand their data needs and provide them with clean, well-structured datasets.
• Develop and manage data infrastructure, including database administration and cloud-based data services.
• Automate data processes and workflows to improve efficiency and reduce manual intervention.

Requirements

• Bachelor's or Master's degree in Computer Science, Data Science, or a related quantitative field.
• Minimum of 5 years of experience in Python development, with a significant focus on data engineering.
• Strong experience with data pipeline tools such as Apache Spark, Airflow, or similar technologies.
• Proficiency in SQL and experience with various relational and NoSQL databases.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Excellent analytical, problem-solving, and communication skills.

Benefits

• Attractive annual salary with performance-based bonuses.
• Opportunity to work on challenging and impactful data projects in Cardiff .
• Comprehensive health, dental, and vision insurance coverage.
• Company-provided training and professional development opportunities.
• Generous annual leave entitlement and pension scheme.
• A supportive and collaborative team environment focused on data innovation.