Data Engineer - AI Platforms

About the Role

Our client is seeking a skilled Data Engineer to build and optimize robust data pipelines for their advanced AI platforms in Milton Keynes . This role is crucial for ensuring the efficient flow of data required for model training, validation, and deployment. You will work closely with data scientists and ML engineers to architect and implement scalable data solutions, manage data infrastructure, and ensure data quality and accessibility. This is an exciting opportunity to contribute to the core infrastructure that powers our client's artificial intelligence initiatives.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for batch and real-time processing.
• Develop and manage data warehousing solutions and data lake architectures.
• Implement data quality checks and validation processes to ensure accuracy and integrity.
• Optimize data retrieval and processing performance for AI and analytics workloads.
• Collaborate with data scientists and ML engineers to understand data requirements and provide necessary data sets.
• Automate data infrastructure tasks and monitor pipeline performance.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering , ETL development, or data warehousing.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies such as Spark, Hadoop, or Kafka.
• Familiarity with cloud data services on platforms like AWS, Azure, or GCP.
• Knowledge of programming languages like Python or Scala for data manipulation.

Benefits

• Competitive salary and comprehensive benefits package.
• Opportunities for professional growth and certifications in cloud technologies.
• Hybrid working model offering flexibility.
• Contributory pension scheme and life assurance.
• A dynamic and collaborative team environment focused on innovation.