Senior Data Engineer - Big Data

About the Role

Our client is seeking a talented Senior Data Engineer to join their analytics team in Bristol . This role is central to building and optimizing their data pipelines and infrastructure, enabling the business to derive valuable insights from large and complex datasets. You will be responsible for designing, implementing, and maintaining scalable data solutions that support various analytics and machine learning initiatives. This is an exciting opportunity to work with cutting-edge big data technologies and contribute to data-driven decision-making.

Key Responsibilities

• Design, build, and maintain robust, scalable, and efficient data pipelines for batch and real-time data processing.
• Develop and optimize ETL/ELT processes using big data technologies like Spark, Hadoop, and Kafka.
• Build and manage data warehouses and data lakes, ensuring data quality, integrity, and accessibility.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Implement monitoring, logging, and alerting for data pipelines to ensure reliability and performance.
• Contribute to the architecture and design of the company's data platform.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of professional experience in data engineering .
• Strong experience with big data technologies such as Apache Spark, Hadoop ecosystem, and Kafka.
• Proficiency in SQL and experience with various database technologies (relational and NoSQL).
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Strong programming skills in Python or Scala.

Benefits

• Competitive salary and bonus opportunities.
• Comprehensive health, dental, and vision insurance.
• Pension scheme and life assurance.
• Generous annual leave allowance.
• Professional development opportunities and access to training resources.