Senior Data Engineer - Big Data Technologies

About the Role

Our client is seeking a skilled Senior Data Engineer with expertise in Big Data Technologies to join their analytics team in Bristol . You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support our data warehousing and analytics initiatives. This role requires a deep understanding of data architecture, ETL processes, and distributed computing frameworks. Join us to help unlock the power of data, enabling data-driven decisions across the organization through robust and efficient data solutions.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for ingesting, transforming, and storing large datasets.
• Develop and optimize ETL/ELT processes using big data technologies such as Spark, Hadoop, or Flink.
• Implement data warehousing solutions and ensure data quality, integrity, and availability.
• Collaborate with data scientists and analysts to understand their data needs and provide appropriate solutions.
• Monitor and troubleshoot data infrastructure, ensuring optimal performance and uptime.
• Contribute to the development of data governance policies and best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering or software development with a focus on data.
• Strong experience with big data technologies like Apache Spark, Hadoop ecosystem (HDFS, Hive, MapReduce).
• Proficiency in SQL and experience with various database systems (relational and NoSQL).
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Familiarity with data pipeline orchestration tools (e.g., Airflow) and programming languages (e.g., Python, Scala).

Benefits

• Competitive salary and performance incentives.
• Comprehensive health, dental, and vision coverage.
• Pension scheme and life insurance.
• Opportunities for professional growth and development.
• Hybrid working model offering a blend of office and remote flexibility.
• Collaborative and innovative work environment in Bristol .