Senior Data Engineer - Big Data Technologies

About the Role

Our client is seeking a highly skilled Senior Data Engineer with expertise in Big Data technologies to join their dynamic team. This hybrid role, based in Bristol , will focus on designing, building, and maintaining scalable data pipelines and infrastructure that support advanced analytics and business intelligence initiatives. You will work with large, complex datasets, ensuring data quality, accessibility, and efficiency. The role offers the perfect blend of in-office collaboration for strategic discussions and remote flexibility for focused work. You will be instrumental in empowering data-driven decision-making across the organization and working with a team committed to data excellence.

Key Responsibilities

• Design, build, and optimize robust and scalable data pipelines using big data technologies (e.g., Spark, Hadoop, Kafka).
• Develop and maintain ETL/ELT processes to ingest, transform, and load data from various sources.
• Implement data warehousing solutions and ensure data quality, integrity, and availability.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Monitor data infrastructure performance, troubleshoot issues, and implement improvements.
• Ensure data governance, security, and compliance best practices are followed.

Requirements

• 5+ years of experience in data engineering or a related field.
• Proven experience working with big data technologies such as Apache Spark, Hadoop, Hive, or Kafka.
• Strong proficiency in SQL and at least one programming language like Python or Scala.
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Familiarity with data warehousing concepts and database technologies.
• Excellent problem-solving skills and ability to work effectively in a hybrid setting.

Benefits

• Competitive salary and performance bonuses.
• Comprehensive health, dental, and vision insurance.
• Generous pension plan.
• Hybrid work model promoting work-life balance.
• Opportunities for professional growth and development.
• A collaborative and innovative work environment in Bristol .