Senior Data Engineer - Big Data Solutions

About the Role

Our client is seeking a highly skilled Senior Data Engineer to design, build, and maintain their big data infrastructure and pipelines in Bristol . You will be responsible for ensuring the reliability, scalability, and efficiency of data systems that support advanced analytics, machine learning, and business intelligence initiatives. This role requires a deep understanding of data warehousing, ETL processes, and distributed data processing technologies. You will work closely with data scientists, analysts, and software engineers to deliver high-quality data solutions that drive business value and innovation.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and optimize ETL/ELT processes to ingest, transform, and load data from various sources.
• Build and manage data pipelines using big data technologies (e.g., Spark, Hadoop ecosystem).
• Implement data warehousing solutions and optimize data models for performance and usability.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists and analysts to provide them with clean, reliable data for their needs.

Requirements

• 5+ years of experience in data engineering or a related field.
• Proven experience with big data technologies such as Apache Spark, Hadoop, Hive, or Flink.
• Strong proficiency in SQL and programming languages like Python or Scala.
• Experience with cloud data platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data warehousing concepts and database design principles.
• Familiarity with data pipeline orchestration tools (e.g., Airflow).

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• Generous pension contributions and life assurance.
• Opportunities for professional development, training, and conference attendance.
• A collaborative work environment focused on innovation in the thriving tech scene of Bristol .