Open roleExternal
Senior Data Engineer - Big Data Solutions
- oxford, oxfordshire, OX11AA, United Kingdom
- Hybrid
- Full time
- £78,000 - £78,000 Per Annum
Job Description
About the Role
Our client is seeking a highly experienced Senior Data Engineer to join their growing analytics team in Oxford . This role is critical for designing, building, and maintaining scalable data pipelines and infrastructure that support the organization's big data initiatives. You will work with large, complex datasets, implement data warehousing solutions, and ensure data quality and accessibility for analytics and machine learning purposes. The ideal candidate has a strong background in distributed systems and a passion for leveraging data to drive business insights and innovation.
Key Responsibilities
- Design, develop, and optimize big data pipelines and ETL processes using tools like Spark, Kafka, and Airflow.
- Build and maintain robust data warehouse solutions and data lakes on cloud platforms (AWS, Azure, GCP).
- Ensure data quality, integrity, and accessibility for analytics and reporting needs.
- Collaborate with data scientists and analysts to understand data requirements and provide solutions.
- Implement data governance best practices and ensure compliance with data privacy regulations.
- Monitor and troubleshoot data infrastructure, resolving issues promptly to minimize downtime.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of professional experience in data engineering or a related role.
- Strong experience with distributed data processing frameworks such as Apache Spark or Hadoop.
- Proficiency in SQL and experience with various database technologies (relational, NoSQL, data warehouses).
- Experience with cloud data services (e.g., AWS Glue, S3, Redshift, Azure Data Factory).
- Familiarity with data modeling concepts and ETL best practices.
Benefits
- Competitive salary and performance-based incentives.
- Comprehensive health, dental, and vision coverage.
- Generous pension scheme.
- Opportunities for professional development and training.
- Hybrid working model offering flexibility and work-life balance in Oxford .