Open roleExternal
Lead Data Engineer
- derby, derbyshire, DE1 2GN, United Kingdom
- Full time
- £70,000 - £70,000 Per Annum
Job Description
About the Role
Our client is seeking an experienced Lead Data Engineer to architect and manage their data infrastructure in Derby . This critical role involves designing, building, and maintaining scalable data pipelines and systems that enable advanced analytics and data-driven decision-making. You will work with large datasets, collaborate with data scientists and analysts, and mentor a team of data engineers. The ideal candidate has a strong background in data warehousing, ETL processes, and big data technologies, coupled with leadership experience.
Key Responsibilities
- Design, build, and maintain robust and scalable data pipelines using ETL/ELT processes and tools.
- Develop and manage data warehousing solutions, ensuring data integrity, consistency, and accessibility.
- Optimize data storage, processing, and querying performance for large datasets.
- Collaborate with data scientists and analysts to understand their data needs and provide them with reliable data sources.
- Implement data quality checks and monitoring systems to ensure the accuracy and reliability of data.
- Mentor junior data engineers and contribute to the team's technical strategy and best practices.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
- 5+ years of experience in data engineering, data warehousing, or ETL development.
- Proficiency in SQL and experience with relational database systems (e.g., PostgreSQL, SQL Server).
- Experience with big data technologies such as Spark , Hadoop, or distributed processing frameworks.
- Knowledge of cloud data platforms (e.g., AWS Redshift, Azure Data Factory, Google BigQuery).
- Experience with programming languages like Python or Scala for data manipulation and scripting.
Benefits
- Competitive salary and performance-based incentives.
- Opportunity to lead key data initiatives within the company.
- Comprehensive health, dental, and vision insurance.
- Generous pension scheme.
- Budget for professional development and continuous learning.