Senior Data Engineer - Big Data Solutions

About the Role

Our client is seeking a highly experienced Senior Data Engineer to join their fully remote team, specializing in building and optimizing Big Data Solutions . You will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure that support advanced analytics, machine learning, and business intelligence initiatives. This role requires a deep understanding of data warehousing, ETL processes, and big data technologies. You will work with a globally distributed team to ensure data availability, quality, and accessibility for data scientists and analysts, playing a crucial role in enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines using ETL/ELT processes and tools.
• Develop and manage data warehousing solutions and big data platforms (e.g., Hadoop ecosystem, Spark).
• Implement data quality checks and monitoring to ensure the accuracy and reliability of data.
• Collaborate with data scientists and analysts to understand data requirements and provide optimized data access.
• Optimize data storage, retrieval, and processing for performance and cost-efficiency.
• Ensure data governance, security, and compliance best practices are followed across all data infrastructure.

Requirements

• 5+ years of experience in data engineering , with a strong focus on big data technologies.
• Proficiency in programming languages such as Python, Scala, or Java for data manipulation and pipeline development.
• Experience with distributed data processing frameworks like Apache Spark or Hadoop MapReduce.
• Strong knowledge of SQL and experience with various database technologies (relational and NoSQL).
• Familiarity with cloud data platforms (e.g., AWS EMR, Redshift, S3; Azure Data Lake, Databricks).
• Excellent problem-solving skills and the ability to work effectively in a remote, collaborative environment.

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• Generous allowance for remote work setup and ongoing professional development.
• Flexible working hours and a strong focus on work-life balance.
• Opportunity to work on cutting-edge big data projects with a talented, remote team.