Data Engineering Manager, YLD

• We are seeking a highly skilled and experienced Data Engineering Manager to join our team
• Proven experience in data engineering or a similar role, with demonstrated progression into management
• Strong proficiency in programming languages such as Python, Java, or Scala
• Confident user of R or other statistical software
• Experience with distributed storage processing engines (e.g. Apache Hadoop/Spark)
• Extensive experience with workflow management/batch schedulers, such as Airflow, Prefect, and Dagster
• Strong SQL skills: extract, manipulate, transform and analyse large volumes of data with a high level of accuracy
• Solid understanding of database management systems, data warehousing concepts, and cloud-based data platforms (e.g., AWS, Azure, GCP)
• Expert in Continuous Integration and Delivery systems and patterns
• Familiarity with cloud native constructs and orchestration technologies (e.g. Kubernetes, Docker, Terraform, and Ansible)
• Experience with data modelling, schema design, and performance tuning
• Excellent leadership and people management skills, with the ability to motivate and inspire a team
• Strong problem-solving and analytical abilities, with a keen attention to detail
• Exceptional communication and collaboration skills, with the ability to effectively present technical concepts to both technical and non-technical stakeholders

Desirable

• As a Data Engineering Manager, you will be responsible for overseeing and leading a data engineering team to design, develop, and maintain the data infrastructure and systems
• You will collaborate closely with cross-functional teams, including data engineers, data scientists, analysts, and business stakeholders, to ensure data quality, availability, and usability
• Lead and manage a team of data engineers, providing guidance, mentorship, and performance feedback
• Collaborate with cross-functional teams to understand data requirements and translate them into scalable data solutions
• Design and implement robust data pipelines, ETL processes, and data integration workflows
• Ensure data integrity, quality, and security by implementing effective data governance and data management practices
• Identify and evaluate new technologies, tools, and frameworks to optimize data engineering processes and improve efficiency
• Support on architecture, design, and scale data services
• Monitor and optimise data storage and processing systems to ensure optimal performance and scalability.Manage relationships with external vendors, contractors, and partners
• Stay up-to-date with industry trends and best practices in data engineering, and recommend innovative solutions to enhance our data infrastructure
• Contract duration: 6 Months

• Flexible hours & remote work
• £2000/€2000 annual personal development budget
• Medical insurance and Mental Health Program
• A minimum of 25 days annual leave plus bank holidays
• Generous enhanced parental leave policy
• Performance Appraisal rounds every six months
• Social events and company offsites
• Great office coffee and snacks
• £300/€300 annual hardware allowance
• EMI options

The global software consulting market is on a trajectory to reach a staggering $350B by 2025. As technology advances at an unprecedented pace, clients increasingly turn to external experts to harness the full potential of emerging innovations. This surge in demand for specialised software consulting services reflects the recognition that staying competitive in the digital age requires a deep understanding of evolving technology landscapes.