• Several years of experience as a Data Engineer or similar role
• Proven experience developing, and deploying data pipelines in the cloud (AWS preferred)
• Strong proficiency in SQL and experience with scripting languages (Python, Bash)
• Experience with data warehousing solutions (e.g., AWS Redshift, Snowflake)
• Exposure to big data technologies (e.g., Apache Spark, Hadoop)
• Solid understanding of data modelling concepts and techniques
• Excellent communication, collaboration, and problem-solving skills
• A passion for data and a dedication to building high-quality, efficient data solutions

Desirable

• The Core Data team engages and works with stakeholders across the organisation
• A key responsibility of the team is to promote CMC’s data strategy of providing a decentralised approach to data, working with other teams to develop shared data capabilities that will allow them to operate with increased autonomy
• A driving principle of the team is to realise better data citizenship, treat data as a product, and enable CMC to build scalable data services with increased velocity
• Design, build, and maintain scalable data pipelines to deliver relevant and timely data to our users
• Develop and optimise ELT processes to transform raw data into meaningful insights
• Manage and optimise data warehousing plans in Snowflake, ensuring efficient storage, retrieval, and analysis of data
• Implement and maintain data lakes, ensuring data organisation, security, and availability
• Work closely with BI developers, business analysts and internal stakeholders to understand data needs and deliver data in a secure, scalable and efficient way for the whole company
• Ensure data quality, integrity, and governance by implementing and adhering to best practices across the entire data lifecycle
• Perform performance tuning and optimisation of data queries and pipelines to ensure efficient data processing and retrieval
• Participate in our on-call rota to monitor data pipelines and infrastructure, troubleshooting issues as they arise to deliver a robust platform for our critical internal use cases
• Implement and enforce data security and compliance measures across the entire data platform and guide other teams to do the same