Lead Data Engineer | 6 months Outside IR35 | £Competitive Day Rate
Finitas are partnered with a leading conglomorate insurance business who are looking for someone that embraces modernization and uses data to enhance decision-making in the business. You'll bring innovation to the team and work with modern data frameworks, this role is crucial as they elevate the data landscape. You will also be responsible for mentoring the junior team members.
Key responsibilities:
- Lead the design of data solutions with quality, automation, and performance in mind
- Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable
- Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption
- Responsible for the data modelling that feeds the Data Platform
- Maintain and optimise existing data pipelines to improve performance and quality, minimising impacts on business
- Set and embed standards for systems and solutions and share knowledge, ensuring the team remain engaged and skilled in the latest technology
- Be able to prototype and adopt new approaches, driving innovation into our solutions
- Effectively communicate plans and progress to both technical and non-technical stakeholders
- Develop and implement the Data roadmap for strategic data sets
- Communicate complex solutions in a clear and understandable way to both experts and non-experts
- Promote the Data Platform and Data & Analytics team brand throughout the business representing the interests of data engineering in cross-functional forums
Skills and experience required:
- Strong experience in leading AWS and Snowflake cloud data platform transformation
- Experience in delivering data & analytical solutions in a large-scale cloud environment
- Strong experience implementing end-to-end data pipelines on AWS with deep knowledge of data engineering techniques
- Strong experience developing Data Warehouses on Snowflake
- Demonstrable knowledge and ability to embody modern data architecture
- Practical experience of data architecture and data modelling
- Experience managing the costs of data pipelines
- Experience with CI/CD driven data pipeline and infrastructure
- Experience supporting QA and user acceptance testing processes
- Deep knowledge or experience with using as much of the following:
- PySpark, Python, SQL
- Bash Scripting
- Apache
- Atlas
- Glue
- Databrew
- AWS, EC2, RDS, EMR
- DynamoDB
- Kafka, Kinesis, S3
Apply today to find out more!
