Banner Default Image

Data Engineer

Data Engineer

  • Location

    City of London

  • Sector:

    Data and Analytics

  • Job type:

    Permanent

  • Salary:

    Negotiable

  • Contact:

    Ella Ross

  • Contact email:

    e.ross@finitas.co.uk

  • Job ref:

    BBBH76370_1649863632

  • Published:

    about 2 years ago

  • Consultant:

    Ella Ross

Data Engineer

Reports to (Role): Data Analysis Manager

Location: London

Salary: up to £75,000 pa

The Data Engineer is a critical role in the production of data for operations, actionable insight, regulatory reporting and partner reporting. The Data Engineer designs, develops, automates and supports the applications used to extract, transform and load the data from operational systems and other sources to the enterprise data platform for onward consumption by business users, data scientists and other applications.

Job Role Accountabilities

  • Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems
  • Document source-to-target mappings
  • Re-engineer manual data flows to enable scaling and repeatable use
  • Support the build of data streaming systems
  • Write ETL scripts and code to make sure the ETL process performs optimally
  • Develop business intelligence reports that can be re-used
  • Build accessible data for analysis
  • Identify data storage requirements
  • Creating and maintaining a framework to implement and catalogue business logic in the data warehouse
  • Providing Operational Support and rectifying any problems with the warehousing systems
  • Liaising with internal customers to understand business requirements
  • Working closely with IT colleagues to create solutions to extract data
  • Ensuring that metadata exists within the EDW
  • Responding to ad hoc requests for data and information
  • Dealing with service desk requests
  • Recommend continuous improvement of ETL processes and EDW based on user feedback and performance

Experience

  • Proven work experience as a data engineer/ETL developer in a complex environment
  • A Financial Services background is desirable
  • ETL and data warehousing using cloud solutions
  • Migrating data warehouse solutions from on premise to cloud
  • Good proven experience of SQL Server 2014, 2016, 2017, 2019 T-SQL, SSIS, SSAS, SSRS, DQS, MDS, Power BI
  • Good experience and knowledge of Microsoft development, test and project technologies.
  • Experience with IT development processes and delivery lifecycles; development methodology; release strategy and configuration management; development tools, and applications across full project lifecycles
  • Experience working within an Agile environment; delivering within defined Sprints; familiarity with Agile principles ceremonies.
  • Experience in mentoring other team members to improve individual and team capability