Data Engineering Manager / Lead Data Engineer – Microsoft Fabric – (hybrid)

  • Contract
  • Scotland
  • Posted 10 months ago

Sentinel IT

Job title:

Data Engineering Manager / Lead Data Engineer – Microsoft Fabric – (hybrid)

Company

Sentinel IT

Job description

Data Engineering Manager / Lead Data Engineer – Microsoft Fabric – (hybrid)

Job Details:

  • Posted: January 16 2024
  • Location:

Scotland * Salary: £53k – 80k per year + bonus + benefits

  • Specialism: Data
  • Type: Permanent
  • Ref: CG/DE/32208

2024-01-16

2024-02-13 Permanent £53k – 80k per year + bonus + benefits

Sentinel https://www.sentinelit.com

Job Description

Data Engineering Lead / Data Engineering Manager – MS FABRIC, Data Factory, Databricks, Storage Account

Our client requires a Lead Data Engineer to undertake the technical management and development of its Microsoft Fabric data platform, plan and implement technical features and functions.

You will drive and own the establishment of effective data provision and management and will also work closely with the Lead Data Architect and Data Management teams on data models, data governance and security, as well as delivery of technical capabilities, data pipelines and models into production.

Key responsibilities:

– Become the SME and technical owner for the Microsoft Fabric platform, owning the platform development, including planning for and implementing technical features and functions that support the data product lifecycle and roadmap. (e.g. streaming analytics, use of CoPilot, etc.)

– Lead a 3rd party data engineering capability, using a professional and recognised life cycle approach covering analysis, planning, design, development, testing, deployment and maintenance.

– Ensure that business requirements coming into the data engineering team are appropriate and can be delivered

– Lead on the design, engineering, improvement and productionisation of enterprise level data solutions using Microsoft Fabric and other associated Azure based capabilities.

– Work alongside data architects, data scientists, data analysts and other data consumers to collaborate on the models and algorithms in order to optimise them for data quality, security and governance.

Skills:

– Excellent technical data warehousing / data engineering background across analysis, design and development

– Experience with designing, building, and operating analytics solutions using Azure cloud technologies.

– Demonstrable use of specific Azure data related resources including:

  • Data Factory
  • Databricks
  • Storage Account (Data Lake / Delta Lake)
  • SQL Database
  • SQL Data Warehouse (Dedicated SQL Pool)

– The ability to lead and mentor a data engineering team who are:

  • Designing and building new data models.
  • Designing and building appropriate ETL pipelines for required data.
  • Engineering robust solution components.
  • Undertaking testing/QA; undertaking code reviews and other assurance related activities.

– Experience with Azure DevOps. Lead on all best practices and standards in terms of source repository control, CI/CD and change control.

Expected salary

£80000 per year

Location

Scotland

Job date

Thu, 18 Jan 2024 08:57:56 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (un-jobs.net) you saw this job posting.

To apply for this job please visit jobviewtrack.com.

Job Location