Lead Data Engineer

Job title:

Lead Data Engineer

Company

Irwin Mitchell

Job description

We’re a national law firm with a local reach. Our philosophy is ‘Expert Hand, Human Touch’ – something you’ll find in the way we work with our clients and how we support our teams. But we’re more than just a law firm – we’re a team of people working together to help individuals and businesses navigate life’s ups and downs. Working here you’ll feel a part of our friendly and inclusive environment.

We’ll value you for who you are and what you bring. We support each other and push boundaries to achieve incredible things and make a real difference to our clients and communities.

We’re always looking to support our colleagues in working in a way that best works for them. Please speak to one of our Talent Acquisition Team to find out more information about our flexible working arrangements.

Your Role and What You’ll Be Doing

As a Lead Data Engineer, you will play a pivotal role in leading the development and implementation of cutting-edge Data Engineering solutions. Leveraging your technical expertise and leadership skills, you will drive innovation, collaboration, and excellence in our Data Engineering initiatives, transforming the way data is used at Irwin Mitchell.

Your Role

The Lead Data Engineer will be responsible for providing leadership and guidance to the engineering team, supporting the technical vision and designing and contributing to architectural decisions. You will contribute to the technical direction, define best practices, and ensure adherence to industry standards.

The Lead Data Engineer will collaborate with stakeholders to understand business goals and translates them into technical requirements, designing complex software systems with scalability and performance in mind. You will mentor and coach less experienced engineers, share knowledge, and foster a culture of continuous learning.

Additionally, you will possess deep technical expertise in specific domains, conduct code and design reviews, and actively stay up-to-date with industry trends and emerging technologies. They play an important role in setting the technical direction, solving complex technical challenges, and ensuring the successful delivery of projects aligned with business objectives.

What You’ll Be Doing

• Lead the design, development, and deployment of Data engineering solutions to solve complex business problems.
• Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and translate them into scalable and performant Data solutions.
• Stay up-to-date with the latest advancements in Data, identifying and evaluating new frameworks, and technologies that can enhance our Data capabilities.
• Provide technical guidance and mentorship to junior team members, fostering their growth and development in Data engineering.
• Drive the implementation of best practices, standards, and efficient processes to ensure the reliability, scalability, and accuracy of Data models and systems.
• Communicate effectively with both technical and non-technical stakeholders, presenting complex Data concepts and findings in a clear and concise manner.
• Lead and contribute to research and development projects, driving innovation and pushing the boundaries of Data technology within the organization.
• Performance Optimization: Monitoring and optimizing the performance of data pipelines, databases, and data processing systems. This involves identifying bottlenecks, tuning queries, and implementing performance improvements.
• Data Architecture: Designing and implementing the data architecture to support the organization’s data needs. This involves identifying the appropriate data storage technologies, defining data models, and ensuring data integration and interoperability.
• Data Pipeline Development: Building and maintaining scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into the data warehouse or data lake. This includes data cleansing, data transformation, and data enrichment processes.
• Data Warehousing: Designing and managing data warehouses or data lakes to store and organize structured and unstructured data. This involves optimizing data storage, ensuring data quality, and implementing data security measures.
• Data Governance: Establishing and enforcing data governance policies and procedures to ensure data integrity, privacy, and compliance with relevant regulations (such as GDPR or CCPA). This includes defining data access controls, data retention policies, and data lineage documentation.
• All aspects of Coaching and Mentoring including guiding technical growth and professional development, develop tailored coaching plans, offer constructive feedback, set expectations and goals, promote best practices and new technologies, act as a technical resource and contribute to the overall technical excellence of the Engineering team.

About You

Essential

• Master’s or Ph.D. degree in STEM, or a related field with a focus on Data.
• Extensive experience in designing and implementing Data solutions in real-world applications.
• Strong programming skills in languages such as Python and SQL, and proficiency with Data libraries and frameworks.
• Solid understanding of Data concepts for ingesting, storing, serving data.
• Expert in designing, developing, optimizing, and maintaining end-to-end data pipelines and data lakehouse solutions using Python/PySpark, Azure Data Factory, and Azure Databricks.
• Demonstrated experience with Data frameworks and tools, such as TensorFlow, PyTorch, or scikit-learn.
• Experience with big data technologies and distributed computing frameworks, such as Apache Spark, Hadoop, or similar.
• Strong analytical and problem-solving skills, with the ability to approach complex problems in a structured and systematic manner.
• Excellent communication and interpersonal skills, enabling effective collaboration, stakeholder management, and mentorship.
• Proven leadership abilities, with experience in leading Data projects, guiding teams, and driving technical excellence.

Desirable

• Influential within the Data community
• Strong publication record or contributions to the Data community is a plus.
• Experience of working within a Professional services firm

Our Benefits – What We Can Offer You

• Flexible working options – Make work fit around your life, not the other way around.
• 25 days holidays as standard plus bank holidays – You can ‘buy’ up to 35hrs of extra holiday too
• Generous and flexible pension schemes.
• Volunteering days – Two days of volunteering every year for a cause of your choice (fully paid)
• Westfield Health membership, offering refunds on medical services alongside our Aviva Digital GP services.

We also offer a wide range of well-being initiatives to encourage positive mental health both in and out of the workplace and to make sure you’re fully supported to work in a way that best suits you. This includes our Flexible by Choice programme which gives our colleagues more choice over how they wish to work subject to role and client requirements.

We have recently been ranked in the Best Workplaces for Wellbeing for Large Organisations for 2023!

Our responsible business programmes are fundamental to who we are and our purpose. We’re committed to being a diverse and inclusive workplace where our colleagues can flourish, and we have established a number of inclusion network groups across our business to support this aim.

Our commitment to Social Responsibility, community investment activity and tackling climate change is a fundamental part of who we are. It’s made up of four strands: Our People, Our Community, Our Environment and Our Pro Bono.

Additional Information

As part of the Irwin Mitchell Group’s on-boarding process all successful applicants are required to complete the group’s employment screening process. This process helps to ensure that all new employees meet our standards in relation to honesty and integrity therefore protecting the interests of the Group, existing employees, clients, partners and other stakeholders.

Depending on the role you apply for we may carry out checks that will establish your eligibility to work in the UK, and criminal record check and financial checks ­with a credit reference agency will also be undertaken.

The employment screening process will fully comply with Data Protection and other applicable laws.

Irwin Mitchell LLP is an equal opportunity employer.

We’re proud of our values, and we’re looking for people who share them

Sub-Department:

Data

Sub-Division:

Data

Company:

IM LLP

Working Hours:

Full Time

Vacancy Type:

Permanent

:

Flexible

Salary:

Competitive

Share this page

Vacancy Alerts

Create an alert subscription based on this vacancy

Loading

© 2024 Irwin Mitchell LLP is Authorised & Regulated by the Solicitors Regulation Authority.

Expected salary

Location

United Kingdom

Job date

Thu, 18 Jan 2024 08:56:28 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (un-jobs.net) you saw this job posting.