Data Engineer (Databricks)

Job title:

Data Engineer (Databricks)

Company

Robert Half

Job description

Job Description:Data Engineer (Databricks)Are you looking for a World Class career? Do you want to work in a company which is at the forefront of AI?This is an outstanding opening to join a Growing Tech Company!This role is ONLY 1 day in the office based in Central London!This is a career lead and permanent role due to the 2025-2030 roadmap we are only looking at perm hires and candidates from a perm background.About the jobAre you looking to work for an organisation with a real purpose – one where there is no limit to fresh ideas and discovering what’s new?We’re revolutionising the way data drives business insights and innovation to support more people to be happy at work. Our cutting-edge data platform, built on Databricks and Azure, is the backbone of our data-driven decision-making. This platform already leverages AI to generate insights for retailers and is built to be carbon-efficient, supporting our commitment to sustainability.As a Senior Data Engineer, you’ll be at the forefront of our Databricks-based data platform. You’ll architect, design and manage our datalake infrastructure, automated deployments across multiple workspaces, pipelines, and workflows using Databricks SQL, Python notebooks, and Delta Live Tables (DLT). Your expertise will ensure smooth data operations by tracking down and resolving issues within Databricks notebooks and codebase.You’ll work closely with stakeholders to understand data requirements and deliver solutions thatRequirementsWe are looking for individuals with strong problem-solving skills, attention to detail, and excellent communication and collaboration abilities. An analytical mindset is essential, along with the ability to adapt to changing requirements and work in a small team in a fast-paced environment.

• Proven experience as a Senior Data Engineer, with a focus on Databricks and Azure, is essential. Proficiency in Python and SQL, strong knowledge of Spark, and experience with automated deployment tools like Azure DevOps and Terraform are required.
• Familiarity with Azure Data Lake Storage is crucial and the Databricks, platform including unity-catalog. We are looking for a T-shaped data engineer who is happy to work on all aspects of the data platform. A passion for using technology and data to impact others is highly valued.
• Knowledge of new features being introduced by Databricks and Microsoft, and how implementation of such features could benefit an organisation.
• You will work with Databricks, including Workflows/Jobs, DLT Pipelines, Delta Live Tables (DLT), automated deployment, architecture, and security.
• Programming languages and tools such as Python, PySpark, Pandas, Pytest, and SQL will be used.
• You will be involved in data modelling concepts like schema design and ETL/ELT processes.
• The role involves working with cloud technologies, specifically Azure, and using version control systems like Git. CI/CD pipelines and collaboration tools such as Azure ADO, Slack, and Teams.

Excellent benefits on offer

• A pension scheme of up to 9% employer contributions.
• Life assurance of four times your salary.
• Private Medical Insurance
• A health cash plan, allowing you to claim back on the cost of a number of services such as optical, dental, and medical.
• 25 days annual leave, plus bank holidays.
• Additional days off including a duvet day, self-development/volunteering day, and a day to celebrate your birthday

Ready to take your career to the next level? Apply now and join us on this exciting journeyFlexible working 1 day in the office in Central London2 Stage process and fast turnaround!Apply now!Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to equal opportunity and diversity. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-noticeSecurity alert: scammers are currently targeting jobseekers. Robert Half do not ask candidates for a fee or request candidates to send applications through instant messaging services such as WhatsApp or Telegram. Learn how to protect yourself by visiting our website: roberthalf.com/gb/en/how-spot-recruitment-scams-and-protect-yourselfRequirements:Data Engineer (Databricks), Data Engineer,

Expected salary

Location

London

Job date

Tue, 05 Nov 2024 07:29:39 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (un-jobs.net) you saw this job posting.