Royal Bank of Canada
Job title:
Lead Data Engineer
Company
Royal Bank of Canada
Job description
Job Summary As part of the P&CB Data & Analytics team you will generate value by transforming raw data from a complex array of source systems into user-friendly data assets which will be used by RBC’s team of data scientists and insights analysts. You will develop, test, deploy, and maintain software to create complete and accurate data, using a variety of big data platforms, languages and tools, including Hadoop, Spark, Scala, Neo4j, Git and Maven. You will collaborate with a highly talented team of data engineers, data scientists, data architects, and data analysts in order to deliver business value to the organization. You will develop recommendations for new ways to improve data quality throughout the data transformation lifecycle.Job DescriptionWhat is the opportunity?As part of the P&CB Data & Analytics team you will generate value by transforming raw data from a complex array of source systems into user-friendly data assets which will be used by RBC’s team of data scientists and insights analysts. You will develop, test, deploy, and maintain software to create complete and accurate data, using a variety of big data platforms, languages and tools, including Hadoop, Spark, Scala, Neo4j, Git and Maven. You will collaborate with a highly talented team of data engineers, data scientists, data architects, and data analysts in order to deliver business value to the organization. You will develop recommendations for new ways to improve data quality throughout the data transformation lifecycle.What will you do?Develop, test, and deploy software to generate data assets (relational, graph, other) for use by downstream insight analysts and data scientistsWork with big data, graph, and cloud technologies such as Spark, Hadoop, Hive, Neo4j, S3, EMR, EC2, Lambda, and KafkaWork closely with stakeholders to ensure successful data asset design and developmentJoin data across multiple data environments, such as HDFS, S3 and Data Warehouses, using complex optimized queriesUse Scala, Cypher, Spark, GitHub, Maven, Jenkins and Airflow to develop and deploy automated data-producing software packagesCreate software artifacts and patterns for reuse within the enterpriseEnsure ETL pipelines are produced with the highest quality standards, metadata and validated for completeness and accuracyWork on a cross-functional Agile team responsible for end-to-end delivery of business needsHelp develop new solutions for batch and real-time data and analytics use casesHelp improve data management processes – acquiring, transforming and storing massive volumes of structured and unstructured dataWork closely with development teams to learn about needs, current processes and to promote best practices.Must-haveBachelors in Computer Science, Software Engineering, Mathematics, or other STEM majors. Masters/PhD considered an asset.Professional software development experience with Python, Scala, Spark, Hadoop, Neo4j, Java, Linux, and SQL.Experience with other analytics programming languages (Python)3+ years of experience in the big data ecosystem, with Hadoop (Pig, Hive, HDFS), Apache Spark, and NoSQL/SQL databasesExperience using Git and Maven while collaborating on a software development teamExperience using ETL big data pipelines (Apache Airflow), knowledge of CI workflows and build/test automationNice-to-haveExperience with other data analytics and visualization tools such as TableauExperience with Agile software developmentExperience with DevOps concerns, including CI/CDWhat’s in it for you?We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services.
- Opportunities to do challenging work, to take on progressively greater accountabilities and to building close relationships with clients
- Access to a variety of job opportunities across business and geographies.
#LI-Hybrid#LI-Post#LI-PKJob Skills Apache Airflow, Apache Hadoop, Apache Spark, Cloud Computing, Data Mining, ETL Processing, GitHub, Neo4j, Python (Programming Language), Quality Management, Requirements Analysis, Scala (Programming Language), Software Product Management, Structured Query Language (SQL), Waterfall ModelAdditional Job DetailsAddress: RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity: TORONTOCountry: CanadaWork hours/week: 37.5Employment Type: Full timePlatform: PERSONAL & COMMERCIAL BANKINGJob Type: RegularPay Type: SalariedPosted Date: 2025-02-24Application Deadline: 2025-03-15Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date aboveInclusion and Equal Opportunity EmploymentAt RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.Join our Talent CommunityStay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at .
Expected salary
Location
Toronto, ON
Job date
Tue, 25 Feb 2025 23:01:49 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (un-jobs.net) you saw this job posting.