What is the opportunity?

Join our Data Engineering team in this exciting time as we implement Bank of Ireland's new cloud-based data platform, and drive the near real-time exploitation of data to support our Digital and Customer strategies.

As a Data Engineer, you will be responsible for the design and build of reliable, scalable, and performant data pipelines. You will technical leadership and guidance to other data engineers

We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test and engineering patterns and frameworks.

In this Role, you will

• Work closely with data architects, analysts, and business stakeholders in an agile delivery team, where you will design and deliver batch and streaming solutions.

• Work with distributed data processing frameworks like Apache Spark, Hadoop, Impala and Hive to process and analyse large-scale datasets.
• Integrate data from structured, semi-structured, and unstructured sources such as relational databases, flat files, and streaming platforms like Kafka.
• Ensure data quality, consistency, and integrity across the pipeline.
• Collaborate with DevOps teams to deploy to various environments.

• Optimize data processing jobs for performance and cost efficiency.
• Document data pipelines, workflows, and processes to ensure maintainability and knowledge sharing.

What Will Make You Stand Out

You are a Data Engineer with 4+ years' experience and a high capacity to learn and develop your data engineering skills. We are looking for someone with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way.

Further technical knowledge and/or experience in the below are necessary to apply:

• Strong experience with Apache Spark and Hadoop Ecosystem.
• Proficiency in programming languages like Python, Scala, or Java.
• Hands-on experience with SQL for querying and managing large datasets.
• Experience with streaming pipelines with tools such as Apache Kafka or Spark Streaming.
• Familiarity with orchestration tools like Airflow, Oozie etc.
• Data Engineering experience with any cloud platform.
• Strong understanding of distributed computing principles and performance tuning for Spark jobs.
• Knowledge of DevOps pipelines including tools such as Bitbucket, Jenkins, GitHub.
• Experience in Scrum/Kanban, SAFe delivery methodologies.
• Strong problem-solving and analytical skills.

Experience with any of the following will help you to stand out but is not necessary to apply for this role:

• Cloudera CDH/CDP platform experience
• Experience with Delta Lake, Apache Iceberg, or Apache Hudi for managing large-scale data lakes.
• Knowledge of containerization and orchestration tools like Docker and Kubernetes..
• Knowledge of data modelling and schema design for big data systems.
• Experience with building ci-cd pipelines using Jenkins, ansible, terraform etc for deploying data pipelines.

More About The team

Our growing and exciting Data Engineering team provides the engineering services for the Group's Enterprise Data Warehouse , Enterprise Data Lake and Operational Data Store. We sit within the Group Data & Analytics Office which is the core team for all things data in the bank.

We deliver the data elements to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda.

We have fully embraced agile software engineering and a DevOps mentality and operate in a highly collaborative team environment.

#li-hybrid #ij-hybrid

Why work with us?

The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 23 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.

Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career!

Flexible working matching promise

We know how important flexible working arrangements are to our colleagues, and we promise to try to match your current flexible working arrangement in this new role (all existing working arrangements considered!)