Person, Hair, Glasses, Accessories, Accessory, Face, Head

Senior EDL Data Engineer

Dublin, Republic of Ireland | Hybrid
Permanent | Full time
Closing date:  Jan 3, 2025

Senior EDL Data Engineer

  • Dublin, Republic of Ireland
  • Full time
  • Closing on: Jan 3 2025

What is the opportunity?

Join our Data Engineering team in this exciting time as we implement Bank of Ireland's new cloud based data lake, take advantage of AI opportunities and transition workloads to that new Enterprise Data Lake platform.

As Senior Data Engineer, you will be responsible for the technical leadership, hands on engineering and mentoring of data engineers within the Data Engineering function.

We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test engineering patterns and frameworks.

In this Role, you will

  • Provide technical leadership and guidance to other data engineers
  • Take the lead in the design and build of complex data flows and process's using our Enterprise Data Lake and Cloud Data Platform
  • Make decisions on engineering frameworks, tooling and patterns
  • Advocate and drive Automation and the adoption of processes such as TDD
  • Be naturally curious and have experimented the use of AI to enhance software engineering processes
  • Solve complex technical problems and provide creative solutions from your experience or through a rational problem solving process.
  • Ensure teams are following engineering best practices, our engineering standards and process's while driving improvements in parallel
  • Ensure that technical development processes, standards, governance and tooling are appropriate and effective for the Enterprise Data Lake and Operational Data Store and meet business requirements

What Will Make You Stand Out

We are seeking a leader with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way!

You have a proven track record (7+ years) as a Senior Engineer in the Data Lake or Data Warehouse domain working in an agile team. You have deep technical knowledge of Data Lakes, Cloud Technologies and Architecture, preferably AWS.

Further technical knowledge and/or experience in the below are necessary to apply:

  • Proficiency in SQL, Python and Scala.
  • Expertise in processing large datasets, streaming data, and unstructured data using HBase, Hive, Impala, Spark.
  • Streaming Data Pipelines with tools like Kafka, NiFi, Spark Streaming.
  • Workflow orchestration skills using Oozie, Airflow, Ctrl-M.
  • Familiar with AI concepts and willingness to explore LLM's, Generative AI and Machine Learning
  • Knowledge in Metadata Management, Governance frameworks (Atlas, Collibra), and Reporting tools (Observability, Looker, Tableau, Qlikview).
  • Building data solutions on AWS
  • Strong knowledge of Cloud Data Platforms and data pipelines
  • Data Ops expertise including Bitbucket, Jenkins, Terraform.
  • Scrum/Kanban, SAFe delivery methodologies.

Experience with any of the following will help you to stand out but is not necessary in order to apply for this role;

  • REST APIs
  • Cloudera CDH/CDP platform and appropriate Cloudera certifications
  • The ability to derive and share Data-Driven insights with Business and Technical teams
  • The ability of identifying and introducing process optimizations

Essential Qualifications

There are no specific qualifications or minimum educational requirements needed for this role.

More About The team

Our growing and exciting Data Engineering team provides the engineering services for the Group's Enterprise Data Warehouse, Enterprise Data Lake and Operational Data Store. We sit within the Group Data & Analytics Office which is the core team for all things data in the bank.

We deliver the data elements to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda.

We have fully embraced agile software engineering and a DevOps mentality and operate in a highly collaborative team environment.

#li-hybrid #ij-hybrid

Why work with us?

The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 25 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.

Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career!

Flexible working matching promise

We know how important flexible working arrangements are to our colleagues, and we promise to try to match your current flexible working arrangement in this new role (all existing working arrangements considered!)

Key Competencies

  • Customer Focused - People Manager
  • One Group, one team - People Manager
  • Champion Transformation - People Manager
  • Accountable - People Manager
  • Manage Risk - People Manager

Where Agency assistance is required Bank of Ireland Recruitment Team will engage directly with suppliers. Unsolicited CVs / profiles supplied to Bank of Ireland by Recruitment Agencies will not be accepted for this role.

We're on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. Reasonable accommodations are offered at every stage of our recruitment process. If you require any assistance, please complete this form and one of our recruitment team members will be in touch via email. Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process.

Apply now

Our application form takes just minutes to complete. If you have any questions or require assistance with our application process, you can fill out this form and one of our recruitment team members will be in touch via email.

 

Email me about jobs like this

Not You?

Thank you

We’re on a journey

Follow our path to leading the industry in creating a digital first environment.

Recommended jobs for you

 

Business Analyst 3 P - Professional Specialism Permanent Customer Focused - Self One Group, one team - Self Agile - Self Champion Transformation - Self Manage Risk - Self Bank of Ireland Hybrid Business Analyst 30906 Dublin Dublin Republic of Ireland Dublin, Republic of Ireland IT, Digital and Analytics What is the opportunity? We have an excellent opportunity for a Business Analyst to join our team! You will have the chance to collaborate closely with technical and test teams to make certain the final design will meet the business' needs and yo... Full time
Welcome Advisor - Portarlington 1 S - Customer Relationship / Customer Management Permanent Customer Focused - Self One Group, one team - Self Agile - Self Accountable - Self Manage Risk - Self Bank of Ireland Onsite Retail S&S F2F 31012 Laois Laois Ireland Laois, Ireland Customer and Relationship Management What is the opportunity? This is an exciting opportunity for an ambitious and self-motivated individual who would like to build their skills and progress their career within Bank of Ireland. Working as part of a dynamic and supportive team you wil... Full time
VisualFiles Developer 3 P - Professional Specialism Temporary - Fixed Term One Group, one team - Self Agile - Self Manage Risk - Self Amplify Capability - Self Champion Transformation - Self Bank of Ireland Hybrid Digital operations 30495 UK UK United Kingdom UK, United Kingdom IT, Digital and Analytics What is the opportunity? This is an exciting opportunity to join our UK Digital Team as a Visualfiles Developer! You will be involved a number and project and programmes that will help make the customers experience with Bank of Ireland UK. You wi... Full time
Business Cutover Lead 5 P - Professional Specialism Temporary - Fixed Term Accountable - Leader Agile - Leader One Group, one team - Leader Champion Transformation - Leader Manage Risk - Leader Bank of Ireland Hybrid Project Management 30895 Dublin Dublin Republic of Ireland Dublin, Republic of Ireland IT, Digital and Analytics What is the opportunity? Opportunity to be part of a programme which in 2025 will launch a brand-new payroll, expenses and core HR system to all colleagues. The functionality of the system will make it easier for colleagues and people managers to ... Full time
Business Manager - Newry / Portadown 3 S - Customer Relationship / Customer Management Permanent Customer Focused - Self One Group, one team - Self Agile - Self Accountable - Self Manage Risk - Self Bank of Ireland Hybrid Business Banking 30816 Northern Ireland Northern Ireland United Kingdom Northern Ireland, United Kingdom Bank of Ireland UK What is the opportunity? This is an exciting opportunity to be an Ambassador for Bank of Ireland both internally and externally within the local community, ensuring that our customers are put at the heart of everything we do. You will be responsib... Full time