What is the opportunity?

The AI Centre of Excellence (CoE) is the Bank's powerhouse for safe, responsible and scalable AI adoption. It sets the vision, standards and governance that shape how AI is built and deployed across the organisation, while providing the platforms, expertise and partnership needed to turn ideas into high value outcomes.

This role establishes a critical new capability focused on AI trustworthiness and performance. It defines how AI model outputs are tested, monitored and governed across the Bank, from accuracy and bias to hallucination and explainability.

The opportunity is to shape responsible AI standards in practice, influence regulatory alignment, and build a scalable evaluation framework that underpins confidence in AI driven decision making across the organisation.

In this role, you will:

• Own and operationalize the AI model evaluation framework across all archetypes, covering accuracy, bias, hallucination, explainability, robustness, ethical compliance and guardrail thresholds.
• Lead end to end evaluation processes from pathfinder through production, developing quantitative and qualitative testing methodologies for generative AI, classical ML and decisioning models.
• Handle LLMOps monitoring, including performance dashboards, drift detection, degradation alerts and retraining triggers, ensuring outputs feed into 1LOD and 2LOD risk assessments, regulatory submissions and model risk documentation.
• Produce governance ready evaluation reporting, contribute to the AI risk taxonomy and maintain alignment with evolving regulatory expectations and industry standards.
• Build organisational capability through guidance, tooling and knowledge sharing, while applying evaluation frameworks to third party AI systems and vendor models.

What will make you stand out?

• Deep expertise in AI/ML model evaluation and monitoring including generative AI, LLMs and MLOps/LLMOps practices such as drift detection and lifecycle management.
• Strong grounding in responsible AI principles (bias, explainability, fairness, ethics) and experience developing quantitative and qualitative evaluation frameworks.
• Solid understanding of financial services AI regulation (EBA model risk guidelines, EU AI Act) with the ability to translate complex model behaviour into clear, actionable insights for non-technical partners.
• Excellent analytical, communication and collaboration skills, with experience partnering across risk, delivery and technology teams; financial services experience highly desirable.
• Commitment to responsible innovation, ethical standards and continuous professional development.

Essential Qualifications

There are no specific qualifications or minimum educational requirements needed for this role.

More about the team

Working at the intersection of innovation and control, the CoE ensures the Bank can unlock meaningful business impact from AI while upholding the highest expectations of ethics, risk management and regulatory compliance. It's where pioneering capability meets focused execution enabling the Bank to harness AI with confidence, clarity and ambition.

This is a hybrid role, based primarily in Dublin. We typically ask colleagues to spend a minimum of 8 days per month working in-person to support teamwork and connection. Specific arrangements will be confirmed by your recruiter to ensure they meet the needs of the role and team.

#li-hybrid #ij-hybrid

Why work with us?

The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 25 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.

Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career!