Deep Light AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking. Our team combines deep expertise in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.
The QA & Application Testing & Automation Engineer is responsible for the quality, resilience, and performance of the Bank's digital and core operational platforms. This role goes beyond traditional testing, focusing on the end-to-end validation of next-generation AI systems, mobile applications, and enterprise services. By building sophisticated automated frameworks and continuous testing pipelines, you will ensure that every release—from Conversational AI agents to core banking microservices—meets the highest standards of security, scalability, and reliability.
You will act as a quality gatekeeper, collaborating across engineering and cybersecurity teams to accelerate deployment without compromising the Bank's integrity.
As an AI consultancy, our greatest asset is the expertise of our people.
While technical mastery is the foundation of what we do, the ability to bridge the gap between complex data science and actionable business value is what defines your success with Deeplight.
We're looking for individuals who are not only world-class in their fields of specialism, but also compelling communicators and persuasive advocates for their own skills.
You will be the face of our firm, tasked with building trust, articulating the "why" behind your technical decisions, and effectively "selling" your vision to high-level stakeholders.
If you thrive on the challenge of presenting cutting-edge solutions as much as you do on building them, you will fit right in.
Responsibilities- Validate next-gen AI platforms (voice and chat) for accuracy, stability, latency, and safety; ensure AI-driven enterprise search avoids hallucinations
- Build and maintain reusable automation frameworks for web, mobile, and API integrations using Python, Selenium, or Playwright
- Validate RAG (Retrieval-Augmented Generation) pipelines, vector search quality, and grounding accuracy to ensure data retrieval performance
- Implement automated quality checks for MLOps, including drift detection, retraining validation, and model registry integrity
- Conduct scenario-based testing for operational AI agents (KYC, Risk, Compliance) and validate high availability and disaster recovery protocols
- Integrate automated quality gates into CI/CD pipelines to ensure continuous validation within containerized (Docker/Kubernetes) environments
- Verify that all AI engineering aligns with guardrails for fairness, security, explainability, and regulatory requirements
- A Bachelor's degree in Computer Science, AI, Software Engineering, or a related quantitative field. A Master's degree in AI/ML is highly preferred
- A minimum 5+ years in QA and Automation, preferably within a large-scale digital bank or a major digital transformation project
- Proven experience deploying AI/ML QA solutions at an enterprise scale, specifically in banking or financial services
- Deep knowledge of software testing methodologies (Functional, Regression, Security, and Non-functional)
- Proficiency in Python for test automation and expertise with tools like PyTest, Selenium, Playwright, and Postman
- Hands-on experience testing LLM response quality, prompt stability, and agentic orchestration workflows
- Strong experience validating pipelines and storage services across Azure (AI Foundry) and AWS (Sage Maker)
- Proficiency in load and stress testing using tools like JMeter or Locust
- Expertise in SQL and No
SQL test validation (Postgres, Mongo
DB, Cassandra) and data platform integrity
- Competitive salary
- Visa Sponsorship for the successful individual.
- Comprehensive health insurance for the successful individual.
- Professional development and certification support
- Opportunity to work on cutting-edge AI projects
- Career advancement opportunities in a rapidly growing AI company
This…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).