Job Summary

We are seeking a highly skilled AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. The ideal candidate will be responsible for validating generative and predictive AI models, ensuring production readiness, ethical compliance, and scalability. This role blends AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation, while collaborating closely with cross-functional teams.

Must-Have Skills

• Java

• Selenium, Cucumber

• Cloud Technologies (GCP preferred)

• Google Apps

• UiPath RPA

Key Responsibilities

AI & Model Quality Assurance

• Define and execute end-to-end testing and validation frameworks for AI services, including ML models, agentic workflows, and automation solutions.

• Perform data quality audits to validate training and test datasets for bias, noise, and completeness.

• Conduct model performance testing using advanced metrics such as Precision-Recall, F1 Score, and Mean Absolute Error (MAE).

• Execute adversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.

• Monitor models in production for data drift and concept drift.

• Ensure ongoing bias and fairness monitoring to maintain ethical AI outputs.

AI Governance & Compliance

• Act as the primary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.

• Validate real-time observability and autonomous test generation mechanisms.

Automation & RPA Testing

• Design and execute comprehensive test plans and test cases for UiPath RPA solutions (new and existing implementations).

• Validate AI-to-RPA handoff points, where AI agents trigger bots for structured task execution.

• Document defects, track issues, and manage the defect lifecycle through resolution.

Required Qualifications & Experience

• 5+ years of experience in Software Quality Engineering.

• 2+ years of hands-on experience in AI/ML testing and UiPath automation testing.

• Strong understanding of OCR, NLP, and LLM architectures.

• Experience with Java and Python scripting.

ROBOTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ROBOTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ROBOTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract