AI/ML Testing Specialist

Overview

We are hiring experienced AI/ML Testing professionals to support the GEM (Government e-Marketplace) project in New Delhi. This role focuses on validating AI/ML models used in large-scale, data-driven marketplace systems, ensuring fairness, accuracy, transparency, and robustness across critical use cases such as bid scoring, supplier ranking, recommendations, and fraud detection. The ideal candidate will have strong hands-on experience in AI/ML model testing, data validation, and testing of advanced analytics pipelines within regulated or rule-driven environments.

Job Description

Key Responsibilities

  • Test and validate AI/ML models used in data-driven applications, including NLP, recommendation systems, fraud detection, and advanced analytics

  • Ensure AI models meet standards for accuracy, bias mitigation, explainability, performance, and fairness

  • Validate training and inference pipelines to ensure alignment with business rules and procurement policies

  • Design and execute AI/ML testing strategies, including boundary testing, adversarial input simulation, and drift monitoring

  • Identify and mitigate risks related to marketplace misuse, such as algorithm manipulation or biased scoring

  • Perform data validation and model behavior analysis to ensure reliability and transparency of automated decision systems

  • Integrate AI/ML testing frameworks into CI/CD pipelines for continuous validation and monitoring

  • Collaborate with data science, engineering, and business teams to align testing outcomes with functional and regulatory requirements


Requirements

  • Minimum 5+ years of experience in testing AI/ML models and data-driven applications

  • Hands-on experience testing models related to NLP, recommendation engines, fraud detection, and analytics

  • Strong understanding of AI model validation concepts including bias, fairness, explainability, and performance testing

  • Experience in validating data pipelines, training workflows, and inference outputs

  • Ability to design test strategies for complex AI systems, including misuse and adversarial scenarios

  • Working knowledge of integrating testing frameworks into automated CI/CD environments

  • Strong business awareness of AI risks in marketplace ecosystems

  • Bachelor’s or Master’s degree in Engineering, Computer Science, IT, Data Science, or equivalent

  • Immediate joiners preferred

  • Location: New Delhi

Skills & Requirements

AI/ML Testing, Data Validation, Model Accuracy Testing, Bias & Fairness Testing, Explainable AI (XAI), NLP Model Testing, Recommendation Systems Testing, Fraud Detection Models, Advanced Analytics, TensorFlow Model Analysis, MLflow, PyTest, Python, Jupyter Notebooks, Data Science, Adversarial Testing, Drift Monitoring, CI/CD Integration, Marketplace Risk Analysis, AI Governance, Procurement Rule Validation

Apply Now

Join Our Community

Let us know the skills you need and we'll find the best talent for you