QA Engineer (EST hours) ID35731

Overview Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine Get AI-powered advice on this job and more exclusive features. AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17 industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. What you will do Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid; Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior; Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience; Test and validate integration points between AI components and core business logic; Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data; Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates); Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers. MUST HAVES Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience; 3 years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies; Solid understanding of SDLC, Agile methodologies, and software quality principles; Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.; Comfortable working with REST APIs, data pipelines, and backend services; Familiarity with cloud platforms (AWS or Azure) and CI/CD tools; Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership; Quick, proactive learner—especially important in the fast-evolving world of AI; Upper-Intermediate English level. NICE TO HAVES Experience testing AI/ML systems in production environments; Familiarity with GenAI model evaluation metrics; Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues. PERKS AND BENEFITS Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. Flextime: Tailor your schedule for an optimal work-life balance, with options of working from home and going to the office. Job details Seniority level: Mid-Senior level Employment type: Full-time Industries: IT Services and IT Consulting J-18808-Ljbffr

Location: Sorocaba, São Paulo, BR

Posted Date: 9/11/2025