Hi there! AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. Why join us If you’re looking for a place to grow, make an impact, and work with people who care, we’d love to meet you! :)
About the role We are looking for a Manual QA Engineer to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You’ll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.
What you will do ● Perform manual testing of web applications to identify bugs, glitches, and inconsistencies; ● Develop, maintain, and execute detailed manual test cases based on product requirements and specifications; ● Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.; ● Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements; ● Design and execute test scenarios to verify AI behavior, including prompt—response consistency, contextual relevance, and deterministic vs. non-deterministic outputs; ● Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate); ● Conduct manual API testing to validate request/response accuracy, error handling, and integration; ● Use TestRail to create, manage, and track test plans, test cases, and test execution results; ● Use Jenkins CI/CD pipelines; ● Report and document defects clearly using the bug tracking system (JIRA); ● Participate in daily stand-ups, sprint planning, and other Agile team meetings; ● Review user stories and acceptance criteria to understand the scope of testing; ● Estimate own tasks, report on risks to the team lead; ● Collaborate with developers and other QA team members to reproduce issues and verify fixes; ● Maintain and update test documentation as needed.
Must haves ● 2+ years of experience with manual testing; ● Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models; ● Knowledge of Testing and Quality Assurance Processes; ● Strong experience with Test Design activities to cover a set of product requirements; ● Knowledge of Test Design techniques; ● Knowledge of testing methodologies; ● Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes; ● Experience with Postman (API testing) and Browser developer tools; ● Experience with UI testing; ● Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles; ● Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain); ● Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization); ● Experience with TestRail as a Test Management system (as a user, test execution is required); ● Basic understanding of CI/CD process; ● Upper-intermediate English level.
Nice to haves ● Experience with SSO testing; ● Experience in Performance or Load.
Perks and benefits ● Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps ● Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities ● A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands ● Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office — whatever makes you the happiest and most productive.
Meet Our Recruitment Process Asynchronous stage — An automated, self-paced track that helps us move faster and give you quicker feedback: ● Short online form to confirm basic requirements ● 30–60 minute skills assessment ● 5-minute introduction video
Synchronous stage — Live interviews ● Technical interview with our engineering team (scheduled at your convenience) ● Final interview with your future teammates
