We’re opening the position of a Senior Automation QA Engineer (Python) to the new team on the project of our Customers. They provide SaaS solutions that help companies to optimize their businesses. These solutions include business planning & execution, processes automation, and optimization. The Customers’ platform leverages industry-leading Artificial Intelligence (AI agents). In this position, you will be responsible for testing the AI agents through UI and API layers. Responsibilities: * Design, develop, and maintain automated test scripts and frameworks using Python, Playwright, and pytest * Create test strategies to validate AI agent workflows, APIs, and agent integrations * Implement end-to-end, integration, and regression testing for AI-powered solutions * Build and execute test plans to validate: * — Conversational logic, user flows, and AI agent response accuracy * — Web UI functionality, API interactions, data pipelines, and back-end services * — Performance, reliability, accessibility, and scalability of AI-driven applications * Develop and maintain Playwright-based UI automation for cross-browser testing and modern web applications * Integrate automated testing into CI/CD pipelines using GitHub Actions * Perform manual exploratory testing for complex or evolving features where automation is not yet practical
Requirements: * 4+ years of experience in QA automation, with strong hands-on skills in Python, Playwright, and pytest * Experience testing APIs (REST, GraphQL) with tools like Postman/Newman * Knowledge of CI/CD pipelines and automation integration * Familiarity with performance/load testing tools (BlazeMeter, JMeter) * Strong debugging, troubleshooting, and problem-solving skills * Excellent written and spoken communication skills * English level — Upper-Intermediate or higher
Will be a plus: * Knowledge of GitHub Actions * Familiarity with AI/ML testing approaches (e.g., NLP testing, model response validation, fuzz testing) * Hands-on experience in testing AI conversational agents (e.g., OpenAI, Azure OpenAI, Copilot, Dialogflow, Rasa, LangChain)
We offer: * Remote-first work model with flexible working hours (we provide all equipment) * Comfortable and fully equipped offices in Lviv and Rzeszów * Competitive compensation with regular performance reviews * Referral Bonus Program * 18 paid vacation days per year * 12 days of paid sick leave per year * Extra paid leave (blood donation, marriage, childbirth, etc.) * Health & wellness support: either a monthly budget for medical insurance and sports activities, or a full medical insurance plan, depending on your cooperation model * Mental Health Program — company-covered psychologist consultations, with an annual coverage limit * English, German, and Polish language courses and Speaking Clubs * Corporate merch gifts for your special dates * Corporate subscription to learning platforms, regular meetups and webinars * Friendly team that values accountability, innovation, teamwork, and customer satisfaction * Maternity leave * Inclusive environment where everyone feels valued and treated equally. We proudly partner with VeteranHub to support Ukrainian veterans * We are committed to supporting Ukraine and actively participate in charity initiatives
