Lead QA Engineer
Qualys
- Location
- Onsite (Pune, Maharashtra)
- Employment
- Full-time
- Level
- Senior Level
Posted 3 weeks ago
About the role
Qualys is seeking a Lead QA Engineer to join its Big Data Platform team in Pune. The role focuses on building automated tests for API-based data access and Spark data processing jobs to ensure pipeline accuracy and reliability.
Skills
QA Automation
Python
Java
REST API
Postman
RestAssured
Big Data
Apache Spark
SQL
Data Validation
CI/CD
Jenkins
GitLab CI
Git
Data Pipelines
JIRA
Full job details
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
We are looking for an QA Automation Engineer to join our Big Data Platform team. You will build and maintain automated tests for API-based data access and Spark data processing jobs, working with data engineers to ensure our data pipelines are accurate, reliable, and performant.
Responsibilities
- Build and maintain automated test scripts for REST/API-based data access services
- Test Spark job outputs for correct transformations, aggregations, and schema
- Validate data pipelines end-to-end for completeness, accuracy, and consistency
- Write SQL queries to verify data in databases/data lakes against expected results
- Work with data engineers/PMs to define test scope from pipeline requirements
- Log and track defects (e.g., JIRA) and support root cause analysis
- Debug and analyze logs to identify failure root cause and enable resolution
- Integrate automated tests into CI/CD pipelines
- Maintain deployment pipelines and workloads for QA environments
Qualifications
- 7-9 years of QA/automation experience
- Working knowledge of Python or Java for test scripting
- Exposure to REST API testing (Postman, RestAssured, or requests)
- Basic understanding of big data concepts and Apache Spark (DataFrames, jobs, transformations)
- Good SQL skills for data validation
- Exposure to CI/CD tools (Jenkins/GitLab CI) and Git
- Strong analytical skills and good communication for cross-functional collaboration