We are seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.
Location: Indore, Gurugram, Raipur
Key Responsibilities
- Test Framework Development: Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python.
- ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
- UI & BDD Automation: Automate functional, regression, and end-to-end user workflows using Selenium WebDriver integrated with BDD Cucumber.
- Service & Pipeline Testing: Build and execute test suites using Pytest for data scripts, API services, and scheduled pipeline jobs.
- Database & Query Verification: Author advanced SQL queries to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
- Functional & Integration Testing: Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
- CI/CD Integration: Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
- Defect Management: Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.
Required Qualifications
- Experience: 5 years of hands-on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
- Programming Languages: Strong proficiency in both Java and Python.
- Automation Tools & Frameworks:
- Hands-on expertise with Selenium WebDriver.
- Strong working knowledge of BDD frameworks (Cucumber / Gherkin syntax).
- Deep experience with Pytest for Python-based test development.
- Database & ETL Skills:
- Advanced SQL skills (joins, window functions, aggregations, subqueries) for large-scale data validation.
- Proven experience in ETL/ELT Testing, validating source-to-target data mappings, reconciliation, and schema integrity.
- Testing Methodologies: Solid foundation in Functional Testing, Regression Testing, End-to-End Testing, and Data Quality Assurance best practices.
- Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).
Why Join Us?
- Work on cutting-edge cloud data projects.
- Leadership opportunity with high ownership.
- Dynamic and growth-oriented work environment.