Data QA Engineer

As a Data QA Engineer, you will play a critical role in ensuring that data processed into our data lakehouse is of high quality and reliability, and that we avoid functional and regression defects. You will collaborate closely with cross-functional teams, including product managers, data engineers, BI developers and data scientists, to identify, report, and help resolve issues in our data-driven applications.

Required Skills
Skill Years of Experience Expertise Level Skill Requirement Level
AZURE SQL SERVER 3-4 4 Required
PYTHON 3-4 4 Required
POWER BI 3-4 4 Required
ETL 3-4 4 Required
QUALITY ASSURANCE 3-4 4 Required
AZURE DEVOPS 3-4 4 Required
AZURE DATA LAKE 3-4 4 Required
DATA WAREHOUSE 3-4 4 Required
Job Description

I have recently started at ABS working for Jim Smith. I am looking for two resources:
QA/QE resource with focus on testing databases, ETL, has good understanding of what QA is. Needs to be able to work independently with some guidance from me.
Job Title: Data QA Engineer (ETL/ELT, Data Lakehouse/Warehouse, Business Intelligence)
Location: Remote, with preference for on-site.
• Remote would be 8 hours per day, with 9am to 3pm being the minimum required “core hours” less lunchtime
• On-site would be a Hybrid schedule at the ABS Spring, TX location. Required in the office Tuesday, Wednesday and Thursday and working on Monday and Friday from either (contractor’s choice) home or the ABS office
Job Description:
The Data and Analytics team at ABS is seeking a skilled and detail-oriented Quality Engineer with expertise in ETL/ELT data pipelines to join our dynamic team. As a Data QA Engineer, you will play a critical role in ensuring that data processed into our data lakehouse is of high quality and reliability, and that we avoid functional and regression defects. You will collaborate closely with cross-functional teams, including product managers, data engineers, BI developers and data scientists, to identify, report, and help resolve issues in our data-driven applications.

Responsibilities:
- Utilize Azure DevOps for test case management and issue/defect tracking.
- Write clear and concise defect details describing actual versus expected behaviors.
- Identify and implement automated test cases required for Azure DevOps user stories and/or defects based on ticket descriptions, ensuring accuracy of D&A’s ETL/ELT pipelines.
- Conduct thorough manual and automated testing of data pipelines and transformations to identify defects and inconsistencies.
- Collaborate with the development and product management teams to understand complex data requirements, transformations, and analytical processes, providing early feedback on potential issues.
- Continuously improve testing processes, methodologies, and tools related to data quality, analytics testing, and Azure DevOps integration.
- Perform regression testing of data-related components to validate bug fixes and new features across different releases.

Qualifications:
- Strong understanding of software testing methodologies, tools, and processes, with a specific focus on data validation, analytics testing, and Azure DevOps integration.
- 5 years of experience as a QA Engineer in writing clear and concise test cases and test documentation for software applications
- 3 years of experience as a QA Engineer with a specialization in data testing, including knowledge of data quality frameworks and ETL/ELT processes.
- 3 years of experience writing and executing basic-to-intermediate SQL queries.
- 3 years of experience working in an Agile development environment, adapt to changing requirements and priorities.
- 2 years of experience with Git source control (GitHub, GitLab, Azure DevOps, etc.)
- 3 years of hands-on experience with Azure DevOps for automated test case management and issue tracking.
- 3 years of experience working on a Team following a Continuous Integration (CI)
- Strong analytical and problem-solving skills, with a keen eye for data accuracy, anomalies, and DevOps efficiency.
- Excellent communication skills to effectively collaborate with cross-functional data and development teams.
- Nice-to-have requirement: any experience with DBT

CI/DC pipelines big +