We are seeking a highly skilled and experienced QA Automation Data Engineer to be an integral part of our dynamic Data Engineer Team. As a QA Automation Data Engineer, you will play a crucial role in ensuring the accuracy, reliability, and efficiency of our data processing, ingestion, and architecture methodologies. Your primary focus will be to develop and execute robust testing strategies to validate data pipelines, ETL workflows, and data transformations in our data platform. Working closely with the Data Engineer Team, you will deliver high-quality and reliable data solutions to support our business needs. Additionally, as the quality owner, you will take charge of production issues, conduct postmortems, and drive continuous improvement initiatives to enhance data quality and system performance. Responsibilities:
- Data Testing and Validation: Develop comprehensive test plans and execute them to ensure data integrity, accuracy, and consistency throughout the data processing lifecycle. Collaborate with the Data Engineer Team to identify data quality issues and drive their resolution.
- SQL Proficiency: Utilize your strong SQL skills and in-depth understanding of business logic to create complex queries for data validation, verification, and error detection.
- Python Automation: Leverage your expertise in Python automation to build and maintain testing frameworks, automation scripts, and data validation tools. Automate repetitive tasks to streamline the testing process and improve team productivity.
- End-to-End Testing: Perform end-to-end testing of data pipelines, data transformations, and ETL workflows to validate data flow and identify potential bottlenecks or issues.
- Documentation: Create and maintain detailed documentation for test cases, test scenarios, and test results. Document data anomalies, data discrepancies, and potential improvements in data processing.
- Collaborate with Data Engineers: Work seamlessly with the Data Engineer Team to understand data processing workflows and architecture. Participate in code reviews and provide feedback to improve code quality and maintainability.
- Continuous Improvement: Proactively identify opportunities for process improvement, testing automation, and data quality enhancements. Implement best practices and industry standards to ensure data quality and reliability.
Requirements:
- Minimum 3 years of experience in Quality Assurance (QA).
- Strong SQL skills and a deep understanding of data structures, data models, and business logic, with a minimum of 3 years of hands-on experience writing SQL queries.
- Proficient in Python programming, with at least 2 years of experience in developing automation scripts for data testing and validation.
- Knowledge of data processing methodologies, data ingestion, and data architecture.
- Analytical mindset and a keen eye for detail to identify data quality issues and troubleshoot data-related problems effectively.
- Excellent communication skills, both written and verbal, with the ability to collaborate with cross-functional teams.
- Proven ability to work in a fast-paced, agile environment and manage multiple priorities effectively.
Advantages:
- Bachelor's degree in Computer Science / Industrial Engineering / Information Systems or a related field is preferred.
- Familiarity with the technology stack used by the Data Engineer Team, including dbt, Snowflake (data warehouse), Apache Airflow (as an orchestrator), nifi, and Kafka.
#LI-MT2
#LI-hybridֿ
Companies like Twitch, Twitter, GoDaddy, and Roblox entrust Tipalti to scale their business rapidly and dramatically reduce finance friction. Headquartered in San Mateo, California, we're a well-funded startup with a multi-billion dollar valuation.
But beyond the technology and impressive growth, Tipalti is fueled by a commitment to our customers. We work hard for our 98% customer retention rate built on trust and reliability. Tipalti means "We handled it," a mission our customers know we deliver consistently.
Around personal growth and wellness, Tipalti offers competitive benefits, a flexible workplace, career coaching, and an environment where you can thrive and be an impact player! Our culture ensures everyone checks their egos at the door and stands ready to reach success together. We also dedicate ourselves to diversity and equal opportunity for all.