We are currently looking for a highly motivated expert in Data Quality Engineering to join our client. In this role, you will cultivate a strong testing culture within our customer’s platform operating model from the very beginning. You will be responsible for designing a cutting-edge Databricks data lakehouse on Azure, utilizing DevOps and CI/CD pipelines. The platform you create will enable metadata-driven data pipelines for efficient data collection, transformation, and presentation through PowerBI.

• Evaluate COTS/ Open-source product and recommend right fit solutions for given customer challenge

• Develop and execute manual and automated test cases for software applications to ensure the reliability of data pipelines, ETL processes, and data transformations

• End to end integration testing between multiple independent systems and interfaces(flat files, APIs (ETL), etc.

• Collaborate with cross-functional teams to ensure quality and timely delivery of products

• Utilize Cloud services, Snowflake data warehouse, and ODS to test data integration and migration processes

• Conduct functional, integration, regression, and performance testing of database systems using industry standard technologies (SQL, Python, iCEDQ, etc.)

• Create and maintain documentation of test plans, test cases and testing results

• Communicates technical architecture to other technical teams and leadership teams

• Work with Data Stewards & Business Analysts to understand and define data quality thresholds

• You preferably hold a degree in computer science.

• You have over 5 years of overall experience, with a minimum of 3 years in relevant roles (designing or optimizing data architectures and pipelines)

• You possess a good understanding of Data Quality, Data Modernization, and Data Migration

• You have experience in monitoring data quality by designing and deploying data tests at scale

• You are experienced in automation using data observability platforms

• You have experience in architecting Data Assurance (from strategy to execution) for complex Data Warehousing/Data Lake projects

• You have a good knowledge of SQL, Python, and/or Scala programming languages and testing

• You are well-versed in SQL Server or Oracle Databases and Power BI

• You have experience with Azure Cloud-hosted data solutions such as ADLS, ADFS, Databricks, or others

• You have exposure to at least one of the BI tools such as Power.BI, Tableau, Qlik, or Data.world

• You are experienced in automated data validation using products like RightData, DataGaps, ICEDQ, or equivalent

• You have experience working with version control tools like Git, Bitbucket, or ADO