Data Engineering Specialist

Specialist - Data Engineering

Key Responsibilities

MDM Developer role

Algorithm Development Optimization

Develop implement and maintain the core linking algorithms utilizing Logit and Probit functions to model the probability of a record match

Select and engineer relevant covariates features for matching and apply appropriate nonparametric transforms to input data

Fit and refine statistical models using Maximum Likelihood Estimation MLE and calculate match probabilities by inverting the link functions

Integrate Bayes Rule principles to compute and update match probabilities dynamically over time

Process Management Certification

Lead the Keying process by designing and assigning robust unique identifiers keys to records for effective deduplication

Oversee the Linking process to accurately connect related records across multiple systems and datasets

Implement and execute the Certification process to validate the accuracy and performance of the keying and linking framework

Manage critical documented processes including the Data Mismatch Process Match Logic Improvement and Data Fragmentation Report

Required Qualifications

Education

Bachelors or Masters degree in Computer Science Statistics Data Science or a related quantitative field

Experience

5 years of experience in data engineering data quality or data science focusing on record linkage data matching or probabilistic record matching and entity resolution program

Technical Skills

Strong proficiency in statistical modeling and machine learning particularly MLE Logit and Probit regression

Expertise in SQL and programming languages eg Python R used for data transformation and statistical analysis

Experience with nonparametric methods and feature engineering for matching contexts

Familiarity with data governance principles and techniques for managing data quality eg deduplication standardization