Job DescriptionnbspWe are seeking a highly skilled Senior Data Engineer to join our data and analytics team The ideal candidate will have extensive experience in working with diverse data sources performing data profiling and identifying matching records across systems to create master data records This role requires strong analytical and technical skills along with expertise in data quality integration transformation and cloudbased data platformsnbspRoles amp Responsibilities Data Source Analysisnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Analyze multiple structured and unstructured data sources to understand schemas data quality and relationshipsnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Assess and document the metadata formats and business rules of incoming data setsData Profiling amp Matchingnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Perform comprehensive data profiling to assess completeness accuracy uniqueness and consistency of datanbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Develop logic to match and reconcile records across different systems using keys rules or fuzzy matching techniquesMaster Data Management MDMnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Design and implement processes for building and maintaining golden master recordsnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Support creation and maintenance of master data across domains such as customer product asset etcnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Handle data deduplication and standardizationETL amp Data Pipelinesnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Build scalable data pipelines using Azure Data Factory for ingesting transforming and cleansing data from multiple sourcesnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Ensure efficient data movement across staging processing and analytical layersnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Leverage Azure Synapse Analytics optional for advanced data processing and analyticsCollaboration amp Governancenbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Work closely with business analysts data stewards and application owners to understand data definitions and ownershipnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Enforce data governance standards and best practicesPerformance amp Optimizationnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Monitor data workflows and optimize performance for largescale processingnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Troubleshoot data issues and implement robust logging and monitoringnbspRequirementsRequirements nbspQualification and Education Requirements nbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Bachelors or Masters degree in Computer Science Data Engineering or a related fieldnbspMinimum ExperienceSkills Requirednbsp nbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp 5 years of experience in data engineering ETL development or data integrationnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Proven experience in data profiling matching and MDM Master Data Managementnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Expertise in SQL for querying transforming and optimizing complex datasetsnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Strong proficiency in Python or PySpark for data processing and pipeline developmentnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Experience with Azure Data Factory for building and managing data pipelinesnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Familiarity with Azure Synapse Analytics is a plusnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Strong expertise in ETLELT tools eg Talend Informatica SSIS Apache NiFinbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Familiarity with data quality frameworks and metadata managementnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Strong communication skills in both Arabic and EnglishnbspPreferred Skillsnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Experience with data cataloging tools eg Azure Purview Alationnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Knowledge of data modeling and normalization techniquesnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Understanding of data privacy and compliance standards GDPR HIPAA etcnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbspnbsp Familiarity with REST APIs and integrating with thirdparty data services nbsp
Visit
Careersaas to find millions of new and unfilled roles, including thousands of remote and hybrid positions.
