Azure Data Engineer Job at Siri InfoSolutions Inc, Charlotte, NC

dVE4Rmk5RzBLVEZhdWViWEk5VzIvTzMw
  • Siri InfoSolutions Inc
  • Charlotte, NC

Job Description

Job Title : Azure Data Engineer

Location : Charlotte, NC (Onsite)

Position : Contract

Job Description

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and modern cloud-based data solutions using Microsoft Azure technologies. The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable data platforms and deliver high-quality data for analytics and reporting.

Must Have Technical/Functional Skills

  • 5+ years of experience in Data Engineering , with strong hands-on experience in Microsoft Azure.
  • Strong experience with Azure Data Factory (ADF) for designing and developing ETL/ELT pipelines.
  • Strong proficiency in SQL and experience working with relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Hands-on experience with Azure Databricks and PySpark for large-scale data processing and transformation.
  • Experience developing scalable ETL/ELT data pipelines and implementing data integration solutions.
  • Strong experience with Azure Data Lake Storage Gen2 (ADLS) .
  • Experience with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Strong Python programming skills for data processing and automation.
  • Experience with Delta Lake and lakehouse architecture.
  • Experience implementing incremental data loads, CDC, SCD Type 1/Type 2, and data partitioning.
  • Experience with Azure Key Vault , managed identities, service principals, and Azure security concepts.
  • Experience with Git/Azure DevOps for source control, CI/CD, and deployment automation.
  • Experience monitoring and troubleshooting Azure data pipelines and production data workloads.
  • Strong understanding of data modeling, data warehousing concepts, and dimensional modeling.

Responsibilities

  • Design and develop scalable data pipelines using Azure Data Factory .
  • Build data processing solutions using Azure Databricks, PySpark, and Python .
  • Develop and optimize SQL queries, stored procedures, and data transformation logic.
  • Ingest data from databases, APIs, files, and other enterprise sources into Azure Data Lake.
  • Design and maintain ADLS Gen2, Databricks, and Synapse data solutions.
  • Implement batch and incremental data processing frameworks.
  • Develop reusable ETL/ELT frameworks and data integration components.
  • Perform data validation, reconciliation, and quality checks.
  • Optimize data pipelines and Spark jobs for performance and cost.
  • Implement CI/CD pipelines using Azure DevOps and Git.
  • Secure data pipelines using Azure Key Vault, managed identities, RBAC, and other Azure security mechanisms.
  • Monitor production pipelines and troubleshoot failures and data issues.
  • Collaborate with data architects, business analysts, BI developers, and other engineering teams.
  • Document data pipelines, architecture, data mappings, and technical processes.

Job Tags

Contract work

Similar Jobs

Coeur d'Alene Resort

Executive Chef - University Inn Best Western - Moscow Idaho Job at Coeur d'Alene Resort

 ...Executive Chef Best Western University Inn & Conference Center | Moscow, Idaho A Proud Member of Hagadone Hospitality Compensation: DOE (Dependent on Experience) Relocation Assistance: Negotiable for the Right Candidate The Best Western University Inn &... 

Doral Medical and Multi Specialty Facility LLC

Spanish-speaking Patient Care Navigator (MA Preferred) Job at Doral Medical and Multi Specialty Facility LLC

 ...New Role: Patient Care Navigator (MA Preferred) Rate: $25$27 per hour Helping patients feel supported, informed, and connected every...  ...), Advanced Primary Care Management (APCM), Home Care, and Adult Day Care, helping them access the care that fits their needs best.... 

MAHLE GmbH

Production Operator - 3rd Shift Job at MAHLE GmbH

 ...efficiently operate all machinery Perform work in an environmentally conscious manner and reduce waste Ability to work all designated shifts Excellent attendance record Ability to work in a team environment Other duties as assigned Our Offering We will... 

Denali Water Solutions LLC

Class A Lead Support Driver - Req. ID: 4072 Job at Denali Water Solutions LLC

 ...Driver plays a critical role in ensuring the safe and efficient transportation of goods within and beyond the Dallas, TX area. This position...  ..., adhering to all safety regulations, and supporting the logistics team to meet delivery schedules. The Lead Support Driver will... 

N8n

Data Engineer Job at N8n

 ...strong SQL skills and hands-on experience building production-grade data pipelines. ~ dbt and BigQuery: You have production...  ...Python to build pipelines, automate processes, and develop data engineering tools. ~ Data modeling: You understand dimensional modeling,...