Location: Richfield, MN (Candidate has to work from the client office 5 days/week).
Job Description:
Responsibilities
Ideate overall Azure Native Data Analytics Architecture that include Azure Synapse workspace(Synapse pipelines, Synapse Serverless Spark, Synapse Serverless SQL and in-depth of Synapse Dedicated pool)
Experience creating Data Platforms in Azure Analytics platform
Design and develop data engineering pipelines for big data applications and managing pipelines life cycles.
To have strong hands on experience in Synapse workspace and Synapse dedicated pool workload & resource Optimization.
To have strong hands on experience in Synapse workspace dev-ops
Hands of experience in Performance optimization.
To have strong hands-on experience to designing & write Polybase scripts, SQL queries and stored procedures in Synapse.
Job Requirement
Very strong hands on experience in Synapse workspace data loading and dedicated pool & Serverless pool SQL optimization.
Perform design, implement & release of synapse pipelines and Spark pipelines.
Very good hands on experience in design and development for processing versatile Sources(structure, non-structural & semi-structural data) & Sinks
Atleast 12-14 years of experience in Data engineering architecture/design/implementation and atleast 3 years of experience in Azure Cloud technologies like ADF, Synapse and other Azure native data solutions.
MUST have minimum 2 - 3 years of programming experience in Big Data technologies and Azure Analytics Platform
Experience in Azure technologies includes Azure Data Services - ADLS - Data Lake Storage, ADF - Azure Data Factory, Azure Cloud Services, Synapse workspace, SQL.
Strong written and verbal communication skills
Working knowledge with AGILE development, SCRUM and Application Lifecycle Management
Additionally experience in AKS (Azure kubernetes Services or Kubernetes) & Power BI Services will be considered additional weight in consideration decision.