Sr Azure Data Engineer Job at Zapcom, Dallas, TX

clRRVUtCdnRpRzRxSnU0Z2UwK2M2TEdSVGc9PQ==
  • Zapcom
  • Dallas, TX

Job Description

  • Design and implement data ingestion, transformation, and movement using Azure Data Factory (ADF), Azure Synapse, and Data Lake.
  • Collaborate with business stakeholders, data scientists, and engineers to build robust data solutions.
  • Develop and manage high-volume, real-time, and batch data ingestion pipelines using Azure Data Factory (ADF).
  • Implement event-driven architectures for real-time data movement and processing.
  • Develop large-scale data processing solutions using Azure Databricks and Apache Spark with PySpark, Scala, or Python.
  • Optimize data partitioning, caching, and indexing for efficient performance.
  • Manage complex transformations and aggregations for structured and unstructured datasets.
  • Design and implement high-performance data models in Azure Synapse Analytics using dedicated SQL Pools and Spark Pools.
  • Optimize query performance, workload management, and cost efficiency in Synapse Analytics.
  • Implement column store indexes, partitioning strategies, and data caching to enhance performance.
  • Design and manage secure, scalable data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2).
  • Implement RBAC (Role-Based Access Control), encryption, and data masking to ensure security.
  • Implement Azure Monitor, Log Analytics, and Application Insights for data pipeline monitoring and troubleshooting.
  • Optimize cost management, auto-scaling, and performance tuning across Azure services.

Requirements

  • 8+ years of experience in data engineering, ETL development, and cloud-based data integration,
  • Strong experience with Azure Data Factory (ADF): ETL/ELT pipeline orchestration and data movement.
  • Azure Databricks: Large-scale data transformation and big data processing with Apache Spark, PySpark, Scala, or Python.
  • Azure Synapse Analytics: Data warehousing, SQL Pools, Spark Pools, and performance tuning.
  • Azure Data Lake Storage Gen2 (ADLS Gen2): Secure, scalable data lake architecture.
  • SQL Server: Advanced T-SQL, stored procedures, indexing, and query optimization.
  • Power BI, Tableau, or other BI tools for data visualization.
  • Financial/Banking experience.

Job Tags

Full time,

Similar Jobs

Huckberry

Apparel Designer - Outdoor & Active Job at Huckberry

 ...obsessed, highly creative, and entrepreneurial outdoor & active designer to help us grow the outdoor and active brands here at Huckberry...  ...who is passionate about all aspects of the outdoor and active industry and has a keen eye for design and fabrics. You will be responsible... 

Autism Speaks

Summer Events Intern (Remote NJ or PA) Job at Autism Speaks

 ...an Events Intern for the Summer semester! This is a 10-12 week remote program and students must be eligible for academic credit....  ...Partnership events, Luncheons and Golf Outings. At the end of this internship, the Events Intern should have working knowledge of key event skills... 

Crab Boss Maryland

Delivery Driver/Logistics Specialist Job at Crab Boss Maryland

 ...Crab Boss Maryland in Brandywine, MD is looking for one delivery driver/logistics specialist to join our team. We are located on 14125...  ..., punctual, and engaged. Responsibilities: Driving Long Distances: Expect to drive a significant number of miles , to different... 

Bartley Healthcare Nursing and Rehabilitation

Activity Assistant Job at Bartley Healthcare Nursing and Rehabilitation

 ...Purpose of Your Job Position The primary purpose of your job position is to assist the Activity Director in planning, organizing, developing and directing the overall operation of the Activity Department in accordance with current federal, state and local standards, guidelines... 

China Global Connections

Chemistry Teacher Job at China Global Connections

 ...program. Job detailsDeliver chemistry courses to high school students utilizing the IB DP framePrepare lessons, lectures, tutoring techniques...  ...allowance range from 4,000 to 9,000 RMBPublic holidaysFully paid Summer and Winter holidaysRelocation allowanceMedical health...