Job Description
Position: - Azure Lead Data Engineer
Location: - Warren, NJ
Job Description
Requirement:
~10+ Year experience as Data Engineer with experience in building ETL/Data pipelines with cloud technologies
~4+ years extensive experience in designing, developing, and implementing scalable data pipelines using Databricks to ingest, transform, and store structured and unstructured data.
~5+ years' experience programming languages such as Python/PySpark and query languages like SQL
~5+ years' experience in building metadata driven data ingestion pipelines using ADF
~5+ years' experience in analyzing, optimizing, and tuning existing data pipelines for performance, reliability, and efficiency
~2+ years' experience in implementing MLOps practices to streamline the deployment and management of machine learning models.
~2+ years' experience in utilizing Apache Airflow for job orchestration and workflow management
~ Familiarity with CI/CD tools and practices for automating the deployment of data engineering solutions.
~ Experience in collaborating with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions
~ Knowledge/Experience in implementing security measures and standard processes to ensure data privacy and compliance with regulatory standards
~ In-depth knowledge of data engineering concepts, ETL processes, and data architecture principles.
Job Tags
Similar Jobs
Area Temps, Inc.
05 - 176287 mp A large distribution company has openings for Class A CDL Drivers to join their team. Will be driving a straight truck following all company, DOT regulations, and making deliveries in a timely manner, load and unload trucks, safely use forklifts, side...
Ace Partners USA Manufacturing
...Senior Tool & Model Maker Lincolnwood, IL 30-50p/h depending on experience and education (Advanced) Basic - Experience Level 1-3 years Intermediate Experience 5-10 years Advance Experience 10-15 years **Shifts:**1st shift or 2nd shift ~1st shift:...
The UPS Store #5901
Detailed resume required for considerationMust be able to provide business referencesThis is a career, not a jobMinimum Bachelor's requiredLooking for someone who is fast, smart, sharper, and a quick learner. Looking for someone with who is experienced with sales...
SourcePro Search, LLC
We are currently seeking a QA Analyst with thorough understanding of end-to-end system testing in a fast paced, highly technical and complex business environment. The ideal candidate should be well versed in performing both manual and automated testing for various types...
Heap
...organizations quickly get a deep understanding of their customers whole online journey. We are a global leader in the experience analytics... ...blog. Contentsquare is looking for a high-energy, driven Sales Development Manager with sound business acumen, strong technical...