Title: Azure Databricks Lead
Location: Cincinnati, Ohio
Duration: 6 Months+
Key Responsibilities:
Data Pipeline Design and Development
Designing developing and maintaining scalable data pipelines and ETL processes using Azure Databricks Data Factory and other Azure services
Spark Job Implementation and Optimization
Implementing and optimizing Spark jobs data transformations and workflows within Databricks
Data Model Development
Developing and maintaining data models and data dictionaries
Data Quality and Governance
Developing and maintaining data quality checks governance policies and security procedures
ETL Process Design and Maintenance
Designing and creating ETL processes to supply data to various destinations including data warehouses
Data Integration
Integrating data from various sources into Azure Databricks
Collaboration
Working with other teams including data engineers data scientists and analysts to ensure data quality and consistency
Monitoring and Optimization
Implementing effective monitoring processes to track performance and optimize workflows
Data Lakehouse Solutions
Contributing to the design and implementation of data lakehouse solutions using Databricks
Skills and Qualifications
Azure Databricks Proficiency Experience with Azure Databricks PySpark and Spark
Programming Languages Proficiency in languages like Python SQL and Scala
ETL and Data Warehousing Strong understanding of ETL processes data warehousing concepts and data modeling
Cloud Platforms Experience with cloud platforms particularly Microsoft Azure
Data Engineering Experience in data engineering data pipelines and data integration
Data Governance and Security Knowledge of data governance policies and procedures
Excellent problem solving and debugging skills
Strong communication and teamwork skills
Exp Level: 10-14 years
Skills
Mandatory Skills : ANSI-SQL, Azure BLOB, Azure Data Factory, AZURE DATA LAKE, Azure Functions, Azure SQL, Azure Synapse Analytics, Databricks, Java, Python, Scala, Snowflake
Are you a seasoned BCBA with a passion for leadership and making a real difference in the lives of children? Do you thrive... ...'ll Bring: Experience Matters: Minimum of 5 years as a Board Certified Behavior Analyst (BCBA). Certification: Board Certified Behavior Analyst...
JOB SUMMARY: Responsible to manage all aspects of Wood Fabrication which includes the following operations: CNC Router, Wood Mill, Subassembly, Final Assembly, Stain and Finishing. Must have working knowledge in furniture manufacturing or cabinet manufacturing. Has the...
...Savings Account\r\nOptional life and dependent life insurance\r\nOptional voluntary benefits including accident, critical illness and hospital indemnity Insurance, and legal plan\r\nTuition reimbursement\r\n\r\nBase pay in range will be determined by applicants skills and...
...of a new challenge. This is what makes us great. Our client is primarily a site/civil engineering firm which focuses on land development, municipal services, traffic and transportation engineering, GIS, survey, and landscape design. With our experienced and dedicated...
Are you passionate about helping students achieve their academic goals? We're looking for dedicated, experienced tutors and teachers with virtual tutoring experience to provide personalized 1:1 or group lessons to students across the country. This is a great opportunity...