Title: Azure Databricks Lead
Location: Cincinnati, Ohio
Duration: 6 Months+
Key Responsibilities:
Data Pipeline Design and Development
Designing developing and maintaining scalable data pipelines and ETL processes using Azure Databricks Data Factory and other Azure services
Spark Job Implementation and Optimization
Implementing and optimizing Spark jobs data transformations and workflows within Databricks
Data Model Development
Developing and maintaining data models and data dictionaries
Data Quality and Governance
Developing and maintaining data quality checks governance policies and security procedures
ETL Process Design and Maintenance
Designing and creating ETL processes to supply data to various destinations including data warehouses
Data Integration
Integrating data from various sources into Azure Databricks
Collaboration
Working with other teams including data engineers data scientists and analysts to ensure data quality and consistency
Monitoring and Optimization
Implementing effective monitoring processes to track performance and optimize workflows
Data Lakehouse Solutions
Contributing to the design and implementation of data lakehouse solutions using Databricks
Skills and Qualifications
Azure Databricks Proficiency Experience with Azure Databricks PySpark and Spark
Programming Languages Proficiency in languages like Python SQL and Scala
ETL and Data Warehousing Strong understanding of ETL processes data warehousing concepts and data modeling
Cloud Platforms Experience with cloud platforms particularly Microsoft Azure
Data Engineering Experience in data engineering data pipelines and data integration
Data Governance and Security Knowledge of data governance policies and procedures
Excellent problem solving and debugging skills
Strong communication and teamwork skills
Exp Level: 10-14 years
Skills
Mandatory Skills : ANSI-SQL, Azure BLOB, Azure Data Factory, AZURE DATA LAKE, Azure Functions, Azure SQL, Azure Synapse Analytics, Databricks, Java, Python, Scala, Snowflake
**Job Description:**The **e-Commerce Specialist** plans and executes marketing initiatives including search, email marketing, social and online advertising campaigns... ...team on website development to insure SEO optimization. This person makes recommendations regarding emerging...
SharePoint Online Web Developer Location: Washington, D.C. (On-site) About the Role: Join our team supporting the U.S. Citizenship... ..., security, and continuous improvement of their critical internal communication and collaboration tools. Your expertise will be...
...warehouse duties and fill in as a delivery driver when needed. What youll do: Receive... ...gate, electric pallet jack, along with a CDL B License and Hazmat Endorsement! We... ...oriented, FUN place to work; truck routes are ALWAYS local, meaning youre home daily!...
...Library Assistant (6761C), Library Administration - 78968 About Berkeley At the University of California, Berkeley, we are dedicated... ...ability to use a Windows PC and Windows-based tablet. Basic experience with email, word processing, and spreadsheet software. Ability...
...Career in Insurance Claims with Allied Universal Compliance and Investigation Services. Allied Universal Compliance and Investigation... ...and coordinate efforts+ Maintain confidentiality and adhere to legal and ethical standards in conducting surveillance operations**...