Senior Azure Databricks Administrator
CTG
CTG is seeking to fill a Senior Azure Databricks Administrator position for our client in Cincinnati, OH. Location: Cincinnati, OH Duration: 12 months Duties: Azure Databricks Administration & Management: Deploy, configure, and manage Azure Databricks workspaces in a scalable, cost-efficient, and secure manner. Administer clusters, jobs, notebooks, and workflows, ensuring high availability and performance. Monitor and optimize compute resource utilization and autoscaling strategies to improve cost efficiency. Manage Databricks Runtime versions, libraries, and dependencies across environments. Security & Compliance: Implement and manage Unity Catalog for fine-grained access control and data governance. Enforce Role-Based Access Control (RBAC) and integrate Databricks with Azure Active Directory (AAD). Ensure compliance with SOC 2, HIPAA, GDPR, and internal security standards. Set up audit logging, monitoring, and alerting for security and operational insights. Performance Optimization & Troubleshooting: Tune Apache Spark workloads to improve query performance and resource efficiency. Analyze and troubleshoot performance bottlenecks in ETL and ML workloads. Optimize Delta Lake storage, caching, and indexing strategies for better query execution. Automation & Infrastructure as Code (IaC): Automate Databricks workspace deployment using Terraform, ARM Templates, or Databricks REST API. Develop and maintain CI/CD pipelines for Databricks job deployment and configuration management. Implement monitoring solutions using Azure Monitor, Prometheus, or Grafana. Collaboration & Integration: Work closely with data engineers, data scientists, and DevOps teams to support data pipelines and analytics workloads. Integrate Databricks with Azure Data Lake, Azure Synapse Analytics, and Snowflake. Provide technical guidance and best practices for efficient Spark job execution and cost optimization. Skills: Expertise in Azure Databricks administration, configuration, and performance optimization. Strong proficiency in Apache Spark, PySpark, SQL, and Scala. Hands-on experience with Databricks Unity Catalog, Delta Lake, and MLflow. Knowledge of Azure cloud services, including Azure Data Lake, Azure Synapse, and Azure Key Vault. Experience in Infrastructure as Code (Terraform, Bicep, or ARM Templates). Proficiency in CI/CD automation using Azure DevOps, GitHub Actions, or Jenkins. Strong understanding of network security, identity management (AAD), and encryption best practices. Excellent problem-solving skills and ability to troubleshoot complex Databricks workloads. Strong communication and documentation skills. Experience: Minimum 5+ years of experience in Azure Databricks administration and optimization. Experience working with large-scale data processing and analytics workloads. Education: Bachelor's degree in Computer Science, Information Technology, or a related field preferred. Preferred Qualifications: Databricks Certified Associate or Professional certification. Experience with Azure Kubernetes Service (AKS) and serverless computing. Familiarity with Kafka, Apache Airflow, and event-driven architectures. Knowledge of Python, PowerShell, or Bash scripting for automation. Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required. CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role. To Apply: To be considered, please apply directly to this requisition using the link provided. Kindly forward this to any other interested parties. Thank you! About CTG CTG, a Cegeka company, is at the forefront of digital transformation, providing IT and business solutions that accelerate project momentum and deliver desired value. Over nearly 60 years, we have earned a reputation as a faster and more reliable, results-driven partner. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. CTG leverages the expertise of over 9,000 team members in 19 countries to provide innovative solutions. Together, we operate across the Americas, Europe, and India, working in close cooperation with over 3,000 clients in many of today's highest-growth industries. For more information, visit www.ctg.com. Our culture is a direct result of the people who work at CTG, the values we hold, and the actions we take. In other words, our people define our culture. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. Part of our mission is to cultivate a workplace that attracts and develops the best people, reflected by our recognition as a Great Place to Work Certified™ company across many of our global operations. CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws. CTG is an Equal Opportunity and Affirmative Action Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. Our Affirmative Action program serves to promote occupational equality and diversity through good faith efforts. CTG is fully committed to promoting employment opportunities for members of protected classes.
Confirm your E-mail: Send Email
All Jobs from CTG