Databricks Platform Administrator
On-site Ortigas Center Full-time Mid-level Data Engineering
At a glance
Mid-level Data Engineering role at Questronix Corporation. Ortigas Center · full-time.
Pay not stated Data Engineering salary
RoleData Engineering
SeniorityMid-level
LocationOrtigas Center
WorkplaceOn-site
EmploymentFull-time
PostedFeb 19, 2024
Role brief
dataroles summary, based on the employer's posting.
What you'll do
- Set up and maintain Databricks clusters and workspaces, then monitor resource use and resolve performance issues
- Adjust cluster settings to balance speed and cost, and apply software updates and patches
- Control access to sensitive data through permissions, security rules and encryption
- Create backup and recovery plans, and document platform settings, procedures and operating practices
- Connect Databricks with data sources, warehouses and lakes while gathering requirements from technical and business teams
What you bring
- A relevant bachelor's degree, such as in computer science or data engineering
- Two to three years working with the Databricks platform
- Strong understanding of Apache Spark and Databricks architecture
- Experience managing clusters, workspaces, notebooks, user groups and permissions, including scheduled housekeeping jobs
Who this fits
This role suits someone with hands-on Databricks administration experience who can work with data engineers, data scientists and business analysts. You must be willing to work fully onsite in Ortigas.
From the employer
- Install, configure, and maintain Databricks clusters and workspaces.
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Perform regular software updates and patches.
- Optimize cluster configurations for performance and cost-effectiveness.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
Requirements
- Bachelor's degree in a relevant field (computer science, data engineering, etc.)
- 2 to 3 years experience with Databricks Platform
- Strong knowledge of Apache Spark and Databricks architecture.
- Familiar with managing clusters, workspaces, notebooks, user group management.
- Familiar with configuring permissions.
- Can create notebooks related to cleanup/housekeeping and schedule/manage jobs through Databricks
- Willing to be assigned in Ortigas (fully onsite)
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.