Senior Data Platform Engineer- Databricks

Job Description

Day-To-Day:

Insight Global is seeking a Platform Engineer focused on databricks for one of our largest clients in Downtown Cleveland. The Platform Engineer will be responsible for configuring, installing, and upgrading hardware and software to maintain the integrity of the company's technology environment. This position will primarily be responsible for managing cloud platforms, and leading the scalability of our new Power BI platform rollout. This includes managing Microsoft Fabric capacity to ensure optimization for user performance and cost management. This includes troubleshooting issues, developing solutions aligned with organizational standards, and supporting the integration of DevOps tools such as API Gateway and Terraform with authentication, caching, and logging services. The role involves collaborating with DevOps and production teams to test new features and support launches, refining templates and scripts for automation, and creating prioritized task lists while managing inter-team dependencies. Additionally, the engineer will identify security threats and recommend compliance measures, review and refine security and resiliency policies, contribute to high-level design documentation, compile data for user requests, and coordinate platform changes and customizations with vendors to ensure smooth operations.

Salary: $120-140k

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

Must Haves:

• Bachelor's degree in Computer Science or related field

• 6+ years of professional experience in platform engineering and infrastructure components

• Familiarity with enterprise monitoring and log management tools: Dynatrace, Splunk, Elastic, ELK

• Experience managing and maintaining cloud environments (AWS, GCP, Azure) Azure strongly preferred

• Strong background in backend operational support (patching, upgrades, etc.) for data platforms and servers

• Experience administering Databricks platforms (This role's Primary responsibility will be administering data bricks platform, supporting and monitoring the implementation into their environment Preferred Qualifications:

• Experience with enterprise data tools: Snowflake, MicroStrategy, Informatica, Fivetran, Business Objects

• Experience administering Fabric, Power BI, and Azure (not just developing reports/dashboards with PowerBI

• Knowledge of Windows Server or SQL Server

• DevOps experience

• Familiarity with Security Controls, Security Automation, and Security Audits