Platform Engineer

Job Description

Job Description

Summary:

We are seeking an experienced Platform Engineer who will be part of the Platform team managing the Data Science platform.

Job Responsibilities:

• Support ongoing Data Science Infrastructure operations.

• Develop and deploy AWS environments using CI/CD processes for a rapidly growing team of Data Scientists.

• Manage and support large-scale environments to meet the needs of current and future Data Science teams.

• Champion and grow the environment by implementing and overseeing the image management lifecycle process.

• Assist in setting up and managing AWS accounts specifically for the Data Science platform.

• Provide hands-on development using CI/CD tools such as Azure DevOps.

• Utilize Infrastructure as Code IaC tools such as Terraform for environment setup and management.

• Develop scripts and applications using programming languages such as Python.

• Manage database technologies including Athena Oracle MySQL and Postgres.

• Leverage AWS services essential for Data Lake Data Science AI/ML teams.

• Handle and resolve requests from development and business users addressing any roadblocks.

• Manage secured infrastructure enforce security measures and apply necessary guard rails.

• Resolve infrastructure vulnerabilities within SLAs and maintain audit logs.

• Perform system upgrades and patching providing on-call support as needed.

• Conduct root cause analysis and knowledge transfer sessions with the internal team.

• Collaborate with Network Database Infrastructure and Architecture teams to align on projects and strategies.

Basic Qualifications:

• Bachelor’s degree in computer science or a related field.

• 2 years experience in Data Science Infrastructure.

• 2 years extensive experience with Data Lake Data Science and AI/ML services hosted on AWS infrastructure.

• 2 years working knowledge of the following technologies:

o Kubernetes

o AWS services such as SageMaker Glue Lambda Athena

o CI/CD tools like Azure DevOps

o IaC tools like Terraform

o Docker and ECR Elastic Container Registry

o Security tools like AQUA and Kenna

• 2 years experience in technical write-ups.

Preferred Qualifications:

• AWS and Terraform certified professionals. Kubernetes or CKA

• Familiarity with technical service management and product life cycle maintenance.

• Knowledge of programming and scripting languages such as Python and shell scripting.

• In-depth knowledge of database technologies like Athena Oracle MySQL.

• Extensive experience with CI/CD and IaC tools such as Azure DevOps and Terraform.