Senior Data Engineer (With Python Experience)
Job Description
We are seeking a skilled Senior Data Engineer with a solid background in data engineering and software engineering and exposure to machine learning. The ideal candidate will work with Polars as the primary data frame library and contribute to building testing and optimizing data-driven solutions.
Key Responsibilities
- Develop robust data transformations using Python and Polars for efficient processing and analytics tasks.
- Hands-on experience in data engineering
- Write clean maintainable and efficient code with a strong emphasis on software engineering principles.
- Gather data from diverse sources transforming it efficiently and delivering clean reliable datasets and reports that support critical business decision-making.
- Implement and maintain unit testing and end-to-end testing.
- Utilize Docker for testing and development environments.
- Manage data infrastructure on GCP
- Apply a foundational understanding of machine learning concepts in project work.
- Contribute to projects requiring some Ruby coding support.
Requirements
- 6 years of experience in data engineering
- Strong proficiency in Python.
- Hands-on experience in data engineering including designing building and optimizing data pipelines ETL processes and workflows.
- Solid software engineering skills (design architecture and best practices).
- Experience working with Polars (or similar data frame libraries).
- Knowledge of unit testing and end-to-end testing frameworks.
- Hands-on experience with Docker for testing purposes.
- Exposure to GCP services.
- Basic understanding of machine learning concepts.
- Good to have some experience with Ruby .
Recommended Jobs
Patrol Officer- Certified-Protective Services Cleveland Hts
**Location: Cleveland Heights Health Center** **Biweekly Hours: 80.00** **Shift: 0800-2030; 0900-2130; 0700-1530; 1500-2330; 2300-0730** **The MetroHealth System is redefining health care by going bey…
Locum Tenens Radiology Job Middleburg, OH
Though your CompHealth recruiter will be your single point of contact, they are backed by dozens of specialized teams, giving them the ability to focus on the details that matter to you. That means w…
Director, UC Cancer Center, College of Medicine
Current UC employees must apply internally via SuccessFactors Founded in 1819, the University of Cincinnati ranks among the nation’s best urban public research universities. Home to 53,235 s…
Onsite Haitian Creole Interpreter - Dayton Ohio
At Propio Language Services we are closing the language gap by connecting people anywhere and anytime through innovative technology and solutions. Founded in 1998 Propio Language Services provi…
PHYSICAL THERAPIST - OUTPATIENT - LODGE AT LEWES
Why Beebe?: Become part of the Beebe team - an inclusive team positioned in a vibrant, coastal community. Enjoy a fulfilling career as you support the health of our patients and a team focused on exc…
Au Pair
We're a young professional family who is currently expecting twins. We have a 3 year old daughter currently and the twins are due in September. We are looking for a Live in Au Pair that will hopefully…
CNC/Manual Machinist
Manufacturing Technician JOB-10045261 Anticipated Start Date November 23, 2025 Location Antioch, CA Type of Employment Contract Hire Employer Info Our client i…
Locum Cardiothoracic Physician Assistant
Palm Health Resources is hiring an experienced Cardiothoracic Physician Assistant for a 6 month locum contract in Delaware! Candidate must have a DE license or be in process of obtaining! Candidat…
JT553 - ASSOCIATE MANUFACTURING PROCESS TECHNICIAN - NS
QUALITY CONSULTING GROUP, a leader in the pharmaceutical, biotech, medical devices, and manufacturing industry, is looking for a talented, highly motivated and enthusiastic to join our team. In this r…