Senior Big Data Engineer (Python/PySpark)

Position Title: Senior Big Data Engineer (Python/PySpark)

Provide locations/flexible work by preference: 1. Pittsburgh PA - Two PNC Plaza OR Cleveland OH - Strongsville Technology Center **Please note, the hiring team is not looking to source out of any other tech hubs at this time**
Ability to work remote: Hybrid - 3 days in office, 2 Remote
Acceptable time zone(s): EST
Days of the week: Mon-Fri, 40 hours
Working Hours (Flexible): 8-5pm EST

Roles and Responsibilities:

• Interact with Business to understand the requirement on a daily evolving need and adapt to the needs.
• Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach.
• Dedicated and committed approach with good communication skills and participation in agile ceremonies.
• Hands on Experience with Object Oriented Programming including limitations.
• Familiarity with cross-platform development
• Able to handle all the database storage and retrieval mechanisms on Data Lake Platforms and extensive experience in handling.
• Extensive Unix/FTP/ File Handling
• Strong Hands-on experience with SQL databases

Must Have Technical Skills:

• A deep understanding and multi-process architecture and the threading limitations of Python.
• Pyspark Data engineering skills
• Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems(supporting csv/parquet/)
• Extensive knowledge in understanding Data and creating Data Pipelines
• Hands on experience designing and implementing APIs
• Hands on experience building microservices using FastAPI or related technologies.
• Experience writing unit testing and ensure code coverage.
• Experience with Agile Methodology/JIRA/Confluence
• Experience in version control using Git

Flex Skills/Nice to Have: Added advantage if worked on Big Data, PySpark libraries.

Education/Certifications:
Bachelors Preferred
Python or Spark certifications are a plus

Role Differentiator: Conversion possibility, growth opportunities are immense, there is always work and always ways to grow and a place where you can be energized by new work and opportunities. Supporting the bank in a huge way in this department and very critical to the bank's success.

Skills:

• A deep understanding and multi-process architecture and the threading limitations of Python
• Experience in version control using Git
• Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems(supporting csv/parquet/)
• Experience with Agile Methodology/JIRA/Confluence
• Experience writing unit testing and ensure code coverage.
• Extensive knowledge in understanding Data and creating Data Pipelines
• Hands on experience building microservices using FastAPI or related technologies.
• Hands on experience designing and implementing APIs
• Pyspark Data engineering skills

Share your resume with [email protected] . Also connect me at LinkedIn : (16) Ariz J. Khan | LinkedIn

Ref: #404-IT Pittsburgh

System One, and its subsidiaries including Joulé, ALTA IT Services, TeamPeople, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.