Junior/Intermediate PySpark Data Engineer – Data Migration (MS SQL / OCI)

Our client is a large organization in the healthcare sector, undergoing a digital transformation focused on building a modern cloud-based data platform. The project aims to centralize data from multiple internal systems into a unified environment to improve accessibility, reporting, and analytical capabilities.

The team is working on implementing a scalable cloud data lake to enable efficient data processing, governance, and insights across departments. The solution will serve as the foundation for data-driven decision-making and future AI and analytics initiatives.

Leobit is looking for a Junior/Intermediate PySpark Data Engineer – Data Migration (MS SQL / OCI) to join our team.

Overview:

We are looking for a motivated Junior/Intermediate PySpark Data Engineer to join our team and support the migration of enterprise datasets from Microsoft SQL Server to Oracle Cloud Infrastructure (OCI).

You will work with experienced engineers and data architects to develop and maintain PySpark-based ETL pipelines, ensure data quality, and help implement scalable, cloud-based data migration solutions.

Requirements:

• Two years of working experience in data engineering or a related technical field (at least)
• Practical experience with PySpark, Spark SQL, and Python (academic or commercial)
• Solid knowledge of SQL and basic experience with MS SQL Server (T-SQL)
• Understanding of ETL concepts, data quality, and data migration principles
• Familiarity with cloud data platforms (experience with OCI, AWS, or Azure is a plus)
• Basic knowledge of data modeling and schema mapping concepts
• Experience with version control tools (Git) and CI/CD workflows is an advantage
• Team-oriented mindset, curiosity, and willingness to learn new technologies
• Bachelor’s or Master’s degree in computer science (or similar technical field)
• Level of English: Upper-Intermediate (at least)

Responsibilities:

• Develop and maintain PySpark ETL pipelines to extract and load data from MS SQL Server to OCI (Object Storage / Autonomous DB)
• Assist in building and maintaining metadata-driven ingestion and transformation processes
• Perform data validation, profiling, and reconciliation between source and target systems
• Support integration of OCI data services such as Data Flow, Data Integration, Object Storage, and Autonomous Database
• Work closely with senior engineers, data architects, and DBAs on migration tasks and performance tuning
• Document ETL processes, data mappings, and migration progress
• Participate in troubleshooting and resolving data or performance issues under guidance

We Offer:

• Interesting and challenging projects
• Competitive compensation and regular results-based salary review
• A broad range of professional education and personal development possibilities
• Comfortable and cozy working environment 
• Motivated colleagues with profound knowledge of the technical field
• Attractive compensation package 

Accelerate your career with Leobit!