Senior Data Engineer (Spark & Python Specialist)
per year
per year
Our client is seeking an experienced Senior Data Engineer to play a critical role in advancing a modern cloud-based data platform. This opportunity is ideal for a highly skilled engineer with deep Spark and Python expertise who enjoys solving complex data challenges, modernising legacy systems, and contributing to scalable, high-performance data solutions within a collaborative engineering environment.
Requirements
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
6 years of experience working with Spark and PySpark in production environments
Strong Python development experience, including reusable library development and testing
Solid T-SQL skills and experience translating complex business logic into scalable solutions
Experience with Azure Synapse Analytics, Dedicated SQL Pools, and Azure Data Factory
Hands-on experience with Delta Lake and Parquet within high-volume environments
Strong understanding of Spark internals, performance tuning, partitioning, and optimization
Experience with Docker and cloud-agnostic development practices
Strong communication, collaboration, and leadership abilities Should you meet the requirements for this position, please email your updated CV attached to it .jobs@tumaini.co.za , alternatively contact XXX-XXXX or visit our website, www.tumaini.co. Correspondence will only be conducted with short listed candidates. Should you not hear from us within 3 days, please consider your application unsuccessful.
Submit your application for this position at Tumaini Consulting
Submit your application for this position