Senior Data Engineer

R936K - R1M

per year

Job Description

Hire Resolve's client is seeking a talented individual to join their dynamic team in Gauteng. You'll thrive in a remote-first work culture that prioritizes innovation and collaboration, with monthly in-person get-togethers to foster team bonding and idea sharing.

Responsibilities

Stay Current with SQL

Continuously learn and apply the latest SQL features and programming practices through education, study, and participation in conferences, workshops, and groups.

Data Management

Oversee data backups from local directories to shared drives and VSTS.

Issue Resolution

Identify and resolve problems stemming from customer feedback and testing, correcting them or escalating to appropriate personnel.

Code Quality Assurance

Evaluate code to ensure it meets industry standards , is valid, properly structured, and compatible with various Azure SQL versions .

Requirements Analysis

Analyze technical requirements to accurately determine user needs.

System Integration

Manage data analysis and the integration of disparate systems .

Performance Optimization

Guarantee high quality and optimal performance of delivered code, adhering to internal guidelines.

Database Expertise

Apply deep understanding of database operations and optimization for Microsoft SQL Server .

Reporting Development

Develop effective reporting systems that provide accessible information for decision-making.

Troubleshooting

Conduct thorough troubleshooting on code, tables, indexes, and SQL Server instances .

Report Generation

Generate and deliver quality reports to customers, performing comprehensive quality assurance checks.

Cross-functional Collaboration

Partner with various teams to translate business requirements into scalable data solutions .

Design Participation

Contribute to design reviews, providing valuable input on requirements, product design, and potential issues.

Software Validation

Test and validate software against major architectural requirements, with a focus on scalability and performance .

System Quality

Ensure the overall quality of the entire system.

Technology Advancement

Stay up-to-date with the latest Microsoft data technologies, Azure services , and data engineering best practices.

Performance Enhancement

Troubleshoot and optimize Azure data pipelines and SQL Server performance , and resolve data quality issues.

Cost Optimization

Continuously improve data infrastructure to reduce latency, increase throughput, and optimize Azure costs using FinOps principles .

Tool Integration

Evaluate and integrate new Microsoft data tools and Azure services to enhance our data platform capabilities.

Mentorship

Mentor and guide junior data engineers, fostering their growth.

Architectural Oversight

Participate in architecture reviews, ensuring all data solutions meet high-quality standards and best practices.

Stakeholder Communication

Communicate effectively with stakeholders to understand data requirements and provide technical solutions.

Independent Delivery

Work autonomously and deliver high-quality work within tight deadlines.

Minimum Requirements

Data Processing

7 years of T-SQL/SQL Server expertise, deep Azure Synapse Analytics skills, and C#/.NET for data processing applications.

Microsoft Data Stack

Strong proficiency in Azure Data Factory, Azure Databricks, SQL Server Integration Services (SSIS), Azure Stream Analytics, and Event Hubs .

Cloud & Infrastructure

Experience with Azure Synapse Analytics, Power Designer for data modeling, and Azure DevOps for CI/CD.

Data Modeling

Expertise in dimensional modeling with Power Designer, SQL Server Data Tools (SSDT), schema design for OLAP/OLTP, and performance optimization.

Business Intelligence

Experience with Power BI integration, SSAS/SSRS , and knowledge of DAX/MDX and semantic layer design.

DevOps & Orchestration

Proficient with Azure DevOps pipelines, ARM templates/Bicep, Azure Monitor, and Application Insights .

Testing

Experience with unit testing for T-SQL and data pipelines, data quality frameworks, and integration testing with Azure Data Factory. Strong understanding of basic DB concepts, joins, aggregate functions, and commands (DDL, DML, TCL DCL). Proficiency in advanced SQL concepts like CTE, Recursive queries, Pivots, Self joins, Temporary functions, UDF, etc.

Deep understanding of relational database concepts with solid knowledge of MS-SQL . Proficiency with version control systems such as Git and Azure Repos . Strong problem-solving and troubleshooting skills in Microsoft environments.

Experience with ETL tools . Expertise in SQL Server performance tuning and optimization of large-scale data systems. Advantageous Skills Experience with Azure Machine Learning and Azure Cognitive Services for ML pipelines.

Experience with Microsoft Fabric and its unified analytics platform. Real-time analytics with Azure Stream Analytics and Complex Event Processing. Azure Cost Management and FinOps experience optimizing data workloads.

Power Platform integration (Power Apps, Power Automate) for data workflows. Experience with Cosmos DB for multi-model database scenarios.

Microsoft Certified

Azure Data Engineer Associate or Azure Solutions Architect certification.

Benefits

Competitive salary based on experience. IF you meet the above requirements and want to make a career-changing move, apply today by emailing your CV to itcareers@hireresolve.za.com You can also connect with Daniel on LinkedIn or contact Hire Resolve If you meet the above requirements we will contact you within 3 working days

Apply for Senior Data Engineer

Submit your application for this position at Hire Resolve

Add a few notes about your experience first for a more personal draft. You can edit the draft before submitting.

PDF, DOC, or DOCX (max 5MB)

Ready to Apply?

Submit your application for this position