Senior Data Engineer
per year
per year
Hire Resolve's client is seeking a talented individual to join their dynamic team in Gauteng. You'll thrive in a remote-first work culture that prioritizes innovation and collaboration, with monthly in-person get-togethers to foster team bonding and idea sharing.
Responsibilities
Stay Current with SQL
Continuously learn and apply the latest SQL features and programming practices through education, study, and participation in conferences, workshops, and groups.
Data Management
Oversee data backups from local directories to shared drives and VSTS.
Issue Resolution
Identify and resolve problems stemming from customer feedback and testing, correcting them or escalating to appropriate personnel.
Code Quality Assurance
Evaluate code to ensure it meets industry standards , is valid, properly structured, and compatible with various Azure SQL versions .
Requirements Analysis
Analyze technical requirements to accurately determine user needs.
System Integration
Manage data analysis and the integration of disparate systems .
Performance Optimization
Guarantee high quality and optimal performance of delivered code, adhering to internal guidelines.
Database Expertise
Apply deep understanding of database operations and optimization for Microsoft SQL Server .
Reporting Development
Develop effective reporting systems that provide accessible information for decision-making.
Troubleshooting
Conduct thorough troubleshooting on code, tables, indexes, and SQL Server instances .
Report Generation
Generate and deliver quality reports to customers, performing comprehensive quality assurance checks.
Cross-functional Collaboration
Partner with various teams to translate business requirements into scalable data solutions .
Design Participation
Contribute to design reviews, providing valuable input on requirements, product design, and potential issues.
Software Validation
Test and validate software against major architectural requirements, with a focus on scalability and performance .
System Quality
Ensure the overall quality of the entire system.
Technology Advancement
Stay up-to-date with the latest Microsoft data technologies, Azure services , and data engineering best practices.
Performance Enhancement
Troubleshoot and optimize Azure data pipelines and SQL Server performance , and resolve data quality issues.
Cost Optimization
Continuously improve data infrastructure to reduce latency, increase throughput, and optimize Azure costs using FinOps principles .
Tool Integration
Evaluate and integrate new Microsoft data tools and Azure services to enhance our data platform capabilities.
Mentorship
Mentor and guide junior data engineers, fostering their growth.
Architectural Oversight
Participate in architecture reviews, ensuring all data solutions meet high-quality standards and best practices.
Stakeholder Communication
Communicate effectively with stakeholders to understand data requirements and provide technical solutions.
Independent Delivery
Work autonomously and deliver high-quality work within tight deadlines.
Minimum Requirements
Data Processing
7 years of T-SQL/SQL Server expertise, deep Azure Synapse Analytics skills, and C#/.NET for data processing applications.
Microsoft Data Stack
Strong proficiency in Azure Data Factory, Azure Databricks, SQL Server Integration Services (SSIS), Azure Stream Analytics, and Event Hubs .
Cloud & Infrastructure
Experience with Azure Synapse Analytics, Power Designer for data modeling, and Azure DevOps for CI/CD.
Data Modeling
Expertise in dimensional modeling with Power Designer, SQL Server Data Tools (SSDT), schema design for OLAP/OLTP, and performance optimization.
Business Intelligence
Experience with Power BI integration, SSAS/SSRS , and knowledge of DAX/MDX and semantic layer design.
DevOps & Orchestration
Proficient with Azure DevOps pipelines, ARM templates/Bicep, Azure Monitor, and Application Insights .
Testing
Experience with unit testing for T-SQL and data pipelines, data quality frameworks, and integration testing with Azure Data Factory. Strong understanding of basic DB concepts, joins, aggregate functions, and commands (DDL, DML, TCL DCL). Proficiency in advanced SQL concepts like CTE, Recursive queries, Pivots, Self joins, Temporary functions, UDF, etc.
Deep understanding of relational database concepts with solid knowledge of MS-SQL . Proficiency with version control systems such as Git and Azure Repos . Strong problem-solving and troubleshooting skills in Microsoft environments.
Experience with ETL tools . Expertise in SQL Server performance tuning and optimization of large-scale data systems. Advantageous Skills Experience with Azure Machine Learning and Azure Cognitive Services for ML pipelines.
Experience with Microsoft Fabric and its unified analytics platform. Real-time analytics with Azure Stream Analytics and Complex Event Processing. Azure Cost Management and FinOps experience optimizing data workloads.
Power Platform integration (Power Apps, Power Automate) for data workflows. Experience with Cosmos DB for multi-model database scenarios.
Microsoft Certified
Azure Data Engineer Associate or Azure Solutions Architect certification.
Benefits
Competitive salary based on experience. IF you meet the above requirements and want to make a career-changing move, apply today by emailing your CV to itcareers@hireresolve.za.com You can also connect with Daniel on LinkedIn or contact Hire Resolve If you meet the above requirements we will contact you within 3 working days
Submit your application for this position at Hire Resolve
Submit your application for this position