Data Engineer

Apply Now

Tower Group are currently seeking candidates for their open Data Engineer position in Pinetown, KwaZulu-Natal through Go Job Search. Are you an experienced candidate looking to take up a Data Engineer role such as with an industry leading company like Tower Group?

Key Performance AreasTake responsibility for assigned projects in line with divisional requirements.Ensure timeous completion of all documentation.Work within stipulated budget constraints.Conduct and review business process maps to review data centered processes.Identify and implement data centered projects.Identify project timing and ensure this is maintained.Systematic solution design of the ETL and data pipeline in line with business user specifications :Ensure highest data quality assurance, data accuracy and data completeness through regular and in-depth review and testing of work.Create and maintain easily understandable technical documentation.Conduct data design, database architecture, metadata and repository creation activities and tasks as required by business stakeholder.Translate business needs into long-term architecture solutions.Define, design, and build dimensional databases.Design the ETL pipelines.Develop data warehousing blueprints, evaluate hardware and software platforms, and integrate systems.Evaluate reusability of current data for additional analyses.Conduct data cleaning to purge old, unused, or duplicate data.Review object and data models and the metadata repository to structure the data for better management and quicker access.Determine processes to ensure execution of relevant data application requirements for various business needs.Utilise relevant templates that outlines the requirements for each step within the data modelling journey.Conduct testing and quality control of databases to ensure accurate and appropriate use of data.Initiate and successfully motivate improved ways of operating. Develop and implement ETL pipelines aligned to the approved solution design :Enhance and maintain existing ETL frameworks in line with agreed design patterns and internal governance standards to improve the EDW product offering and to remain scalable.Implement the ETL pipeline in a timely manner.Utilise most accurate and consistent data source to remodel into a central data set that is understandable to the end user.Understand data structures to deliver data sets in accordance with exact requirements of end user brief.Ensure data is precise, benchmarked and validated against financial records.Deliver on standard data marts that can be utilised for reporting and analysis which is well documented and understood by business users.Translate Meta data into explanatory reports and visuals for easy understanding to end user.Perform data pre-processing which includes data manipulation, transformation, normalisation, standardisation, visualisation, and derivation of new variables/features, as applicable to developing specific algorithms or models. Ensure data governance and data quality assurance standards are upheld :Facilitate an understanding of data sources to ensure governance, procedures and standards are upheld.Build data quality metrics and conduct data validation testing.Follow the IT governance process when implementing a change to ensure governance standards and protocols are followed.Work close with business to understand business processes and standards to develop data quality assurance metrics.Build exception reports to help identify data quality problems.Provide feedback to business owners on identified problems to ensure quality of data is rectified.Utilise specialist knowledge to explain the data and transfer the understanding to business end user.Conduct training and upskilling on new reports and or self-service analytics platforms to relevant stakeholders.Communication to stakeholders to keep them abreast of current developments within the function and to manage expectations.Apply the standards set out in all legislation, policy and procedure that affects the stakeholders.Deal effectively and timeously with stakeholder complaints and ensure that complaints are resolved or escalated in line with agreed standards. Minimum Qualification / Experience Required3-Year IT related Degree.Post-graduate qualification (advantageous).3+ years experience and understanding in designing and developing data warehouses according to the Kimball methodology.Adept at design and development of ETL processes.SQL development experienceSAS Data Studio and AWS experience advantageousThe ability to ingest/output CSV, JSON and other flat file types and any related data sources.Intermediate to proficient in Python or R or other related programming languagesData Architecture, Data Modelling and Data Pipelining.Solutions Architecture.

Apply now and a member of the team at Tower Group will get in touch with you to discuss your career options further.

Apply Now

Tagged as: Data Engineer