Data Engineering Solution Architect

Apply Now

Datafin are currently seeking candidates for their open Data Engineering Solution Architect position in Cape Town, Western Cape through Go Job Search. Are you an experienced candidate looking to take up a Data Engineering Solution Architect role such as with an industry leading company like Datafin?

ENVIRONMENT: BECOME part of a world-class innovative, forward-thinking and strategic IT architecture team as the next Data Engineering Solution Architect sought by a growing Retail Giant. Your core role will be to create the Data Engineering architecture for the target environments to deliver data pipelines into the bigger Business Intelligence environments. Extensive subject matter knowledge of Data Engineering is essential, as well as ETL, Relational Databases, Data Warehousing and Big Data. The successful incumbent will require a Degree in Information Systems / B Sc Computer Science (or similar), 5+ years’ IT projects from an Information and Data architecture and design perspective (SDLC), proven experience creating Data Engineering solutions, building and maintaining reliable and scalable ETL on Big Data platforms as well as experience working with varied forms of data infrastructures. You will also require DataOps and/or DevOps frameworks and proven experience using Python and SQL to create, manage, manipulate data pipelines and – sets. You also need TOGAF and Zachman frameworks, AWS/Azure/Google, ARIS Preferable/ or Sparx Enterprise Architect) experience.DUTIES: Collaborate closely with the Data, Integration and Analytics teams –Define and continuously improve the Data Engineering Architecture framework and modeling standards:Define a structured Data Engineering Architecture approach and methodology for capturing the key views of the enterprise.Architect the next-generation Big Data analytics framework developed on a group of core technologies.Align to the enterprise data reference architecture in support of the enterprise and regulatory information governance needs such as Information Security, Enterprise Information Management, POPI, PCI, etc.Identify, define, and communicate standards, guidelines, formats, meta-models, policies, best practices, and governance practices for Data Engineering architectures and designs.Ensure that the Data Engineering approach integrates into the methodologies and processes of the rest of the Enterprise Architecture team.Stay abreast of best practices and/or new developments in Data Engineering and related disciplines and drive adoption as deemed appropriate.Define and create solution level Data Engineering architecture models that enable specific BI and analytics requirements –Analyse the inputs and outputs of BI and analytics and create related Data Engineering Architectures and designs for the baseline (“as is”) and target (“to be”) solution architectures.Coordinate with System Analysts, Development teams and DBAs to ensure creation of physical database and an optimal implementation of the Data Engineering design.Define Data Engineering Architecture governance processes and quality compliance criteria.Perform quality assurance checks on Data Engineering Architectures and Designs and enforce quality compliance criteria to set policies and standards.Perform quality checks on existing Data Engineering Architectures and Designs to identify potential business risks areas and make re-engineering recommendations.Ensure Data Engineering security conforms to Information Security Governance policies and standards.Provide expert Data Engineering guidance, ensure solution architectures and designs are in line with the Data Engineering technology standards and conduct architecture and design reviews as part of the Architecture Review Committee –Define and develop the overall Data Engineering Architecture landscape in partnership with the Domain Architect, Data Analytics team and other Solution Architects.Review proposed solution architectures ensuring alignment with architecture principles, the architecture framework, cloud reference architectures, set technology standards and identify critical gaps, and recommend improvements.Give guidance and advice to peers in respect to Data Engineering solution designs ensuring the designs conform to industry best practices and standards.REQUIREMENTS: Qualifications –Degree in Information Systems / B Sc Computer Science (or similar).Experience/Skills –5 Years and up –Working experience within the IT industry.IT projects from an Information and Data architecture and design perspective (SDLC).Demonstrable knowledge of Data Engineering Architecture and familiarity with various architecture viewpoints (Business, Applications, Data, and Technology Architectures) is required.Proven experience creating Data Engineering solutions, building and maintaining reliable and scalable ETL on Big Data platforms as well as experience working with varied forms of data infrastructures.Experience working with DataOps and/or DevOps frameworks.Proven experience using scripting languages such as Python and SQL to create, manage, manipulate data pipelines and – sets.Solution Architectures, System Analysis and Design, Data Modeling and Application Development methodologies.Experience with data profiling, data cleansing/quality, performance issues, reporting and data analysis.Database and data management (Data Replication, Backup and Recovery, DBMS Scaling techniques, SOA, ODS/OLTP vs Data Warehouse/OLAP/VLDB).Various Data Modeling paradigms (dimensional, data vault, normalized, NoSQL).2 – 3 Years and up –Knowledge of various architecture frameworks including TOGAF and Zachman frameworks (TOGAF Certification would be a distinct advantage).Knowledge of implementing future-fit Data Engineering technologies and capabilities such as APIs, API Portals, and Lakehouse architectures.Proven experience with Data Engineering in a cloud environment (AWS/Azure/Google) as well as on-premise.Implementing and using EA tools and EA meta-model definition (ARIS Preferable/ or Sparx Enterprise Architect).Retail industry experience with an understanding of retail business processes and the information and data requirements of these processes.Desirable –Leadership role in an Information and Data Analysis environment.ATTRIBUTES:Strong analytical, problem-solving and logical skills.Excellent team-working, interpersonal skills.Delivery of compelling presentations to all levels of stakeholders and excellent communication and relationship building skills.Develop of proposals and excellent written communication & presentation skills.Excellent organisation and facilitation skills.Strong Conflict Management.

Apply now and a member of the team at Datafin will get in touch with you to discuss your career options further.

Apply Now

Tagged as: Data Engineering Solution Architect