Job title : Senior Data Engineer
Job Location : Gauteng, Johannesburg
Deadline : November 26, 2024
Quick Recommended Links
Job Summary
- Designs, builds, manages, and monitors strategic data assets through the pipeline of data retrieval, storage, database design, and distribution of information assets throughout the organisation.
Job Description
- Design and assemble large, complex data sets to meet functional / non-functional requirements
- Source data from internal and external data sources, engaging with technical subject matter experts
- Design and build infrastructure required for optimal extraction, transformation and loading of data across a variety of data sources using various ‘big data’ technologies
- Help streamline a better supply chain for advanced analytics that goes from experimentation into production. Identify, design and implement internal process improvements: automating manual processes, optimising data delivery, re-designing models for greater scalability.
- Explore, analyse, and profile data from our various internal and external data sources, and help data scientist to prepare data for analytical purposes
- Resolve critical data modelling issues impacting the functionality of business intelligence products in production
- Engage with a wide range of technical stakeholders including data scientist, business analysis, other data engineers and solutions architects
- Work with data and analytics experts to strive for greater functionality in our data systems
Requirements
- More than 5 years of data engineering experience
- Bachelor`s degrees as a minimum qualification
- Proven experience with
- Scala or Python or Java development
- Spark and Hadoop data platforms
- Linux environments
- SQL scripting
- AWS
- Skilled in developing data pipelines
- Expertise in data analysis and exploration
- Strong problem solving abilities
Education
- Bachelor`s Degrees and Advanced Diplomas: Information Technology, Bachelor`s Degrees and Advanced Diplomas: Manufacturing, Engineering and Technology
How to Apply for this Offer
Interested and Qualified candidates should Click here to Apply Now
- Research / Data Analysis jobs