2 weeks ago
Job title : Data Engineer
Job Location : South Africa,
Deadline : October 19, 2024
Quick Recommended Links
Responsibilities
- Automate repetitive data workflows to improve processing efficiency and reduce manual tasks.
- Collaborate with data scientists, machine learning engineers, and other stakeholders to understand data requirements and deliver effective solutions.
- Build and optimize ETL (Extract, Transform, Load) processes for accurate and streamlined data collection, transformation, and storage.
- Maintain thorough documentation of data processes, systems, and workflows for transparency and future reference.
- Integrate data from various sources, including APIs, databases, and external platforms, ensuring seamless data flow.
- Manage and enhance database systems with a focus on data integrity, performance, and security.
- Design, implement, and maintain scalable data pipelines and infrastructure for efficient data flow and management.
Requirements
Technical Skills:
- Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
- Knowledge of big data tools and technologies (e.g., Hadoop, Spark).
- Experience with data pipeline and workflow management tools.
- Proficiency in programming languages such as Python.
- Experience with cloud services (e.g., AWS, GCP, Azure) and data warehousing solutions (e.g., Redshift, BigQuery).
- Familiarity with data modeling, data warehousing, and ETL processes.
- Experience: Proven experience as a Data Engineer, Data Architect, or in a similar role.
- Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
How to Apply for this Offer
Interested and Qualified candidates should Click here to Apply Now
- ICT jobs