Job Descriptions :
Data Engineer (Multi-database Access and ETL/ELT Expert)
Required skilled and experienced Data Engineer who will be responsible for accessing multiple databases, designing and implementing efficient ETL/ELT processes, and building robust data pipelines.
The data engineer shall have expertise in handling diverse data sources and will possess a strong understanding of data integration.
The data engineer will play a crucial role in effective management and analysis of the data assets.
Responsibilities :
• Get access to a large set of data sources and integrate data from these sources, ensuring efficient and secure data retrieval.
• Design and develop ETL/ELT processes to extract, transform, and load data from source systems to target destinations.
• Build and maintain scalable data pipelines to support data processing and analysis requirements.
• Collaborate with cross-functional teams, including data scientists, analysts, and stakeholders, to understand data requirements and develop appropriate data engineering solutions.
• Optimize and fine-tune data pipelines for performance, scalability, and reliability.
• Implement data quality checks and validation processes to ensure the accuracy and integrity of data.
• Troubleshoot and resolve data-related issues, such as data inconsistencies or pipeline failures.
• Stay updated with emerging trends and technologies in data engineering and data integration to recommend and implement best practices.
• Collaborate with IT and database administrators to ensure data security, access controls, and compliance with data privacy regulations.
• Provide documentation, training, and support to other team members regarding data engineering processes and tools.
Requirements:
- Engineering degree in Computer Science, Information Systems, or a similar related field and degree.
- Proven experience as a Data Engineer, To work with multiple databases, implementing ETL/ELT processes.
- Strong understanding of data engineering concepts, data integration, and data pipeline requirements.
- Proficient in SQL and hands-on experience with various databases, such as PostgreSQL,Oracle, MySQL or NoSQL databases like MongoDB and Elasticsearch etc.
- Experience with ETL/ELT tools and frameworks, such as Apache Spark, Apache Kafka, or Talend.
- Familiarity with cloud platforms and services, such as AWS, Azure, or Google Cloud Platform.
- Knowledge of data modeling, data warehousing, and data governance principles.
- Understanding of data security, access controls, and compliance with data privacy regulations.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration abilities, with the ability to work effectively in a team environment.
- Relevant certifications in data engineering, ETL/ELT, or cloud platforms (e.g., AWS Certified Big Data – Specialty, Microsoft Certified: Azure Data Engineer) would be a plus.