Position Title: Senior Data Engineer
Reports To: Team Lead
Position Summary:
We are seeking a highly skilled Senior Data Engineer to design, develop, and optimize our data infrastructure. The ideal candidate will have a strong background in data engineering, excellent problem-solving skills, and experience working with large-scale data systems.
Position Responsibilities:
1. Data Pipeline Development:
* Design, build, and maintain efficient and scalable data pipelines.
* Ensure data quality and consistency across various sources and destinations.
2. Data Integration:
* Integrate data from various sources including databases, APIs, and third-party systems.
* Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions.
3. Data Storage and Management:
* Implement and manage data storage solutions such as data lakes, warehouses, and databases.
* Optimize storage solutions for performance, cost, and scalability.
4. Data Governance and Security:
* Establish and enforce data governance policies and procedures.
* Ensure compliance with data privacy regulations and implement security measures to protect sensitive data.
5. Performance Optimization:
* Monitor and optimize the performance of data pipelines and storage solutions.
* Troubleshoot and resolve data-related issues promptly.
6. Collaboration and Mentorship:
* Work closely with cross-functional teams to support data-driven initiatives.
* Mentor junior data engineers and promote a culture of continuous learning and improvement.
Requirement & Qualifications: