Description:
My client are seeking a highly specialized Data Engineer with a deep focus on cloud technologies to join their team. As a Cloud Technology Data Engineer Specialist, you will be responsible for designing, implementing, and optimizing data solutions exclusively within cloud environments. This role requires an expert understanding of various cloud platforms and services to ensure the efficient and secure storage, processing, and retrieval of data for their organization.
Key Responsibilities:
Qualifications:
-
- Cloud Expertise: Become the go-to expert in all major cloud platforms, including AWS, Azure, Google Cloud, and niche cloud providers, understanding their unique data-related offerings and capabilities.
- Data Architecture Design: Collaborate with data architects to design and implement cloud-based data architecture solutions that are scalable, reliable, and cost-effective.
- Data Integration: Develop and maintain data pipelines and ETL processes optimized for cloud environments, ensuring the seamless flow of data between on-premises and cloud systems.
- Data Security: Implement robust security measures and access controls for data stored in the cloud, adhering to industry best practices and compliance requirements.
- Performance Optimization: Continuously optimize data processing and storage in the cloud, fine-tuning systems for maximum efficiency and cost-effectiveness.
- Data Warehousing: Design and manage cloud-based data warehousing solutions, selecting the appropriate services and technologies for data storage and retrieval.
- Data Governance: Establish and enforce data governance policies and procedures specific to cloud environments, ensuring data quality and compliance.
- Monitoring and Troubleshooting: Implement comprehensive monitoring and alerting systems to proactively identify and address data-related issues in the cloud.
- Documentation: Create detailed documentation for cloud data solutions, including architecture diagrams, process flows, and best practices.
- Cloud Vendor Evaluation: Stay up-to-date with the latest cloud technologies and evaluate new cloud services for their potential to improve data engineering processes.
- Bachelor's degree in computer science, information technology, or a related field (advanced degree preferred).
- Extensive experience (5+ years) as a data engineer with a strong focus on cloud technologies.
- Certification in one or more major cloud platforms (e.g., AWS Certified Data Analytics, Azure Data Engineer, Google Cloud Professional Data Engineer).
- Proficiency in programming languages such as Python, Java, or Scala.
- In-depth knowledge of data modeling, SQL, and NoSQL databases.
- Strong problem-solving skills and the ability to troubleshoot complex data issues in cloud environments.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.