Job Description:
We are seeking a highly skilled and motivated Cloud Data Engineer with a strong background in computer science or statistics, coupled with at least 5 years of professional experience. The ideal candidate will possess a deep understanding of cloud computing, particularly in AWS, and should have a proven track record in data engineering, Big Data applications, and AI/ML applications.
Responsibilities:
- Cloud Expertise:
- Proficient in AWS services such as EC2, VPC, Lambda, DynamoDB, API Gateway, EBS, S3, IAM, and more.
- Design, implement, and maintain scalable cloud-based solutions.
- Execute efficient and secure cloud infrastructure configurations.
- Data Engineering:
- Develop, construct, test, and maintain architectures, such as databases and processing systems.
- Utilize coding skills in Spark and Python for data processing and manipulation.
- Administer multiple ETL applications to ensure seamless data flow.
- Big Data Applications:
- Work on end-to-end Big Data application projects, from conception to deployment.
- Optimize and troubleshoot Big Data solutions to ensure high performance.
- AI/ML Applications:
- Experience in developing and deploying AI/ML applications based on NLP, CV, and GenAI.
- Collaborate with data scientists to implement machine learning models into production environments.
- DevOps and Infrastructure as a Service (IaaS):
- Possess knowledge and experience with DevOps applications for continuous integration and deployment.
- Set up and maintain infrastructure as a service, ensuring scalability and reliability.
Qualifications:
- Bachelor’s degree in computer science, Statistics, or a related field.
- 5+ years of professional experience in cloud computing, data engineering, and related fields.
- Proven expertise in AWS services, with a focus on EC2, VPC, Lambda, DynamoDB, API Gateway, EBS, S3, IAM, etc.
- Proficient coding skills in Spark and Python for data processing.
- Hands-on experience with Big Data application projects.
- Experience in AI/ML applications, particularly in NLP, CV, and GenAI.
- Administration experience with multiple ETL applications.
- Knowledge and experience with DevOps tools and processes.
- Ability to set up and maintain infrastructure as a service.
Soft Skills:
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work effectively in a fast-paced and dynamic team environment.
- Proactive mindset with a commitment to continuous learning and improvement.