Data Engineer

Job Description

JALA is looking for a Data Engineer who will be responsible to monitoring data quality and infrastructure, preparing raw data for further processing, and managing CI/CD operations within GitHub. This role also involves ingesting data into a data lake and creating automation pipelines using Python-based tools.

Tasks and Responsibilities :

• Ingest data source into data lake
• Create automation pipeline using python based tools
• Monitor data quality and infrastructure
• Prepare raw data for further processing
• Maintain CI/CD operation in github

Requirements :

• Intermediate python developer
• Having experience minimum 1 year
• Familiar with AWS services related to data solution (S3, EC2, VPC, Lambda, Glue)
• Intermediate in RDBMS query language
• Familiar with apache airflow and pyspark