Role and ResponsibilitiesWhat Youll DoBe responsible for system architecture design and data engineering activities including data ingestion, modelling, processing and data governanceWork with team to improve the data pipeline to process large scale data efficientlyBe a data steward to educate and promote the data importance and data-driven culture.Be constantly challenged to learn and grow with new technologies, identify and solve complex problems via dataCollaborate with cross-functional teams, including data scientists and business stakeholders.Design and implement data architecture that supports analytical needs and scalabilityImplement and maintain cloud-based data solutions for various use cases ranging from batch data processing, near-real time dataSkills and Qualifications:Good experience with open-source technologies such as Airflow, Superset, Datahub, Great ExpectationGood Hadoop ecosystem knowledge (e.g. Hadoop, Spark, Kafka, Hive, Presto)Proficient in at least one programming language and scripting languages (e.g. Python, Scala, Java, Bash)Good experience with CICD tools such as GitHub ActionsFamiliar with Agile/Scrum software development methodologiesJob Types: Full-time, Permanent
Job Title
Data Engineer (Full-time)