Job Title

Data Engineer, $70-90K USDMandatory requirements:2+ years’ experience in managing large scale unstructured and real time data platform.2+ years’ experience in Pandas, NumPy, PySpark, and Pydantic 2+ years GCP Platform Experience: Hands-on experience GCP, including services like BigQuery, Cloud Storage, Cloud Functions, Dataflow, Cloud Pub/Sub, and GCP Identity & Access Management (IAM).-Unstructured and real time data management & Optimization: Proven experience building and optimizing pipelines for managing unstructured and real time data, ensuring they can handle large-scale data loads across distributed cloud environments.- Platform Engineering: Familiarity with platform engineering concepts, including Infrastructure-as-Code (IaC), CI/CD, cloud resource management, and designing systems for scalability and reliability in cloud environments.- Containerization & Orchestration: Experience with containerization and orchestration using Docker and Kubernetes, managing cloud-native applications and services.- In-depth knowledge of SQL and NoSQL databases, with experience managing large-scale, distributed data storage systems and writing complex queries for data extraction and transformation.- Excellent problem-solving and debugging skills, with a proactive approach to optimizing data infrastructure and pipelines for reliability and performance.- Strong communication and collaboration skills, with the ability to work effectively in agile teams, liaise with business stakeholders, and mentor junior team members.