Key Responsibilities: Work with stakeholders to architect and develop data driven-solutions that support diverse data consumers across the organization. Drive the development and implementation of robust data models and semantic layers for business intelligence and analytics. Architect, build, and optimize data pipelines using technologies such as Python, Scala, Beam, Spark, Iceberg, Airflow, and other GCP services. Build APIs to deliver real-time or pre-calculated data for high frequency, low latency applications and microservices. Develop and implement rigorous testing, data validation, monitoring and alerting strategies to ensure accuracy and consistency while minimizing MTTR. Mentor and guide junior data engineers to promote best practices and elevate the technical capabilities of the team. Collaborate with business and engineering teams, including Staff Developers and Product Managers, to identify and meet data delivery and transformation needs. Actively contributes to building a data-driven culture that prioritizes hypotheses-driven product development. What Youll Bring BA/BS in Computer Science, Engineering, Math, or a related field; advanced degrees are a plus. 4+ years of experience in software development, with at least 2 years as a Data Engineer. Extensive hands-on experience with relational databases like BigQuery for data warehousing and analytics, as well as some experience with non-relational databases such as BigTable. Proven ability to write complex SQL queries and perform advanced analysis on large datasets. Strong programming experience in Python, Scala, Java, or other data processing languages. Strong experience with cloud technologies (GCP, AWS, Azure) and data infrastructure. Advanced understanding of data warehouse concepts and best practices. Strong experience with Git for version control and collaborative development. Strong oral and written communication skills, with an ability to articulate technical concepts to both technical and non-technical stakeholders. Proven team player that will work well in a dynamic and fast-paced environment. Experience working in an agile environment with a focus on iterative delivery and continuous improvement. Passionate about data, with a strong desire to learn and continuously improve.
Job Title
Senior Data Engineer - BigData