About the Role We are seeking aStaff Engineer with a minimum of 9years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to opensource communities, and mentor senior engineers while shaping the future of largescale data infrastructure. This is a fulltime, onsite position open to candidates with valid work authorization. Why Join Us At Acceldata, you wont just be writing codeyoull be defining the architecture and technical vision for modern data platforms used by some of the world''''s largest enterprises. As a Staff Engineer, youll lead highimpact initiatives that directly influence how petabytescale data is managed, observed, and optimized across hybrid and cloud ecosystems. Youll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and opensource innovation. Your technical decisions will shape missioncritical systems, and your contributions will be visible across the global data ecosystem. Responsibilities Own the endtoend architecture of major platform components, driving design decisions that impact scalability, reliability, and performance. Architect and implement nextgeneration distributed data storage, processing, and query optimization systems. Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions. Lead contributions to Apache projects and opensource communities, establishing Acceldatas presence and technical reputation. Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput. Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning. Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform. Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals. Lead rootcause analysis for critical production issues and drive systemic improvements to prevent recurrence. Work across diverse environments: Bare Metal, VM, Kubernetes, and multicloud architectures. Mandatory Skills & Qualifications 9+ years of handson software development experience with at least 5 years focused on distributed systems or big data platforms. Expertlevel proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus. Deep understanding of distributed computing principles including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models. Extensive handson experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar). Expertlevel Linux proficiency including kernel tuning, performance analysis, and debugging at the system level. Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure). Deep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus). Proven ability to diagnose and resolve complex issues including memory leaks, deadlocks, GC tuning, and distributed system failures. Strong understanding of architectural patterns for scalable, faulttolerant distributed systems. Excellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences including senior leadership. Demonstrated ability to work effectively with crossfunctional teams, external contributors, and the opensource community. Desired Skills (Bonus) History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink). Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures. Experience developing or optimizing query engines, query planners, or execution frameworks. Familiarity with data governance, security, lineage, and compliance frameworks. Experience leading largescale data platform migrations or Hadoop distribution upgrades. Published technical blogs, papers, or conference presentations on distributed systems topics. Experience leading or maintaining opensource projects. To Apply Please submit your resume and cover letter to Person at File by the date. We look forward to reviewing your application! We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. #J-18808-Ljbffr
Job Title
Staff Engineer - Open Source Data Platform (ODP)