Skip to Main Content

Job Title


Lead Big Data Platform Engineer


Company : The Hartford


Location : Columbus, OH


Created : 2026-03-16


Job Type : Full Time


Job Description

Join our innovative team as we seek a skilled Lead Big Data Platform Engineer. At The Hartford, we pride ourselves on making a significant impact in the insurance industry by going beyond conventional coverages and policies. This is an exciting opportunity to shape the future of our data platforms and help others achieve their goals. As a vital member of our Cloud Big Data Platform Engineering & Operations team, you will leverage your extensive experience in AWS Big Data/EMR infrastructure, Infrastructure as Code (IaC), security, automation, and observability to create and maintain scalable solutions that meet the evolving needs of Data & Analytics applications across the organization. In this role, you will mentor and guide fellow engineers, fostering a culture of technical excellence and collaboration. We are looking for a passionate technologist who thrives in a fast-paced, dynamic environment and is dedicated to building resilient data platforms. Responsibilities: Administer and engineer Big Data platforms across multiple Hadoop clusters in AWS, including serverless and containerized environments for optimal performance and reliability. Design, implement, and maintain scalable and resilient multi-tenant Data Platforms using Infrastructure as Code (IAC) in alignment with The Hartford's engineering principles. Ensure operational excellence by leading incident triaging and service restoration efforts to minimize impact on the business. Utilize Site Reliability Engineering (SRE) principles to implement robust tooling, alerting, and automated responses to maintain system reliability. Drive the architecture of Platform, PaaS, and SaaS solutions to meet current and future business needs, focusing on innovation and operational excellence. Participate in on-call rotations to provide hands-on expertise during service-impacting incidents. Evaluate and integrate emerging data technologies to drive innovation in big data and analytics. Act as a subject matter expert for data platforms, resolving complex technical issues and ensuring platform reliability. Provide mentorship to junior and mid-level data engineers, promoting skill development and best practices. Collaborate with data scientists and analysts to empower self-service data capabilities. Create training materials and lead sessions to enhance user engagement with data solutions. Support documentation and metadata management to improve data discoverability and self-service analytics. Foster a collaborative environment and strong commitment to shared objectives and strategic goals. Qualifications: Bachelor's degree in computer science, Computer Engineering, or a related field. Extensive experience in platform administration, big data technologies, and data operations. Proficient in tools and concepts such as Hadoop, Linux, Python, SQL, Spark, cloud platforms, and performance tuning. Minimum 7 years of experience in IT, platform administration, or database management. At least 3 years hands-on experience with AWS and Infrastructure as Code (CloudFormation, Terraform). Experience providing architectural guidance and technical direction. Background in data engineering, focusing on data ingestion, preparation, and analytics applications. Familiarity with Change Management and Incident Management processes. Experience implementing Reliability Engineering practices and observability tools like Splunk and CloudWatch is a plus. Strong analytical and problem-solving skills with effective communication abilities. Preferred Skills: Advanced experience with AWS services (EMR, EKS, S3, etc). Configuration management experience using CloudFormation or Terraform. Advanced programming/scripting skills (Python, Bash). AWS Solution Architect Certification is preferred. Cloudera Admin Certification is a plus. This role offers a hybrid work schedule, requiring in-office presence in Columbus, OH, Chicago, IL, Hartford, CT, or Charlotte, NC, three days a week (Tuesday through Thursday). Candidates must be authorized to work in the US without company sponsorship. We do not support the STEM OPT I-983 Training Plan endorsement for this position. Compensation: The annualized base pay ranges from $136,000 to $204,000, depending on experience and performance, alongside other rewards and incentives. The Hartford is an Equal Opportunity Employer, supporting inclusivity for all individuals regardless of background.