Job Title

The RoleTactable is seeking an experienced Senior Data Engineer with strong expertise in Databricks to own and further develop our data infrastructure, ingestion, and to help us build our data products. You'll work independently while collaborating closely with both engineering and other data teams to build robust, scalable data systems. As a professional with a deep understanding of Java, Python, Databricks, youll take the lead in building data pipelines used to ingest the information that fuels models and trading systems.The ideal candidate will have experience working in an evolving startup environment. You will be an in the moment problem solver with the ability to think about the short term and long term plan. You're energized about building and scaling and being part of a forward-thinking organization.We are building an incredible company and looking for talented, energetic, and motivated people to join our team. You can learn more about our Company, Culture and Values here:https://www.tactable.io/careers.Responsibilities:Design, build, and maintain highly scalable and robust data pipeline architectures leveraging frameworks such as Apache Spark, Hadoop, and cloud-based services (e.g., AWS, GCP, Azure).Using data warehouse solutions like Snowflake, Redshift, or BigQuery, aggregate and integrate large, complex data sets to meet both functional and non-functional requirements.Develop and implement process-improvement strategies, including automating manual tasks, optimizing data delivery, and restructuring infrastructure for scalability using workflow orchestration tools such as Apache Airflow or Luigi.Collaborate with stakeholders (executive, product, data, and design teams) to address data infrastructure and reporting needs, integrating DevOps practices (Docker, Kubernetes, Terraform) for smooth deployment.Create data tools for analytics and data science teams, helping them build and optimize data-driven solutions using Python and SQL.Implement automated testing frameworks, data validation, and compliance measures to ensure data quality, integrity, and security across the data architecture.Provide mentorship and technical expertise to junior engineers and analysts, guiding them in best practices for data engineering, performance optimization, and secure data handling.Monitor and optimize data processing performance and resource utilization using relevant metrics and logging/monitoring tools (e.g., Prometheus, Grafana, CloudWatch).Requirements:8+ years of professional experience as a Java Engineer, with at least 4 years in a Data Engineering or similar roleStrong proficiency in Java and related frameworks (Spring, Hibernate, Spring Boot)Hands-on experience with Apache Airflow or DatabricksProven track record in designing and implementing large-scale data pipelines and datasetsIn-depth knowledge of SQL and NoSQL databasesFamiliarity with cloud platforms (AWS, Azure, GCP)Experience creating RESTful APIs and working with microservices architecturesProficiency in standard DevOps tools (Jenkins, Maven, Gradle, Git) and CI/CD pipelinesCompetency with automation and scripting (Bash, Python)Excellent analytical, problem-solving, and troubleshooting skillsStrong communication skills, with the ability to interact effectively with stakeholders at various levelsSelf-directed, proactive, and adept at supporting multiple teams and systems simultaneouslyYou must be eligible to work in Canada to be considered for this roleNice to Have:Experience in financial services, banking, insurance, or media sectors.Knowledge of containerization and orchestration tools such as Docker and Kubernetes.Experience with streaming technologies such as Apache Kafka or Spark Streaming.Familiarity with big data technologies, including Spark, Azure Data Factory, BigQuery, Snowflake.Understanding of Data Governance frameworks and best practices.Other Skills:Degree in Computer Science, Engineering, or equivalent industry experienceStrong communication and teamwork skillsStrong time management skills and ability to manage multiple workstreamsWhat We Offer:Hybrid working modelComprehensive Health BenefitsGenerous holidays and flexible PTOLaptop/Equipment providedPotential for professional growth and advancement