Our CompanyWe exist to bring amazing people together to explore the art of possible.Bailey Abbott are a progressive and dynamic IT Consultancy business working across both Public and Private sectors. People are at the core of everything we do. We''re all about nurturing and inspiring people ours and our clients. We bring a positive attitude and mindset to everything we do. We confidently use our knowledge and skills to solve problems, finding a better and easier way forward.We deliver transformational outcomes to take businesses further, fearlessly. Confidence and trust is fundamental to delivering superior outcomes and we take ownership and responsibility for our commitments.Our PeopleOur specialist IT Consultants are creative, collaborative, and passionate. We''re strong advocates for change, challenging the status quo through new thinking, technology, and practices. Always exploring creative ways to simplify complexity.As a Consultant with Bailey Abbott, you will have the opportunity to build your project portfolio by gaining exposure and experience working across different clients, industries, technologies, and methodologies, all while having the stability and security of a permanent position.Our Career OpportunityBailey Abbott have an exciting opportunity for a Senior Data Engineer to join our Data Intelligence capability. Our Data Intelligence specialists work within an active community of practice, enabling you to benefit from their years of collective experience and wisdom.Working as a Senior Data Engineer you will get the opportunity to:Represent Bailey Abbott, sharing your skills and knowledge to help deliver projects for our clientsDevelop and maintain ETL (Extract, Transform, Load) pipelines to ingest, process, and transform data within our Microsoft Azure-based data lake, utilising Azure Data FactoryDesign and implement efficient data models and schemas in Azure to ensure data quality and reliability, integrating Azure Purview for data governanceUtilise your proficiency in SQL and NoSQL databases to optimise data storage and retrieval in Azure environmentsLeverage big data technologies such as Apache Spark, Hadoop, or Azure HDInsight to process and analyse large datasetsCollaborate with data scientists, analysts, and stakeholders to understand business requirements and deliver valuable data solutions tailored for Azure ecosystemsWrite high-quality, scalable code in languages such as Python, Java, or Scala to support Azure-based data engineering tasksContinuously monitor, troubleshoot, and optimise data pipelines in Azure for performance and reliabilityStay up-to-date with industry best practices and emerging technologies in the Azure landscape to drive innovation in our data platformBachelor''s degree in a related field or equivalent work experienceDemonstrated experience in data engineering or a related role, with a specific focus on Microsoft AzureProficiency in SQL and NoSQL databases, with a strong understanding of data manipulation and querying in AzureDemonstrable experience in ETL pipeline development using Azure Data Factory, data modeling, and schema designFamiliarity with Azure big data technologies such as Apache Spark, Hadoop, or Azure HDInsightExperience with Azure Purview for data governance and catalogingApplication of CI/CD and DevOps methodologies, including source code managementProgramming skills in languages like Python, Java, or Scala, with a focus on Azure applicationsExperience Snowflake isStrong problem-solving skills and attention to detailEffective communication and collaboration skills in an Agile team settingAzure certification or relevant cloud experience is highly desirableExposure to emerging approaches such as Azure FabricPaid Birthday LeaveAccess to Employee Assistance ProgramFlexible Working OptionsNovated LeasingRegular team gatherings including monthly team lunchProfessional development opportunities and continuous learningFinancial benefits through Discount StoreOur clients are diverse and so are we. We engage with great talent from all walks of life to bring their extensive and varied experience to help promote innovation. We encourage applications from candidates from all backgrounds to further strengthen Bailey Abbott.Bailey Abbott. Explore Possible. #J-18808-Ljbffr
Job Title
Senior Data Engineer