JDA minimum of a BS degree in computer science, software engineering, or related scientific discipline is desired3+ years of work experience in building scalable and robust data engineering solutionsStrong understanding of Object Oriented programming and proficiency with programming in Python (TDD) and Pyspark to build scalable algorithms3+ years of experience in distributed computing and big data processing using the Apache Spark framework including Spark optimization techniques2+ years of experience with Databricks, Delta tables, unity catalog, Delta Sharing, Delta live tables(DLT) and incremental data processingExperience with Delta lake, Unity CatalogAdvanced SQL coding and query optimization experience including the ability to write analytical and nested queries3+ years of experience in building scalable ETL/ ELT Data Pipelines on Databricks and AWS (EMR)2+ Experience of orchestrating data pipelines using Apache Airflow/ MWAAUnderstanding and experience of AWS Services that include ADX, EC2, S33+ years of experience with data modeling techniques for structured/ unstructured datasetsExperience with relational/columnar databases - Redshift, RDS and interactive querying services - Athena/ Redshift SpectrumPassion towards healthcare and improving patient outcomesDemonstrate analytical thinking with strong problem solving skillsStay on top of emerging technologies and posses willingness to learnAbout Company-PureSoftware is a global software products and digital services company that is driving transformation for the world's top organizations across multiple verticals such as banking and financial services, telecom, healthcare, gaming and entertainment.PureSoftware has been in business since 2005 and has focused on value at every stage of software development and uniform adoption of software process methodology. With presence in 11 geographical locations, we work closely with our clients and partners to exceed their expectations, building confidence in our capabilities to deliver software solutions to their requirements. With an employee strength of 1300+ people, our experience encompasses industries like Financial Institutions & Insurance, Banking, Telecom, Life Sciences, Gaming, Hi-Tech, Retail, Manufacturing, Supply Chain and Automotive.PureSoftware has successfully executed projects in areas like Application Development, Application Testing, Application Support & Maintenance, RPA, IoT, Machine Learning & AI, Customer Experience, Mobility, Data Intelligence & Analytics, Cloud, Accessibility Validation Services and Product Engineering (Software & Firmware) Services. PureSoftware have also developed our own product, which is our intellectual property - Arttha (Arttha is a cloud ready, multi tenanted, open API based unified fintech solution, providing users with omni-channel experience. PureSoftware has an award winning fintech platform called Arttha and has been deployed by more than 150 financial institutions in emerging markets such as Indonesia, Malaysia, Nepal, Myanmar, and countries in Africa. It provides an unrivalled experience in the digital financial services space and delivers a range of business offerings like e-wallets, micro-lending, digital payments, agent banking, digital banking etc. all integrated as different modules in the same application.
Job Title
AWS Data Engineer