Position Summary Experienced software engineer utilizing Big Data & Cloud technologies to program for custom solutions for Adobe Experience Cloud customers and frameworks. What you’ll do • Develop low level design as per approved Tech Specification or equivalent inputs provided. • Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs. • Build and delivery technology deliverables compliant with functional requirements. • Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc. • Process technology deliverables through full development lifecycle. • Maintain and support existing solutions and technology frameworks. • Attend regular scrum events of equivalent and provide update on the deliverables. • Work independently with none or minimum supervision. Requirements 6+ years(6 year) of professional software engineering mostly focused on the following: • Developing ETL pipelines involving big data. • Developing data processing/analytics applications primarily using PySpark. • Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming. • Clear understanding and ability to implement distributed storage, processing and scalable applications. • Experience of working with SQL and NoSQL database. • Ability to write and analyze SQL, HQL and other query languages for NoSQL databases. • Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries. Data Engineer – AEP Comptency • Experience of developing applications that consume the services exposed as ReST APIs. Special Consideration given for • Experience of working with Container-orchestration systems like Kubernetes. • Experience of working with any enterprise grade ETL tools. • Experience & knowledge with Adobe Experience Cloud solutions. • Experience & knowledge with Web Analytics or Digital Marketing. • Experience & knowledge with Google Cloud platforms. • Experience & knowledge with Data Science, ML/AI, R or Jupyter.
Job Title
Data Engineer