Responsibilities: Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services End to end development lifecycle of complex large-scale and multi-user applications Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios Big Data ETL considering enterprise data management for data lakes and data warehouses Data Orchestration -Data Transformation and Data integration using MS Azure services Develop batch processing, streaming and integration solutions Automate Azure Data Factory pipelines Manage and enforce data policies and standards Monitor databases and data processing for a specified scenario Implement big data real-time processing and integration solutions Manage Azure DevOps pipelines Basic Qualifications: Education: B.E./M.Sc./M.E./M. Tech. Minimum 2 Years in Azure Data Engineering Knowledge & Skills: Very strong @ SQL-PL SQL-Spark SQL Scala PySpark Interaction with No SQL Databases Interaction with Event Hub, IoT Hub Databases Files Processing – XML, CSV, Excel, Jason, etc. Formats Structured and Non-Structured Data processing Data ETL Capabilities Knowledge of Distributed Big Data Processing Data Warehouse and Data Lake Implementation experience in past Interaction with REST APIs , Web Services Required Competencies: Customer Focus Good verbal & written English communication Ability to work with globally diverse teams Readiness to work in flexible work timings Abstract & Analytical Thinking An interpersonal savvy. A very good team player Nimble learning. Willingness to explore and adapt Certifications: MS Azure Data Engineer (MS Certified) is preferred
Job Title
Data Engineer