Role: Data Engineer Location: Hyderabad, Bangalore5 days WFOExperience: 7+ years ResponsibilitiesKnowledge to ingest, cleanse, transform and load data from varied data sources in the above Azure ServicesStrong knowledge of Medallion architectureConsume data from source with different file format such as XML, CSV, Excel, Parquet, JSONCreate Linked Services with different type of sources.Create automated flow for pipeline which can consume data i.e may receive file via email or Share point.Strong problem-solving skill such as backtracking of dataset, data analysis etc.Strong Knowledge of in advanced SQL techniques for carrying out data analysis as per client requirement.Required SkillsThe candidates need to understand different data architecture patterns and parallel data processing. S/he should be proficient in using the following services to create data processing solutions:Azure Data FactoryAzure Data Lake StorageAzure DatabricksStrong Knowledge inPySparkSQLGood programming skill inPythonDesired SkillsAbility to query the data from serverless SQL Pool in Azure Synapse Analytics.Knowledge of Azure DevOps.Knowledge to configure any dataset with Vnet, Subnet NetworksKnowledge of Microsoft Entra ID, to create App registration for single and multitenant for security purpose.
Job Title
Azure Data Engineer