Job Title

Job Role: PySpark Data EngineerWe are seeking a dynamic and versatile Data Analyst and Data Engineer to join our team. The ideal candidate will work on multiple projects simultaneously, leveraging their expertise in data analysis and engineering to deliver high-quality insights and solutions. This role demands a proactive, detail-oriented professional who can adapt to diverse client requirements and collaborate effectively across teams. Key Responsibilities: Dual Role Managemen t : Work as both a Data Analyst and Data Engineer on different projects,seamlessly switching between responsibilities as required. 2. System Expertise: Thoroughly learn and understand the client's data systems and architecture to ensure quick and accurate analysis for requests from various teams and projects. 3. Tool Proficiency: Utilize tools and platforms such as Pyspark, Python, SQL Developer and other technologies as needed for data processing, analysis, and reporting. 4. Data Analysis & Reporting: Create insightful and actionable analysis reports tailored to client needs. Convert reports into client-preferred formats, ensuring clarity and precision. 5. Data Pipeline Development: Design and develop scalable and efficient data pipelines for data cleanup, processing, and storage. Automate workflows and ensure smooth data ingestion, transformation, and output processes. 6.Coding Best Practices: Write clean, maintainable, and efficient code in PySpark, adhering to industry best practices for performance optimization and readability. 7. Collaboration & Communication: Work closely with project stakeholders, understanding their requirements, and delivering results in a timely and professional manner. Collaborate across teams to align data strategies with business objectives. 8. Problem-Solving & Innovation: Proactively identify and address data-related challenges, ensuring data integrity, security, and accessibility. Stay updated with the latest trends in data engineering and analytics, implementing innovative solutions where applicable. Qualifications: 4 years of strong experience in data analysis, data engineering, and working with large-scale datasets. Expertise in tools like Pyspark, Python, SQL Developer and other technologies as needed Proficiency in creating detailed analysis reports. Solid understanding of ETL processes, data pipeline development, and data modeling. Proven ability to work on multiple projects simultaneously, maintaining high standards of quality and efficiency. Excellent communication and interpersonal skills to interact effectively with clients and team members.