Highly experienced data engineer with over 8 years of expertise in designing and implementing scalable, high-performance data processing systems. Proven ability to manage project timelines and deliverables, collaborate with cross-functional teams, and deliver efficient, scalable solutions that support critical business processes. Adept at working in fast-paced environments with a strong focus on trading activities, operational efficiency, and scalability. Skilled in utilizing a variety of technologies, including Airflow for orchestrating data workflows, PySpark for large-scale data processing, and AWS services such as EMR and Athena to deliver cloud-based solutions. Extensive experience with Python, SQL, and the Hadoop ecosystem ensures the development of reliable and robust data pipelines that process over 5 TB of data daily. Experienced in collaborating with stakeholders, including portfolio managers, traders, and operations teams, to gather requirements and develop custom solutions tailored to business needs. Strong focus on knowledge sharing through application demos, documentation, and team training.