Event Name: | Workshop by Adjunct Faculty on “Building a Real-time Data Pipeline: From REST API to Analytics using Python, Kafka, Spark & ClickHouse” |
Event Date: | 13-14 June-2025 |
Venue: *Mention only if its conducted in offline mode, else mention the online platform which is used to conduct* | Offline mode: DS-12, Big Data Laboratory, Department of MCA Gogte Institute of Technology, Belagavi |
Organizing Department: | Department of MCA |
Faculty Coordinator: | Prof. Mrutyunjaya S.Emmi |
Chief Guest/ Guest of Honour/ Speaker etc. details: *Provide Name, Designation, Organization name* | Resource person: Mr. Mallanagouda Patil, Data Architect & Senior Staff Engineer, NETSKOPE SOFTWARE INDIA PRIVATE LIMITED, Bengaluru, Karnataka, India |
Brief about the event: *Mention key topics covered in the session* | The contents of this program are designed to support Real-time Data Pipeline management in industries The following topics are included in this program: 1. Ingestion Layer with Python Flask 2. Kafka Streaming Layer 3. Processing & Storage: ETL Layer with Apache Spark 4. Storage Layer with ClickHouse 5. Project ideas |