A REVIEW ON REAL-TIME DATA PIPELINES FOR E-COMMERCE TRANSACTIONAL DATA ANALYTICS


Mahesha K, Sagar BR, Tejonidhi M, Yashwanth N , Ambika V
Dept of CSE-Data Science, ATME College of Engineering, Mysuru, Karnataka
Abstract
The exponential growth of e-commerce has necessitated the development of robust real-time data pipelines capable of processing high-velocity transactional data for instant decision-making. This review paper systematically examines existing methodologies, tools, and challenges in designing and implementing such pipelines, focusing on ingestion, processing, and analytics layers. By analyzing recent literature, we evaluate architectural frameworks (e.g., Kafka, Spark, Flink), performance trade-offs (latency vs. throughput), and emerging trends (AutoML, event-driven architectures). The paper highlights gaps in scalability, privacy, and interpretability while proposing future directions for intelligent, self-optimizing pipelines.
Keywords: Real-Time Data Processing, E-Commerce, Stream Processing, Apache Kafka, Fraud Detection, Automl,Genai, E-Commerce Data
Journal Name :
EPRA International Journal of Research & Development (IJRD)

VIEW PDF
Published on : 2025-08-30

Vol : 10
Issue : 8
Month : August
Year : 2025
Copyright © 2025 EPRA JOURNALS. All rights reserved
Developed by Peace Soft