Optimizing End to end Machine Learning Pipelines Using Hybrid Edge Cloud Architectures for Real Time Decision making Applications

Real time decision making applications, such as those used in autonomous vehicles, smart cities, and industrial IoT, require fast, scalable, and accurate analytics to ensure timely responses and optimized operations. Traditional cloud-based systems face significant challenges in meeting these requirements due to high latency, limited scalability, and bottlenecks in data processing. This study explores the use of a hybrid Edge Cloud architecture to optimize End to end machine learning (ML) pipelines for real time applications. The proposed system offloads time-sensitive tasks to edge devices, while computationally intensive processes are handled by the cloud, ensuring efficient use of resources and reduced latency. Experimental results demonstrate that the hybrid model reduces inference latency by up to 70% compared to cloud-only systems, while maintaining model accuracy and increasing throughput. Additionally, the scalability of the hybrid architecture is highlighted, as it can handle large-scale data streams and adapt to varying workloads. The findings show that hybrid Edge Cloud architectures are well-suited for applications where fast decision making is critical, such as autonomous systems and real time analytics in smart cities. However, challenges remain in managing resources across edge and cloud systems, particularly in balancing computational loads and ensuring system reliability. Future research should focus on optimizing task partitioning, integrating advanced edge AI models, and exploring the use of 5G networks to enhance performance further. Overall, the study demonstrates the potential of hybrid Edge Cloud systems in overcoming the limitations of traditional cloud-based ML pipelines and provides insights into the future of real time data processing.