From Optimal Model to Web Application

Employee churn is a significant challenge for organizations, leading to substantial costs associated with recruiting, onboarding, and training new employees. High turnover rates can negatively impact overall productivity, employee morale, and organizational stability. Therefore, accurately predicting employee churn is crucial for companies to implement targeted retention strategies, minimize turnover, and reduce associated expenses. In this study, we leveraged machine learning techniques to predict employee churn using the "HR Analytics" dataset from Kaggle. One of the key challenges in churn prediction is class imbalance, where the number of employees who leave is significantly lower than those who stay. To address this, we applied two data-balancing techniques: Synthetic Minority Over-sampling Technique (SMOTE) and Random Over-Sampling (ROS). We then trained and evaluated four machine learning models Logistic Regression, Random Forest, Decision Tree, and Extreme Gradient Boosting (XGBoost) on the balanced datasets. The F1 scores for the SMOTE-balanced data were: Logistic Regression (0.5990), Random Forest (0.9753), Decision Tree (0.9319), and XGBoost (0.9634). Meanwhile, the ROS-balanced data produced F1 scores of: Logistic Regression (0.5978), Random Forest (0.9760), Decision Tree (0.9475), and XGBoost (0.9703). The results demonstrated that ROS yielded superior performance, particularly for the Random Forest and XGBoost models, leading us to select ROS for further hyperparameter tuning. Using RandomizedSearchCV for optimization, the Random Forest model achieved the highest F1 score of 0.9779. Finally, we deployed the optimized Random Forest model via a Flask API, enabling HR professionals to access a user-friendly web interface for realtime churn prediction. This research highlights the effectiveness of machine learning in HR analytics and underscores the practical benefits of predictive modeling in workforce management, helping organizations proactively address employee retetion challenges.