Abstract

As cyber-attacks evolve in complexity and frequency; the development of effective network intru-sion detection systems (NIDS) has become increasingly important. This paper investigates the ef-ficacy of the XGBoost algorithm for feature selection combined with deep learning (DL) techniques, such as ANN, 1DCNN, and BiLSTM, to create accurate intrusion detection systems (IDSs) and evaluating it against NSL-KDD, CIC-IDS2017, and UNSW-NB15 datasets. The high accuracy and low error rate of the classification models demonstrate the potential of the proposed approach in IDS design. The study applied the XGBoost feature extraction technique to obtain a reduced feature vector and addressed data imbalance using the synthetic minority oversampling technique (SMOTE), significantly improving the models' performance in terms of precision and recall for individual attack classes. The ANN + BiLSTM model combined with SMOTE consistently outperformed other models within this paper, emphasizing the importance of data balancing techniques and the effectiveness of integrating XGBoost and DL approaches for accurate IDSs. Future research can focus on implementing novel sampling techniques explicitly designed for IDSs to enhance minority class representation in public datasets during training.