FLSEST: CTR model based on important features and soft threshold
DOI:
https://doi.org/10.15837/ijccc.2026.1.7069Keywords:
Recommendation algorithm, Click-through rate, Adapted Anisotropic Diffusion Filtering and Deep Learning, attention mechanism, Squeeze excitation and soft threshold networkAbstract
Click-through rate (CTR) prediction plays a pivotal role in developing effective recommendation systems across industries. While existing models like DeepFM primarily focus on low-order and high-order feature interactions, they often fail to sufficiently account for the heterogeneous importance distribution among individual features. To address this limitation, we propose FLSEST, a novel architecture integrating a squeeze-excitation and soft threshold (SEST) mechanism that dynamically amplifies discriminative features while suppressing noise from less informative ones. Drawing inspiration from FLEN’s design philosophy, we additionally introduce a feature-weighting bilinear interaction (FWBI) layer to resolve gradient coupling phenomena during feature interaction learning. Extensive experimental evaluations on multiple public datasets demonstrate that our FLSEST model achieves superior prediction performance compared to state-of-the-art shallow and deep recommendation models. Moreover, integrating our proposed SEST network with mainstream models such as FwFM and DeepFM further enhances their predictive capabilities, confirming the versatility and effectiveness of our approach.
References
Y. Yang and P. Zhai, "Click-through rate prediction in online advertising: A literature review," Information Processing & Management, vol. 59, no. 2, p. 102853, 2022. https://doi.org/10.1016/j.ipm.2021.102853
P. Morala, J. A. Cifuentes, R. E. Lillo, and I. Ucar, "Towards a mathematical framework to inform neural network modelling via polynomial regression," Neural Networks, vol. 142, pp. 57-72, 2021. https://doi.org/10.1016/j.neunet.2021.04.036
M. Blondel, A. Fujino, N. Ueda, and M. Ishihata, "Higher-order factorization machines," Advances in neural information processing systems, vol. 29, 2016.
S. Rendle, "Factorization machines with libfm," ACM Transactions on Intelligent Systems and Technology (TIST), vol. 3, no. 3, pp. 1-22, 2012. https://doi.org/10.1145/2168752.2168771
Z. Li, D. Jin, and K. Yuan, "Attentional factorization machine with review-based user-item interaction for recommendation," Scientific Reports, vol. 13, no. 1, p. 13454, 2023. https://doi.org/10.1038/s41598-023-40633-4
Y. Yin, N. D. Ochieng, J. Sun, X. Bao, and Z. Wang, "Penet: A feature excitation learning approach to advertisement click-through rate prediction," Neural Networks, vol. 172, p. 106127, 2024. https://doi.org/10.1016/j.neunet.2024.106127
S. Guo, X. Liao, F. Meng, Q. Zhao, Y. Tang, H. Li, and Q. Zong, "Fsasa: Sequential recommendation based on fusing session-aware models and self-attention networks," Computer Science and Information Systems, vol. 21, no. 1, pp. 1-20, 2024. https://doi.org/10.2298/CSIS230522067G
X. Zeng, S. Li, Z. Zhang, L. Jin, Z. Guo, and K. Wei, "Rain: Reconstructed-aware in-context enhancement with graph denoising for session-based recommendation," Neural Networks, vol. 184, p. 107056, 2025. https://doi.org/10.1016/j.neunet.2024.107056
S. Wang, J. Zhu, Y. Wang, C. Ma, X. Zhao, Y. Zhang, Z. Yuan, and S. Ruan, "Hierarchical gating network for cross-domain sequential recommendation," ACM Transactions on Information Systems, vol. 43, no. 4, pp. 1-32, 2025. https://doi.org/10.1145/3715321
P. V. de Campos Souza, "Fuzzy neural networks and neuro-fuzzy networks: A review the main techniques and applications used in the literature," Applied soft computing, vol. 92, p. 106275, 2020. https://doi.org/10.1016/j.asoc.2020.106275
H. Wu, Z. Zhang, K. Yue, B. Zhang, J. He, and L. Sun, "Dual-regularized matrix factorization with deep neural networks for recommender systems," Knowledge-Based Systems, vol. 145, pp. 46-58, 2018. https://doi.org/10.1016/j.knosys.2018.01.003
P. Wen, W. Yuan, Q. Qin, S. Sang, and Z. Zhang, "Neural attention model for recommendation based on factorization machines," Applied Intelligence, vol. 51, pp. 1829-1844, 2021. https://doi.org/10.1007/s10489-020-01921-y
K. Xiao, X. Jiang, P. Hou, and H. Zhu, "Autoeis: Automatic feature embedding, interaction and selection on default prediction," Information Processing & Management, vol. 61, no. 1, p. 103526, 2024. https://doi.org/10.1016/j.ipm.2023.103526
L. Zhang, W. Shen, J. Huang, S. Li, and G. Pan, "Field-aware neural factorization machine for click-through rate prediction," IEEE Access, vol. 7, pp. 75 032-75 040, 2019. https://doi.org/10.1109/ACCESS.2019.2921026
J. Pan, J. Xu, A. L. Ruiz, W. Zhao, S. Pan, Y. Sun, and Q. Lu, "Field-weighted factorization machines for click-through rate prediction in display advertising," in Proceedings of the 2018 world wide web conference, 2018, pp. 1349-1357. https://doi.org/10.1145/3178876.3186040
T. Huang, Z. Zhang, and J. Zhang, "Fibinet: combining feature importance and bilinear feature interaction for click-through rate prediction," in Proceedings of the 13th ACM conference on recommender systems, 2019, pp. 169-177. https://doi.org/10.1145/3298689.3347043
X. Jin, Y. Xie, X.-S. Wei, B.-R. Zhao, Z.-M. Chen, and X. Tan, "Delving deep into spatial pooling for squeeze-and-excitation networks," Pattern Recognition, vol. 121, p. 108159, 2022. https://doi.org/10.1016/j.patcog.2021.108159
M. Gomez-Rodriguez, L. Song, H. Daneshm, and B. Schölkopf, "Estimating diffusion networks: Recovery conditions, sample complexity and soft-thresholding algorithm," Journal of Machine Learning Research, vol. 17, no. 90, pp. 1-29, 2016.
C. Wu, F. Wu, L. Lyu, Y. Huang, and X. Xie, "Fedctr: Federated native ad ctr prediction with cross-platform user behavior data," ACM Transactions on Intelligent Systems and Technology (TIST), vol. 13, no. 4, pp. 1-19, 2022. https://doi.org/10.1145/3506715
M. Papagelis and D. Plexousakis, "Qualitative analysis of user-based and item-based prediction algorithms for recommendation agents," Engineering Applications of Artificial Intelligence, vol. 18, no. 7, pp. 781-789, 2005. https://doi.org/10.1016/j.engappai.2005.06.010
Y. Koren, R. Bell, and C. Volinsky, "Matrix factorization techniques for recommender systems," Computer, vol. 42, no. 8, pp. 30-37, 2009. https://doi.org/10.1109/MC.2009.263
G. Kang, L. Ding, J. Liu, B. Cao, and Y. Xu, "Web api recommendation based on self-attentional neural factorization machines with domain interactions," IEEE Transactions on Network Science and Engineering, vol. 10, no. 6, pp. 3953-3963, 2023. https://doi.org/10.1109/TNSE.2023.3277695
Y. Qu, B. Fang, W. Zhang, R. Tang, M. Niu, H. Guo, Y. Yu, and X. He, "Product-based neural networks for user response prediction over multi-field categorical data," ACM Transactions on Information Systems (TOIS), vol. 37, no. 1, pp. 1-35, 2018. https://doi.org/10.1145/3233770
X. He and T.-S. Chua, "Neural factorization machines for sparse predictive analytics," in Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval, 2017, pp. 355-364. https://doi.org/10.1145/3077136.3080777
Y. Yang, B. Xu, S. Shen, F. Shen, and J. Zhao, "Operation-aware neural networks for user response prediction," Neural Networks, vol. 121, pp. 161-168, 2020. https://doi.org/10.1016/j.neunet.2019.09.020
Q. Lu, S. Li, T. Yang, and C. Xu, "An adaptive hybrid xdeepfm based deep interest network model for click-through rate prediction system," PeerJ Computer Science, vol. 7, p. e716, 2021. https://doi.org/10.7717/peerj-cs.716
A. Kumar, D. K. Jain, A. Mallik, and S. Kumar, "Modified node2vec and attention based fusion framework for next poi recommendation," Information Fusion, vol. 101, p. 101998, 2024. https://doi.org/10.1016/j.inffus.2023.101998
Q. Zhang, W. Liao, G. Zhang, B. Yuan, and J. Lu, "A deep dual adversarial network for crossdomain recommendation," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 4, pp. 3266-3278, 2021. https://doi.org/10.1109/TKDE.2021.3132953
B. Chen, Y.Wang, Z. Liu, R. Tang, W. Guo, H. Zheng, W. Yao, M. Zhang, and X. He, "Enhancing explicit and implicit feature interactions via information sharing for parallel deep ctr models," in Proceedings of the 30th ACM international conference on information & knowledge management, 2021, pp. 3757-3766. https://doi.org/10.1145/3459637.3481915
K. Mao, J. Zhu, L. Su, G. Cai, Y. Li, and Z. Dong, "Finalmlp: an enhanced two-stream mlp model for ctr prediction," in Proceedings of the AAAI conference on artificial intelligence, vol. 37, no. 4, 2023, pp. 4552-4560. https://doi.org/10.1609/aaai.v37i4.25577
Y. Wang, Y. Qin, F. Sun, B. Zhang, X. Hou, K. Hu, J. Cheng, J. Lei, and M. Zhang, "Disenctr: Dynamic graph-based disentangled representation for click-through rate prediction," in Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, 2022, pp. 2314-2318. https://doi.org/10.1145/3477495.3531851
Z. Tao, X. Wang, X. He, X. Huang, and T.-S. Chua, "Hoafm: a high-order attentive factorization machine for ctr prediction," Information Processing & Management, vol. 57, no. 6, p. 102076, 2020. https://doi.org/10.1016/j.ipm.2019.102076
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 jianlin chen
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
