Particle swarm optimization design of convolutional neural networks with a fuzzy learning rate estimation for diabetic retinopathy detection and classification
One of the leading causes of blindness in young adults is diabetic retinopathy, a chronic eye complication that arises from diabetes mellitus. It occurs due to progressive damage caused by persistently high blood glucose levels. Convolutional neural networks are becoming a fundamental tool for analyzing and classifying medical images, making them a valuable aid in medical diagnosis. This work proposes a particle swarm optimization-based design of convolutional neural networks. During training, fuzzy logic estimates the learning rate based on the accuracy and loss of both the training and validation sets. The Asia Pacific Tele-Ophthalmology Society 2019 Blindness Detection dataset was used to test the proposed method. In the binary case, the best accuracy was 96.73%; in the multiclass case, it was 77.49%. The results demonstrate that the proposed method, when fuzzy logic is applied, improves diagnostic accuracy for diabetic retinopathy compared with a design that excludes fuzzy logic from the learning process and applies the adaptive moment estimation algorithm.

- Wang J, Xu L, Shao J, Lv J, Zeng X, Li W. SODAS: Second-order optimization differential architecture search for diabetic retinopathy prediction. Neural Networks. 2026;196:108419. doi: 10.1016/j.neunet.2025.108419
- Pedrini A, Nowosielski Y, Rehak M. Diabetic retinopathy— recommendations for screening and treatment. Wien Med Wochenschr. 2025;175:253-263. doi: 10.1007/s10354-025-01088-6
- Hayat M, Allawi Y, Alamro W, et al. A Hybrid Convolutional Neural Network–Long Short-Term Memory (CNN– LSTM)–Attention Model Architecture for Precise Medical Image Analysis and Disease Diagnosis. Diagnostics. 2025;15(21):2673. doi: 10.3390/diagnostics15212673
- Rivero-Cacho A, Sánchez-Barroso G, Pastor-Pérez P, García-Sanz-Calcedo J. Forecasting indoor air quality in high-risk operating theatres in hospitals using Artificial Neural Networks. J Build Eng. 2025;111:113339. doi: 10.1016/j.jobe.2025.113339
- Castillo-Girone S, Munera S, Martínez-Sober M, Blasco J, Cubero S, Gómez-Sanchis J. Artificial Neural Networks in Agriculture, the core of artificial intelligence: What, When, and Why. Comput Electron Agric. 2025;230:109938. doi: 10.1016/j.compag.2025.109938
- Castillo O, Melin P, Valdez F, et al. A Review on the Role of Fuzzy Logic in Hybrid Intelligent Systems. Comput Sist. 2025;29(3):1723-1740. doi: 10.13053/cys-29-3-5897
- Liawrungrueang W, Cho S, Kotheeranurak V, Jitpakdee K, Kim P, Sarasombath P. Osteoporotic vertebral compression fracture (OVCF) detection using artificial neural networks model based on the AO spine-DGOU osteoporotic fracture classification system. N Am Spine Soc J. 2024;19:100515. doi: 10.1016/j.xnsj.2024.100515
- da Silva G, Roque R, Arreguín Sámano M, Dias N, Golzio A, Bonini Neto A. Multilayer Perceptron, Radial Basis Function, and Generalized Regression Networks Applied to the Estimation of Total Power Losses in Electrical Systems. Mach Learn Knowl Extr. 2026;8(1):4. doi: 10.3390/make8010004
- Karimov S, Sotvoldiyeva D, Khalilov D, Mamadaliyev N. Deep neural network for semantic segmentation of satellite images. In: International Scientific Conference on Green Energy. Vol 587. 2024:03006. doi: 10.1051/e3sconf/202458703006
- Melin P, Ramirez M, Castillo O. Clustering, Classification, and Time Series Prediction by Using Artificial Neural Networks. Springer; 2024. doi: 10.1007/978-3-031-71101-5
- Sayeh K, Tamalouzt S, Sahri Y, Belaid S, Bekhiti A. Artificial intelligence-based direct power control for power quality improvement in a WT-DFIG system via neural networks: Prediction and classification techniques. J Franklin Inst. 2025;362(1):107401. doi: 10.1016/j.jfranklin.2024.107401
- Semmad A, Bahoura M. Comparative study of respiratory sounds classification methods based on cepstral analysis and artificial neural networks. Comput Biol Med. 2024;171:108190. doi: 10.1016/j.compbiomed.2024.108190
- Conforti A, Ruggiero M, Lucchetti L, et al. Artificial Intelligence and Machine Learning in the Diagnosis and Management of Osteoporosis: A Comprehensive Review. Medicina. 2026;62(1):27. doi: 10.3390/medicina62010027
- Sabarish J. Artificial Neural Networks in Medical Diagnosis. Int J Res Publ Rev. 2024;5(6):2576-2579. doi: 10.55248/gengpi.5.0624.1505
- Castillo O. Review on Quantum Optimization of Type-1, Type-2 and Type-3 Fuzzy Systems. In: Artificial Intelligence and Quantum Computing: Early Innovations. Vol 1. Springer; 2025:235-244. doi: 10.1007/978-3-031-85614-3_12
- Valdez F, Castillo O, Melin P. A Bibliometric Review of Type-3 Fuzzy Logic Applications. Mathematics. 2025;13(3):375. doi: 10.3390/math13030375
- Rodrigues Lima-Junior F. Advances in Fuzzy Logic and Artificial Neural Networks. Mathematics. 2024;12(24):3949. doi: 10.3390/math12243949
- Liu J, Lv W, Sun Z, Song Q. Modified correlation coefficients of hesitant fuzzy sets based on proximity and their application in medical diagnosis. Comp Appl Math. 2026;45(1). doi: 10.1007/s40314-025-03383-9
- Sheth F, Mathur P, Gupta A, Chaurasia S. An advanced artificial intelligence framework integrating ensembled convolutional neural networks and Vision Transformers for precise soil classification with adaptive fuzzy logic-based crop recommendations. Eng Appl Artif Intell. 2025;158:111425. doi: 10.1016/j.engappai.2025.111425
- Park S, Kim T. Fuzzy Inference System for Interpretable Classification of Wafer Map Defect Patterns. Electronics. 2025;15(1):130. doi: 10.3390/electronics15010130
- Carreras J, Roncador G, Hamoudi R. Ulcerative Colitis, LAIR1 and TOX2 Expression, and Colorectal Cancer Deep Learning Image Classification Using Convolutional Neural Networks. Cancers. 2024;16(24):4230. doi: 10.3390/cancers16244230
- Giri L, Regmi P, Gurung G, et al. Diagnostic Accuracy of an Offline CNN Framework Utilizing Multi-View Chest X-Rays for Screening 14 Co-Occurring Communicable and Non-Communicable Diseases. Diagnostics. 2025;16(1):66. doi: 10.3390/diagnostics16010066
- Poma Y, Melin P. Momentum Adaptation in Convolutional Neural Networks Using a Fuzzy Gravitational Algorithm. In: Intelligent System Design Based on Soft Computing Models. Vol 1223. Springer; 2025:91-101. doi: 10.1007/978-3-031-97309-3_8
- Emraha A, Yildirimb Ö. Comparison of machine learning algorithms for automatic prediction of Alzheimer disease. J Chin Med Assoc. 2025;88(2):98-107. doi: 10.1097/JCMA.0000000000001188
- Srikanth M, Sunitha P, Puppala R, Asileti S, Akshaykranth A. A novel framework for intrusion detection in IOT networks using hybrid optimization algorithm and convolutional neural networks. Franklin Open. 2026;14:100461. doi: 10.1016/j.fraope.2025.100461
- Revathi K, Shirley C, Sreethar S, Ezhilarasi P. Brain tumor segmentation using optimized depth wise separable convolutional neural network with dense U-Net. Knowl Based Syst. 2025;324:113678. doi: 10.1016/j.knosys.2025.113678
- Rehman M, Aamir M, Nawi N, Khan A, Lashari S, Khan S. An Optimized Neural Network with Bat Algorithm for DNA Sequence Classification. Comput Mater Contin. 2022;73(1):493-511. doi: 10.32604/cmc.2022.021787
- Antonius F, Sekhar J, Rao V, et al. Unleashing the power of Bat optimized CNN-BiLSTM model for advanced network anomaly detection: Enhancing security and performance in IoT environments. Alex Eng J. 2023;84:333-342. doi: 10.1016/j.aej.2023.11.015
- Rashno A, Fadaei S. Convolutional neural networks optimization using multi-objective particle swarm optimization algorithm. Inf Sci. 2025;689:121443. doi: 10.1016/j.ins.2024.121443
- Jain S, Jain A, Jangid M. MGWO-CNN: hyperparameter optimization of CNN classifier for cervical cancer detection using Modified Grey Wolf Optimizer. Sci Rep. 2025;15(1):43514. doi: 10.1038/s41598-025-26047-4
- Ye J, Zhao Z, Ghafourian E, Tajally A, Alkhazaleh H, Lee S. Optimizing the topology of convolutional neural network (CNN) and artificial neural network (ANN) for brain tumor diagnosis (BTD) through MRIs. Heliyon. 2024;10(16):e35083. doi: 10.1016/j.heliyon.2024.e35083
- Naji R, Dulaimi H, Al-Khazraji H. An Optimized PID Controller Using Enhanced Bat Algorithm in Drilling Processes. J Eur Syst Autom. 2024;57(3):767-772. doi: 10.18280/jesa.570314
- Díaz-Bello D, Vargas-Salgado C, Montuori L, Alcázar- Ortega M. Cluster-based demand prediction: a hybrid approach with grey wolf optimizer and multilayer perceptron network. Clean Technol Environ Policy. 2025;27(12):8411- 8429. doi: 10.1007/s10098-025-03299-2
- Mohakud R, Dash R. Designing a grey wolf optimization based hyper-parameter optimized convolutional neural network classifier for skin cancer detection. J King Saud Univ Comput Inf Sci. 2022;34(8):6280-6291. doi: 10.1016/j.jksuci.2021.05.012
- Pulido M, Melin P, Castillo O. Design of Ensemble Neural Networks with Type-3 Fuzzy Aggregation using Particle Swarm Optimization and Genetic Algorithms for Ethereum Prediction. Comput Sist. 2025;29(3):1765-1783. doi: 10.13053/cys-29-3-5910
- Sánchez D, Melin P, Castillo O, Castro J. Optimal Genetic Design of Interval Type-3 Fuzzy Aggregators for Modular Neural Networks Applied to Human Recognition. Int J Fuzzy Syst. 2025;28:85-104. doi: 10.1007/s40815-024-01932-8
- Mazouzi A, Hadroug N, Hafaifa A, Iratni A, Colak I. Particle swarm optimization of fuzzy logic-based energy management system for enhanced efficiency in fuel cell hybrid electric vehicles. Sustain Comput Inform Syst. 2025;48:101239. doi: 10.1016/j.suscom.2025.101239
- Hong TY, Chen CC. Hyperparameter optimization for convolutional neural network by opposite-based particle swarm optimization and an empirical study of photomask defect classification. Appl Soft Comput. 2023;148:110904. doi: 10.1016/j.asoc.2023.110904
- Mumali F, Kałkowska J. Intelligent support in manufacturing process selection based on artificial neural networks, fuzzy logic, and genetic algorithms: Current state and future perspectives. Comput Ind Eng. 2024;193:110272. doi: 10.1016/j.cie.2024.110272
- Xu XF, Wang K, Ma WH, et al. Multi-objective particle swarm optimization algorithm based on multi-strategy improvement for hybrid energy storage optimization configuration. Renew Energy. 2024;223:120086. doi: 10.1016/j.renene.2024.120086
- Luo X, Wang W, Xu Y, et al. A deep convolutional neural network for diabetic retinopathy detection via mining local and long-range dependence. CAAI Trans Intell Technol. 2024;9:153-166. doi: 10.1049/cit2.12155
- Sorgente V, Correra S, Verrillo I, et al. NeoNet: A Novel Deep Learning Model for Retinal Disease Diagnosis and Localization. Sensors. 2025;25(19):6147. doi: 10.3390/s25196147
- El-Hag N, Sedik A, El-Shafai W, et al. Classification of retinal images based on convolutional neural network. Microsc Res Tech. 2021;84(3):394-414. doi: 10.1002/jemt.23596
- Kansal S, Mishra B, Sethi S, Vinayak K, Kansal P, Narayan J. RetinoDeep: Leveraging Deep Learning Models for Advanced Retinopathy Diagnostics. Sensors. 2025;25(16):5019. doi: 10.3390/s25165019
- Elhani D, Megherbi A, Zitouni A, Dornaika F, Sbaa S, Taleb-Ahmed A. Optimizing convolutional neural networks architecture using a modified particle swarm optimization for image classification. Expert Syst Appl. 2023;229:120411. doi: 10.1016/j.eswa.2023.120411
- Melin P, Sánchez D, Cordero-Martínez R. Particle Swarm Optimization of Convolutional Neural Networks for Diabetic Retinopathy Classification. In: Fuzzy Logic and Neural Networks for Hybrid Intelligent System Design. Studies in Computational Intelligence. Vol 1061. Springer; 2023:237- 252. doi: 10.1007/978-3-031-22042-5_14
- Ibrahim AL, Fathi BG, Abdulrazzaq MB. Improving the Adam optimizer via projection-based gradient correction in deep learning. Knowl Based Syst. 2026;336:115267. doi: 10.1016/j.knosys.2026.115267
- Cheng W, Pu R, Wang B. AMC: Adaptive Learning Rate Adjustment Based on Model Complexity. Mathematics. 2025;13(4):650. doi: 10.3390/math13040650
- Wu T, Dong Q, Yu W, Li Z, Guo M. A general learning rate improvement strategy for deep neural networks training. Complex Intell Syst. 2026;12:106. doi: 10.1007/s40747-026-02226-2
- Feng L, Hao G, Jian W. Efficient hybrid fuzzy weighted 3D FCNN with TSO PSO optimization for accurate multi modal MRI brain tumor classification. Sci Rep. 2025;15:36037. doi: 10.1038/s41598-025-19889-5
- Sobhanifard F. Optimization of Bayesian Neural Networks using hybrid PSO and fuzzy logic approach for time series forecasting. Discov Artif Intell. 2025;5:132. doi: 10.1007/s44163-025-00322-9
- Aggarwal C. Neural Networks and Deep Learning: A Textbook. Springer; 2023. doi: 10.1007/978-3-031-29642-0
- Goodfellow I, Bengio Y, Courville A. Deep Learning. MIT Press; 2016. Available from: https://mitpress.mit. edu/9780262035613/deep-learning/ [Last accessed on October 11, 2025].
- Zafar A, Aamir M, Nawi N, et al. A Comparison of Pooling Methods for Convolutional Neural Networks. Appl Sci. 2022;12(17):8643. doi: 10.3390/app12178643
- Linke M, Meßmer T, Micard G, Schubert G. Power grid operation in distribution grids with convolutional neural networks. Smart Energy. 2025;17:100169. doi: 10.1016/j.segy.2024.100169
- Ozturk S. Convolutional Neural Networks for Medical Image Processing Applications. 1st ed. CRC Press; 2022. doi: 10.1201/9781003215141
- Zadeh L. Fuzzy sets. Inf Control. 1965;8(3):338-353. doi: 10.1016/s0019-9958(65)90241-x
- Masjedy H, Reza Adel S. Fuzzy logic theory: A unifying pathway to intelligent accountability in addressing methodological challenges of applied linguistics. Res Methods Appl Linguist. 2025;4(3):100278. doi: 10.1016/j.rmal.2025.100278
- Saatchi R. Fuzzy Logic Concepts, Developments and Implementation. Information. 2024;15(10):656. doi: 10.3390/info15100656
- Eberhart R, Kennedy J. A new optimizer using particle swarm theory. In: MHS’95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science. IEEE; 1995:39-43. doi: 10.1109/mhs.1995.494215
- Liu W, Bai Y, Zhang C, Wang Z, Yang A, Wu M. PSO-DFNN: A particle swarm optimization enabled deep fuzzy neural network for predicting the pellet strength. Alex Eng J. 2024;106:505-516. doi: 10.1016/j.aej.2024.08.069
- Kowalski P, Słoczyński T. A modified particle swarm optimization procedure for triggering fuzzy flip-flop neural networks. Int J Appl Math Comput Sci. 2021;31(4):577-586. doi: 10.34768/amcs-2021-0039
- Engelbrecht AP. Fundamentals of Computational Swarm Intelligence. Wiley; 2005.
- Eberhart R, Shi Y. Comparing Inertia Weights and Constriction Factors in Particle Swarm Optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation. Vol 1. 2000:84-88. doi: 10.1109/cec.2000.870279
- Xin J, Chen G, Hai Y. A Particle Swarm Optimizer with Multi-stage Linearly-Decreasing Inertia Weight. In: 2009 International Joint Conference on Computational Sciences and Optimization. 2009:505-508. doi: 10.1109/cso.2009.420
- Kingma D, Ba J. Adam: A Method for Stochastic Optimization. arXiv. Preprint posted online 2014. doi: 10.48550/arXiv.1412.6980
- Sánchez D. Optimization of Interval Type-3 Fuzzy Inference Systems Using a Genetic Algorithm Applied to Medical Classification. In: Modern Artificial Intelligence Based on Soft Computing Techniques. Vol 1204. Springer; 2025:381-394. doi: 10.1007/978-3-031-88279-1_24
- Asia Pacific Tele-Ophthalmology Society. APTOS 2019 Blindness Detection. Kaggle. Available from: https://www. kaggle.com/c/aptos2019-blindness-detection [Last accessed on October 11, 2025].
- Gangwar A, Ravi V. Diabetic retinopathy detection using transfer learning and Deep Learning. In: Evolution in Computational Intelligence. Vol 1176. Springer; 2021:679- 689. doi: 10.1007/978-981-15-5788-0_64
- Aslan E, Özüpak Y, Alpsalaz F, Elbarbary ZMS. A Hybrid Machine Learning Approach for Predicting Power Transformer Failures Using Internet of Things-Based Monitoring and Explainable Artificial Intelligence. IEEE Access. 2025;13:113618-113633. doi: 10.1109/ACCESS.2025.3583773
- Kassani SH, Kassani PH, Khazaeinezhad R, Wesolowski MJ, Schneider KA, Deters R. Diabetic Retinopathy Classification Using a Modified Xception Architecture. In: 2019 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT). IEEE; 2019:1-6. doi: 10.1109/isspit47144.2019.9001846
