zbMATH — the first resource for mathematics

Enhancing software reliability modeling and prediction through the introduction of time-variable fault reduction factor. (English) Zbl 1202.90102
Summary: Over the past three decades, many software reliability models with different parameters, reflecting various testing characteristics, have been proposed for estimating the reliability growth of software products. We have noticed that one of the most important parameters controlling software reliability growth is the fault reduction factor (FRF) proposed by Musa. FRF is generally defined as the ratio of net fault reduction to failures experienced. During the software testing process, FRF could be influenced by many environmental factors, such as imperfect debugging, debugging time lag, etc. Thus, in this paper, we first analyze some real data to observe the trends of FRF, and consider FRF to be a time-variable function. We further study how to integrate time-variable FRF into software reliability growth modeling. Some experimental results show that the proposed models can improve the accuracy of software reliability estimation. Finally, sensitivity analyses of various optimal release times based on cost and reliability requirements are discussed. The analytic results indicate that adjusting the value of FRF may affect the release time as well as the development cost.

90B25 Reliability, availability, maintenance, inspection in operations research
68N30 Mathematical aspects of software engineering (specification, verification, metrics, requirements, etc.)
62N05 Reliability and life testing
Full Text: DOI
[1] Xie, M., Software reliability modeling, (1991), World Scientific Publishing · Zbl 0824.68025
[2] Pham, H., Software reliability, (2000), Springer · Zbl 0943.68007
[3] Lyu, M.R., Handbook of software reliability engineering, (1996), McGraw-Hill
[4] P. Carnes, Software reliability in weapon systems, in: Proceedings of the 8th International Symposium On Software Reliability Engineering (ISSRE 1997), Albuquerque, NM, USA, November 1997, pp. 114-115.
[5] Schneidewind, N.F.; Keller, T.W., Application of reliability models to the space shuttle, IEEE softw., 9, 4, 28-33, (1992)
[6] Almering, V.; van Genuchten, M.; Cloudt, G.; Sonnemans, P.J.M., Using software reliability growth models in practice, IEEE softw., 24, 6, 82-88, (2007)
[7] Ehrlich, W.K.; Lee, K.; Molisani, R.H., Applying reliability measurements: a case study, IEEE softw., 7, 2, 56-64, (1990)
[8] W.D. Jones, Reliability models for very large software systems in industry, in: Proceedings of the Second International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 35-42.
[9] Musa, J.D., A theory of software reliability and its application, IEEE trans. softw. eng., SE-1, 3, 312-327, (1975)
[10] Musa, J.D.; Iannino, A.; Okumoto, K., Software reliability: measurement, prediction, application, (1987), McGraw-Hill
[11] Musa, J.D., The measurement and management of software reliability, Proc. IEEE, 68, 9, 1131-1143, (1980)
[12] Musa, J.D., Software reliability engineering: more reliable software, faster and cheaper, (2004), Authorhouse
[13] P.A. Hamilton, J.D. Musa, Measuring reliability of computation center software, in: Proceedings of the Third International Conference on Software Engineering (ICSE 1978), Atlanta, GA, USA, May 1978, pp. 29-36.
[14] M.J. Fries, Software Error Data Acquisition, Technical Report, Rome Air Development Center, 1977, RADC-TR-77-130.
[15] D.M. Weiss, Evaluating Software Development by Analysis of Change Data, Computer Science Technical Report, University of Maryland, 1981, TR-1120.
[16] Basili, V.R.; Perricone, B.T., Software errors and complexity: an empirical investigation, Commun. ACM, 27, 1, 42-52, (1984)
[17] Friedman, M.A.; Tran, P.Y.; Goddard, P.L., Reliability of software intensive systems, (1995), Noyes Publications
[18] K. Wu, Y.K. Malaiya, The effect of correlated faults on software reliability, in: Proceedings of the 4th International Symposium on Software Reliability Engineering (ISSRE 1993), Denver, CO, USA, November 1993, pp. 80-89.
[19] M.C. Chen, H.P. Wu, H.J. Shyur, Analyzing software reliability growth model with imperfect-debugging and change-point by genetic algorithms, in: Proceedings of the 29th International Conference on Computers and Industrial Engineering (ICC&IE 2001), Montreal, Canada, November 2001, pp. 520-526.
[20] Jones, C., Software defect-removal efficiency, IEEE comput., 29, 4, 94-95, (1996)
[21] Zhang, X.; Shin, M.Y.; Pham, H., Exploratory analysis of environmental factors for enhancing the software reliability assessment, J. syst. softw., 57, 1, 73-78, (2001)
[22] Chiu, K.C.; Huang, Y.S.; Lee, T.Z., A study of software reliability growth from the perspective of learning effects, Reliab. eng. syst. saf., 93, 10, 1410-1421, (2008)
[23] Kapur, P.K.; Goswami, D.N.; Bardhan, A.; Singh, O., Flexible software reliability growth model with testing effort dependent learning process, Appl. math. model., 32, 7, 1298-1307, (2008) · Zbl 1183.68194
[24] Goel, A.L., Software reliability models: assumptions, limitations, and applicability, IEEE trans. softw. eng., 11, 12, 1411-1423, (1985)
[25] Huang, C.Y.; Lyu, M.R.; Kuo, S.Y., A unified scheme of some nonhomogenous Poisson process models for software reliability estimation, IEEE trans. softw. eng., 29, 3, 261-269, (2003)
[26] M. Ohba, X.M. Chou, Does imperfect debugging affect software reliability growth? in: Proceedings of the 11th IEEE International Conference on Software Engineering (ICSE 1989), Pittsburgh, PA, USA, May 1989, pp. 237-244.
[27] Lin, C.T.; Huang, C.Y., Enhancing and measuring the predictive capabilities of testing-effort dependent software reliability models, J. syst. softw., 81, 6, 1025-1038, (2008)
[28] Wu, Y.P.; Hu, Q.P.; Xie, M.; Ng, S.H., Modeling and analysis of software fault detection and correction process by considering time dependency, IEEE trans. reliab., 56, 4, 629-642, (2007)
[29] Tamura, Y.; Yamada, S., A flexible stochastic differential equation model in distributed development environment, Eur. J. oper. res., 168, 1, 143-152, (2006) · Zbl 1077.90020
[30] T.M. Khoshgoftaar, T.G. Woodcock, Software reliability model selection: a case study, in: Proceedings of the Second IEEE International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 183-191.
[31] Ohba, M., Software reliability analysis models, IBM J. res. dev., 28, 4, 428-443, (1984)
[32] Malaiya, Y.K.; von Mayrhauser, A.; Srimani, P.K., An examination of fault exposure ratio, IEEE trans. softw. eng., 19, 11, 1087-1094, (1993)
[33] N. Li, Y.K. Malaiya, Fault exposure ratio estimation and applications, in: Proceedings of the Seventh International Symposium on Software Reliability Engineering (ISSRE 1996), White Plains, NY, USA, November 1996, pp. 372-381.
[34] Musa, J.D., Rationale for fault exposure ratio K, ACM SIGSOFT softw. eng. notes, 16, 3, 79, (1991)
[35] Shyur, H.J., A stochastic software reliability model with imperfect-debugging and change-point, J. syst. softw., 66, 2, 135-141, (2003)
[36] Chang, Y.C.; Liu, C.T., A generalized JM model with applications to imperfect debugging in software reliability, Appl. math. model., 33, 9, 3578-3588, (2009) · Zbl 1185.68239
[37] Huang, C.Y.; Lin, C.T., Software reliability analysis by considering fault dependency and debugging time lag, IEEE trans. reliab., 55, 3, 436-450, (2006)
[38] Xie, M.; Hu, Q.P.; Wu, Y.P.; Ng, S.H., A study of the modeling and analysis of software fault-detection and fault-correction processes, Qual. reliab. eng. int., 23, 4, 459-470, (2007)
[39] Lo, J.H.; Huang, C.Y., An integration of fault detection and correction processes in software reliability analysis, J. syst. softw., 79, 9, 1312-1323, (2006)
[40] Keller, G., Statistics for management and economics, (2008), South-Western College
[41] SourceForge.net, An Open Source Software Website. 2008. Available from: <http://sourceforge.net> (cited last accessed 11.12.08).
[42] K.Z. Yang, An Infinite Server Queueing Model for Software Readiness Assessment and Related Performance Measures, Ph.D. Dissertation, Department of Electrical Engineering and Computer Sciencein, Syracuse University, NY, USA, 1996.
[43] Huang, C.Y., Cost-reliability-optimal release policy for software reliability models incorporating improvements in testing efficiency, J. syst. softw., 77, 2, 139-155, (2005)
[44] Huang, C.Y.; Lin, C.T., Analysis of software reliability modeling considering testing compression factor and failure-to-fault relationship, IEEE trans. comput., 59, 2, 283-288, (2010) · Zbl 1368.68180
[45] X. Li, M. Xie, S.H. Ng, Sensitivity Analysis of Release Time of Software Reliability Models Incorporating Testing Effort with Multiple Change-Points, Applied Mathematical Modelling, in press. doi:10.1016/j.apm.2010.1003.1000. · Zbl 1201.68038
[46] C.C. Chen, C.T. Lin, H.H. Huang, S.W. Huang, C.Y. Huang, CARATS: a computer-aided reliability assessment tool for software based on object-oriented design, in: Proceedings of IEEE Region 10 Conference (TENCON 2006), Hong Kong, China, November 2006, pp. 1-4.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.