Материал: + An Orchestrated Survey on Automated Software TestCase Generation

symbolic specifications, in: Grabowski and Nielsen (2005). pp. 1–15. Fraser, G. and Zeller, A., 2010. Mutation-driven generation of unit tests and

oracles. In:Proc. of the 19th International Symposium on Software Testing and Analysis (ISSTA’10), pp. 147–158. ACM.

Fraser, G. and Zeller, A., 2011. Exploiting common object usage in test case generation. In:Proc. of the International Conference on Software Testing, Verification and Validation (ICST’11), pp. 80–89. IEEE.

Free Software Foundation, 2012. GNU GCC compiler collection, Available at http://gcc.gnu.org/.

Friedman, G., Hartman, A., Nagin, K., Shiran, T., 2002. Projected state machine coverage for software testing. In: Proc. of the 2002 International Symposium on Software Testing and Analysis (ISSTA’02), pp. 134–143.

Ganesh, V., Dill, D. L., 2007. A decision procedure for bit-vectors and arrays. In: Proc. of the 19th International Conference on Computer Aided Verification (CAV’07), pp. 519–531.

Ganov, S. R., Killmar, C., Khurshid, S., Perry, D. E., 2008. Test generation for graphical user interfaces based on symbolic execution. In: Proc. of the 3rd IEEE/ACM International Workshop on Automation of Software Test (AST’08), pp. 33–40.

Garvin, B. J., Cohen, M. B., Dwyer, M. B., 2011. Evaluating improvements to a meta-heuristic search for constrained interaction testing. Empirical Software Engineering (EMSE) 16 (1), 61–102, Feb.

Gaudel, M. C., 1995. Testing can be formal, too. In: Mosses, P. D., Nielsen, M., Schwartzbach, M.I. (Eds.), TAPSOFT’95: Proc. of the 6th International Joint Conference on Theory and Practice of Software Development, LNCS 915, pp. 82–96. Springer.

Glover, F., Kochenberger, G. (Eds.), 2003. Handbook of Metaheuristics. Springer.

Godefroid, P., 2007. Compositional dynamic test generation. In: Proc. of the 34th annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL’07), pp. 47–54.

Godefroid, P., Kiezun, A., Levin, M. Y., 2008a. Grammar-based whitebox fuzzing. In: Proc. of the ACM SIGPLAN 2008 Conference on Programming Language Design and Implementation (PLDI’08), pp. 206–215.

Godefroid, P., Klarlund, N. and Sen, K., 2005. DART: directed automated random testing. In: V. Sarkar and M. W. Hall, editors, Proc. of the ACM

SIGPLAN 2005 ConferenceAcceptedon Programming Language Design and Imple-

mentation (PLDI’05), pp. 213–223. ACM.

Godefroid, P., Levin, M. Y., Molnar, D. A., 2008b. Automated whitebox fuzz testing. In: Proc. of the 15th Annual Network and Distributed System Security Symposium (NDSS’08).

Godefroid, P., Luchaup, D., 2011. Automatic partial loop summarization in dynamic test generation. In: Proc. of the 2011 International Symposium on Software Testing and Analysis (ISSTA’11, pp. 23–33.

Godefroid, P., Taly, A., 2012. Automated synthesis of symbolic instruction encodings from I/O samples. In: Proc. of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’12, pp. 441– 452.

Grabowski, J., Nielsen, B. (Eds.), 2005. Formal Approaches to Software Testing, 4th International Workshop, FATES 2004, Linz, Austria, September 21, 2004, Revised Selected Papers. LNCS 3395, Springer.

Grechanik, M., Csallner, C., Fu, C., Xie, Q., 2010. Is data privacy always good for software testing?, in: Proc. of the IEEE 21st International Symposium on Software Reliability Engineering (ISSRE’10), pp. 368–377.

Grieskamp, W., 2006. Multi-paradigmatic model-based testing. In: (Havelund et al., 2006), pp. 1–19.

Grieskamp, W., Gurevich, Y., Schulte, W., Veanes, M., 2002. Generating fi- nite state machines from abstract state machines. In: Proc. of the 2002 International Symposium on Software Testing and Analysis (ISSTA’02), pp. 112–122.

Grieskamp, W., Hierons, R. M., Pretschner, A., 2011a. 10421 Summary

– Model-Based Testing in Practice, in: Grieskamp, W., Hierons, R. M., Pretschner, A. (Eds.), Model-Based Testing in Practice, Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany, Dagstuhl, Germany. URL http://drops.dagstuhl.de/opus/volltexte/2011/2925.

Grieskamp, W., Kicillof, N., 2006. A schema language for coordinating construction and composition of partial behavior descriptions. In: Whittle, J., Geiger, L., Meisinger, M. (Eds.), Proc. of the 2006 International Workshop on Scenarios and State Machines: Models, Algorithms, and Tools (SCESM’06), ACM. pp. 59–66.

Grieskamp, W., Kicillof, N., Stobie, K., Braberman, V. A., 2011b. Model-

based quality assurance of protocol documentation: tools and methodology. Software Testing, Verification and Reliability (STVR) 21, 55–71.

Grieskamp, W., Kicillof, N., Tillmann, N., 2006a. Action machines: a framework for encoding and composing partial behaviors. International Journal of Software Engineering and Knowledge Engineering 16, 705–726.

Grieskamp, W., Nachmanson, L., Tillmann, N., Veanes, M., 2003. Test case generation from AsmL specifications. In: Borger,¨ E., Gargantini, A., Riccobene, E. (Eds.), Abstract State Machines, Springer. p. 413.

Grieskamp, W., Qu, X., Wei, X., Kicillof, N., Cohen, M. B., 2009. Interaction coverage meets path coverage by smt constraint solving. In: Nu´nez,˜ M., Baker, P., Merayo, M.G. (Eds.), Proc. of the Joint Conference of the 21st

ManuscriptIFIP International Conference on Testing of Communicating Systems and pp. 185–196.

9th International Workshop on Formal Approaches to Testing of Software (TESTCOM/FATES’09), LNCS 5826, pp. 97–112. Springer.

Grieskamp, W., Tillmann, N., Schulte, W., 2006b. XRT - exploring runtime for

.net - architecture and applications. Electr. Notes Theor. Comput. Sci. 144,

3–26.

Grieskamp, W., Tillmann, N., Veanes, M., 2004. Instrumenting scenarios in a model-driven development environment. Information & Software Technol-

ogy 46, 1027–1036.

Grosso, C. D., Antoniol, G., Penta, M. D., Galinier, P. and Merlo, E., 2005. Improving network applications security: a new heuristic to generate stress testing data. In: GECCO 2005: Proc. of the 2005 conference on Genetic

and evolutionary computation, volume 1, pp. 1037–1043. ACM.

Groz, R., Charles, O., Renevot,´ J., 1996. Relating conformance test coverage to formal specifications. In: Gotzhein, R., Bredereke, J. (Eds.), Proc. of the IFIP TC6/6.1 International Conference on Formal Description Techniques IX/Protocol Specification, Testing and Verification XVI (FORTE’96), pp.

195–210. Chapman & Hall.

Harman, M., 2008. Open problems in testability transformation. In: Proc. of the 1st International Workshop on Search Based Testing (SBT’08), Keynote

paper.

Harman, M., 2011. Software engineering meets evolutionary computation.

IEEE Computer, 44(10), 31–39.

Harman, M., Islam, F., Xie, T. and Wappler, S., 2009. Automated test

data generation for aspect-oriented programs. In: Proc. of the 8th International Conference on Aspect-Oriented Software Development (AOSD’09),

Harman, M., Jia, Y. and Langdon, B.,2011. Strong higher order mutationbased test data generation. In: Proc. of the 8th European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE ’11), pp. 212–222. ACM.

Harman, M. and Jones, B. F., 2001. Search based software engineering. Information and Software Technology 43(14):833–839.

Harman, M., Kim, S. G., Lakhotia, K., McMinn, P. and Yoo, S., 2010. Optimizing for the number of tests generated in search based test data generation with an application to the oracle cost problem. In: Proc. of the 3rd International Workshop on Search-Based Software Testing (SBST’10), pp. 182 - 191.

Harman, M., Lakhotia, K. and McMinn, P., 2007. A multi-objective approach to search-based test data generation. In: Proc. of the 9th Annual Conference on Genetic and Evolutionary Computation(GECCO’07), pp. 1098 – 1105. ACM Press.

Harman, M., Mansouri, A. and Zhang, Y., 2009. Search based software engineering: A comprehensive analysis and review of trends techniques and applications. Technical Report TR-09-03, Department of Computer Science, King’s College London, April.

Harman, M. and McMinn, P., 2010. A theoretical and empirical study of search based testing: Local, global and hybrid search. IEEE Transactions on Software Engineering 36(2), 226–247.

Hartman, A., 2002. Model-Based Test Generation Tools. Technical Report. AGEDIS Consortium. http://www.agedis.de/documents/ ModelBasedTestGenerationTools_cs.pdf.

Hartman, A. and Raskin, L., 2004. Problems and algorithms for covering arrays. Discrete Math 284, 149 – 156.

Hartmann, J., Vieira, M., Foster, H., Ruder, A., 2005. A UML-based approach to system testing. Innovations in Systems and Software Engineering (ISSE) 1(1), 12–24.

Havelund, K., Nu´nez,˜ M., Rosu, G., Wol , B. (Eds.), 2006. Formal Approaches to Software Testing and Runtime Verification, First Combined International Workshops, FATES 2006 and RV 2006, Seattle, WA, USA, August 15-16,

2006, Revised Selected Papers. LNCS 4262, Springer.

Helke, S., Neustupny, T., Santen, T., 1997. Automating test case generation from Z specifications with Isabelle. In: Bowen, J.P., Hinchey, M.G., Till, D. (Eds.), Proc. of the 10th International Conference of Z Users on The Z Formal Specification Notation (ZUM’97), pp. 52–71.Springer.

Hemmati, H., Arcuri, A., and Briand, L. 2010. Reducing the cost of modelbased testing through test case diversity. In: Proc. of the 22nd IFIP International Conference on Testing Software and System (ICTSS’10), pp. 63–78.

Hemmati, H., Arcuri, A. and Briand, L. 2011. Empirical investigation of the e ects of test suite properties on similarity-based test case selection. In: Proc. of the 4th International Conference on Software Testing, Verification and Validation (ICST’11, pp. 327–336.

Hierons, R. M., 2010. Reaching and distinguishing states of distributed systems. SIAM J. Comput. 39, 3480–3500.

Hierons, R. M., Merayo, M. G., Nu´nez,˜ M., 2008. Implementation relations for the distributed test architecture. In: Suzuki, K., Higashino, T., Ulrich, A., Hasegawa, T. (Eds.), Testing of Software and Communicating Systems: Proc. of the Joint Conference of the 20th IFIP TC 6/WG 6.1 International Conference on Testing of Software and Communicating Systems and the 8th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES’08).. LNCS 5047, pp. 200–215.Springer.

Hierons, R. M., Ural, H., 2008. The e ect of the distributed test architecture on the power of testing. Comput. J. 51, 497–510.

Hnich, B., Prestwich, S., Selensky, E., Smith, B., 2006. Constraint models for the covering test problem. Constraints 11, 199–219.

Huima, A., 2007. Implementing conformiq qtronic. In: Petrenko, A., Veanes, M., Tretmans, J., Grieskamp, W. (Eds.), Testing of Software and Communicating Systems: Proc. of the Joint Conference of the 19th IFIP International Conference on Testing of Communicating Systems and 7th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES’07), LNCS 4581, pp. 1–12.Springer.

Huo, J., Petrenko, A., 2005. Covering transitions of concurrent systems through queues. In: Proc. of the 16th IEEE International Symposium on Software Reliability Engineering, (ISSRE’05), pp. 335–345.

Inkumsah, K. and Xie, T., 2007. Evacon: a framework for integrating evolutionary and concolic testing for object-oriented programs. In: Stirewalt,

R. E. K., Egyed, A. and Fischer,AcceptedB., editors, Proc. of the 22nd IEEE/ACM In-

ternational Conference on Automated Software Engineering (ASE’07), pp. 425–428. ACM.

Iqbal, M. Z., Arcuri, A. and Briand, L. 2011. Automated system testing of realtime embedded systems based on environment models. Technical Report 2011-19, Simula Research Laboratory.

Jard, C., Jeron,´ T., 2005. TGV: theory, principles and algorithms. International Journal on Software Tools for Technology Transfer (STTT) 7, 297–315.

Jayaraman, K., Harvison, D., Ganeshan, V., Kiezun, A., 2009. A concolic whitebox fuzzer for Java. In: Proc. of the 1st NASA Formal Methods Symposium, pp. 121–125.

Jeannet, B., Jeron,´ T., Rusu, V., Zinovieva, E., 2005. Symbolic test selection based on approximate analysis. In: Halbwachs, N., Zuck, L.D. (Eds.), Proc. of the 11th international conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’05), pp. 349–364. Springer.

Kaplan, M., Klinger, T., Paradkar, A. M., Sinha, A., Williams, C., Yilmaz, C., 2008. Less is more: A minimalistic approach to UML model-based conformance test generation. In: Proc. of The 1st IEEE International Conference on Software Testing Verification and Validation (ICST’08), pp. 82–91.IEEE Computer Society.

Katara, M., Kervinen, A., 2006. Making model-based testing more agile: A use case driven approach. In: Bin, E., Ziv, A., Ur, S. (Eds.), Haifa Verification Conference, pp. 219–234. Springer.

Kahk¨onen,¨ K., Launiainen, T., Saarikivi, O., Kauttio, J., Heljanko, K., Niemela,¨ I., 2011. LCT: An open source concolic testing tool for Java programs. In: Proc. of the 6th Workshop on Bytecode Semantics, Verification, Analysis and Transformation (Bycode’11), pp. 75–80.

Khurshid, S., Pasareanu, C., Visser, W., 2003. Generalized symbolic execution for model checking and testing. In: Proc. of the 9th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’03), pp. 553–568.

Khurshid, S., Suen, Y. L., 2005. Generalizing symbolic execution to library classes, in: Proc. of the 6th Workshop on Program Analysis for Software Tools and Engineering (PASTE’05), pp. 103–110.

King, J. C., 1975. A new approach to program testing. In: Programming

Methodology. LNCS Vol. 23, pp. 278–290.

Kuhn, D., Higdon, J., Lawrence, J., Kacker, R., Lei,, Y., 2012. Combinatorial methods for event sequence testing. In: Proc. of the 5th IEEE International Conference on Software Testing, Verification and Validation (ICST ’12), pp. 601-609.

Kuhn, D. and Okun, V., 2006. Pseudo-exhaustive testing for software. In: Proc. of the 30th NASA/IEEE Software Engineering Workshop (SEW’06), pp. 153–158.

Kuhn, D., Wallace, D. R., Gallo, A. M., 2004. Software fault interactions and implications for software testing. IEEE Transactions on Software Engineering 30 (6), 418–421.

Kuliamin,ManuscriptV. V., Petrenko, A. K., Kossatchev, A., Burdonov, I. B., 2003. The UniTesK approach to designing test suites. Programming and Computer

Software 29, 310–322.

Kuo, F.-C., 2006. On Adaptive Random Testing. PhD thesis, Faculty of Information and Communication Technologies, Swinburne University of Technology.

Lakhotia, K., Harman, M. and McMinn, P., 2008. Handling dynamic data structures in search based testing. In: Proc. of the 10th annual conference on Genetic and evolutionary computation (GECCO’08), pp. 1759 – 1766. ACM Press.

Lakhotia,K., McMinn,P. and Harman, M., 2010. An empirical investigation into branch coverage for C programs using CUTE and AUSTIN. Journal of Systems and Software, 83(12), 2379–2391.

Lakhotia, K., Tillmann, N., Harman, M., de Halleux, J., 2010. Flopsy - Searchbased floating point constraint solving for symbolic execution. In: Proc. of the 23rd IFIP International Conference on Testing Software and Systems (ICTSS’10), pp. 142–157.

Larsen, K. G., Mikucionis, M., Nielsen, B., 2004. Online testing of real-time systems using UPPAAL, in: Grabowski and Nielsen (2005). pp. 79–94. pp. 79–94.

Lee, D., Yannakakis, M., 1996. Principles and methods of testing finite state machines - a survey. In: Proceedings of the IEEE 84(8), 1090–1123. IEEE Computer Society Press.

Legeard, B., Peureux, F., Utting, M., 2002. Automated boundary testing from Z and B. In: Eriksson, L. H., Lindsay, P. A. (Eds.), FME 2002:Formal methods-Getting IT Right, LNCS 2391, pp. 21–40. Springer.

Legeard, B., Utting, M., 2010. Model-based testing – next generation functional

software testing. Journal of Software Technology 12. http://journal. thedacs.com/issue/52/145.

Lei, Y., Kacker, R., Kuhn, D. R., Okun, V., Lawrence, J., 2008. Ipog-ipog- d: e cient test generation for multi-way combinatorial testing. Software Testing Verification and Reliability 18, 125–148.

Lin, Y., Tang, X., Chen, Y. and Zhao, J., 2009. A divergence-oriented approach to adaptive random testing of Java programs. In: Proc. of the 2009 IEEE/ACM International Conference on Automated Software Engineering (ASE’09), pp. 221–232.

Liu, M.-H., Gao, Y.-F., Shan, J.-H., Liu, J.-H., Zhang, L. and Sun, J.-S.,2006. An Approach to Test Data Generation for Killing Multiple Mutants. In: Proc. of the 22nd IEEE International Conference on Software Maintenance (ICSM’06), pp. 113–122.

Liu, H., Xie, X., Yang, J., Lu, Y., and Chen, T. Y. 2011. Adaptive random testing through test profiles. Software: Practice and Experience, 41(10), 1131–1154.

Ma, K. K., Khoo, Y. P., Foster, J. S., Hicks, M., 2011. Directed symbolic execution. In: Proc. of the 18th International Conference on Static Analysis (SAS’11), pp. 95–111.

Malaiya, Y. K., 1995. Antirandom testing: Getting the most out of black-box testing. In: Proc. of the 6th International Symposium on Software Reliability Engineering (ISSRE’95, pp. 86–95.

Mandl, R., 1985. Orthogonal Latin squares: an application of experiment design to compiler testing. Communications of the ACM 28 (10), 1054–1058.

Majumdar, R., Saha, I., 2009. Symbolic robustness analysis. In: Proc. of the 30th IEEE Real-Time Systems Symposium (RTSS’09), pp. 355–363.

Majumdar, R., Sen, K., 2007. Hybrid concolic testing. In: Proc. of the 29th International Conference on Software Engineering (ICSE’07), pp. 416–426.

Majumdar, R., Xu, R. G., 2007. Directed test generation using symbolic grammars. In: Proc. of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE’07), pp. 134–143.

Majumdar, R., Xu, R. G., 2009. Reducing test inputs using information partitions. In: Proc. of the 21st International Conference on Computer Aided

Verification (CAV’09), pp. 555–569.

Mayer, J., 2005. Lattice-based adaptive random testing. In: Proc. of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE’05), pp. 333–336.

McGregor, J. D., 2001. Testing a software product line. Tech. rep. No. cmu/sei- 2001-tr-022, Carnegie Mellon Software Engineering Institute.

McMinn, P., 2004. Search-based software test data generation: A survey. Software Testing, Verification and Reliability 14(2), 105–156.

McMinn, P., 2011. Search-based software testing: Past, present and future. In: Proc. of the 4th International Workshop on Search-Based Software Testing (SBST 2011), pp. 153–163. IEEE.

McMinn, P., Binkley, D. and Harman, M., 2009. Empirical evaluation of a nesting testability transformation for evolutionary testing. ACM Transactions on Software Engineering Methodology, 18(3), 11:1–11:27.

McMinn, P., Harman, M., Hassoun, Y., Lakhotia, K. and Wegener, J., 2012. Input domain reduction through irrelevant variable removal and its e ect on local, global and hybrid search-based structural test data generation. IEEE Transactions on Software Engineering 38(2), 453–477.

McMinn, P., Shahbaz, M. and Stevenson, M., 2012. Search-based test input generation for string data types using the results of web queries. In: Proc. of the 5th International Conference on Software Testing, Verification and Validation (ICST’12).

McMinn, P., Stevenson, M. and Harman, M., 2010. Reducing qualitative human oracle costs associated with automatically generated test data. In:Proc. of the 1st International Workshop on Software Test Output Validation (STOV’10), pp. 1–4.

Merkel, R. G., 2005. Analysis and Enhancements of Adaptive Random Testing. PhD thesis, School of Information Technology, Swinburne University of Technology.

Michael, C., McGraw, G. and Schatz, M., 2001. Generating software test data by evolution. IEEE Transactions on Software Engineering 27(12), 1085– 1110.

de Moura, L. M., Bjørner, N., 2008. Z3: An e cient SMT solver. In: Proc. of the 14th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’08), pp. 337–340.

Nachmanson, L., Veanes, M., Schulte, W., Tillmann, N., Grieskamp, W., 2004.

Optimal strategies for testingAcceptednondeterministic systems. In: Avrunin, G. S.,

Rothermel, G. (Eds.), Proc. of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’04), pp. 55–64.

Naito, S., Tsunoyama, M., 1981. Fault detection for sequential machines by transition-tours. In: Proc. of the 11th annual International Symposium on Fault-Tolerant Computing (FTCS’81), pp. 238–243.

Ngo, M. N., Tan, H. B. K., 2007. Detecting large number of infeasible paths through recognizing their patterns. In: Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, pp. 215–224.

Nguyen, C., Perini, A., Tonella, P., Miles, S., Harman, M. and Luck, M., 2009. Evolutionary testing of autonomous software agents. In: Proc. of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’09), pp. 521–528.

Nie, C. , Leung, H. , 2011. A survey of combinatorial testing. ACM Computing Surveys 43 (2), 1–29.

Nielsen, B., Skou, A., 2003. Automated test generation from timed automata. International Journal on Software Tools for Technology Transfer (STTT) 5, 59–77.

Nurmela, K., 2004. Upper bounds for covering arrays by tabu search. Discrete Applied Mathematics 138 (1-2), 143–152.

O utt, A. J., Abdurazik, A., 1999. Generating tests from UML specifications. In: France, R. B., Rumpe, B. (Eds.), Proc. of the 2nd International Conference on The Unified Modeling Language: Beyond the Standard (UML’99), pp. 416–429. Springer.

Ostrand, T. J. and Balcer, M. J., 1988. The category-partition method for specifying and generating functional tests. Communications of the ACM 31, 678– 686.

Papadakis, M. and Malevris, N., 2010. Automatic mutation test case generation via dynamic symbolic execution. In: Proc. of the 21st International Symposium on Software Reliability Engineering (ISSRE’10).

Pasareanu, C. S., Mehlitz, P. C., Bushnell, D. H., Gundy-Burlet, K., Lowry, M. R., Person, S., Pape, M., 2008. Combining unit-level symbolic execution and system-level concrete execution for testing NASA software. In: International Symposium on Software Testing and Analysis (ISSTA’08), pp. 15–26.

Pasareanu, C. S., Rungta, N., 2010. Symbolic PathFinder: Symbolic execution of Java bytecode. In: Proc. of the 25th IEEE/ACM International Conference on Automated Software Engineering (ASE’10), pp. 179–180.

Pasareanu, C. S., Rungta, N., Visser, W., 2011. Symbolic execution with mixed concrete-symbolic solving. In: Proc. of 2011 International Symposium on Software Testing and Analysis (ISSTA’11), pp. 34–44.

Pasareanu, C. S., Visser, W., 2009. A survey of new trends in symbolic execution for software testing and analysis. International Journal on Software Tools for Technology Transfer 11, 339–353.

Paulson, L. C., 1994. Isabelle - A Generic Theorem Prover (with a contribution by T. Nipkow). LNCS 828, Springer.

Perrouin,ManuscriptG., Sen, S., Klein, J., Baudry, B., Traon, Y. l., 2010. Automated and scalable t-wise test case generation strategies for software product lines. In:

Proc. of the Third International Conference on Software Testing, Verification and Validation (ICST’10), pp. 459–468.

Pezze,` M. and Young, M., 2007. Software Testing and Analysis - Process, Principles and Techniques. Wiley.

Plat, N., Larsen, P. G., 1992. An overview of the iso/vdm-sl standard. SIGPLAN Notice. 27, 76–82.

Qi, D., Roychoudhury, A., Liang, Z., Vaswani, K., 2009. Darwin: An approach for debugging evolving programs. In: Proc. of the 2009 Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, pp. 33–42.

Qu, X., Cohen, M. B. and Rothermel, G., 2008. Configuration-aware regression testing: An empirical study of sampling and prioritization. In: Proc. of the 2008 International Symposium on Software Testing and Analysis (ISSTA’08), pp. 75–85.

Qu, X., Cohen, M. B. and Woolf, K. M., 2007. Combinatorial interaction regression testing: A study of test case generation and prioritization. In: Proc. of the 23rd International Conference on Software Maintenance (ICSM’07), pp. 255–264.

Santelices, R. A., Chittimalli, P. K., Apiwattanapong, T., Orso, A., Harrold, M. J., 2008. Test-suite augmentation for evolving software. In: Proc. of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE’08), pp. 218–227.

Santelices, R. A., Harrold, M. J., 2010. Exploiting program dependencies for scalable multiple-path symbolic execution. In: Proc. of the 2010 International Symposium on Software Testing and Analysis (ISSTA’10), pp. 195–

206.

Saxena, P., Poosankam, P., McCamant, S., Song, D., 2009. Loop-extended symbolic execution on binary programs. In: Proc. of the 2010 International Symposium on Software Testing and Analysis (ISSTA’10), pp. 225–236.

Segall, I., Tzoref-Brill, R., Farchi, E., 2011. Using binary decision diagrams for combinatorial test design. In: Proc. of the 2011 International Symposium on Software Testing and Analysis (ISSTA’11), pp. 254–264.

Sen, K., Agha, G., 2006. CUTE and jCUTE: Concolic unit testing and explicit path model-checking tools. In: Proc. of the 18th International Conference on Computer Aided Verification (CAV’06), pp. 419–423.

Sen, K., Marinov, D., Agha, G., 2005. CUTE: A concolic unit testing engine for C, in: proc. of the 2005 Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, pp. 263–272.

Shahbazi, A., Tappenden, A. F. and Miller, J., 2012. Centroidal voronoi tessellations - a new approach to random testing. IEEE Transactions on Software Engineering (in press).

Sherwood, G. B., 1994. E ective testing of factor combinations. In: Proc. of the 3rd International Conference on Software Testing, Analysis & Review (STAR’94), pp. 151–166.

Souza, M., Borges, M. d’Amorim, M. and Pasareanu, C. S., 2011. CORAL: Solving complex constraints for symbolic pathfinder. In: M. G. Bobaru, K. Havelund, G. J. Holzmann, and R. Joshi (eds.), NASA Formal Methods - Third International Symposium (NFM’11), LNCS 6617, pp. 359– 374.Springer.

Stardom, J., 2001. Metaheuristics and the search for covering and packing arrays, Master’s thesis, Simon Fraser University.

Sterling, L., Shapiro, E. Y., 1994. The Art of Prolog - Advanced Programming Techniques, 2nd Ed. MIT Press.

Tai, K. C. and Lei Y., 2002. A test generation strategy for pairwise testing. IEEE Transactions on Software Engineering 28 (1), 109–111.

Tappenden, A. and Miller, J., 2009. A novel evolutionary approach for adaptive random testing. IEEE Transactions on Reliability 58(4), 619–633.

Tappenden, A. and Miller, J., 2013. Automated cookie collection testing. ACM Transactions on Software Engineering and Methodology (in press).

Tillmann, N., de Halleux, J., 2008. Pex-White box test generation for .NET. In: Proc. of the 2nd International Conference on Tests and Proofs (TAP’08), pp. 134–153.

Tomb, A., Brat, G. P., Visser, W., 2007. Variably interprocedural program analysis for runtime error detection. In: Proc. of the 2007 International Symposium on Software Testing and Analysis (ISSTA’07), pp. 97–107.

Tonella, P., 2004. Evolutionary testing of classes. In: Proc. of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA ’04), pp. 119–128. ACM.

Tretmans, J., 1996. Test Generation with Inputs, Outputs, and Repetitive Quiescence. Software—Concepts and Tools 17, 103–120.

Tretmans, J., 2008. Model Based Testing with Labelled Transition Systems. In: Hierons, R., Bowen, J., Harman, M. (Eds.), Formal Methods and Testing, pp. 1–38. Springer-Verlag.

Tretmans, J., Brinksma, E., 2003. TorX: Automated model based testing. In: Proc. of the 1st European Conference on Model-Driven Software: Foundations and Applications (ECMDA-FA’05), pp. 31–43.

Tung, Y., Aldiwan, W. S., 2000. Automating test case generation for the new generation mission software system. In: Proc. of the IEEE Aerospace Conference, pp. 431–437.

Utting, M., Legeard, B., 2007. Practical Model-Based Testing - A Tools Approach. Morgan Kaufmann.

Vasilevskii, M., 1973. Failure diagnosis of automata. Kibernetika , 98–108. Veanes, M., Bjørner, N., 2010. Alternating simulation and IOCO. In: Petrenko,

A., da Silva Simao,˜ A., Maldonado, J. C. (Eds.), Proc. of the 22nd IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS’10), pp. 47–62. Springer.

Veanes, M., Campbell, C., Grieskamp, W., Schulte, W., Tillmann, N., Nachmanson, L., 2008. Model-based testing of object-oriented reactive systems with Spec Explorer. In: Hierons, R. M., Bowen, J. P., Harman, M. (Eds.), Formal Methods and Testing, pp. 39–76. Springer.

Veanes, M., Campbell, C., Schulte, W., 2007. Composition of model programs. In: Derrick, J., Vain, J. (Eds.), Proc. of the 27th IFIP WG 6.1 International Conference on Formal Methods for Networked and Distributed

Veanes, M., de Halleux, P., Tillmann, N., 2010. Rex: Symbolic regular expression explorer. In: Proc. of the 3rd International Conference on Software Testing, Verification and Validation (ICST’10), pp. 498–507.

Walcott, K. R., So a, M. L., Kapfhammer, G. M. and Roos, R. S., 2006. Time aware test suite prioritization. In: Proc. of the International Symposium on Software Testing and Analysis (ISSTA’06), pp. 1 – 12. ACM Press.

Wegener, J. and Buhler,¨ O., 2004. Evaluation of di erent fitness functions for the evolutionary testing of an autonomous parking system. In:Genetic and Evolutionary Computation Conference (GECCO 2004), LNCS 3103. pp. 1400–1412. Springer.

Wegener, J. and Grochtmann, M., 1998. Verifying timing constraints of realtime systems by means of evolutionary testing. Real-Time Systems 15(3), 275 – 298.

Weyuker, E. J., 1979. Translatability and decidability questions for restricted classes of program schemas. SIAM Journal on Computing 8(4), 587–598.

White, L. J. and Cohen, E. I., 1980. A domain strategy for computer program testing. IEEE Transactions on Software Engineering 6(3), 247–257.

Wieczorek, S., Stefanescu, A., 2010. Improving testing of enterprise systems by model-based testing on graphical user interfaces. In: Sterritt, R., Eames, B., Sprinkle, J. (Eds.), Proc. of the 2010 17th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS’10), pp. 352–357.

Systems (FORTE’07), pp. 128–142.AcceptedSpringer.

Yilmaz, C., Cohen, M. B. and Porter, A., 2006. Covering arrays for e cient fault characterization in complex configuration spaces. IEEE Transactions on Software Engineering 31 (1), 20–34.

Yoo, S., Harman, M., Tonella, P. and Susi, A., 2009. Clustering test cases to achieve e ective and scalable prioritisation incorporating expert knowledge. In: Proc. of the 2009 ACM International Conference on Software Testing and Analysis (ISSTA 09), pp. 201–212.

Yuan, X., Cohen, M. and Memon, A., 2011. GUI interaction testing: Incorporating event context. IEEE Transactions on Software Engineering 37 (4), 559 –574.

Zhan, Y. and Clark, J. A., 2005. Search-based mutation testing for simulink models. In: H.-G. Beyer and U.-M. O’Reilly, editors, Proc. of the 2005 Ge-

netic and Evolutionary Computation Conference (GECCO’05), pp. 1061– 1068. ACM.

Zhang, Y., Finkelstein, A. and Harman, M., 2008. Search based requirements optimisation: Existing work and challenges. In: Proc. of the International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ’08), LNCS 5025, pp. 88–94. Springer.

Zhang, P., Elbaum, S. G., Dwyer, M. B., 2011. Automatic generation of load tests. In: Proc. of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE’11), pp. 43–52.

Zhou, B., Okamura, H. and Dohi T., 2013. Enhancing performance of random testing through Markov chain Monte Carlo methods. IEEE Transactions on

ManuscriptComputers 62(1), 186 – 192.

Zhu, H., Hall, P. A. V. and May, J. H. R., 1997. Software unit test coverage and adequacy. ACM Computing Surveys 29(4), pp. 366–427.