Software Testing Seminar

Sunday 16:00-18:00 (no class on 20/2)
Shmuel (Mooly) Sagiv
    We will study different techniques for testing software. There will be a special
    guest lecture by Shumel Ur from IBM Haifa Research Group who is a worlwide
    expert in Testing.
     

    Schedule:

    1. Sunday 27/2 Mooly Sagiv, Introduction (Based on an old book by G. Myers)
    2. Friday  4/3 10:00-12:00 Shmuel Ur Email ur@il.ibm.com, Functional and Code coverage. Article cited
    3. Sunday 5/3 Miller Ofer
    4. Sunday 12/3  Trebitch Dmitry Bug Trapper
    5. Sunday 19/3Ety Navon  The Category-Partition  Method for Specifying and Generating                 Functional Tests
    6. Sunday 26/3 Eran Yahav  Structured Testing: A Testing Methodology Using the Cyclomatic Complexity Metric
    7. April 2, Dan Bredley  Software Reliability via Run-Time Result-Checking
    8. April 9, Sharon Magen, The infeasibility of

      9. quantifying the reliability of life-critical real-time software
    9. April 30, Oran Maza Automatically Detecting Equivalent Mutants and Infeasible Paths
    10. May 7, Ilya Sedelnikov, A First Step Towards Automated Detection of Buffer Overrun Vulnerabilities
    11. May 14,  Alex Warshavsky, A tool for pro-active defense against the buffer overrun attack

      12.                                         Discussion
    12. May 21, Nir Andelman An Experimental Evaluation of Data Flow and Mutation Regression Testing
    13. May 28, Ori Dvir ADL - Assertion Definition Language

      14.             Sharon Magen The Infeasibility of Quantifying the Reliability of Life-Critical Real-Time Software
    14. June 4, Yair Miranda Specman Utility for Construction and Control of Automatic Test Generators.

      15.             Mooly Sagiv, Summary
       

    List of Papers (please send me Email if you want to present a differtrent article)

    Misc
          IEEE Software on "why Testing is so difficult"
    Black box testing
    1. Fuzz Revisited : A Re-Examination of the Reliability of the Unix Utility Services

      2. Miller et al.
    2. Anthony Iannino, John D. Musa, Kazuhira Okumoto, Bev Littlewood: Criteria for Software

      3. Reliability Model Comparisons. TSE 10(6): 687-691 (1984)
    3. The Infeasibility of Quantifying the Reliability of Life-Critical Real-Time Software

      4. Ricky W. Butler  and George B. Finelli
      Selected by Sharon Magen
    4. Software Reliability via Run-Time Result-Checking   Blum and Wasserman.

      5. Selected by Danny Bradley
    5. Black-Box Testing : Techniques for Functional Testing of Software and   Systems

      6. Beizer, Boris John Wiley Sons (C) will be avalable soon
    White box testing
    1. Automatically Detecting Equivalent Mutants and Infeasible Paths, Jeff Offutt and Jie Pan. The Journal of Software Testing, Verification, and Reliability, Vol 7, No. 3, pages 165--192,  September 1997.

      2. Selected by Oran Maza (30/4)
    2. Thomas J. Ostrand, Marc J. Balcer: The Category-Partition Method for Specifying and

      3.  Generating Functional Tests. CACM 31(6): 676-686 (1988)
      Selected by Ethy Navon
    3. Structured Testing: A Testing Methodology Using the Cyclomatic Complexity Metric

      4. A.H. Watson and T.J. Macbe
      Selected by Eran Yahav
    4. J. B. Goodenough and S. L. Gerhart

      5. Toward a Theory of Testing: Data Selection
      Criteria," in Current Trends in Programming Methodology, volume II:Program Validation, R. T. Yeh
      (Ed.), Prentice-Hall, Englewood Cliffs, NJ, 1977, pp. 44-79.
    5. Test Template Framework: A Specification-Based Testing Case Study

      6. Carrington, D. C., Stocks, P. S.
      TIn: Proceedings of the 1993 International Symposium on Software
      Testing and Analysis (ISSTA), ,
    6. UNA Based Iterative Test Data Generation and its Evaluation

      7. N. Gupta, A. Mathur, and M.L. Soffa
      Proceedings of the IEEE Automated Software Engineering Conference
      Oct 1999.
    7. An Experimental Evaluation of Data Flow and Mutation Regression Testing

      8.  Jeff Offutt, Jie Pan, Kanupriya Tewary, and Tong Zhang
      Selected by Nir Andelman
      Testing Software Practice and Experience, 26(2):165--176,  February, 1996.
    8. On the limit of control flow analysis for regression test selection

      9. Thomas Ball
      Proceedings of ACM SIGSOFT international symposium onSoftware testing and analysis March 2 - 4, 1998, Clearwater Beach, FL USA
    9.  Empirical Studies of a Prediction Model for Regression Test Selection

      10.  Mary Jean Harrold, Gregg Rothermel, David Rosenblum, and Elaine
       Weyuker. ACM Transactions on Software Engineering and Methodology
    Design for Test
       
    1. Mehlhorn et. al.: Checking Geometric Properties  or Verification of Geometric

      2. Structures, 12th Annual Symp. on Computational Geometry, pp 159 - 165, 1996
    Testing Program Cleanness, e.g., no buffer overflow
    1.    A First Step Towards Automated Detection of Buffer Overrun Vulnerabilities

      2. Selected by  Ilya Sedelnikov
      A. Aiken Brewer, J. Foster, and D. Wagner.
      Proceedings of the 2000 Network and Distributed Systems Security Conferece Brewer, J. Foster, and D. Wagner.
    2. A tool for pro-active defense against the buffer overrun attack

      3. Bruschi, D. and  Rosti, E. and  Banfi, R.
      Proc. of the European Symposium on Research in
      Computer Security, ESORICS '98
      Selected by Alex  Warshavsky
    Tools
    1. ADL - Assertion Definition Language

      2. Sun Microsystems
    2. Mothra a tool for Mutattion Testing

      3. Jefferson Offutt
    3.    Verisoft   tool for Systematic Software Testing.

      4. P. Godfroid
      Presented by Ofer Miler
    4. The slicing tool Coder Surrfer
    5. ESC Java COMPAC
    6. Implementing an Interprocedural Dataflow Tester using Abstract Execution

      7. John Lloyd and Mary Jean Harrold

There will be also an option to study in depth testing softeware developed by an Israeli company such as Mercury or MuTek. Please ask instructor

For further information Email: sagiv@math.tau.ac.il