Software Testing, Verification and Review Methodology (STAR)

Overview

Software Testing, Verification and Review Methodology are essential for attaining a high degree of functional correctness and reliability in software products. As software systems and applications become increasingly more complex, it becomes ever more challenging to maintain a high quality using the existing testing practices. We aim at making significant contributions in the area of Software Testing & Verification by developing new technologies, practices, and tools. Several activities have already been seeded based on existing verification technologies. Functional Coverage (FoCus) has been recognized for its value to software testing quality both inside and outside IBM. We are now working on a tool for testing concurrent and distributed Java applications (ConTest), and we also see an opportunity for applying Formal Verification techniques to various types of software.

Activities

Publications

List of recent selected papers

  • "Measuring an Improving Latency to Avoid Test Suite Wear Out",
    Shmuel Ur, Mark Harman and Shin Yoo, SBST, Best Paper Award.
  • "Automated Substring Hole Analysis",
    Yoram Adler, Eitan Farchi, Moshe Klausner, Dan Peleg, Orna Raz, Moran Shochat, Shmuel Ur and Aviad Zlotnick, ICSE 2009.
  • "A Concurrency Testing Tool and itsPlug-ins for Dynamic Analysis and Runtime Healing",
    Yarden Nir-Buchbinder, Zdenek Letko, Bohuslav Kerena, Rachel Tzoref-Brill, Shmuel Ur, and Tomás Vojnar, RV 2009.
  • "Advanced Code Coverage Analysis Using Substring Holes",
    Yoram Adler, Eitan Farchi, Moshe Klausner, Dan Pelleg, Orna Raz, Moran Shochat, Shmuel Ur and Aviad Zlotnick, ISSTA 2009.
  • "Cross-Entropy-Based Replay of Concurrent Programs",
    Hana Chockler, Eitan Farchi, Benny Godlin, Sergey Novikov, FASE 2009: 201-215.
  • "Forcing Small Models of Conditions on Program Interleaving for Detection of Concurrent Bugs",
    Ehud Trainin, Yarden Nir-Buchbinder, Rachel Tzoref-Brill, Aviad Zlotnick, Shmuel Ur and Eitan Farchi, PADTAD 2009.
  • "An Effective Method for Keeping Design Artifacts Up-to-Date",
    Yochai Ben-Chaim, Eitan Farchi, Orna Raz, Wikis4SE 2009.
  • "Hardware-less testing for RAS software",
    Aviad Zlotnick, Orna Raz, SYSTOR 2009: 17.
  • "Controlling Levels of False Negative and False Positive Errors via Separate Adaptive Thresholds",
    David Breitgand, Ealan Henis, Maayan Goldstein, Onn Shehory, IM 2009.
  • "Automated Collaboration among Communicating, Semiautonomous Vehicles",
    Dan Chevion, Ron Sivan, Onn Shehory, Yuval Shimony, MIMS 2009.
  • "RacingSnail: Improving Throughput via Slowdowns",
    Maayan Goldstain, Onn Shehory, Rachel Tzoref-Brill, Shmuel Ur. P3AD 2009.
  • "Proceedings of ICAC 2009",
    Book editor: Onn Shehory, IEEE, 2009.
  • "The future of software engineering and multi-agent systems",
    D. Weyns, H.V.D. Parunak and O. Shehory, International Journal of Agent-Oriented Software Engineering, Vol. 3 No. 4, pp.369–377. 2009.
  • "Lecture notes in BIP: Agent-Mediated Electronic Commerce X and Trading Agent Design and Analysis",
    O. Shehory and W. Ketter (Eds.), Springer 2009, to appear.
  • "Probabilistic Alternative to Regression Suites",
    Shady Copty, Shai Fine, Shmuel Ur, and Avi Ziv, Theoretical Computer Science, Volume 404, Issue 3, 28 September 2008, pages 219-234.
  • "Deadlocks: From Exhibiting to Healing",
    Yarden Nir-Buchbinder, Rachel Tzoref, and Shmuel Ur. Proceedings of the 2008 Runtime Verification Workshop, Springer, 2008.
  • "Automatic Debugging of Concurrent Programs through Active Sampling of Low Dimensional Random Projections",
    Elad Yom-Tov, Rachel Tzoref, Shmuel Ur, and Shlomo Hoory. Proceedings of ASE 2008: The 23rd IEEE/ACM International Conference on Automated Software Engineering, 2008.
  • "The Advantages of Post-Link Code Coverage Hardware and Software: Verification and Testing",
    Eitan Farchi, Shachar Fienblit, Yakov Filiarsky, Shay Gammer, Gad Haber, Moshe Klausner, Nitzan Peleg, Sergey Novikov, and Orna Raz. Third International Haifa Verification Conference, HVC 2007, Haifa, October 2007.
  • "Instrumenting Where It Hurts: An Automatic Concurrent Debugging Technique",
    Rachel Tzoref, Shmuel Ur, and Elad Yom-Tov. ISSTA 2007: Proceedings of the ACM/SIGSOFT International Symposium on Software Testing and Analysis, ACM, 2007.
  • "Choosing a Test Modeling Language: A Survey",
    Alan Hartman, Mika Katara, Sergey Olvovsky. Haifa Verification Conference 2006: 204-218.
  • "Model-Driven Testing as an Infrastructure for Custom-Made Solutions",
    Alan Hartman, Andrei Kirshin, and Sergey Olvovsky. System Testing and Validation Workshop 2006: 918.
  • "Advanced Analysis Techniques for Cross-Product Coverage",
    Hezi Azatchi, Eitan Marcus, Laurent Fournier, Shmuel Ur, Avi Ziv, and Keren Zohar, IEEE Transactions on Computers, Volume 55, No. 11, pages 1367-1379, November 2006.
  • "Applications of Synchronization Coverage",
    Arkady Bron, Eitan Farchi, Yonit Magid, Yarden Nir, and Shmuel Ur. PPOPP 2005: 206-212.
  • "Automatic Simulation of Network Problems in UDP-Based Java Programs",
    Eitan Farchi, Yoel Krasny, and Yarden Nir, IPDPS 2004.

Manager

Eitan Farchi,