Because the artifacts are automatically packed when you download the benchmarks, it might take some time for the download dialog to appear.
| TerpSpreadSheet |
| Author: | GUITAR group | Last Updated: | June 12, 2010, 23:01:23, CDT | Language: | Java | Size: | 176 Events, 6337 LOC | Versions: | 1 |
|
| TerpSpreadSheet is a simple Java application for processing spreadsheets, drawing graphs and charts (similar to MS Excel). The program was developed by senior Software Engineering students at the University of Maryland, College Park as term projects. This program has multiple versions developed by different teams in several semesters. This benchmark is based on TerpSpreadSheet version 3.0. We downloaded this version of TerpSpreadSheet, obtained its GUI structure, generated Event-Flow Graph (EFG), Event-Interaction Graph (EIG), and a test pool consisting of 1000 length-2 test cases. The original source code was seeded with faults to produce mutants (each mutant has only one single fault). Test cases were executed on the original program and on each mutant. The GUI states were compared to detect GUI errors and generate the fault matrix. The coverage matrix (coverage for each test case) were also collected using coverage measurement tools. More detail on the artifacts are available in the README.txt file in the root directory. More detail on the experimental results were reported in the paper. |
Application |
| Downloaded from: http://www.cs.umd.edu/~atif/TerpOfficeWeb/TerpOfficeV3.0/TerpSpreadsheet/WebFiles/TS3.html |
| Source code: application/src |
| Binary: application/bin |
| Instrumented binary: application/instrumented-bin |
| Mutants: application/mutants |
Test Cases |
| Universal test pool: test/testpool |
| Selected test suites: test/testsuites.tar.bz2 |
Scripts |
| Execution scripts: scripts |
Fault Matrix |
| Fault matrix: fault-matrix/TerpSpreadSheet3-fault_matrix.txt |
Coverage Matrix |
| Due to its large size, the coverage matrix is only available on DVD upon request. They can also be re-generated using the provided scripts |
Models |
| Event-flow graph (EFG): models/TerpSpreadSheet3.efg |
| Event-interaction graph (EIG): models/TerpSpreadSheet3.eig |
| GUI structure: models/TerpSpreadSheet3.gui |
Documents |
| Experimental procedure: documents/experimental_procedure.png |
Environment |
| Operating system: Linux version 2.6.31-19-generic (Ubuntu 9.10) |
| JDK (with JRE): Java 1.6 update 15 |
| GUI environment: Gnome 2.28.0 |
Tools |
| GUITAR Replayer: http://www.cs.umd.edu/~atif/Benchmarks/common/JavaGUIReplayer2.zip |
| Code Coverage Tool: http://cobertura.sourceforge.net |
| Call-stack Coverage Tool: https://sourceforge.net/projects/javacctagent |
BibTeX for Reference |
| Bibtex file: bibtex/umd.coverage.2010.bib |