The WPBS is composed of a set of benchmarks that perform ontology management operations in the WebODE platform. These operations are performed through the methods of the WebODE Ontology Management API.
Each benchmark executes a method from the API with different settings and stores its execution time. The list of the benchmarks can be found here.
The execution environment of the computer must be the same before executing all the benchmarks. The variables that influence the results are controled, except for WebODE's load, that is generated. This load is worked out from the operations performed in the benchmarks.
In order to run the benchmark suite, you must download the source code, compile it, and run it with the desired parameters in a computer where WebODE is running.
The command line parameters when executing the benchmarks are the following:
-factor <factor>: Integer. The load
factor of the benchmark suite.
-n_times <n_times>: Integer. The consecutive executions of a method in
a benchmark.
[-warming <warming>]: Integer. The number of executions of a method in
a benchmark before start measuring.
[-restore]: Boolean. The benchmarks restore the benchmark suite initial load
state after their execution.
The files with the results will be hierarchically stored in a directory.
Ontology Engineering Group
Facultad de Informática
Universidad Politécnica de Madrid