Back to the WebODE Performance Benchmark Suite
To be able to compare the results of the benchmark suite execution, the load state of WebODE when executing every benchmark must be the same.
This load state must also allow to execute the benchmark with different load factors and with no errors.
Each benchmark's minimum load state has been defined as the ontology components that must exist in WebODE in order to execute the benchmark with no errors. The list of the benchmark's minimum load states can be found here.
If we want to execute several benchmarks with the same load state, this load state must have the ontology components needed by the benchmarks.
For example, given the following four benchmarks:
| Name | Method (Descriptions) | Operation | Minimum Load State |
| benchmark1_1_08 | insertTerm | Inserts X concepts into an ontology | 1 ontology |
| benchmark1_1_09 | insertTerm | Inserts a concept into X ontologies | X ontologies |
| benchmark1_3_20 | removeTerm | Removes X concepts from an ontology | 1 ontology with X concepts |
| benchmark1_3_21 | removeTerm | Removes a concept from X ontologies | X ontologies with 1 concept |
The initial load state of the four benchmarks is:
| Benchmarks | Initial Load State | |
| benchmark1_1_08, benchmark1_1_09 benchmark1_3_20, benchmark1_3_21 |
1 ontology with | X concepts |
| X ontologies with | 1 concept | |
Therefore, the benchmark suite initial load state, used when executing all the benchmarks, has been defined as the union of all the benchmarks’ minimum load states.
| Benchmark suite initial load state | ||||
| 1 ontology with | X term references | |||
| 1 concept with | X class attributes | |||
| X instance attributes | ||||
| X synonyms | ||||
| X+1 concepts with | 1 class attribute with | X values | ||
| X class attributes with | 1 value | |||
| 1 instance attribute with | X values | |||
| X instance attributes with | 1 value | |||
| X synonyms | ||||
| X parent concepts | ||||
| X child concepts | ||||
| X ad-hoc term relations | ||||
| X term references | ||||
| X ontology references | ||||
| X term relations | ||||
| X constants | ||||
| X formulas | ||||
| 1 instance set with | 1 instance with | X instance attributes with | X values | |
| X+1 instances with | At least 1 value | |||
| X instance sets with | At least 1 instance | |||
| At least 1 relation instance | ||||
| X groups | ||||
| X ontologies with | 2 concepts with | 1 parent concept | ||
| 1 child concept | ||||
| 1 ad-hoc term relation | ||||
| X concepts with | 1 class attribute | |||
| 1 term reference | ||||
| 1 ontology reference | ||||
| At least 1 term relation | ||||
| At least 1 imported term | ||||
| 1 constant | ||||
| 1 formula | ||||
| 1 instance set with | 2 instances with | 1 instance attribute with | 1 value | |
| At least 1 relation instance | ||||
| 1 group | ||||