Attention! This benchmark suite has been updated. The actual version can be found here. Attention!
The RDF(S) Export Benchmark Suite is composed of the different benchmarks that have to be performed in each ontology development tool to evaluate their RDF(S) exporters.
This benchmark suite has been built regarding the common components of the knowledge model of ontology development tools (classes, datatype properties, object properties, and instances) and the combinations that can be obtained with these components.
Each benchmark exports one specific combination of elements of the knowledge model of the tool to RDF(S) and checks if the elements were correctly exported.
The description of a benchmark includes the benchmark identifier, a description of the benchmark in natural language and a graphical representation of the ontology. Then, for each ontology development tool, the benchmark must be instantiated for its own knowledge model.
The benchmarks are grouped according to the main component that they manage, and these are: classes, properties or instances. It also shows the instantiation of the benchmark for WebODE.
When the combination of components of the benchmark cannot be represented in the knowledge model of the tool, it is represented with "-".
| Legend:
|
| Class benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E01 | Export just one class |
|
Export just one concept |
| E02 | Export several classes |
|
Export several concepts |
| Metaclass benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E03 | Export one class that is instance of another class that is instance of a third one |
|
- |
| E04 | Export one class that is instance of several classes |
|
- |
| E05 | Export several classes that are instance of the same class |
|
- |
| E06 | Export one class that is instance of another class and viceversa |
|
- |
| E07 | Export just one class that is instance of himself |
|
- |
| Subclass benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E08 | Export one class that is subclass of another class that is subclass of a third one |
|
Export one concept that is subclass of another concept that is subclass of a third one |
| E09 | Export one class that is subclass of several classes |
|
Export one concept that is subclass of several concepts |
| E10 | Several classes that are subclass of the same class |
|
Export several concepts that are subclass of the same concept |
| E11 | Export one class that is subclass of another class and viceversa, forming a cycle |
|
- |
| E12 | Export just one class that is subclass of himself, forming a cycle |
|
- |
| Class and object property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E13 | Export one class that has an object property with another class |
|
Export one concept that has a relation with another concept with a cardinality of "N" |
| E14 | Export one class that has the same object property with several classes |
|
- |
| E15 | Export several classes that have the same object property with the same class |
|
- |
| E16 | Export just one class that has an object property with itself |
|
Export just one concept that has a relation with itself with a cardinality of "N" |
| Class and datatype property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E17 | Export just one class that has a datatype property with a literal |
|
Export just one concept that has an instance attribute of type "String" with a minimum cardinality of "1" and a maximum cardinality of "N" with a string value |
| E18 | Export just one class that has the same datatype property with several literals |
|
Export just one concept that has an instance attribute of type "String" with a minimum cardinality of "1" and a maximum cardinality of "N" with several string values |
| Datatype property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E19 | Export just one datatype property | - | |
| E20 | Export several datatype properties | - | |
| E21 | Export just one datatype property that has as domain a class | - | |
| E22 | Export just one datatype property that has as domain several classes | - | |
| E23 | Export several datatype properties that have as domain the same class | - | |
| E24 | Export just one datatype property that has as range "String" | - | |
| E25 | Export several datatype properties that have as range "String" | - | |
| E26 | Export just one datatype property that has as domain a class and as range "String" | - | |
| E27 | Export just one datatype property that has as domain several classes and as range "String" | - | |
| Object property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E28 | Export just one object property | - | |
| E29 | Export several object properties | - | |
| E30 | Export just one object property that has as domain a class | - | |
| E31 | Export just one object property that has as domain several classes | - | |
| E32 | Export several object properties that have as domain the same class | - | |
| E33 | Export just one object property that has as range a class | - | |
| E34 | Export just one object property that has as range several classes | - | |
| E35 | Export several object properties that have as range the same class | - | |
| E36 | Export just one object property that has as domain a class and as range another class | - | |
| E37 | Export just one object property that has as domain a class and as range several classes | - | |
| E38 | Export just one object property that has as domain several classes and as range a class | - | |
| E39 | Export just one object property that has as domain several classes and as range several classes | - | |
| E40 | Export just one object property that has as domain and range the same class | - | |
| Instance benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E41 | Export just one instance of a class |
|
Export just one instance of a concept |
| E42 | Export just one instance of several classes |
|
- |
| E43 | Export several instances of a class |
|
Export Several instances of a concept |
| Instance and object property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E44 | Export one instance that has an object property with another instance of the same class |
|
Export one concept that has a relation with itself with a cardinality of "N" and one instance of the concept that has a relation instance with another instance of the same concept |
| E45 | Export one instance that has the same object property with several instances of the same class |
|
Export one concept that has a relation with itself with a cardinality of "N" and one instance of the concept that has a relation instance with several instances of the same concept |
| E46 | Export several instances that have the same object property with the same instance of the same class |
|
Export one concept that has a relation with itself with a cardinality of "N" and several instances of the concept that have a relation instance with another instance of the same concept |
| E47 | Export just one instance that has an object property with himself |
|
Export one concept that has a relation with itself with a cardinality of "N" and one instance of the concept that has a relation instance with itself |
| E48 | Export just one instance that has an object property with another instance of another class |
|
Export one concept that has a relation with another concept with a cardinality of "N" and one instance of the concept that has a relation instance with an instance of the other concept |
| E49 | Export just one instance that has the same object property with several instances of another class |
|
Export one concept that has a relation with another concept with a cardinality of "N" and one instance of the concept that has a relation instance with several instances of the other concept |
| E50 | Export several instances that have the same object property with the same instance of another class |
|
Export one concept that has a relation with another concept with a cardinality of "N" and several instances of the concept that have a relation instance with an instance of the other concept |
| Instance and datatype property benchmarks | |||
| Id | Description | Graphical representation | WebODE's instantiation |
| E51 | Export just one instance that has a datatype property with a literal |
|
Export one concept that has an instance attribute of type "String" with a minimum cardinality of "1" and a maximum cardinality of "N" and one instance of the concept with a string value in the instance attribute |
| E52 | Export just one instance that has the same datatype property with several literals |
|
Export one concept that has an instance attribute of type "String" with a minimum cardinality of "1" and a maximum cardinality of "N" and one instance of the concept with several string values in the instance attribute |
