Attention! This benchmark suite has been updated. The actual version can be found here. Attention!
The RDF(S) Import Benchmark Suite is composed of the different benchmarks that have to be performed in each ontology development tool to evaluate their RDF(S) importers.
This benchmark suite has been built regarding the components of the knowledge model of RDF(S) commonly used by ontology development tools (classes, properties and instances) and the combinations that can be obtained with these components. It also considers the different ways of writing these components in the RDF/XML syntax.
Each benchmark imports one specific combination of elements of the knowledge model of RDF(S) into the tool and checks if the elements were correctly imported into the ontology development tool. Some of these benchmarks (like I03) may not have a correct meaning in some tools.
The description of a benchmark includes the benchmark identifier, a description of the benchmark in natural language, a graphical representation of the graph, and files with the RDF(S) graph that must be imported both in the Notation3 and RDF/XML formats (the RDF/XML file has been generated from the Notation3 file using cwm).
The benchmarks are grouped according to the main component that they manage, and these are: classes, properties or instances.
All the files composing the benchmark suite can be downloaded here.
| Legend:
|
| Class benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I01 | Import just one class |
|
graph01.n3 | graph01.rdfs |
| I02 | Import several classes with no properties between them |
|
graph02.n3 | graph02.rdfs |
| Metaclass benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I03 | Import one class that is instance of another class, being this last class instance of a third one |
|
graph03.n3 | graph03.rdfs |
| I04 | Import one class that is instance of several classes |
|
graph04.n3 | graph04.rdfs |
| I05 | Import several classes that are instance of the same class |
|
graph05.n3 | graph05.rdfs |
| I06 | Import one class that is instance of another class and viceversa |
|
graph06.n3 | graph06.rdfs |
| I07 | Import just one class that is instance of himself |
|
graph07.n3 | graph07.rdfs |
| Subclass benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I08 | Import one class that is subclass of another class, being this last class subclass of a third one |
|
graph08.n3 | graph08.rdfs |
| I09 | Import one class that is subclass of several classes |
|
graph09.n3 | graph09.rdfs |
| I10 | Import several classes that are subclass of the same class |
|
graph10.n3 | graph10.rdfs |
| I11 | Import one class that is subclass of another class and viceversa, forming a cycle |
|
graph11.n3 | graph11.rdfs |
| I12 | Import just one class that is subclass of himself, forming a cycle |
|
graph12.n3 | graph12.rdfs |
| Class and property benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I13 | Import one class that has a property with another class |
|
graph13.n3 | graph13.rdfs |
| I14 | Import one class that has the same property with several classes |
|
graph14.n3 | graph14.rdfs |
| I15 | Import several classes that have the same property with the same class |
|
graph15.n3 | graph15.rdfs |
| I16 | Import just one class that has a property with itself |
|
graph16.n3 | graph16.rdfs |
| I17 | Import just one class that has a property with a literal |
|
graph17.n3 | graph17.rdfs |
| I18 | Import just one class that has the same property with several literals |
|
graph18.n3 | graph18.rdfs |
| Property benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I19 | Import just one property | graph19.n3 | graph19.rdfs | |
| I20 | Import several properties | graph20.n3 | graph20.rdfs | |
| Subproperty benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I21 | Import one property that is subproperty of another property that is subproperty of a third one | graph21.n3 | graph21.rdfs | |
| I22 | Import one property that is subproperty of several properties | graph22.n3 | graph22.rdfs | |
| I23 | Import several properties that are subproperty of the same property | graph23.n3 | graph23.rdfs | |
| I24 | Import one property that is subproperty of another property and viceversa | graph24.n3 | graph24.rdfs | |
| I25 | Import just one property that is subproperty of himself | graph25.n3 | graph25.rdfs | |
| Property with domain and range benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I26 | Import just one property that has as domain a class | graph26.n3 | graph26.rdfs | |
| I27 | Import just one property that has as domain several classes | graph27.n3 | graph27.rdfs | |
| I28 | Import several properties that have as domain the same class | graph28.n3 | graph28.rdfs | |
| I29 | Import just one property that has as domain rdfs:Class | graph29.n3 | graph29.rdfs | |
| I30 | Import several properties that have as domain rdfs:Class | graph30.n3 | graph30.rdfs | |
| I31 | Import just one property that has as range a class | graph31.n3 | graph31.rdfs | |
| I32 | Import just one property that has as range several classes | graph32.n3 | graph32.rdfs | |
| I33 | Import several properties that have as range the same class | graph33.n3 | graph33.rdfs | |
| I34 | Import just one property that has as range rdfs:Class | graph34.n3 | graph34.rdfs | |
| I35 | Import several properties that have as range rdfs:Class | graph35.n3 | graph35.rdfs | |
| I36 | Import just one property that has as range rdfs:Literal | graph36.n3 | graph36.rdfs | |
| I37 | Import several properties that have as range rdfs:Literal | graph37.n3 | graph37.rdfs | |
| I38 | Import just one property that has as domain a class and as range another class | graph38.n3 | graph38.rdfs | |
| I39 | Import just one property that has as domain a class and as range several classes | graph39.n3 | graph39.rdfs | |
| I40 | Import just one property that has as domain several classes and as range a class | graph40.n3 | graph40.rdfs | |
| I41 | Import just one property that has as domain several classes and as range several classes | graph41.n3 | graph41.rdfs | |
| I42 | Import just one property that has as domain and range the same class | graph42.n3 | graph42.rdfs | |
| I43 | Import just one property that has as domain a class and as range rdfs:Literal | graph43.n3 | graph43.rdfs | |
| I44 | Import just one property that has as domain several classes and as range rdfs:Literal | graph44.n3 | graph44.rdfs | |
| I45 | Import just one property that has as domain rdfs:Class and as range rdfs:Class | graph45.n3 | graph45.rdfs | |
| I46 | Import just one property that has as domain rdfs:Class and as range rdfs:Literal | graph46.n3 | graph46.rdfs | |
| Instance benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I47 | Import just one instance of a class |
|
graph47.n3 | graph47.rdfs |
| I48 | Import just one instance of several classes |
|
graph48.n3 | graph48.rdfs |
| I49 | Import several instances of a class |
|
graph49.n3 | graph49.rdfs |
| Instance and property benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I50 | Import one instance that has a property with another instance of the same class |
|
graph50.n3 | graph50.rdfs |
| I51 | Import one instance that has the same property with several instances of the same class |
|
graph51.n3 | graph51.rdfs |
| I52 | Import several instances that have the same property with the same instance of the same class |
|
graph52.n3 | graph52.rdfs |
| I53 | Import just one instance that has a property with himself |
|
graph53.n3 | graph53.rdfs |
| I54 | Import one instance that has a property with another instance of another class |
|
graph54.n3 | graph54.rdfs |
| I55 | Import one instance that has the same property with several instances of another class |
|
graph55.n3 | graph55.rdfs |
| I56 | Import several instances that have the same property with the same instance of another class |
|
graph56.n3 | graph56.rdfs |
| I57 | Import just one instance that has a property with a literal |
|
graph57.n3 | graph57.rdfs |
| I58 | Import just one instance that has the same property with several literals |
|
graph58.n3 | graph58.rdfs |
| URI reference benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I59 | Import several classes with absolute URI references | graph59.rdfs | ||
| I60 | Import several classes with URI references relative to a base URI | graph60.rdfs | ||
| I61 | Import several classes with URI references transformed from rdf:ID attribute values | graph61.rdfs | ||
| I62 | Import several classes with URI references relative to an ENTITY declaration | graph62.rdfs | ||
| Empty node benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I63 | Import several classes with empty nodes | graph63.rdfs | ||
| I64 | Import several classes with empty nodes shortened | graph64.rdfs | ||
| Multiple properties benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I65 | Import several classes with multiple properties | graph65.rdfs | ||
| I66 | Import several classes with multiple properties shortened | graph66.rdfs | ||
| Typed node benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I67 | Import several classes with typed nodes | graph67.rdfs | ||
| I68 | Import several classes with typed nodes shortened | graph68.rdfs | ||
| String literal benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I69 | Import several classes with properties with string literals | graph69.rdfs | ||
| I70 | Import several classes with properties with string literals as XML attributes | graph70.rdfs | ||
| Blank node benchmarks | ||||
| Id | Description | Graphical representation | N3 | RDF/XML |
| I71 | Import several classes with blank nodes with identifier | graph71.rdfs | ||
| I72 | Import several classes with blank nodes shortened | graph72.rdfs | ||
