The OWL Import Benchmark Suite

Introduction - Using the import suite - Groups Back to Home

Introduction

This page contains a description of the OWL Import Benchmark Suite (OIBS), along with all the material necessary for using it in a given tool. The purpose of the OIBS is to assess the quality of the OWL importers of the ontology development tools that will take part in the OWL interoperability benchmarking.

The benchmark suite has been defined to cover the OWL Lite species of OWL.

Identify a benchmark

In this page, each benchmark is described by:

All the files have been validated with WonderWeb OWL Species Validator.

Moreover, all benchmarks are described using the Description Logics formalism. This description can be found here.

The groups


The graphical description of the single benchmarks will use the following symbols:

Classes:

Properties:

Individuals:

Syntax and abbreviation:

A

B

C

D

E

F

G

H

I

J

K

L

The OIBS has been built considering the OWL vocabulary and splitting it into groups according to the OWL Guide and to the OWL Semantics and Abstract Syntax. There are separate groups for checking the import of classes, properties and instances; there is an additional group, whose purpose is to evaluate the import of the different variants of the RDF/XML syntax.

It is possible to download all the benchmarks in a single zip file from here.

Class benchmarks

Group A: Class hierarchies

These benchmarks are intended for checking the import of classes and class hierarchies. It includes subclass of value restrictions and cardinality restrictions on properties and classes that are class intersections.

ID

Description

OWL File

Graphical representation

ISA01

Import a single class

ISA01.OWL

ISA02

Import a single class, subclass of a second class which is subclass of a third one

ISA02.OWL

ISA03

Import a class that is subclass of two classes

ISA03.OWL

ISA04

Import several classes subclass of a single class

ISA04.OWL

ISA05

Import two classes, each subclass of the other

ISA05.OWL

ISA06

Import a class, subclass of itself

ISA06.OWL

ISA07

Import a class which is subclass of an anonymous class defined by an owl:someValuesFrom value constraint in an object property

ISA07.OWL

ISA08

Import a class which is subclass of an anonymous class defined by an owl:allValuesFrom value constraint in an object property

ISA08.OWL

ISA09

Import a class which is subclass of an anonymous class defined by an owl:minCardinality=0 cardinality constraint in an object property

ISA09.OWL

ISA10

Import a class which is subclass of an anonymous class defined by an owl:maxCardinality=1 cardinality constraint in an object property

ISA10.OWL

ISA11

Import a class which is subclass of an anonymous class defined by an owl:cardinality=1 cardinality constraint in an object property

ISA11.OWL

ISA12

Import a class which is subclass of an anonymous class defined by an owl:minCardinality=0 and an owl:maxCardinality=1 cardinality constraints in an object property

ISA12.OWL

ISA13

Import a class which is subclass of an anonymous class defined by an owl:minCardinality=0 cardinality constraint in a datatype property

ISA13.OWL

ISA14

Import a class which is subclass of an anonymous class defined by an owl:maxCardinality=1 cardinality constraint in a datatype property

ISA14.OWL

ISA15

Import a class which is subclass of an anonymous class defined by an owl:cardinality=1 cardinality constraint in a datatype property

ISA15.OWL

ISA16

Import a class which is subclass of an anonymous class defined by an owl:minCardinality=0 and an owl:maxCardinality=1 cardinality constraints in a datatype property

ISA16.OWL

ISA17

Import a class which is subclass of a class defined by the intersection of two other classes

ISA17.OWL

Group B: Class equivalences

These benchmarks are intended for checking the import of equivalences on classes. It includes classes equivalent to value restrictions and cardinality restrictions on properties and classes equivalent to intersection of classes.

ID

Description

OWL File

Graphical representation

ISB01

Import several classes which are all of them equivalent

ISB01.OWL

ISB02

Import a class which is equivalent to an anonymous class defined by an owl:someValuesFrom value constraint in an object property

ISB02.OWL

ISB03

Import a class which is equivalent to an anonymous class defined by an owl:allValuesFrom value constraint in an object property

ISB03.OWL

ISB04

Import a class which is equivalent to an anonymous class defined by an owl:minCardinality=0 cardinality constraint in an object property

ISB04.OWL

ISB05

Import a class which is equivalent to an anonymous class defined by an owl:maxCardinality=1 cardinality constraint in an object property

ISB05.OWL

ISB06

Import a class which is equivalent to an anonymous class defined by an owl:cardinality=1 cardinality constraint in an object property

ISB06.OWL

ISB07

Import a class which is equivalent to an anonymous class defined by an owl:minCardinality=0 and an owl:maxCardinality=1 cardinality constraints in an object property

ISB07.OWL

ISB08

Import a class which is equivalent to an anonymous class defined by an owl:minCardinality=0 cardinality constraint in a datatype property

ISB08.OWL

ISB09

Import a class which is equivalent to an anonymous class defined by an owl:maxCardinality=1 cardinality constraint in a datatype property

ISB09.OWL

ISB10

Import a class which is equivalent to an anonymous class defined by an owl:cardinality=1 cardinality constraint in a datatype property

ISB10.OWL

ISB11

Import a class which is equivalent to an anonymous class defined by an owl:minCardinality=0 and an owl:maxCardinality=1 cardinality constraints in a datatype property

ISB11.OWL

ISB12

Import a class which is equivalent to an anonymous class defined by the intersection of two other classes

ISB12.OWL

Group C: Classes defined with set operators

These benchmarks are intended for checking the import of intersections of classes.

ID

Description

OWL File

Graphical representation

ISC01

Import a class which is intersection of two other classes

ISC01.OWL

ISC02

Import a class which is intersection of several other classes

ISC02.OWL

Property benchmarks

Group D: Property hierarchies

These benchmarks are intended for cheking the import of properties and property hierarchies.

ID

Description

OWL File

Graphical representation

ISD01

Import a single object property

ISD01.OWL

ISD02

Import an object property that is subproperty of another object property that is subproperty of a third one

ISD02.OWL

ISD03

Import a single datatype property

ISD03.OWL

ISD04

Import a datatype property that is subproperty of another datatype property that is subproperty of a third one

ISD04.OWL

Group E: Properties with domain and range

These benchmarks are intended for checking the import of domain and range constraints of properties.

ID

Description

OWL File

Graphical representation

ISE01

Import a single object property with domain a class

ISE01.OWL

ISE02

Import a single object property with range a class

ISE02.OWL

ISE03

Import a single object property with domain a class and range another class

ISE03.OWL

ISE04

Import a single object property with domain and range the same class

ISE04.OWL

ISE05

Import a single object property with domain multiple classes and range a class

ISE05.OWL

ISE06

Import a single object property with domain a class and range multiple classes

ISE06.OWL

ISE07

Import a single datatype property with domain a class

ISE07.OWL

ISE08

Import a single datatype property with range rdfs:Literal

ISE08.OWL

ISE09

Import a single datatype property with domain a class and range rdfs:Literal

ISE09.OWL

ISE10

Import a single datatype property with domain multiple classes and range rdfs:Literal

ISE10.OWL

Group F: Relations between properties

These benchmarks are intended for checking the import of equivalences among properties.

ID

Description

OWL File

Graphical representation

ISF01

Import several object properties with domain a class and range another class, which are all of them equivalent

ISF01.OWL

ISF02

Import several datatype properties with domain a class and range rdfs:Literal, which are all of them equivalent

ISF02.OWL

ISF03

Import an object property with domain a class and range another class, which is inverse of another object property

ISF03.OWL

Group G: Global cardinality constraints and logical property characteristics

These benchmarks are intended for checking the import of the logical characteristics of properties (symmetric, transitive, functional, and inverse functional).

ID

Description

OWL File

Graphical representation

ISG01

Import a single transitive object property with domain and range the same class

ISG01.OWL

ISG02

Import a single symmetric object property with domain and range the same class

ISG02.OWL

ISG03

Import a single functional object property with domain a class and range another class

ISG03.OWL

ISG04

Import a single functional datatype property with domain a class and range rdfs:Literal

ISG04.OWL

ISG05

Import a single inverse functional object property with domain a class and range another class

ISG05.OWL

Individual benchmarks

Group H: Single individuals

These benchmarks are intended for checking the import of instances of classes.

ID

Description

OWL File

Graphical representation

ISH01

Import one class and one individual that is instance of the class

ISH01.OWL

ISH02

Import several classes and one individual that is instance of all of them

ISH02.OWL

ISH03

Import one class and several individuals that are instance of the class

ISH03.OWL

Group I: Named individuals and properties

These benchmarks are intended for checking the import of the instances of classes with properties among these instances.

ID

Description

OWL File

Graphical representation

ISI01

Import one class, one object property with domain and range the class, and one individual of the class that has the object property with another individual of the same class

ISI01.OWL

ISI02

Import one class, one object property with domain and range the class, and one individual of the class that has the object property with himself

ISI02.OWL

ISI03

Import two classes, one object property with domain one class and range the other class, and one individual of one class that has the object property with an individual of the other class

ISI03.OWL

ISI04

Import one class, one datatype property with domain the class and range rdfs:Literal, and one individual of the class that has the datatype property with a literal

ISI04.OWL

ISI05

Import one class, one datatype property with domain the class and range rdfs:Literal, and one individual of the class that has the datatype property with several literals

ISI05.OWL

Group J: Anonymous individuals and properties

These benchmarks are intended for checking the import of anonymous individuals that have properties with other (named) individuals.

ID

Description

OWL File

Graphical representation

ISJ01

Import one class, one object property with domain and range the class, and one anonymous individual of the class that has the object property with another individual of the same class

ISJ01.OWL

ISJ02

Import two classes, one object property with domain one class and range the other class, and one anonymous individual of one class that has the object property with an individual of the other class

ISJ02.OWL

ISJ03

Import one class, one datatype property with domain the class and range rdfs:Literal, and one anonymous individual of the class that has the datatype property with a literal

ISJ03.OWL

Group K: Individual identity

These benchmarks are intended for checking the import of simple instances of classes and equivalences and differences among them.

ID

Description

OWL File

Graphical representation

ISK01

Import one class and two named individuals of the class that are the same

ISK01.OWL

ISK02

Import one class and two named individuals of the class that are the different

ISK02.OWL

ISK03

Import one class and three named individuals of the class that are all of them different

ISK03.OWL

Syntax and abbreviation

These benchmarks are not related with the OWL knowledge model, but with the possible variants in the use of the RDF/XML syntax in OWL ontologies.

Group L: Syntax and abbreviation benchmarks

ID

Description

OWL File

Graphical representation
URI reference benchmarks
ISL01 Import several resources with absolute URI references ISL01.OWL -
ISL02 Import several resources with URI references relative to a base URI ISL02.OWL -
ISL03 Import several resources with URI references transformed from rdf:ID attribute values ISL03.OWL -
ISL04 Import several resources with URI references relative to an ENTITY declaration ISL04.OWL -
Empty node benchmarks
ISL05 Import several resources with empty nodes ISL05.OWL -
ISL06 Import several resources with empty nodes shortened ISL06.OWL -
Multiple properties benchmarks
ISL07 Import several resources with multiple properties ISL07.OWL -
ISL08 Import several resources with multiple properties shortened ISL08.OWL -
Typed node benchmarks
ISL09 Import several resources with typed nodes ISL09.OWL -
ISL10 Import several resources with typed nodes shortened ISL10.OWL -
String literal benchmarks
ISL11 Import several resources with properties with string literals ISL11.OWL -
ISL12 Import several resources with properties with string literals as XML attributes ISL12.OWL -
Blank node benchmarks
ISL13 Import several resources with blank nodes with identifier ISL13.OWL -
ISL14 Import several resources with blank nodes shortened ISL14.OWL -
Language identification benchmarks
ISL15 Import several resources with properties with xml:lang attributes ISL15.OWL -
This benchmarking activity
is supported by the
Knowledge Web
Network of Excellence.		 KWeb logo

For any comment, suggestion, question; or if you want to participate either in the development of the suites or in the benckmarking activity, please drop an email to: .