Experimental Evaluation JWS

We present more details of the experiments submitted to the Journal of Web Semantics. We performed two sets of tests taking into account the profile of the ontologies:

OWL DL: comparison of the classification task performed over 182 DL ontologies extracted from the ORE'13 dataset by the following reasoners:
- JFact
- HermiT
- Pellet
- TrOWL
OWL EL: comparison of the classification task performed over 193 EL ontologies extracted from the ORE'13 dataset by the following reasoners:
- ELK
- jcel
- JFact
- HermiT
- Pellet
- TrOWL

The tests were performed for the following devices:

Galaxy Nexus
Galaxy Tab 2 7.0
PC

Ontologies (DL)

Click here to download the complete DL dataset.

Stats Dataset (DL)

Dataset (DL)

Ontologies (EL)

Stats Dataset (EL)

Dataset (EL)

Galaxy Nexus

Results for the reasoners running on a Google Galaxy Nexus with Android 4.2.1:

JFact
HermiT
Pellet
TrOWL
ELK
jcel

Galaxy Nexus: JFact

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Nexus: HermiT

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Nexus: Pellet

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Nexus: TrOWL

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Nexus: ELK

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Nexus: jcel

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2 7.0

Results for the reasoners running on a Samsung Galaxy Tab 2 with Android 4.1.2:

JFact
HermiT
Pellet
TrOWL
ELK
jcel

Galaxy Tab 2: JFact

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2: HermiT

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2: Pellet

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2: TrOWL

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2: ELK

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

Galaxy Tab 2: jcel

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC

Results for the reasoners running on a Windows 64-bits, i5-2320, 3.00GHz, 16GB RAM:

JFact
HermiT
Pellet
TrOWL
ELK
jcel

PC: JFact

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC: HermiT

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC: Pellet

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC: TrOWL

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC: ELK

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error

PC: jcel

Note: Reasoner(C) represents the time needed for the creation of the reasoner, Reasoner(CL) represents the time needed for the classification task.
-777 represents an Unsupported Data Type error, -999 represents an Out Of Memory error