OAEI 2026 track · provisional
DISO-OAEI distributes ten curated ontologies spanning cyber security, command & control, and smart environments — and evaluates matching systems on two tasks: classic global alignment against a repaired silver standard, and candidate ranking with explicit NIL abstention.
The tasks
Task 1 measures whole-alignment quality the traditional OAEI way; Task 2 isolates local decision quality — including knowing when no match exists.
Submit one full OAEI Alignment RDF per pair. Scored with partiality-corrected precision, recall and F1 — micro- and macro-averaged — against the repaired silver standard R⁺≈, with the unrepaired R≈ as secondary. Self-score locally with the provided tools.
Task description →For each source entity, rank a fixed 50-candidate pool best-first — placing the NIL candidate early to abstain when no equivalent exists. Unsupervised; scored organiser-side with Hits@{1,3,5,10} and MRR, macro-averaged over both pairs.
Task description →Data
Three archives cover everything. Verify your copy against the SHA-256 checksums — they are computed from the shipped files on every site build.
| Archive | Contents | SHA-256 |
|---|---|---|
| _DISO_OM_ontologies.zip | The 10 task ontologies (OWL) | d3f8706109c8b50c28d713399ab31113af6176d4f142653948fa53bb878eec6e |
| _DISO_OM_reference_alignments.zip | Task 1 reference alignments (6 pairs) | bff2acae2155c4a63ca71f94961d7785c9433a3b561e736b37588fa26f882c0d |
| _DISO_ranking_candidates.zip | Task 2 candidate pools (2 pairs) | 294fe886f89e8ca07eaa7cdd1fd2949d6832f9eae58da199477ba275fe0663a7 |
Individual ontologies and per-pair reference files are listed on the ontologies and Task 1 pages. Reference alignment creation methodology: diso-mappings.
Timeline
The network
Drawn from the DISO collection — publicly available ontologies for defence, intelligence, national security, and operationally adjacent domains.
Citation
A Zenodo DOI for the track dataset is pending and will be published here once minted. Until then, cite the underlying collection:
Dilworth, J., Cotovio, P., Herron, D., Pesquita, C., Jimenez-Ruiz, E., Cripps, P., & Dewdney, N. (2026). DISO: Defence, Intelligence and Security Ontologies (1.1.0) [Data set]. Zenodo. https://doi.org/10.5281/zenodo.20760510
People
Jon Dilworth, Pedro Cotovio, and Ernesto Jimenez-Ruiz.
Dave Herron, Catia Pesquita, Paul Cripps, and Nigel Dewdney.
Supported by Turing Innovations Limited and The Alan Turing Institute's Defence and Security Programme via the project GUARD.
Questions or corrections: open an issue on the track repository or contact the organisers.