Skip to content

Add coverage tests for the remaining pilot metrics - #40

Merged
andresTabiTuwien merged 6 commits into
mainfrom
feat/pilot-tests-setup
Oct 26, 2026
Merged

andresTabiTuwien merged 6 commits into
mainfrom
feat/pilot-tests-setup

Conversation

@andresTabiTuwien

Copy link
Copy Markdown
Collaborator

Summary

Adds the 23 pilot metric tests that were still missing from DCSCoverageEvaluator, so all 43 OSTrails pilot metrics with a coverage test are now implemented. They are also registered in the database through CoverageMetricSeeder. Rules follow the OSTrails DMP evaluation metrics catalog (https://docs.ostrails.eu/en/latest/commons/dmp/dmp-evaluation-metrics.html). Where the catalog conflicts with the DMP Common Standard (DCS), the change is listed below.

Changes

New tests

Each test is one function, registered in DCSCoverageEvaluator.functionMap through its area file. The comment above each function states when it returns PASS, FAIL or INDETERMINATE.

New and reused datasets (DatasetProvenanceTests.kt)

  • data.new.1 New dataset declared
  • data.new.2 Collection or creation method (technical_resource)
  • data.new.3 Access conditions (data_access and license)
  • data.new.4 Sufficient metadata
  • data.reused.co.2 Persistent identifier
  • data.reused.co.3 License with start_date
  • data.reused.co.4 Distribution information
  • data.reused.co.6 Personal data flag
  • data.reused.co.7 Sensitive data flag
  • data.reused.co.8 Access URL
    Security, sensitive data and access (SecurityAccessTests.kt)
  • secur.co.2 Access rights management for sensitive data
  • secur.comp.1 GDPR or ethics review referenced
  • secur.co.4 Access control and user roles
  • sens.secure.co.1 Protection method described
  • data.shar.co.2 Data restrictions
  • data.shar.comp.2 Embargo
  • own.co.2 Data owner role
    Repository, storage and cost (RepositoryStorageTests.kt)
  • repo.comp.2 FAIR-conformant repository
  • store.cov.2 Secure storage in a trusted repository
  • repo.co.4 Backup strategy
  • meta.qual.2 README referenced
  • cost.co.1 Personnel and monetary budget
  • cost.co.2 No additional resources stated

@andresTabiTuwien
andresTabiTuwien merged commit a245450 into main Oct 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant