Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Developer guide: add more about validation #91

Open
yarikoptic opened this issue Aug 14, 2023 · 1 comment
Open

Developer guide: add more about validation #91

yarikoptic opened this issue Aug 14, 2023 · 1 comment
Assignees

Comments

@yarikoptic
Copy link
Member

yarikoptic commented Aug 14, 2023

ATM we have quite a lot of "heterogeneity" in how we do validation. We have multiple layers

  • pynwb

  • bidsschematools

  • nwbinspector

  • dandischema

  • dandi-cli glueing: uses above + adding more (zarr checking) - relies on content to be available, not just validation of extracted metadata

  • dandi-archive: invokes validations of dandischema, validates extracted metadata, not relying on content being present

We also have two "dataset layouts": DANDI and BIDS, with DANDI being our "ad-hoc" layout which is instrumented in code in dandi-cli.

NB We might move DANDI layout into dandischema

We have https://www.dandiarchive.org/handbook/135_validation/ which outlines to user only some, very limited, set of validations. We should get some more detailed description of "validation framework" and "DANDI layout" here.

edit: and then worth getting some meeting/presentation for DANDI team to sync our knowledge etc on all these aspects.

@yarikoptic yarikoptic self-assigned this Aug 14, 2023
@CodyCBakerPhD
Copy link
Contributor

I will also combine PyNWB + NWB Inspector validation into one when I debug the .nwb.zarr implementation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants