Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate Zarr v3 compatibility module with registry. #699

Open
sharkinsspatial opened this issue Feb 6, 2025 · 1 comment
Open

Integrate Zarr v3 compatibility module with registry. #699

sharkinsspatial opened this issue Feb 6, 2025 · 1 comment

Comments

@sharkinsspatial
Copy link

Over in Virtualizarr we're in the process of transitioning our internal metadata model to Zarr v3 zarr-developers/VirtualiZarr#424 and in turn need to now update our codec pipeline specifications to v3 as well. Some of format readers extract codec configuration from archival files using format specific libraries (like h5py) and use that conf along with the numcodecs registry to return concrete Codec types.

Can we extend the registry to support returning Zarr v3 compatible codecs as well? I started exploring a PR but I was a bit unsure of how to tackle the optional Zarr v3 dep. I think the easiest path here might be separate zarrv3 registry module so that would raise the same ImportError. Any thoughts on the best path forward here?

@d-v-b
Copy link
Contributor

d-v-b commented Feb 10, 2025

codecs are only sensitive to the zarr v2 / zarr v3 distinction in their JSON representation. So if we can ensure that each codec can serialize to / from a zarr v2 or zarr v3 JSON representation, then there should be no problem with having the v3 codecs in the registry. And we 100% need to drop the zarr-python dependency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants