Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for zarr #423

Merged
merged 9 commits into from
Feb 1, 2025
Merged

Support for zarr #423

merged 9 commits into from
Feb 1, 2025

Conversation

gmaze
Copy link
Member

@gmaze gmaze commented Dec 19, 2024

In this PR we shall provide base support for exporting an Argo dataset to a zarr archives,local or remote.

A simple dataset export to zarr would be:

from argopy import DataFetcher
ds = DataFetcher(src='gdac', mode='expert').float(6903091).to_xarray()
ds.argo.to_zarr("6903091_prof.zarr")

Data variable types and compression would be automatically handled by argopy.

@gmaze gmaze added enhancement New feature or request performance labels Dec 19, 2024
Copy link

codecov bot commented Dec 19, 2024

❌ 1 Tests Failed:

Tests completed Failed Passed Skipped
1688 1 1687 217
View the top 1 failed tests by shortest run time
.::.
Stack Traces | 0s run time
C:\Users\runneradmin\micromamba\envs\argopy-tests\Lib\importlib\__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1204: in _gcd_import
    ???
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1126: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:241: in _call_with_frames_removed
    ???
<frozen importlib._bootstrap>:1204: in _gcd_import
    ???
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1126: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:241: in _call_with_frames_removed
    ???
<frozen importlib._bootstrap>:1204: in _gcd_import
    ???
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:940: in exec_module
    ???
<frozen importlib._bootstrap>:241: in _call_with_frames_removed
    ???
argopy\__init__.py:28: in <module>
    from .xarray import ArgoAccessor  # noqa: E402
argopy\xarray.py:11: in <module>
    from dask.delayed import Delayed
E   ModuleNotFoundError: No module named 'dask'

To view more test analytics, go to the Test Analytics Dashboard
📢 Thoughts on this report? Let us know!

@gmaze gmaze self-assigned this Jan 31, 2025
gmaze added 3 commits January 31, 2025 16:14
fux bug whereby knowns GDAC were not checked alive by isAPIconnected
@gmaze gmaze marked this pull request as ready for review January 31, 2025 15:47
fix bug for core env
@gmaze gmaze merged commit 42938a6 into master Feb 1, 2025
39 checks passed
@gmaze gmaze deleted the support-zarr branch February 3, 2025 08:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant