Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Icechunk #1

Draft
wants to merge 41 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
b65b627
Update env with icechunk
dcherian Dec 3, 2024
d677c8e
Support Icechunk stores
dcherian Dec 3, 2024
8672cab
try again
dcherian Dec 3, 2024
fbb5c27
cleanup
dcherian Dec 4, 2024
d2087e9
Update container
dcherian Jan 17, 2025
3f13157
new apps
dcherian Jan 17, 2025
9a9d0ce
Pass around Repo/uri instead of Store
dcherian Jan 17, 2025
99d2b85
rework committing
dcherian Jan 17, 2025
8c81366
update versions
dcherian Jan 23, 2025
639f47c
boost timeout on write_herbie
dcherian Jan 23, 2025
b571d7d
Revert "update versions"
dcherian Jan 24, 2025
7bd4e13
One more log statement
dcherian Jan 24, 2025
8ad8b67
silence subnormal warning?
dcherian Jan 24, 2025
84647bd
some docstrings
dcherian Jan 24, 2025
0508d24
Perhaps easier logs?
dcherian Jan 24, 2025
07c5eab
some log formatting
dcherian Jan 24, 2025
924b4b2
silence warnings some more.
dcherian Jan 24, 2025
1132688
remove dask from writing
dcherian Jan 24, 2025
701be44
one more log statement
dcherian Jan 29, 2025
261dcce
Merge branch 'main' into icechunk
dcherian Jan 29, 2025
fa8b32d
Add verify
dcherian Jan 29, 2025
fc4ca15
verify: read all steps by default
dcherian Jan 29, 2025
200b1de
5 min cron
dcherian Jan 29, 2025
7a71a72
add logging store
dcherian Jan 30, 2025
8ead4df
turn on logging store, bump timeout
dcherian Jan 30, 2025
f4a48a9
update pins
dcherian Jan 31, 2025
44eac1a
bump al
dcherian Feb 3, 2025
28b801e
bump icechunk
dcherian Feb 3, 2025
0a8d6f2
Silence one more warning?
dcherian Feb 3, 2025
fdc02b8
generalize more
dcherian Feb 4, 2025
fec05af
fix warning ignores?
dcherian Feb 4, 2025
019d5f7
try again
dcherian Feb 4, 2025
1e4e34a
back to 3.11
dcherian Feb 4, 2025
f0e6084
update env
dcherian Feb 4, 2025
06c4455
dev icechunk
dcherian Feb 4, 2025
7661855
limit zarr concurrency
dcherian Feb 4, 2025
2fb90a9
update log message
dcherian Feb 4, 2025
4fc19c2
fix verify
dcherian Feb 6, 2025
ee04ad3
limit to single concurrency
dcherian Feb 6, 2025
987cf42
WIp gfs
dcherian Feb 24, 2025
287755c
Bump icechunk, zarr, arraylake
dcherian Feb 24, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ channels:
- conda-forge

dependencies:
- arraylake
- arraylake >=0.14.0
- cfgrib
- dask
- fsspec
Expand All @@ -12,3 +12,4 @@ dependencies:
- xarray
- pip:
- modal
- icechunk
Loading