Skip to content

Commit

Permalink
Merge pull request #21 from aladinor/refactoring
Browse files Browse the repository at this point in the history
creating a ~1Gb dataset for reproducibility porposes
  • Loading branch information
aladinor authored Oct 4, 2024
2 parents cd2effd + accfc01 commit f344eaf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion sigmet2zarr/create_dataset.py
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ def radar_convert():
fs = fsspec.filesystem("s3", anon=True)
radar_files = [
f"s3://{i}" for i in sorted(fs.glob(f"{str_bucket}{query}*"))
]
][:30]
for files in batch(radar_files, n=12):
bag = db.from_sequence(files, npartitions=len(files)).map(
accessor_wrapper
Expand Down

0 comments on commit f344eaf

Please sign in to comment.