Code

single binary lindi using tar#89

Code

Merged

magland merged 40 commits intomainNeurodataWithoutBorders/lindi:mainfrom lindi-tarNeurodataWithoutBorders/lindi:lindi-tarCopy head branch name to clipboardSep 17, 2024

+3,507-201

Commits

Commits on Jul 9, 2024

• Split large unchunked contiguous HDF5 datasets into smaller chunks

  magland

  committed
  3bd8903

  Copy full SHA for 3bd8903

• relax timing test

  magland

  committed
  9f9a2d4

  Copy full SHA for 9f9a2d4

• Add auto chunk padding in LindiH5ZarrStore and LindiReferenceFileSystemStore

  magland

  committed
  a6ebaac

  Copy full SHA for a6ebaac

Commits on Jul 13, 2024

• Fix split chunk size calculations

  magland

  committed
  ac7acd2

  Copy full SHA for ac7acd2

Commits on Jul 16, 2024

• Remove debug print statements from SplitDatasetH5Item

  magland

  committed
  75a95d4

  Copy full SHA for 75a95d4

• Bump version to 0.3.13 in pyproject.toml

  magland

  committed
  ffcd45a

  Copy full SHA for ffcd45a

Commits on Jul 17, 2024

• Add method to retrieve keys in LindiH5pyFile class

  magland

  committed
  af32db8

  Copy full SHA for af32db8

Commits on Jul 18, 2024

• Implement items() for LindiH5pyFile

  magland

  committed
  24c5371

  Copy full SHA for 24c5371

• Merge branch 'impl-keys' into split-contiguous-datasets

  magland

  committed
  1db7e81

  Copy full SHA for 1db7e81

• Bump version to 0.3.14 in pyproject.toml

  magland

  committed
  b7fb391

  Copy full SHA for b7fb391

Commits on Jul 20, 2024

• Improve code comments

  magland

  committed
  18e3ecc

  Copy full SHA for 18e3ecc

• _get_padded_size()

  magland

  committed
  3b9f2e9

  Copy full SHA for 3b9f2e9

Commits on Aug 2, 2024

• lindi tar format

  magland

  committed
  34a21f9

  Copy full SHA for 34a21f9

• CI fix

  magland

  committed
  8c4a310

  Copy full SHA for 8c4a310

• Add lindi tar nwb example

  magland

  committed
  ab9abc6

  Copy full SHA for ab9abc6

• Update example

  magland

  committed
  f63ac99

  Copy full SHA for f63ac99

• Update LindiTarFile to handle remote file operations

  magland

  committed
  4e983ef

  Copy full SHA for 4e983ef

• Write local tar from remote h5

  magland

  committed
  11174b5

  Copy full SHA for 11174b5

Commits on Aug 3, 2024

• do not rely on tarfile

  magland

  committed
  dec2e6e

  Copy full SHA for dec2e6e

Commits on Aug 5, 2024

• Custom tarfile writer

  magland

  committed
  46f7d5f

  Copy full SHA for 46f7d5f

• Update readme

  magland

  committed
  52a3672

  Copy full SHA for 52a3672

• Update README.md: fix typo "ammending" to "amending"

  magland

  committed
  075419b

  Copy full SHA for 075419b

• Update README.md

  magland

  authored
  dcf15ae

  Copy full SHA for dcf15ae

• Update README.md

  magland

  authored
  facf095

  Copy full SHA for facf095

• Batch set items

  magland

  committed
  85d9bee

  Copy full SHA for 85d9bee

• Merge branch 'lindi-tar' of https://github.com/neurodatawithoutborders/lindi into lindi-tar

  magland

  committed
  d591c1b

  Copy full SHA for d591c1b

Commits on Aug 6, 2024

• Revise README

  magland

  committed
  7e3f3a7

  Copy full SHA for 7e3f3a7

• Update README

  magland

  committed
  bbbf24e

  Copy full SHA for bbbf24e

Commits on Aug 7, 2024

• Improve lindi tar functionality

  magland

  committed
  effbb1e

  Copy full SHA for effbb1e

• Add DANDI example

  magland

  committed
  06f7c8c

  Copy full SHA for 06f7c8c

• Fix typo in assertion message for ROS3 support check

  magland

  committed
  673a343

  Copy full SHA for 673a343

• Update index handling in tar operations

  magland

  committed
  cf4ddb1

  Copy full SHA for cf4ddb1

Commits on Aug 8, 2024

• Update source URL or path in LindiH5pyFile classes

  magland

  committed
  e8b8278

  Copy full SHA for e8b8278

• Update internal references to remote tar file

  magland

  committed
  c1c5d02

  Copy full SHA for c1c5d02

• Update reference check to include total size in calculation

  magland

  committed
  aeac788

  Copy full SHA for aeac788

Commits on Aug 9, 2024

• Require .tar extension on tar lindi files

  magland

  committed
  62873ea

  Copy full SHA for 62873ea

• Update file format description and allowed filename extension

  magland

  committed
  2aa0bde

  Copy full SHA for 2aa0bde

Commits on Aug 13, 2024

• Default chunking

  magland

  committed
  7e5e8c1

  Copy full SHA for 7e5e8c1

• Automatic retries for loading data from URL

  magland

  committed
  32ed84b

  Copy full SHA for 32ed84b

• Add exception handling for failed data loading

  magland

  committed
  1c495e5

  Copy full SHA for 1c495e5