Skip to content

bgzf/ciso/daxcr/dictzip/gzinga/migz/razf frontends using zlib/zlib-ng/7-zip/zopfli/libdeflate/miniz/libslz/igzip/cryptopp/kzip backends with parallel (de)compression. compilable with gcc/clang/icc/open64.

License

Notifications You must be signed in to change notification settings

cielavenir/7bgzf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

371f54c · Feb 10, 2025
Nov 24, 2020
Mar 20, 2024
Feb 10, 2025
Mar 20, 2024
May 5, 2021
May 5, 2021
May 5, 2021
May 5, 2021
May 5, 2021
May 5, 2021
May 5, 2021
Apr 25, 2024
Apr 29, 2024
Jul 2, 2021
Nov 24, 2020
Oct 31, 2022
Feb 10, 2025
Oct 31, 2022
Oct 31, 2022
May 5, 2021
Oct 31, 2022
Nov 16, 2022
Jun 14, 2020
Nov 24, 2020
Jun 14, 2020
Jun 14, 2020
Jun 14, 2020
May 1, 2024
Jul 2, 2021
Jul 2, 2021

Repository files navigation

7bgzf

  • a suite of DEFLATE (RFC 1951) algorithms
  • contact: please use my github profile or the email on the paper (now published!)

Building Instruction

  • Execute compile.sh.

    • 7bgzf is almost static; the dependency is only libc.
  • p7zip and htslib could be installed by system administration command.

  • 7bgzf.so can be injected into libhts.so using LD_PRELOAD environment variable.

    • However, since LD_PRELOAD utilizes procedure linkage table (PLT), samtools / bcftools need to link to libhts.so (not a).
      • The simplest way is to change config.mk.in @Hsource@HTSLIB = $(HTSDIR)/libhts.a to libhts.so.
      • Note: configure --enable-plugins does not work as symbols in exe are prioritized than LD_PRELOAD.
    • BGZF_METHOD environment variable is used to set the compression method. For example, BGZF_METHOD=libdeflate12 means libdeflate level 12.
    • Example: BGZF_METHOD=libdeflate12 LD_PRELOAD=./7bgzf.so samtools view ...
  • Detailed instruction for my ARM assessment should be available on the paper supplementary data.

Side notes (oh I can write this as the paper is published)

  • on-the-fly conversion of compressed files

I have not mentioned explicitly in the paper, but that conversion means PetaGene. They say they provide virtual filesystem via LD_PRELOAD. But I was not able to get evaluation copy - they say no personal evaluation.

About

bgzf/ciso/daxcr/dictzip/gzinga/migz/razf frontends using zlib/zlib-ng/7-zip/zopfli/libdeflate/miniz/libslz/igzip/cryptopp/kzip backends with parallel (de)compression. compilable with gcc/clang/icc/open64.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published