Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add experimental igzip #182

Merged
merged 30 commits into from
Sep 24, 2024
Merged

Add experimental igzip #182

merged 30 commits into from
Sep 24, 2024

Conversation

milesgranger
Copy link
Owner

@milesgranger milesgranger commented Sep 20, 2024 •
edited
Loading

Pretty much on point in performance compared to python-isal

Depends on:

TODO:

  • impl De/Compressor objects
  • fix CI
  • Only supported on 64bit systems per isa-l implementation

@milesgranger
Initial prototype [skip ci]
d84eeb8
@milesgranger
Add updated benchmarks for igzip impl
c2e158a
@milesgranger
Pending impl of write En/Decoder for igzip and updating tests [skip ci]
6c54636
@milesgranger
Add De/Compressors, igzip testing
fae7b1f
@milesgranger
Use updated libcramjam and CI
e24d1b8
@milesgranger
debugging - just windows failing?
91c1e61
@milesgranger
fixup: refactor
263723a
@milesgranger
Try again after some adjustments - everything sad except OSX builds
c7b7120
@milesgranger
debugging
893b182
@milesgranger
remove line break slashes
d182ecf
@milesgranger
try again - maybe just need to copy blosc2 setup with using system libs
f5816d6
@milesgranger
Try using isal system prebuilt lib like blosc2
9aba45d
@milesgranger
Fix feature gates for igzip
0c9ea58
@milesgranger
try to fix windows
0603de8
@milesgranger
another try
b08208b
@milesgranger
Try update isal
b67c6fe
@milesgranger
That worked, try to auto disable isal on 32bit
ec0782d
@milesgranger
Conditionally include igzip if 64bit sys
c47b868
@milesgranger
Another run after updating libcramjam
3d6a445
@milesgranger
Another run after updating libcramjam
5a87fb8
@milesgranger
fix build maybe
adda7bb
@milesgranger
Add back all builds
2de5c38
@milesgranger
fixup
549eb1e
@milesgranger
Debug failing builds now...bleh
15887fa
@milesgranger
Conditionally build isal in ci
26d52ef
@milesgranger
Fixup: mk empty dir when on 32-bit
ef57287
@milesgranger
Wrap up
ba5f6eb
@milesgranger
Fixup
6182802
@milesgranger
Try installing pre-built cross v0.2.5
2af19fe
@milesgranger milesgranger marked this pull request as ready for review September 24, 2024 10:56
@milesgranger milesgranger merged commit 2e6e379 into master Sep 24, 2024
100 checks passed
@milesgranger milesgranger deleted the add-igzip branch September 24, 2024 11:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@milesgranger