#bzip3 — Public Fediverse posts

Ok, that was really unexpected. ;)

#Compression #bzip3

386,009,603 'IMG_8676.xcf'
188,423,510 'IMG_8676.xcf.zst'  #(zstd --ultra -22 was used)
179,906,528 'IMG_8676.xcf.xz'   #(xz -9e was used)
179,719,797 'IMG_8676.xcf.7z'   #(highest options available on 7z were used, IIRC (original file))
140,906,669 'IMG_8676.xcf.bz3'  #(just bzip3, no options specified)

bzip3 is also the fastest out of these (with the given parameters)

Ok, that was really unexpected. ;)

#Compression #bzip3

386,009,603 'IMG_8676.xcf'
188,423,510 'IMG_8676.xcf.zst'  #(zstd --ultra -22 was used)
179,906,528 'IMG_8676.xcf.xz'   #(xz -9e was used)
179,719,797 'IMG_8676.xcf.7z'   #(highest options available on 7z were used, IIRC (original file))
140,906,669 'IMG_8676.xcf.bz3'  #(just bzip3, no options specified)

bzip3 is also the fastest out of these (with the given parameters)

Ok, that was really unexpected. ;)

#Compression #bzip3

386,009,603 'IMG_8676.xcf'
188,423,510 'IMG_8676.xcf.zst'  #(zstd --ultra -22 was used)
179,906,528 'IMG_8676.xcf.xz'   #(xz -9e was used)
179,719,797 'IMG_8676.xcf.7z'   #(highest options available on 7z were used, IIRC (original file))
140,906,669 'IMG_8676.xcf.bz3'  #(just bzip3, no options specified)

bzip3 is also the fastest out of these (with the given parameters)

Ok, that was really unexpected. ;)

#Compression #bzip3

386,009,603 'IMG_8676.xcf'
188,423,510 'IMG_8676.xcf.zst'  #(zstd --ultra -22 was used)
179,906,528 'IMG_8676.xcf.xz'   #(xz -9e was used)
179,719,797 'IMG_8676.xcf.7z'   #(highest options available on 7z were used, IIRC (original file))
140,906,669 'IMG_8676.xcf.bz3'  #(just bzip3, no options specified)

bzip3 is also the fastest out of these (with the given parameters)

Ok, that was really unexpected. ;)

#Compression #bzip3

386,009,603 'IMG_8676.xcf'
188,423,510 'IMG_8676.xcf.zst'  #(zstd --ultra -22 was used)
179,906,528 'IMG_8676.xcf.xz'   #(xz -9e was used)
179,719,797 'IMG_8676.xcf.7z'   #(highest options available on 7z were used, IIRC (original file))
140,906,669 'IMG_8676.xcf.bz3'  #(just bzip3, no options specified)

bzip3 is also the fastest out of these (with the given parameters)

@taylor

Yeah! Of course, this is still a block-sorting compression algorithm*, so you wont get much advantages over zstd or xz when dealing with datasets with more inherent entropy like binary files or whatnot, but it does miracles for text.

* Of course I know what that means. Tell you what, you tell me what you think it means, and I'll tell you if you're right. 🤣

Here's an example with non-text data, where you see that #bzip3 isn't as strong:

Pictures$ for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < Hobbes.jpg |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
3445659 cat
3444164 xz -9e
3441839 zstd --ultra -22
3439158 gzip -9
3384450 bzip2 -9
3274433 bzip3

WAIT.
WHAT.

Let's try something else...

Videos$ f="Federated Timeline.webm"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
1231940 bzip2 -9
1231269 bzip3
1227060 xz -9e
1226931 cat
1226421 zstd --ultra -22
1226241 gzip -9

WHAT?!? THE WORLD IS BROKEN!!!

TrYiNg AgAiNnNn...

Documents$ f="Thinkpad x200 hardware maintenance manual.pdf"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
8942833 cat
8657277 bzip2 -9
8617801 gzip -9
8592319 bzip3
8568484 xz -9e
8535244 zstd --ultra -22

Ok, that makes sense. That's what I was expecting.

YOU SAW NOTHING ELSE. DON'T ASK ME ANY MORE QUESTIONS. 🤣

P.S., here's another interesting one:

138240138   cat (large BMP file)
  3768642	gzip -9
  3143455   PNG format
  1987020	zstd --ultra -22
  1592854	bzip2 -9
  1512291	bzip3
  1501540	xz -9e

@taylor

Yeah! Of course, this is still a block-sorting compression algorithm*, so you wont get much advantages over zstd or xz when dealing with datasets with more inherent entropy like binary files or whatnot, but it does miracles for text.

* Of course I know what that means. Tell you what, you tell me what you think it means, and I'll tell you if you're right. 🤣

Here's an example with non-text data, where you see that #bzip3 isn't as strong:

Pictures$ for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < Hobbes.jpg |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
3445659 cat
3444164 xz -9e
3441839 zstd --ultra -22
3439158 gzip -9
3384450 bzip2 -9
3274433 bzip3

WAIT.
WHAT.

Let's try something else...

Videos$ f="Federated Timeline.webm"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
1231940 bzip2 -9
1231269 bzip3
1227060 xz -9e
1226931 cat
1226421 zstd --ultra -22
1226241 gzip -9

WHAT?!? THE WORLD IS BROKEN!!!

TrYiNg AgAiNnNn...

Documents$ f="Thinkpad x200 hardware maintenance manual.pdf"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
8942833 cat
8657277 bzip2 -9
8617801 gzip -9
8592319 bzip3
8568484 xz -9e
8535244 zstd --ultra -22

Ok, that makes sense. That's what I was expecting.

YOU SAW NOTHING ELSE. DON'T ASK ME ANY MORE QUESTIONS. 🤣

P.S., here's another interesting one:

138240138   cat (large BMP file)
  3768642	gzip -9
  3143455   PNG format
  1987020	zstd --ultra -22
  1592854	bzip2 -9
  1512291	bzip3
  1501540	xz -9e

@taylor

Yeah! Of course, this is still a block-sorting compression algorithm*, so you wont get much advantages over zstd or xz when dealing with datasets with more inherent entropy like binary files or whatnot, but it does miracles for text.

* Of course I know what that means. Tell you what, you tell me what you think it means, and I'll tell you if you're right. 🤣

Here's an example with non-text data, where you see that #bzip3 isn't as strong:

Pictures$ for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < Hobbes.jpg |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
3445659 cat
3444164 xz -9e
3441839 zstd --ultra -22
3439158 gzip -9
3384450 bzip2 -9
3274433 bzip3

WAIT.
WHAT.

Let's try something else...

Videos$ f="Federated Timeline.webm"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
1231940 bzip2 -9
1231269 bzip3
1227060 xz -9e
1226931 cat
1226421 zstd --ultra -22
1226241 gzip -9

WHAT?!? THE WORLD IS BROKEN!!!

TrYiNg AgAiNnNn...

Documents$ f="Thinkpad x200 hardware maintenance manual.pdf"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
8942833 cat
8657277 bzip2 -9
8617801 gzip -9
8592319 bzip3
8568484 xz -9e
8535244 zstd --ultra -22

Ok, that makes sense. That's what I was expecting.

YOU SAW NOTHING ELSE. DON'T ASK ME ANY MORE QUESTIONS. 🤣

P.S., here's another interesting one:

138240138   cat (large BMP file)
  3768642	gzip -9
  3143455   PNG format
  1987020	zstd --ultra -22
  1592854	bzip2 -9
  1512291	bzip3
  1501540	xz -9e

@taylor

Yeah! Of course, this is still a block-sorting compression algorithm*, so you wont get much advantages over zstd or xz when dealing with datasets with more inherent entropy like binary files or whatnot, but it does miracles for text.

* Of course I know what that means. Tell you what, you tell me what you think it means, and I'll tell you if you're right. 🤣

Here's an example with non-text data, where you see that #bzip3 isn't as strong:

Pictures$ for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < Hobbes.jpg |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
3445659 cat
3444164 xz -9e
3441839 zstd --ultra -22
3439158 gzip -9
3384450 bzip2 -9
3274433 bzip3

WAIT.
WHAT.

Let's try something else...

Videos$ f="Federated Timeline.webm"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
1231940 bzip2 -9
1231269 bzip3
1227060 xz -9e
1226931 cat
1226421 zstd --ultra -22
1226241 gzip -9

WHAT?!? THE WORLD IS BROKEN!!!

TrYiNg AgAiNnNn...

Documents$ f="Thinkpad x200 hardware maintenance manual.pdf"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
8942833 cat
8657277 bzip2 -9
8617801 gzip -9
8592319 bzip3
8568484 xz -9e
8535244 zstd --ultra -22

Ok, that makes sense. That's what I was expecting.

YOU SAW NOTHING ELSE. DON'T ASK ME ANY MORE QUESTIONS. 🤣

P.S., here's another interesting one:

138240138   cat (large BMP file)
  3768642	gzip -9
  3143455   PNG format
  1987020	zstd --ultra -22
  1592854	bzip2 -9
  1512291	bzip3
  1501540	xz -9e

@taylor

Yeah! Of course, this is still a block-sorting compression algorithm*, so you wont get much advantages over zstd or xz when dealing with datasets with more inherent entropy like binary files or whatnot, but it does miracles for text.

* Of course I know what that means. Tell you what, you tell me what you think it means, and I'll tell you if you're right. 🤣

Here's an example with non-text data, where you see that #bzip3 isn't as strong:

Pictures$ for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < Hobbes.jpg |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
3445659 cat
3444164 xz -9e
3441839 zstd --ultra -22
3439158 gzip -9
3384450 bzip2 -9
3274433 bzip3

WAIT.
WHAT.

Let's try something else...

Videos$ f="Federated Timeline.webm"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
1231940 bzip2 -9
1231269 bzip3
1227060 xz -9e
1226931 cat
1226421 zstd --ultra -22
1226241 gzip -9

WHAT?!? THE WORLD IS BROKEN!!!

TrYiNg AgAiNnNn...

Documents$ f="Thinkpad x200 hardware maintenance manual.pdf"; for x in cat "gzip -9" "bzip2 -9" "bzip3" "zstd --ultra -22" "xz -9e"; do $x < "$f" |wc -c |tr "\n" "\t"; echo "$x"; done |sort -rn
8942833 cat
8657277 bzip2 -9
8617801 gzip -9
8592319 bzip3
8568484 xz -9e
8535244 zstd --ultra -22

Ok, that makes sense. That's what I was expecting.

YOU SAW NOTHING ELSE. DON'T ASK ME ANY MORE QUESTIONS. 🤣

P.S., here's another interesting one:

138240138   cat (large BMP file)
  3768642	gzip -9
  3143455   PNG format
  1987020	zstd --ultra -22
  1592854	bzip2 -9
  1512291	bzip3
  1501540	xz -9e

For text with a lot of repetition, #bzip3 still blows my mind. 😆

rld@Intrepid:Documents$ for x in cat "gzip -9" "zstd --ultra -22" "xz -9e" "bzip2 -9" bzip3; do $x < weatherlog-2024.txt |wc -c |tr "\n" "\t"; echo "$x"; done
 1735300	cat
   80423	gzip -9
   63275	zstd --ultra -22
   53516	xz -9e
   52374	bzip2 -9
   40645	bzip3
rld@Intrepid:Documents$ echo 1735300/40645 |bc -l
42.69405830975519744125

#Lossless #Compression #LosslessCompression

P.S. times:

real 1.49 zstd --ultra -22
real 0.94 xz -9e
real 0.23 bzip2 -9
real 0.07 gzip -9
real 0.06 bzip3
real 0.00 cat

DANG. 😂

For text with a lot of repetition, #bzip3 still blows my mind. 😆

rld@Intrepid:Documents$ for x in cat "gzip -9" "zstd --ultra -22" "xz -9e" "bzip2 -9" bzip3; do $x < weatherlog-2024.txt |wc -c |tr "\n" "\t"; echo "$x"; done
 1735300	cat
   80423	gzip -9
   63275	zstd --ultra -22
   53516	xz -9e
   52374	bzip2 -9
   40645	bzip3
rld@Intrepid:Documents$ echo 1735300/40645 |bc -l
42.69405830975519744125

#Lossless #Compression #LosslessCompression

P.S. times:

real 1.49 zstd --ultra -22
real 0.94 xz -9e
real 0.23 bzip2 -9
real 0.07 gzip -9
real 0.06 bzip3
real 0.00 cat

DANG. 😂

For text with a lot of repetition, #bzip3 still blows my mind. 😆

rld@Intrepid:Documents$ for x in cat "gzip -9" "zstd --ultra -22" "xz -9e" "bzip2 -9" bzip3; do $x < weatherlog-2024.txt |wc -c |tr "\n" "\t"; echo "$x"; done
 1735300	cat
   80423	gzip -9
   63275	zstd --ultra -22
   53516	xz -9e
   52374	bzip2 -9
   40645	bzip3
rld@Intrepid:Documents$ echo 1735300/40645 |bc -l
42.69405830975519744125

#Lossless #Compression #LosslessCompression

P.S. times:

real 1.49 zstd --ultra -22
real 0.94 xz -9e
real 0.23 bzip2 -9
real 0.07 gzip -9
real 0.06 bzip3
real 0.00 cat

DANG. 😂

For text with a lot of repetition, #bzip3 still blows my mind. 😆

rld@Intrepid:Documents$ for x in cat "gzip -9" "zstd --ultra -22" "xz -9e" "bzip2 -9" bzip3; do $x < weatherlog-2024.txt |wc -c |tr "\n" "\t"; echo "$x"; done
 1735300	cat
   80423	gzip -9
   63275	zstd --ultra -22
   53516	xz -9e
   52374	bzip2 -9
   40645	bzip3
rld@Intrepid:Documents$ echo 1735300/40645 |bc -l
42.69405830975519744125

#Lossless #Compression #LosslessCompression

P.S. times:

real 1.49 zstd --ultra -22
real 0.94 xz -9e
real 0.23 bzip2 -9
real 0.07 gzip -9
real 0.06 bzip3
real 0.00 cat

DANG. 😂

For text with a lot of repetition, #bzip3 still blows my mind. 😆

rld@Intrepid:Documents$ for x in cat "gzip -9" "zstd --ultra -22" "xz -9e" "bzip2 -9" bzip3; do $x < weatherlog-2024.txt |wc -c |tr "\n" "\t"; echo "$x"; done
 1735300	cat
   80423	gzip -9
   63275	zstd --ultra -22
   53516	xz -9e
   52374	bzip2 -9
   40645	bzip3
rld@Intrepid:Documents$ echo 1735300/40645 |bc -l
42.69405830975519744125

#Lossless #Compression #LosslessCompression

P.S. times:

real 1.49 zstd --ultra -22
real 0.94 xz -9e
real 0.23 bzip2 -9
real 0.07 gzip -9
real 0.06 bzip3
real 0.00 cat

DANG. 😂

New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

#bzip3, y'all!

17,396,992 Apr 15 18:52 powertrack-Excelsior-2024.txt
   564,163 Apr 15 18:52 powertrack-Excelsior-2024.txt.bz3

~ $ tail powertrack.txt 
2025-04-15 18:44 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:48
2025-04-15 18:45 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:49
2025-04-15 18:46 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:50
2025-04-15 18:47 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:51
2025-04-15 18:48 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:52
2025-04-15 18:49 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:53
2025-04-15 18:50 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:54
2025-04-15 18:51 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:55
2025-04-15 18:52 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:56
2025-04-15 18:53 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:57

#bzip3, y'all!

17,396,992 Apr 15 18:52 powertrack-Excelsior-2024.txt
   564,163 Apr 15 18:52 powertrack-Excelsior-2024.txt.bz3

~ $ tail powertrack.txt 
2025-04-15 18:44 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:48
2025-04-15 18:45 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:49
2025-04-15 18:46 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:50
2025-04-15 18:47 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:51
2025-04-15 18:48 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:52
2025-04-15 18:49 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:53
2025-04-15 18:50 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:54
2025-04-15 18:51 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:55
2025-04-15 18:52 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:56
2025-04-15 18:53 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:57

#bzip3, y'all!

17,396,992 Apr 15 18:52 powertrack-Excelsior-2024.txt
   564,163 Apr 15 18:52 powertrack-Excelsior-2024.txt.bz3

~ $ tail powertrack.txt 
2025-04-15 18:44 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:48
2025-04-15 18:45 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:49
2025-04-15 18:46 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:50
2025-04-15 18:47 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:51
2025-04-15 18:48 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:52
2025-04-15 18:49 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:53
2025-04-15 18:50 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:54
2025-04-15 18:51 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:55
2025-04-15 18:52 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:56
2025-04-15 18:53 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:57

#bzip3, y'all!

17,396,992 Apr 15 18:52 powertrack-Excelsior-2024.txt
   564,163 Apr 15 18:52 powertrack-Excelsior-2024.txt.bz3

~ $ tail powertrack.txt 
2025-04-15 18:44 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:48
2025-04-15 18:45 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:49
2025-04-15 18:46 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:50
2025-04-15 18:47 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:51
2025-04-15 18:48 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:52
2025-04-15 18:49 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:53
2025-04-15 18:50 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:54
2025-04-15 18:51 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:55
2025-04-15 18:52 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:56
2025-04-15 18:53 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:57

#bzip3, y'all!

17,396,992 Apr 15 18:52 powertrack-Excelsior-2024.txt
   564,163 Apr 15 18:52 powertrack-Excelsior-2024.txt.bz3

~ $ tail powertrack.txt 
2025-04-15 18:44 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:48
2025-04-15 18:45 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:49
2025-04-15 18:46 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:50
2025-04-15 18:47 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:51
2025-04-15 18:48 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:52
2025-04-15 18:49 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:53
2025-04-15 18:50 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:54
2025-04-15 18:51 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:55
2025-04-15 18:52 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:56
2025-04-15 18:53 Battery 0: Not charging, 81%; 0.00488959 W; uptime:  4:57

#bzip3 continues to amaze me:

-rw-r--r-- 1 ~~~ ~~~ 100M Apr  1  2025 outbox.json
$ simplify $(bzip3 < outbox.json |wc -c)
4.57 MiB
$ simplify $(xz -9e < outbox.json |wc -c)
4.69 MiB
$ simplify $(zstd --ultra -22 < outbox.json |wc -c)
5.06 MiB

(I didn't time it, but it was much faster than the other two)

Also, just in case anyone's curious, simplify (poor name pick, but I couldn't think of anything better) is just a bash function for converting byte counts to an SI unit:

function simplify { #Reduces a big bytes count down to megabytes or whatnot
    local steps num
    [ $1 ] || ( warn "simplify() called without parameters\n  (requires a number of bytes with no unit name)"; return 1 )
    steps=0
    num=$1
    while [[ $(echo "$num > 1024" |bc) == 1 ]]  #bc has to be used because num is a float
    do
        let steps++
        num=$(echo "$num/1024" |bc -l)
    done
    #Cut off after two decimal place:
    num=$(echo "$num" |sed 's/\(\.[0-9][0-9]\)[0-9]*$/\1/')
    printf "$num "
    case $steps in
        0)  echo b;;
        1)  echo KiB;;
        2)  echo MiB;;
        3)  echo GiB;;
        4)  echo TiB;;
        5)  echo PiB;;
        6)  echo EiB;;
        7)  echo ZiB;;
        8)  echo YiB;;
        *)  echo "1024 ^ $steps bytes";;
    esac
}

#bzip3 continues to amaze me:

-rw-r--r-- 1 ~~~ ~~~ 100M Apr  1  2025 outbox.json
$ simplify $(bzip3 < outbox.json |wc -c)
4.57 MiB
$ simplify $(xz -9e < outbox.json |wc -c)
4.69 MiB
$ simplify $(zstd --ultra -22 < outbox.json |wc -c)
5.06 MiB

(I didn't time it, but it was much faster than the other two)

Also, just in case anyone's curious, simplify (poor name pick, but I couldn't think of anything better) is just a bash function for converting byte counts to an SI unit:

function simplify { #Reduces a big bytes count down to megabytes or whatnot
    local steps num
    [ $1 ] || ( warn "simplify() called without parameters\n  (requires a number of bytes with no unit name)"; return 1 )
    steps=0
    num=$1
    while [[ $(echo "$num > 1024" |bc) == 1 ]]  #bc has to be used because num is a float
    do
        let steps++
        num=$(echo "$num/1024" |bc -l)
    done
    #Cut off after two decimal place:
    num=$(echo "$num" |sed 's/\(\.[0-9][0-9]\)[0-9]*$/\1/')
    printf "$num "
    case $steps in
        0)  echo b;;
        1)  echo KiB;;
        2)  echo MiB;;
        3)  echo GiB;;
        4)  echo TiB;;
        5)  echo PiB;;
        6)  echo EiB;;
        7)  echo ZiB;;
        8)  echo YiB;;
        *)  echo "1024 ^ $steps bytes";;
    esac
}

#bzip3 continues to amaze me:

-rw-r--r-- 1 ~~~ ~~~ 100M Apr  1  2025 outbox.json
$ simplify $(bzip3 < outbox.json |wc -c)
4.57 MiB
$ simplify $(xz -9e < outbox.json |wc -c)
4.69 MiB
$ simplify $(zstd --ultra -22 < outbox.json |wc -c)
5.06 MiB

(I didn't time it, but it was much faster than the other two)

Also, just in case anyone's curious, simplify (poor name pick, but I couldn't think of anything better) is just a bash function for converting byte counts to an SI unit:

function simplify { #Reduces a big bytes count down to megabytes or whatnot
    local steps num
    [ $1 ] || ( warn "simplify() called without parameters\n  (requires a number of bytes with no unit name)"; return 1 )
    steps=0
    num=$1
    while [[ $(echo "$num > 1024" |bc) == 1 ]]  #bc has to be used because num is a float
    do
        let steps++
        num=$(echo "$num/1024" |bc -l)
    done
    #Cut off after two decimal place:
    num=$(echo "$num" |sed 's/\(\.[0-9][0-9]\)[0-9]*$/\1/')
    printf "$num "
    case $steps in
        0)  echo b;;
        1)  echo KiB;;
        2)  echo MiB;;
        3)  echo GiB;;
        4)  echo TiB;;
        5)  echo PiB;;
        6)  echo EiB;;
        7)  echo ZiB;;
        8)  echo YiB;;
        *)  echo "1024 ^ $steps bytes";;
    esac
}

#bzip3 continues to amaze me:

-rw-r--r-- 1 ~~~ ~~~ 100M Apr  1  2025 outbox.json
$ simplify $(bzip3 < outbox.json |wc -c)
4.57 MiB
$ simplify $(xz -9e < outbox.json |wc -c)
4.69 MiB
$ simplify $(zstd --ultra -22 < outbox.json |wc -c)
5.06 MiB

(I didn't time it, but it was much faster than the other two)

Also, just in case anyone's curious, simplify (poor name pick, but I couldn't think of anything better) is just a bash function for converting byte counts to an SI unit:

function simplify { #Reduces a big bytes count down to megabytes or whatnot
    local steps num
    [ $1 ] || ( warn "simplify() called without parameters\n  (requires a number of bytes with no unit name)"; return 1 )
    steps=0
    num=$1
    while [[ $(echo "$num > 1024" |bc) == 1 ]]  #bc has to be used because num is a float
    do
        let steps++
        num=$(echo "$num/1024" |bc -l)
    done
    #Cut off after two decimal place:
    num=$(echo "$num" |sed 's/\(\.[0-9][0-9]\)[0-9]*$/\1/')
    printf "$num "
    case $steps in
        0)  echo b;;
        1)  echo KiB;;
        2)  echo MiB;;
        3)  echo GiB;;
        4)  echo TiB;;
        5)  echo PiB;;
        6)  echo EiB;;
        7)  echo ZiB;;
        8)  echo YiB;;
        *)  echo "1024 ^ $steps bytes";;
    esac
}

#bzip3 continues to amaze me:

-rw-r--r-- 1 ~~~ ~~~ 100M Apr  1  2025 outbox.json
$ simplify $(bzip3 < outbox.json |wc -c)
4.57 MiB
$ simplify $(xz -9e < outbox.json |wc -c)
4.69 MiB
$ simplify $(zstd --ultra -22 < outbox.json |wc -c)
5.06 MiB

(I didn't time it, but it was much faster than the other two)

Also, just in case anyone's curious, simplify (poor name pick, but I couldn't think of anything better) is just a bash function for converting byte counts to an SI unit:

function simplify { #Reduces a big bytes count down to megabytes or whatnot
    local steps num
    [ $1 ] || ( warn "simplify() called without parameters\n  (requires a number of bytes with no unit name)"; return 1 )
    steps=0
    num=$1
    while [[ $(echo "$num > 1024" |bc) == 1 ]]  #bc has to be used because num is a float
    do
        let steps++
        num=$(echo "$num/1024" |bc -l)
    done
    #Cut off after two decimal place:
    num=$(echo "$num" |sed 's/\(\.[0-9][0-9]\)[0-9]*$/\1/')
    printf "$num "
    case $steps in
        0)  echo b;;
        1)  echo KiB;;
        2)  echo MiB;;
        3)  echo GiB;;
        4)  echo TiB;;
        5)  echo PiB;;
        6)  echo EiB;;
        7)  echo ZiB;;
        8)  echo YiB;;
        *)  echo "1024 ^ $steps bytes";;
    esac
}

Tein vähän #pakkaus-kokeiluja törmättyäni taannoin uuteen pakkaimeen, #Bzip3:een. Ainakin minun tiedostojeni #varmuuskopiointi-pakkaamisessa se hävisi pakkausteholtaan selvästi #XZ:lle, jota olen varmuuskopiointiin käyttänyt, ja pakkausnopeudeltaan selvästi #ZStd:lle, johon siirtymistä olin aprikoinut. #atkjuttuja

Tein vähän #pakkaus-kokeiluja törmättyäni taannoin uuteen pakkaimeen, #Bzip3:een. Ainakin minun tiedostojeni #varmuuskopiointi-pakkaamisessa se hävisi pakkausteholtaan selvästi #XZ:lle, jota olen varmuuskopiointiin käyttänyt, ja pakkausnopeudeltaan selvästi #ZStd:lle, johon siirtymistä olin aprikoinut. #atkjuttuja

Tein vähän #pakkaus-kokeiluja törmättyäni taannoin uuteen pakkaimeen, #Bzip3:een. Ainakin minun tiedostojeni #varmuuskopiointi-pakkaamisessa se hävisi pakkausteholtaan selvästi #XZ:lle, jota olen varmuuskopiointiin käyttänyt, ja pakkausnopeudeltaan selvästi #ZStd:lle, johon siirtymistä olin aprikoinut. #atkjuttuja

Tein vähän #pakkaus-kokeiluja törmättyäni taannoin uuteen pakkaimeen, #Bzip3:een. Ainakin minun tiedostojeni #varmuuskopiointi-pakkaamisessa se hävisi pakkausteholtaan selvästi #XZ:lle, jota olen varmuuskopiointiin käyttänyt, ja pakkausnopeudeltaan selvästi #ZStd:lle, johon siirtymistä olin aprikoinut. #atkjuttuja

Tein vähän #pakkaus-kokeiluja törmättyäni taannoin uuteen pakkaimeen, #Bzip3:een. Ainakin minun tiedostojeni #varmuuskopiointi-pakkaamisessa se hävisi pakkausteholtaan selvästi #XZ:lle, jota olen varmuuskopiointiin käyttänyt, ja pakkausnopeudeltaan selvästi #ZStd:lle, johon siirtymistä olin aprikoinut. #atkjuttuja

BZip3

在 Hacker News 上看到 BZip3 的連結：「Bzip3: A spiritual successor to BZip2 (github.com/kspalaiologos)」。

雖然名字看起來與 bzip2 有關，但看起來是不同的人弄出來的東西，不過有些經典的演算法有留下來用，像是 Burrows-Wheeler transform。

另外值得一提的是，bzip2 是 1996 年出的 (不過 1.0 大約是 2000 年時出的)，BZip3 的第一個 release 在 2022 年，這段時間也累積了不少有趣的演算法可以用。

無損壓縮中如果期望有比較的壓縮率，目前比較常用的應該是 LZMA 類的演算法 (差不多是 2001 年出現的)，用的工具通常會是 X

https://blog.gslin.org/archives/2025/02/02/12240/bzip3/

#Computer #Murmuring #Software #bzip2 #bzip3 #compression #lzma #ratio #xz

BZip3

在 Hacker News 上看到 BZip3 的連結：「Bzip3: A spiritual successor to BZip2 (github.com/kspalaiologos)」。

雖然名字看起來與 bzip2 有關，但看起來是不同的人弄出來的東西，不過有些經典的演算法有留下來用，像是 Burrows-Wheeler transform。

另外值得一提的是，bzip2 是 1996 年出的 (不過 1.0 大約是 2000 年時出的)，BZip3 的第一個 release 在 2022 年，這段時間也累積了不少有趣的演算法可以用。

無損壓縮中如果期望有比較的壓縮率，目前比較常用的應該是 LZMA 類的演算法 (差不多是 2001 年出現的)，用的工具通常會是 X

https://blog.gslin.org/archives/2025/02/02/12240/bzip3/

#Computer #Murmuring #Software #bzip2 #bzip3 #compression #lzma #ratio #xz

BZip3

在 Hacker News 上看到 BZip3 的連結：「Bzip3: A spiritual successor to BZip2 (github.com/kspalaiologos)」。

雖然名字看起來與 bzip2 有關，但看起來是不同的人弄出來的東西，不過有些經典的演算法有留下來用，像是 Burrows-Wheeler transform。

另外值得一提的是，bzip2 是 1996 年出的 (不過 1.0 大約是 2000 年時出的)，BZip3 的第一個 release 在 2022 年，這段時間也累積了不少有趣的演算法可以用。

無損壓縮中如果期望有比較的壓縮率，目前比較常用的應該是 LZMA 類的演算法 (差不多是 2001 年出現的)，用的工具通常會是 X

https://blog.gslin.org/archives/2025/02/02/12240/bzip3/

#Computer #Murmuring #Software #bzip2 #bzip3 #compression #lzma #ratio #xz

BZip3

在 Hacker News 上看到 BZip3 的連結：「Bzip3: A spiritual successor to BZip2 (github.com/kspalaiologos)」。

雖然名字看起來與 bzip2 有關，但看起來是不同的人弄出來的東西，不過有些經典的演算法有留下來用，像是 Burrows-Wheeler transform。

另外值得一提的是，bzip2 是 1996 年出的 (不過 1.0 大約是 2000 年時出的)，BZip3 的第一個 release 在 2022 年，這段時間也累積了不少有趣的演算法可以用。

無損壓縮中如果期望有比較的壓縮率，目前比較常用的應該是 LZMA 類的演算法 (差不多是 2001 年出現的)，用的工具通常會是 X

https://blog.gslin.org/archives/2025/02/02/12240/bzip3/

#Computer #Murmuring #Software #bzip2 #bzip3 #compression #lzma #ratio #xz

BZip3

在 Hacker News 上看到 BZip3 的連結：「Bzip3: A spiritual successor to BZip2 (github.com/kspalaiologos)」。

雖然名字看起來與 bzip2 有關，但看起來是不同的人弄出來的東西，不過有些經典的演算法有留下來用，像是 Burrows-Wheeler transform。

另外值得一提的是，bzip2 是 1996 年出的 (不過 1.0 大約是 2000 年時出的)，BZip3 的第一個 release 在 2022 年，這段時間也累積了不少有趣的演算法可以用。

無損壓縮中如果期望有比較的壓縮率，目前比較常用的應該是 LZMA 類的演算法 (差不多是 2001 年出現的)，用的工具通常會是 X

https://blog.gslin.org/archives/2025/02/02/12240/bzip3/

#Computer #Murmuring #Software #bzip2 #bzip3 #compression #lzma #ratio #xz

friendship ended with lrzip-next. now #bzip3 is my best friend.

friendship ended with lrzip-next. now #bzip3 is my best friend.

friendship ended with lrzip-next. now #bzip3 is my best friend.

friendship ended with lrzip-next. now #bzip3 is my best friend.

friendship ended with lrzip-next. now #bzip3 is my best friend.

#Bzip3 is available for #Debian Sid

Not sure about the unstable notice, the package works just fine on my end.

Official page and tracker
https://tracker.debian.org/pkg/bzip3

#Bzip3 is available for #Debian Sid

Not sure about the unstable notice, the package works just fine on my end.

Official page and tracker
https://tracker.debian.org/pkg/bzip3