                                The Art
                              of Lossless
                           Data Compression
                                vol. 24b

Here are the results of tests performed in August 2002 to compare
lossless compression of "binary" files by all known good enough programs
developed for such purpose, including RK, DC, YBS, Bzip2, RAR, ACE and 7-zip.

See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca

If anybody wants to start or continue such tests,
or can suggest some other sets of files, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

Last eleventh line shows results for the sum of all 5960 files in ten sets.

Original Entropy UHARC PPMonstr   RK     7-zip    777    Slim     RAR    PPMN
257.68%  100%   104.66  101.56  107.16  108.53  109.54  109.25  110.08  109.78
264.52%  100%   102.93  104.25  104.57  104.38  101.98  108.26  109.44  107.91
187.28%  100%   101.06  102.09  103.24  103.26  102.83  104.39  106.01  103.61
346.78%  100%   102.29  113.32  117.47  116.52  121.33  120.26  113.30  125.70
179.82% 100.86  103.11  112.05  111.76  114.98  115.23  108.61  108.24  115.96
393.85%  100%   102.06  101.25  101.74  108.34  109.35  115.75  117.06  117.56
198.15%  100%   103.32  103.66  104.55  103.53  105.74  106.01  108.97  105.68
268.20%  100%   100.24  100.31  101.15  102.28  104.42  109.55  107.13  110.68
237.23%  100%   103.15  103.90  104.30  104.87  104.73  106.60  108.08  105.73
371.66%  100%   106.00  102.67  105.32  107.69  111.36  114.84  118.66  115.55
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
246.50%  100%   102.51  103.77  105.26  106.18  106.83  108.47  109.25  109.31

 SBC  Compressia  ACE    BEE     PPMd     ERI    IMP      DC    BZip2   Pkzip
113.67  111.16  112.74  111.58  112.21  116.94  118.71  114.17  121.17  125.37
111.05  117.82  110.39  111.72  113.25  116.72  112.32  120.04  124.14  131.99
106.33  106.03  106.26  106.92  108.11  109.71  107.52  111.40  113.64  112.97
115.05  120.78  127.34  121.74  125.41  120.90  123.25  122.64  138.61  155.89
 100%   108.56  107.23  117.45  119.50  104.06  119.90  110.52  120.53  127.93
122.77  120.73  120.28  118.04  118.01  127.87  126.85  122.09  131.89  133.52
107.57  105.30  109.95  108.16  110.25  111.05  111.00  112.32  117.13  119.63
109.91  111.50  108.71  113.43  114.34  113.03  119.90  113.97  122.04  125.31
109.40  108.77  108.98  109.87  111.51  112.15  110.19  114.30  118.39  119.62
118.57  113.26  119.61  116.93  119.56  126.73  126.36  127.45  135.84  140.91
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
109.83  110.68  110.89  111.68  113.18  113.94  114.83  115.22  121.24  124.95



[[2]] Speed
===========
4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.

Programs,             Compression/    Overall    Average Users'   Compressed
options               Extraction,      Score         Score           Size
                        seconds     seconds, %    seconds, %       bytes ,  %
no compression            0     0     7613  392     7613  419    27408516  422
777 a -mg               727   401     3792  195     3072  169     9586586  148
777 a -mg -mu32         735   405     3804  196     3076  169     9588918  148
7za a -t7z               70     4     2783  143     2714  149     9752090  150
7za a -t7z -mx          127     4     2616  135     2491  137     8948766  138
7za a -tzip              23     2     3388  174     3365  185    12104526  186
7za a -tzip -mx          56     2     3409  175     3353  184    12062635  186
acb B                   412   414     3723  191     3315  182    10426759  161
acb b                   581   583     4013  206     3438  189    10254633  158
ace32 a -d4096           57     3     2600  134     2543  140     9141767  141
ace32 a -d4096 -m1       48     3     2604  134     2557  141     9190071  142
ace32 a -d4096 -m5       62     3     2610  134     2548  140     9158751  141
arh a -2 -mm            197   184     3213  165     3018  166    10196406  157
arh a -1 -mm             28     6     2986  154     2958  163    10625915  164
arh a -2 -1             304   203     3676  189     3375  186    11408516  176
ba -k -50                47    25     3016  155     2970  163    10601804  163
ba -k                    38    23     2974  153     2936  161    10487070  162
ba -k -10                38    23     2937  151     2899  159    10353984  160
bee a -m1               209   202     3298  170     3090  170    10390747  160
bee a -m2               374   367     3422  176     3052  168     9651819  149
bee a -m3 -s            649   697     3971  204     3328  183     9450207  146
bix a                    68     4     3020  155     2953  162    10612578  164
bix a -mdg               74     2     2999  154     2926  161    10524303  162
bix a -mdg -s            99     2     2822  145     2723  150     9792685  151
boa -m1                 236   227     3624  186     3390  186    11379129  175
boa -m15                690   616     4186  215     3503  193    10368786  160
boa -m15 -s             696   617     4191  216     3502  193    10359887  160
bzip2 -k                 33    10     3130  161     3098  170    11112953  171
bzip2 -k -5              31    10     3132  161     3101  171    11126137  171
bzip2 -k -9              33    10     3130  161     3098  170    11112953  171
ery-e b o12             261   275     2745  141     2487  137     7953204  123
ery-e b o16             260   278     2740  141     2483  137     7928059  122
ery-e b o32             270   287     2753  142     2486  137     7907407  122
ery-e b o64             301   307     2804  144     2506  138     7903715  122
compcl c -b15            51    42     2744  141     2694  148     9544827  147
compcl c -b15 -s         51    42     2743  141     2693  148     9540017  147
dc e                    108    14     2797  144     2690  148     9630736  148
dc e -b16300            131    14     2337  120     2207  121     7888232  122
dc e -b16300 -mb5       130    14     2335  120     2207  121     7888421  122
eri a                    55    31     2782  143     2727  150     9706022  150
eri a -m3                85    38     2777  143     2693  148     9555684  147
eri a -m6                86    38     2785  143     2700  149     9582523  148
gcac a                   44    17     2898  149     2854  157    10212208  157
gcac s                   45    18     2935  151     2890  159    10337588  159
imp98 a -mm              33     1     2749  141     2716  149     9770169  151
imp98 a -mm -m3          53     1     2757  142     2705  149     9730287  150
imp98 a -mm -s4          34     4     2753  142     2720  150     9775588  151
pkzip -es                 3     1     3952  203     3949  217    14212209  219
pkzip -a                  6     1     3437  177     3431  189    12347196  190
pkzip -exx                7     1     3431  176     3423  188    12320267  190
ppmdi e -o12 -m232       53    57     2868  148     2816  155     9930336  153
ppmdi e -o16 -m232       55    58     2866  147     2812  155     9911769  153
ppmn_km e -o6 -M:50     217   219     3150  162     2935  161     9772905  151
ppmn_km e -o7 -M:50     237   239     3188  164     2953  162     9760047  150
ppmn_km e -o8 -M:50     245   246     3183  164     2941  162     9692957  149
ppmn_km e -o9 -M:50     245   246     3185  164     2943  162     9697928  149
ppmonstr e -o12 -m250   276   288     3063  158     2790  153     8996048  139
ppmonstr e -o16 -m250   279   301     3073  158     2797  154     8974666  138
ppmonstr e -o128 -m250  644   703     3834  197     3196  176     8954077  138
ppmy /o6 /m220         2874  2746     8698  447     5852  322    11078479  171
ppmy /o7 /m220         2619  2647     8549  440     5956  328    11819257  182
ppmy /o8 /m220         2572  2598     8596  442     6050  333    12335730  190
qlfc a                   31    19     3019  155     2988  164    10689214  165
rar a -m5 -s             73     5     2373  122     2301  127     8260230  127
rar a -mc16:128t -s      49     6     2354  121     2305  127     8275443  127
rar a -mc16:128t+ -s     68    47     2399  123     2332  128     8222366  127
rk -mf3                 128    73     2815  145     2688  148     9410064  145
rk -mx1                 498   499     3672  189     3179  175     9627044  148
rk -mx3                 844   845     4074  210     3238  178     8584928  132
sbc c -m3                64    21     2181  112     2118  116     7548923  116
sbc c -m3 -b63           74    21     2192  113     2119  117     7548878  116
sbc c -ad -b63           59    26     2193  113     2134  117     7587006  117
slim a -d32 -w22       1940  1954     6487  334     4567  251     9336416  144
slim a -d16 -w22       1936  1972     6500  334     4584  252     9333547  144
slim a -d8 -w22        1948  2017     6556  337     4627  254     9328191  144
slim a -d4 -w22        1923  1922     6435  331     4531  249     9322631  144
szip -o4                 15    20     3163  163     3149  173    11262438  174
szip -o8 -b41            53    24     3042  156     2989  164    10671420  164
ufa a -mg               234    39     3023  155     2792  154     9900254  153
ufa a -mg -mu32         242    43     3036  156     2796  154     9902586  153
ufa a -mg -s            352    25     3164  163     2815  155    10030871  155
uharc a -m1 -md32768    103    14     1944  100     1842  101     6577686  101
uharc a -m2 -md32768    128    14     1954  100     1827  100     6522084  100
uharc a -m3 -md32768    143    14     1960  101     1818  100     6490844  100
uharc a -mz -md32768     23    25     2638  136     2616  144     9325552  144
uharc a -mx -md32768    160   136     2138  110     1979  109     6626726  102
ybs -m15mu               49    17     2693  139     2644  145     9457129  146
ybs -m15mu -r            52    17     2690  138     2639  145     9436857  145
zzip a -a                38    20     2946  152     2909  160    10398266  160
zzip a -mx -mm           40    22     2814  145     2774  153     9907114  153
zzip a -mx -30m          43    23     2976  153     2934  161    10478036  161

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.


[[3]] Details
=============
are no longer put to this main text
(6290 lines reporting 238840 results on 5960 files in 10 sets),
but can be found in FULL version with BINARIES.DAT and *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest24.zip
or http://artest1.tripod.com/artest24.zip


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
ACE 2.04      :W http://winace.host.sk/ace204.exe                                 593K
ERI 5.1fre    :e http://geocities.com/eri32/eri51fre.zip                           89K
GCac 0.9k     :W http://www.emit.jp/gca/gca_v09k.exe                              295K
UHArc 0.4b    :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip                  220K
QLFC 6.6W     :W http://ghido.shelter.ro/DownloadQLFC.php                          49K
ZZip 0.36c    :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip            35K
PPMD var.I,
PPmonstr v.I  :W ftp://ftp.elf.stuba.sk/pub/pc/pack/ppmdi1.rar                     73K
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe                               3470K
PkZip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe     202K
RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe              461K
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe              380K
BA 1.01b5     :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip                 61K
BIX 1.00b7    :W http://www.7-zip.org/dl/ufa/bix100b7.zip                          89K
777 0.04b1    :W http://www.7-zip.org/dl/ufa/777004b1.zip                          72K
UFA 0.04b1    :W http://www.7-zip.org/dl/ufa/ufa004b1.zip                          64K
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip            50K
Imp     1.1   :e http://www.technelysium.com.au/imp110d.zip                       266K
Imp-win 1.12  :W http://www.technelysium.com.au/imp112.exe                        122K
ACB 2.00c     :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip    42K
BOA 0.58b     :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip                     74K
DC 0.98b      :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip                      55K
SZip 1.12a    :W http://www.compressconsult.com/szip/szip_112a_win32.zip           71K
YBS 0.03e     :e http://compression.graphicon.ru/ybs/ybs003ed.zip                  56K
YBS 0.03e     :W http://compression.graphicon.ru/ybs/ybs003ew.zip                  44K
Bzip2 1.0.2   :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe
Compressia 0.98b :W http://www.compressia.com/compcl.exe
SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip
SBC   0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip
BEE 0.6.3     :W http://compression.graphicon.ru/fa/files2/bee063.rar
PPMN_km b4    :W http://compression.graphicon.ru/ms/ppmn_km.rar
PPMY 0.3c     :W http://compression.graphicon.ru/sh/ppmy_3c.rar
7-Zip 2.30b23 :W http://belnet.dl.sourceforge.net/sevenzip/7z230b23.exe
WinRAR 3.00   :W http://www.rarlab.com/rar/wrar300.exe
RAR32  3.00   :e http://www.rarlab.com/rar/rarx300.exe

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
Arhangel   : http://geocities.com/SiliconValley/Lab/6606
BA         : http://hem.spray.se/mikael.lundqvist
Eri32      : http://geocities.com/eri32
  mirror   : http://artest1.tripod.com
RK         : http://rksoft.virtualave.net
Imp,WinImp : http://www.technelysium.com.au/winimp.html
ACE,WinACE : http://www.winace.com
PkZip      : http://www.pkware.com
RAR,WinRAR : http://www.rarlab.com
BZip2      : http://sources.redhat.com/bzip2
SZip       : http://www.compressconsult.com/szip
PPMN       : http://compression.graphicon.ru/ms
YBS        : http://compression.graphicon.ru/ybs
SBC        : http://sbcarchiver.netfirms.com
QLFC       : http://ghido.shelter.ro
GCAC       : http://emit.jp/gca/gca.html
PPMy       : http://www.pilabs.org.ua/sh
ZZip       : ? http://www.zzip.f2s.com
Compressia : http://www.compressia.com/
Ufa,777,
 BIX,7-Zip : http://www.7-zip.org


What's new:
~~~~~~~~~~~
12 new programs were tested:

PPMd v.I
PPMonstr v.I
7-zip 2.30b22
RAR 3.00
BZip2 1.0.2
PPMN_km b4
SBC 0.969b r1
Entropy 0.7
Compressia 0.98b
Bee 0.6.3 u1
PPMy 0.3c
Slim aug17

7-zip, RAR and BZip2 perform exactly as their previous versions
tested in March or earlier.

Latest beta versions of Entropy, Slim, DC were available
from authors by e-mail request:
Entropy: artest@inbox.ru
Slim: grayw@secom.lg.ua
DC: EdgarBinder@t-online.de

 Results of BOA, ZZip, GCAC, YBS, BA, Arhangel, SZip, QLFC, PPMy,
 7-zip with .zip format  are in full version only, BINARIES.DAT file.

FULL version contains all *.BAT and *.DAT files
you'll need to build 10 directories with 5960 files (artest24.zip\COOK_SET\*.*)
and to repeat all our tests (BINS.BAT, BINARIES.DAT).

Some old or less efficient programs will not be included next time:
777, UFA, BIX, ACB, BA, PPMy.


WARNINGS:
~~~~~~~~~

BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc
It types nothing like "CRC fails".

DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress
with "-mb5" switch and [<output>] filename like "any.dc5".
Says nothing like "CRC fails".

Problems in all other compressors were not found.


The LATEST RELEASE, and all previous versions of these tests can be found
at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/


Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak
