                                The Art
                              of Lossless
                           Data Compression
                                vol. 23g

Here are the results of tests performed in March 2002 to compare
lossless compression of True Color (24-bit) images by all known programs
developed for such purpose, including BMF, JPEG-LS and PNG software,
7-Zip, Pkzip, and archivers with special algorithms for 24-bit images.

See Archive Comparison Test by Jeff Gilchrist for more info:
http://compression.ca

If anybody wants to start or continue such tests,
or can suggest some other sets of images, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 and lossy compression of
 up to 10000:1, we hear about it from time to time since PC-XTs)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

The last 13th line shows results for the sum of all 12 sets (627 images, 2 Gb)

Original  BMF    RKIM    UHIC     NK      ERI  ArHanGeL  UHARC    ACE     LSP
312.41% 113.53  115.36  114.15  124.36   100%   125.45  122.14  129.46  131.09
289.11%  100%   124.50  104.88  132.34  114.39  114.61  112.22  121.22  136.11
245.22%  100%   101.38  107.93  109.55  119.38  112.92  118.90  114.33  111.39
238.64%  100%   112.66  104.20  118.11  115.13  110.53  116.65  114.13  122.73
472.81% 102.89   100%   112.24  114.09  136.49  113.06  125.36  120.73  235.68
234.75%  100%   101.90  104.87  106.85  111.69  109.63  116.20  112.65  112.06
300.88%  100%   104.15  104.38  108.18  111.54  111.11  114.52  117.32  123.56
342.65%  100%   102.61  106.05  110.30  116.76  111.60  120.69  118.35  116.50
227.58%  100%   104.53  104.00  108.84  110.57  108.91  114.54  111.00  110.35
547.51%  100%   104.25  104.84  122.41  119.24  107.76  127.07  156.04  132.31
298.76% 108.25  109.28  109.79  118.02   100%   121.54  116.62  124.64  126.27
336.86% 109.13  108.43  110.27  118.18   100%   118.07  110.08  127.27  127.95
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
294.01%  100%   102.57  104.48  109.04  110.21  110.53  115.21  116.54  117.36

  SBC     DC      RK     LOCO    ZZip  PngCrush   RAR    BTPC  Display  pkzipc
135.59  136.16  137.23  169.98  148.92  170.75  138.17  186.58  174.71  190.14
132.90  127.16  127.76  156.41  132.25  151.37  130.66  170.42  164.86  208.56
121.02  123.53  125.13  119.20  130.83  129.45  122.22  129.21  139.53  195.64
125.91  124.69  124.76  127.45  130.68  134.30  124.17  137.49  144.00  184.71
123.91  137.84  134.12  176.37  139.34  145.16  195.15  206.52  157.12  187.70
118.61  118.59  119.99  115.90  125.98  119.56  127.03  123.11  128.83  173.10
119.29  122.63  122.19  120.16  128.24  129.42  137.43  133.15  136.48  169.65
120.21  126.75  127.18  127.12  133.97  134.57  130.87  138.99  143.26  201.54
116.89  120.30  120.62  118.45  126.11  122.15  117.20  123.47  133.10  181.12
119.98  131.16  132.38  151.17  137.53  141.96  130.54  176.94  148.74  193.32
128.82  130.82  130.82  151.91  137.53  156.67  133.91  164.78  161.60  179.17
123.03  127.73  127.52  143.54  129.08  141.78  152.40  150.12  151.10  188.14
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
118.88  122.10  122.58  124.70  128.42  129.61  131.00  135.08  137.88  180.73



[[2]] Speed
===========
A set of 23 Kodak images from ftp://ftp.cipr.rpi.edu/stills/kodak/color/
was used for this test, and a 400MHz PC with 256Mb RAM and Windows98.

Programs,             Compression/   Overall   Average Users'   Compressed
options               Extraction,     Score        Score           Size
                        seconds    seconds, %   seconds, %       bytes ,  %
no compression            0     0    7536  291    7536  300    27133146  314
7za a -tzip              65    10    4426  171    4367  174    15666242  181
7za a -tzip -mx         110     9    4466  172    4366  174    15649266  181
7za a -t7z              208    16    4057  156    3870  154    13800689  159
7za a -t7z -mx          255    16    4080  157    3850  153    13712640  158
ace a -d4096             86    26    3219  124    3142  125    11189907  129
ace32 a -d4096           83    27    3218  124    3144  125    11190095  129
ace32 a -d4096 -m1       83    27    3220  124    3145  125    11196635  129
ace32 a -d4096 -m5       97    27    3238  125    3151  125    11210655  130
arh a                   555   541    5278  204    4779  190    15057230  174
arh a -mm -1            221   134    3373  130    3174  126    10867001  126
bmf -f                   67    23    3012  116    2952  117    10522960  122
bmf -f -q9              321    22    3258  126    2969  118    10494756  121
bmf -f -s               262   217    3211  124    2974  118     9832496  114
bmf -f -s -q9           685   217    3632  140    3016  120     9832496  114
dc e                    143    41    3454  133    3325  132    11772337  136
dc e -b16300 -mb5       141    42    3452  133    3326  132    11772337  136
display -bpng -i --same 180    13    4396  170    4234  168    15131718  175
eri a -3h13              89   100    2593  100    2513  100     8654262  100
eri a -3f13              84    98    2602  100    2526  101     8711394  101
gcac a                  116    50    3487  134    3383  135    11958076  138
gcac s                  120    51    3541  137    3433  137    12133243  140
imp a -2 -s4             56    17    3785  146    3735  149    13365649  154
imp98 a -2 -s4           56    18    3786  146    3736  149    13366580  154
imp98 a -mm -2           54    18    3779  146    3730  148    13345038  154
nk                      401    88    3480  134    3119  124    10770469  124
pkzip -es                15     6    5524  213    5510  219    19812852  229
pkzip -a                 25     6    4650  179    4627  184    16630959  192
pkzip -exx               36     6    4661  180    4629  184    16630245  192
pkzipc -add              29    10    4672  180    4646  185    16682715  193
pkzipc -add -max         37    10    4672  180    4639  185    16652375  192
pkzipc -add -defl        40     9    4639  179    4603  183    16524036  191
pkzipc -add -max -defl   57    10    4645  179    4594  183    16481369  190
pngcrush -q             547     -    4649  179    4157  165    14772830  171
qlfc a                   73    45    3660  141    3594  143    12753187  147
rar a -m2                69    10    4526  175    4463  178    16009598  185
rar a -m3                73    14    3621  140    3555  141    12722261  147
rar a -m5                73    14    3617  139    3551  141    12707651  147
rar a -m3 -mcc+          64    14    3402  131    3344  133    11965218  138
rar a -m4 -mcc+          67    17    3407  131    3347  133    11968818  138
rar a -m5 -mcc+          66    17    3408  131    3348  133    11970517  138
rar a -m1 -mcc+ -s       64    15    3398  131    3341  133    11953784  138
rar a -m3 -mcc+ -s       64    14    3399  131    3341  133    11953790  138
rar a -m5 -mcc+ -s       67    16    3403  131    3343  133    11954884  138
rar32 a -m5 -mcc+ -s     77    18    3415  132    3346  133    11954884  138
rk -mf1                  89    68    3845  148    3765  150    13278748  153
rk -mf2                 218   167    4050  156    3854  153    13196640  152
rk -mf3                 402   173    4232  163    3870  154    13166540  152
rk -mx1                 993  1205    5514  213    4620  184    11938308  138
rk -mx2                1007  1194    5470  211    4563  182    11770300  136
rk -mx3                1132  1275    5637  217    4618  184    11629924  134
rkim c                  185   210    3285  127    3118  124    10405925  120
rkim cx                 509   241    3525  136    3067  122     9989608  115
sbc c -m1 -b63           92    51    3739  144    3656  145    12948240  150
sbc c -m2 -b63          173   111    3537  136    3381  135    11709638  135
sbc c -m3 -b63          179   113    3544  137    3383  135    11709772  135
sbc c -m3 -b63 -a       184   105    3577  138    3411  136    11836838  137
sbc c -m3 -b63 -os      214   148    3538  136    3346  133    11436104  132
sbc c -m3  -os          228   108    3591  138    3386  135    11719160  135
uharc a -m1 -md32768    340    86    3648  141    3342  133    11603482  134
uharc a -m2 -md32768    360    77    3647  141    3323  132    11557731  134
uharc a -m3 -md32768    371    87    3661  141    3326  132    11528980  133
uharc a -mz -md32768     85    94    3889  150    3813  152    13360651  154
uharc a -mx -md32768    526   487    3969  153    3496  139    10644818  123
uhic e                  183   187    3151  122    2986  119    10013246  116
uhic m                  347   365    3458  133    3145  125     9887092  114
zzip a                   82    53    3714  143    3641  145    12889397  149
zzip a -mm              103    56    3751  145    3659  146    12933197  149
zzip a -mm -mx           98    56    3746  144    3658  146    12932675  149
zzip a -mm -mx -26m      97    57    3734  144    3647  145    12891036  149
locoe -c1                75    71    4238  163    4170  166    14730521  170
locoe -c2                82    78    4261  164    4188  167    14770163  171
cbtpc                    78    60    4626  178    4556  181    16160698  187
lsp                      85    85    3324  128    3247  129    11357044  131
lsp -f                   77    75    3393  131    3323  132    11667530  135
lsp -g                   81    78    4329  167    4256  169    15011506  173
lsp -fg                  72    68    4370  169    4305  171    15232420  176

Losslessly compressed with ERI32 to 8,493,000 bytes, this set can be found
at http://artest.virtualave.net/ki/ and http://geocities.com/rao-inc/kodak/

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.


[[3]] Details
=============
are no longer put to this main text
(967 lines reporting 23680 results on 627 files in 12 sets),
but can be found in FULL version with GRAPHICS.DAT and all *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest23.zip
or http://artest1.tripod.com/artest23.zip

1,2,3,4,9th image sets were taken from ftp://ftp.cipr.rpi.edu/stills/ and
/sequences/ , converted from Sun Raster format to Windows Bitmap,
(this conversion changes image headers only, 32 bytes
are replaced by 54 bytes, but image data is not modified)

This site www.cipr.rpi.edu is described in comp.compression FAQ,
in 29 lines of "Subject: [55] Where can I find Lenna and other images?"

Eight images in the 5th set are from the famous Waterloo Color Set,
( losslessly compressed to 2,801,690 bytes,
it can be found at http://geocities.com/eri32 )

6,7,8,12th image sets are from ftp://download.intel.com/pressroom/images/
They were converted from TIFF format to Windows Bitmap.

10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/

Some images were slightly renamed. See GRAPHICS.DAT inside artest23.zip
for more details. Some new images (from download.intel.com) were not added yet.


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
7-Zip 2.30b17 :W http://www.7-zip.org/dl/7zip230b17.exe                           891K
ACE 2.04      :W http://winace.host.sk/ace204.exe                                 593K
BMF 1.1f      :e http://geocities.com/eri32/bmf11f.zip                             76K
ERI 5.1fre    :e http://geocities.com/eri32/eri51fre.zip                           89K
RAR32  3.00b4 :e ftp://pubftp.slovenska.sk/pub/rarsoft/rar/rarx30b4.exe           415K
WinRAR 3.00b4 :W ftp://pubftp.slovenska.sk/pub/rarsoft/rar/wrar30b4.exe           942K
SBC_d 0.910b  :e http://personal.inet.fi/musiikki/sjm/sbc0910b_dos.zip            195K
SBC   0.910b  :W http://personal.inet.fi/musiikki/sjm/sbc0910b_win32.zip          154K
UHArc 0.4b    :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip                  220K
ZZip 0.36c    :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip            35K

ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip            50K
DC 0.98b      :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip                      55K
Imp     1.1   :e http://www.technelysium.com.au/imp110d.zip                       266K
Imp-win 1.12  :W http://www.technelysium.com.au/imp112.exe                        122K
Pkzip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe     202K
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe                               3470K
RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe              461K
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe              380K
RKim   1.06   :W http://rksoft.virtualave.net/downloads/rkim106.zip                57K
UHIC   1.0    :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip                     52K
NK 2.0beta    :W ftp://tu.tusur.ru/pub/ImageTools/NK2beta.ZIP                      52K
PngCrush 1.5.8:e http://download.sourceforge.net/pmt/pngcrush-1.5.8-DOS.zip       147K
JPEG-LS 1.00  :W http://www.hpl.hp.com/loco/jlsrefV100.zip                        325K
SPIHT  Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe            72K
BTPC   4.1    :W http://www.engr.mun.ca/~john/btpc4.1.zip                         715K
Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe             811K
SEA 1.3       :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip                    705K
Alchemy 1.10  :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip                 1462K

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
Arhangel   : http://geocities.com/SiliconValley/Lab/6606
Eri32      : http://geocities.com/eri32
    mirror : http://artest1.tripod.com
RK, RKim   : http://rksoft.virtualave.net
Imp,WinImp : http://www.technelysium.com.au/winimp.html
ACE,WinACE : http://www.winace.com
PkZip      : http://www.pkware.com
RAR,WinRAR : http://www.rarsoft.com
JPEG-LS    : http://www.hpl.hp.com/loco
PngCrush   : http://pmt.sourceforge.net/pngcrush
SPIHT      : http://www.cipr.rpi.edu/research/SPIHT
BTPC       : http://www.engr.mun.ca/~john/btpc.html
Display    : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html
Alchemy    : http://www.handmadesw.com/Products/Image_Alchemy.htm
SEA        : http://www.photodex.com/products/dos
SBC        : http://sbcarchiver.netfirms.com
ZZip       : ? http://www.zzip.f2s.com
Ufa,777,
     7-Zip : http://www.7-zip.org


What's new:
~~~~~~~~~~~
10 new programs were tested:

BMF 1.1f
NK 2.0beta
PngCrush 1.5.8
UHArc 0.4 beta
7-zip 2.30b17
RAR 3.00b4
ACE 2.04
SBC 0.910 beta
ERI 5.1fre
ZZip 0.36c

Latest beta version of DC is available from author by e-mail:
DC: EdgarBinder@t-online.de

Results of IMP and 7-zip are in the full version only, see GRAPHICS.DAT.


WARNINGS:
~~~~~~~~~
NK can't losslessly decompress some 8-bit images.
BMF doesn't save all fields of bmp-headers.

 ESP, Rkive and some other programs are not tested any more,
 their results and links can be found in previous versions:
 ESP   - artest3...artest12
 Rkive - 3...12
 UFA   - 3...12
 777   - 13...14
 BOA   - 7...14
 IMP   - 13...22
 SEA   - 12...19
 CompuShow 2000! - 3...11


The LATEST RELEASE, and all previous versions of these tests can be found
at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/


Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak,
RAO Inc.
