                                The Art
                              of Lossless
                           Data Compression
                                vol. 20g

Here are the results of tests performed in January 2001 to compare
lossless compression of True Color (24-bit) images by all known programs
developed for such purpose, including BMF, JPEG-LS and PNG software,
7-Zip, Pkzip, and archivers with special algorithms for 24-bit images.

See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net

If anybody wants to start or continue such tests,
or can suggest some other sets of images, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 and lossy compression of
 up to 10000:1, we hear about it from time to time since our XTs)
please let us know immediately: artest@hotmail.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

The last 12th line shows results for the sum of all 11 sets (492 images).

original BMF     UHIC    RKIM  Arhangel   NK     ERI32   ACE32   LSP      DC
275.95%  100%   100.55  101.59  110.52  109.68  107.75  114.06  115.50  119.74
289.11%  100%   104.88  124.50  114.61  132.43  111.09  121.58  136.11  127.16
245.22%  100%   107.93  101.38  112.92  109.62  117.91  114.29  111.39  123.53
238.64%  100%   104.20  112.66  110.53  118.18  112.98  114.63  122.73  124.69
457.28% 101.93  110.74   100%   112.34  116.87  129.10  121.47  224.13  138.25
240.06%  100%   105.20  102.07  110.01  106.75  116.64  112.76  112.21  120.24
295.55%  100%   103.23  103.57  111.54  107.73  116.95  117.07  122.83  123.25
340.24%  100%   105.56  102.65  111.26  109.65  116.65  120.16  121.03  125.23
225.19%  100%   104.00  104.47  108.82  108.77  112.16  110.48  109.95  119.63
547.50%  100%   104.84  104.25  107.76  122.73  114.89  152.06  132.31  131.15
379.87%  100%   104.36  130.51  113.80  145.03  117.88  137.19  158.03  145.19
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
297.55%  100%   104.72  105.33  110.92  111.93  116.35  118.68  121.86  124.61

  RK     LOCO  PNGcrush  SBC     RAR     BTPC  Display   IMP     7-zip  PkzipC
120.66% 149.81  150.24  130.66  133.15  164.36  153.89  133.68  159.16  167.62
127.76% 156.41  151.37  136.42  140.60  170.42  164.86  167.62  205.21  208.56
125.13% 119.20  129.45  138.25  124.25  129.21  139.53  163.29  193.86  195.64
124.76% 127.45  134.30  145.82  132.94  137.49  144.00  158.01  182.24  184.71
133.92% 172.49  144.96  141.52  146.11  201.52  156.16  160.00  185.82  187.42
121.81% 114.12  121.00  128.36  126.30  121.61  130.54  137.95  175.32  177.19
122.82% 118.49  130.69  128.14  137.72  131.14  138.27  139.31  170.52  173.47
126.19% 124.50  132.36  135.17  139.00  139.68  141.64  152.56  191.42  194.63
120.18% 117.84  121.50  128.58  122.22  122.53  132.58  146.49  179.50  180.76
132.38% 151.17  141.96  142.15  170.38  176.94  148.74  158.32  186.28  193.32
145.35% 195.34  181.85  160.76  174.25  213.33  191.18  187.48  217.05  224.13
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
125.40% 127.25  132.63  133.56  137.11  139.34  141.62  147.57  182.40  185.54


[[2]] Speed
===========
A set of 23 images totalling 27,133,146 bytes
from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/
was used for this test and a 400 MHz pc with 192 Mb RAM and Windows98.

 Programs,options        Overall      Average      Compress Extract  Compressed
                          score,       Users'        time,   time,     size,
                                       score,       seconds seconds    bytes
                      seconds  %    seconds  %
7z    a     -tzip      4440   152%   4368   157%       79      10     15666242
7z    a -mx -tzip      4485   153%   4368   157%      130       9     15649266
7z    a     -tufa1     4067   139%   3877   140%      212      26     13788872
7z    a -mx -tufa1     4080   139%   3886   140%      215      27     13819864
7zip  a                4440   152%   4369   157%       79      10     15666242
7zip  a -mx            4490   153%   4369   157%      134      10     15649266
ace32 a                3231   110%   3143   113%       97      26     11188623
ace32 a -d4096         3233   110%   3143   113%      100      26     11188111
ace32 a -d4096 -m1     3233   110%   3145   113%       97      26     11194643
ace32 a -d4096 -m5     3256   111%   3152   113%      116      26     11213031
ace32 a -d4096     -s- 3269   112%   3147   113%      136      26     11188811
ace32 a -d4096 -m1 -s- 3270   112%   3149   113%      135      26     11195591
ace32 a -d4096 -m5 -s- 3301   113%   3156   114%      161      26     11214063
alch  ---n             4709   161%   4419   159%      323      56     15594096
alch  ---n 0           4980   170%   4889   176%      100      47     17399494
alch  ---n 1           4534   155%   4365   157%      188      48     15475837
alch  ---n 2           4637   158%   4470   161%      185      48     15857298
alch  ---n 3           4662   159%   4459   161%      224      67     15736143
alch  ---n 4           4708   161%   4418   159%      322      55     15594095
arhangel a             5672   194%   4994   180%      753     737     15057230
arhangel a -mm -1      3430   117%   3200   115%      255     157     10867001
arhangel a -mm -2      3430   117%   3200   115%      255     157     10867001
arhangel a -mm -1 -2   3429   117%   3200   115%      254     157     10867001
bmf     -f             3026   103%   2953   106%       80      23     10522960
bmf     -f    -q9      3374   115%   2980   107%      437      22     10494756
bmf     -f -s          3349   114%   3047   110%      335     283      9832328
bmf     -f -s -q9      3871   132%   3100   112%      856     284      9832328
locoe  -c1             4145   142%   4121   149%       26      28     14730521
locoe  -c2             4163   142%   4135   149%       31      30     14770163
cbtpc                  4555   156%   4517   163%       42      25     16160698
lsp                    3243   111%   3199   115%       48      41     11357044
lsp    -f              3318   113%   3280   118%       42      36     11667530
lsp    -g              4244   145%   4207   152%       40      34     15011506
lsp    -fg             4294   147%   4262   154%       35      28     15232420
dc  e                  3519   120%   3338   120%      200      49     11772337
dc  e -b16300          3520   120%   3339   120%      201      49     11772337
dc  e -b16300 -mb5     3518   120%   3338   120%      199      49     11772337
display -bpng --same   4482   153%   4245   153%      263      16     15131718
eri     a              3564   122%   3348   121%      240      56     11768488
eri     a -m1          3544   121%   3419   123%      139      45     12101876
eri     a -m2          3499   119%   3363   121%      152      47     11884539
eri     a -m3          3516   120%   3344   120%      191      54     11777331
eri     a -m5          3677   125%   3359   121%      352      56     11768450
eri     a     -3e23    2965   101%   2769   100%      218      56      9688919
eri     a -m1 -3e23    3122   107%   3003   108%      133      45     10602311
eri     a -m2 -3e23    2918   100%   2785   100%      147      50      9796177
eri     a -m3 -3e23    2928   100%   2765   100%      180      55      9694703
imp     a -2  -s4      3806   130%   3740   135%       73      21     13365646
imp98   a              4586   157%   4528   163%       64       6     16261267
imp98   a     -m3      4591   157%   4504   162%       96       7     16156757
imp98   a -mm          4327   148%   4241   153%       95       7     15212564
imp98   a -mm -m3      4357   149%   4222   152%      150       8     15118784
imp98   a -mm -2       3797   130%   3733   134%       72      19     13345236
imp98   a -mm -s4      4314   147%   4225   152%       97       7     15154706
imp98   a -2  -s4      3804   130%   3739   135%       72      20     13365818
pkzip  -es             5528   189%   5511   199%       18       7     19812852
pkzip  -a              4658   159%   4629   167%       32       7     16630959
pkzip  -exx            4674   160%   4630   167%       48       7     16630245
pkzipc -add            4683   160%   4646   167%       40       9     16682715
pkzipc -add -max       4685   160%   4639   167%       50       9     16652375
pkzipc -add      -defl 4652   159%   4604   166%       53       9     16524036
pkzipc -add -max -defl 4667   159%   4594   166%       81       9     16481369
pngcrush -q            4822   165%   4175   150%      718       -     14772830
pngcrush -q -loco      4130   141%   3515   127%      683       -     12409745
pngcrush -q -brute     6515   223%   4313   155%    12447       -     14644577
rar   a                4588   157%   4466   161%      136      10     15996627
rar   a  -mm           3703   126%   3662   132%       45      21     13095126
rar   a  -mm -m1       3703   126%   3663   132%       44      21     13098345
rar   a  -mm -m5       3704   126%   3661   132%       47      21     13092151
rar   a  -mm     -mde  3703   126%   3662   132%       45      21     13095126
rar   a  -mm -m1 -mde  3703   126%   3663   132%       44      21     13098345
rar   a  -mm -m5 -mde  3704   126%   3661   132%       47      21     13092151
rar   a  -mm -s  -mde  3699   126%   3657   132%       47      21     13077240
rar32 a  -mm -s  -mde  3712   127%   3664   132%       54      27     13077240
rk   -mf1              3894   133%   3785   136%      121      85     13278736
rk   -mf2              4213   144%   3939   142%      304     244     13196628
rk   -mf3              4457   152%   3946   142%      566     233     13166528
rk   -mx1              5681   194%   4722   170%     1065    1300     11938300
rk   -mx2              6218   213%   5015   181%     1336    1613     11770288
rk   -mx3              6679   228%   5233   189%     1606    1842     11629912
rkim     c             3276   112%   3118   112%      175     211     10405925
rkim     cx            3516   120%   3067   110%      499     243      9989608
sbc c                  3793   129%   3666   132%      141      69     12900021
sbc c -b9              3769   129%   3639   131%      145      69     12802613
sbc c -b51             3769   129%   3639   131%      145      69     12802613
sbc c -b51 -e          3793   129%   3666   132%      141      69     12904168
sbc c      -e          3802   130%   3676   132%      139      68     12941511
sbc c -b51    -os      3878   132%   3668   132%      232     102     12758356
sbc c -b51 -e -os      3795   130%   3669   132%      139      68     12918051
uhic   e               3264   111%   3047   110%      240     243     10013246
uhic   m               3609   123%   3229   116%      422     441      9887092
zzip a                 3736   128%   3646   131%      100      57     12889383
zzip a -mm             3770   129%   3662   132%      119      59     12933183
zzip a -mm -mx         3770   129%   3662   132%      119      59     12932662

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.

Losslessly compressed with ERI32 to 9,560,807 bytes, this set can be found at
http://artest.lgg.ru/kodak/ and http://artest1.tripod.com/Kodak/


[[3]] Details
=============
are no longer put to this main text
(790 lines reporting 15252 results on 492 files in 11 sets),
but can be found in FULL version with GRAPHICS.DAT and *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest20.zip
or http://artest1.tripod.com/artest20.zip

1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and
/image2/ , converted from Sun Raster format to Windows Bitmap,
(this conversion changes image headers only, 32 bytes
are replaced by 54 bytes, but image data is not modified)

This site www.cipr.rpi.edu is described in comp.compression FAQ,
in 29 lines of "Subject: [55] Where can I find Lenna and other images?"

Eight images in the 5th set are from the famous Waterloo Color Set,
( losslessly compressed to 2,889,063 bytes,
it can be found at http://geocities.com/eri32 )

6,7,8th image sets are from  ftp://download.intel.com/pressroom/images/
They were converted from TIFF format to Windows Bitmap.

10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/

Some images were slightly renamed. See GRAPHICS.DAT from artest20.zip for more
details. Some new images (from download.intel.com) were not added yet.


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
7-Zip 2.22    :W http://www.7-zip.com/dl/7zip222.exe                              513K
ACE32 2.0b4   :W ftp://ftp.forlangs.net/pub/windows/winace/ace20b4.exe            576K
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip            50K
BMF    1.1    :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip   132K
DC 0.98b      :W ftp://ftp.cdrom.com/.3/sac/pack/dc124.zip                         55K
ERI32  4.9fre :e http://geocities.com/eri32/eri49fre.zip                           91K
Imp     1.1   :e http://www.winimp.com/imp110d.zip                                266K
Imp-win 1.12  :W http://www.winimp.com/imp112.exe                                 122K
Pkzip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe     202K
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe                               3470K
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe              380K
RKim   1.06   :W http://rksoft.virtualave.net/downloads/rkim106.zip                57K
RAR32  2.80b3 :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx28b3.exe              269K
WinRAR 2.80b3 :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar28b3.exe              620K
SBC 0.500b    :e http://geocities.com/sbcarchiver/sbc0500b.zip                    187K
UHIC   1.0    :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip                     52K
ZZip 0.36b    :W http://www.zzip.f2s.com/zzip-win32.zip                            34K

NK  1.0       :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP                          87K
JPEG-LS 1.00  :W http://www.hpl.hp.com/loco/jlsrefV100.zip                        325K
SPIHT  Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe            72K
BTPC   4.1    :W http://www.engr.mun.ca/~john/btpc4.1.zip                         715K
PngCrush 1.5.3:e http://download.sourceforge.net/pmt/pngcrush-1.5.3-DOS.zip       157K
Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe             811K
SEA 1.3       :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip                    705K
Alchemy 1.10  :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip                 1462K

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
Arhangel     : http://geocities.com/SiliconValley/Lab/6606
Eri32        : http://geocities.com/eri32
      mirror : http://artest1.tripod.com
RK, RKim     : http://rksoft.virtualave.net
Imp,WinImp   : http://www.technelysium.com.au
      mirror : http://www.winimp.com
ACE,WinACE   : http://www.winace.com
Ufa,777,7-Zip: http://www.7-zip.com
PkZip        : http://www.pkware.com
RAR,WinRAR   : http://www.rarsoft.com
JPEG-LS      : http://www.hpl.hp.com/loco
PngCrush     : http://pmt.sourceforge.net/pngcrush
SPIHT        : http://www.ipl.rpi.edu/research/SPIHT
BTPC         : http://www.engr.mun.ca/~john/btpc.html
Display      : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html
Alchemy      : http://www.handmadesw.com/Products/Image_Alchemy.htm
SEA          : http://www.photodex.com/products/dos
SBC          : http://geocities.com/sbcarchiver
ZZip         : http://www.zzip.f2s.com


What's new:
~~~~~~~~~~~
156 new images were added:  108 from ftp://ftp.kodak.com/www/images/pcd/
and 48 from ftp://download.intel.com/pressroom/images/

192 Mb RAM are used for ARTesting now, that's why everything was retested.

11 new programs this time: PngCrush 1.5.3, ERI32 4.9fre, 7-zip 2.22,
WinRAR 2.80b3, RAR32 for DOS and OS/2 2.80b3, ZZip 0.36b, RK 1.04.1,
NK ver.1, DC 0.99.158b, ACE 2.00b4, SBC 0.500b, Pkzip 4.00.

Latest beta versions of DC and UFA are available from authors by e-mail:
DC: EdgarBinder@t-online.de
UFA: support@7-zip.com


WARNINGS:
~~~~~~~~~
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp,
footbal* and susie* from 2nd set, moore29.bmp from 6th.

 ESP, Rkive and some other programs are not tested any more,
 their results and links can be found in previous versions:
 ESP   - artest3...artest12
 Rkive - 3...12
 UFA   - 3...12
 777   - 13...14
 BOA   - 7...14
 UHARC - 5...10
 SEA   - 12...19
 CompuShow 2000! - 3...11

The LATEST RELEASE, and all previous versions of these tests can be found
at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/


The FINAL PART
==============
>     [[5]] PLEASE read THIS before replying to this article
was removed from this text, but can be easily found at
http://geocities.com/SiliconValley/Bay/1995/artest10.html
http://artest1.tripod.com/artest10.html

Send your suggestions, comments to artest@hotmail.ru
With best kind regards,
RAO Inc.
