                                The Art
                              of Lossless
                           Data Compression
                                vol. 21g

Here are the results of tests performed in April-May 2001 to compare
lossless compression of True Color (24-bit) images by all known programs
developed for such purpose, including BMF, JPEG-LS and PNG software,
7-Zip, Pkzip, and archivers with special algorithms for 24-bit images.

See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net

If anybody wants to start or continue such tests,
or can suggest some other sets of images, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 and lossy compression of
 up to 10000:1, we hear about it from time to time since PC-XTs)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

The last 13th line shows results for the sum of all 12 sets (538 images, 1.6Gb)

original  BMF    RKIM    UHIC  ArHanGel   NK     ERI32  UHARC   ACE32    LSP
300.47% 109.19  110.95  109.78  120.65  119.74   100%   118.61  124.51  126.08
289.11%  100%   124.50  104.88  114.61  132.43  118.80  112.29  121.22  136.11
245.22%  100%   101.38  107.93  112.92  109.62  122.97  118.96  114.33  111.39
238.64%  100%   112.66  104.20  110.53  118.18  117.31  116.73  114.13  122.73
472.81% 102.88   100%   112.24  113.06  117.29  134.72  125.91  120.73  235.68
238.40%  100%   102.20  105.10  109.91  107.08  113.89  117.53  112.83  112.67
284.74%  100%   103.04  104.35  110.93  107.79  110.07  113.96  115.95  124.18
337.03%  100%   102.94  105.64  111.14  110.31  116.20  119.99  119.41  116.77
227.58%  100%   104.53  104.00  108.91  109.02  112.99  114.60  111.00  110.35
547.50%  100%   104.25  104.84  107.76  122.73  120.71  127.76  156.04  132.31
379.87%  100%   130.51  104.36  113.80  145.03  124.87  133.06  138.21  158.03
330.47% 109.19  108.47  110.31  118.15  118.64   100%   110.44  126.63  127.67
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
295.73%  100%   104.34  104.48  110.44  111.41  111.93  116.46  118.03  120.41

  DC     SBC      RK     LOCO    ZZip  PngCrush   RAR  Display   7Zip    PkZIP
130.96  131.93  131.99  163.48  143.23  162.68  145.82  168.03  173.80  182.87
127.16  128.32  127.76  156.41  132.25  151.37  140.60  164.86  205.21  208.56
123.53  124.68  125.13  119.20  130.83  129.36  124.25  139.53  193.86  195.64
124.69  125.42  124.76  127.45  130.68  133.56  132.94  144.00  182.24  184.71
137.84  132.70  134.12  176.37  139.34  144.49  144.52  157.12  186.38  187.70
119.39  121.69  120.96  116.52  127.01  120.21  126.14  129.91  173.17  175.08
122.14  121.71  121.60  120.84  126.77  128.63  136.31  136.56  166.25  168.95
125.68  126.36  126.23  125.50  131.75  132.36  138.56  142.03  191.87  195.38
120.30  120.58  120.62  118.45  126.10  122.06  123.23  133.10  179.79  181.12
131.15  131.16  132.38  151.17  137.53  141.64  170.38  148.74  186.28  193.32
145.19  146.36  145.35  195.34  152.55  174.54  174.25  191.18  217.05  224.13
127.56  124.31  127.34  143.24  129.00  140.99  140.25  150.91  180.93  187.70
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
123.21  123.74  123.76  128.33  129.08  130.75  135.54  140.42  179.00  182.50


[[2]] Speed
===========
A set of 23 images totalling 27,133,146 bytes
from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/
was used for this test and a 400 MHz PC with 192 Mb RAM and Windows98.

 Programs,options        Overall      Average      Compress Extract  Compressed
                          score,       Users'        time,   time,     size,
                                       score,       seconds seconds    bytes
                      seconds  %    seconds  %
7z    a     -tzip      4443   164%   4369   167%       83       9     15666242
7z    a -mx -tzip      4487   165%   4370   167%      131       9     15649266
7z    a     -tufa1     4059   149%   3892   149%      186      19     13872996
7z    a -mx -tufa1     4058   149%   3891   149%      185      19     13872996
ace   a -d4096         3234   119%   3144   120%       99      26     11189907
ace32 a                3233   119%   3144   120%       99      26     11191619
ace32 a -d4096         3235   119%   3145   120%      100      26     11190095
ace32 a -d4096 -m1     3235   119%   3146   120%       98      26     11196635
ace32 a -d4096 -m5     3257   120%   3152   120%      117      26     11210655
ace32 a -d4096     -s- 3273   120%   3149   120%      138      26     11191243
ace32 a -d4096 -m1 -s- 3274   121%   3151   120%      137      26     11198127
ace32 a -d4096 -m5 -s- 3302   121%   3157   121%      162      26     11210935
eri     a -3c03        2742   101%   2627   100%      129     112      9007908
eri     a -3e03        2732   101%   2617   100%      129     111      8972364
eri     a -3e03 -h94   2716   100%   2616   100%      112     105      8998827
rar   a                4588   169%   4466   171%      136       9     15996627
rar   a  -mm           3703   136%   3663   140%       45      20     13095126
rar   a  -mm -m1       3703   136%   3663   140%       44      20     13098345
rar   a  -mm -m5       3704   136%   3662   140%       47      20     13092151
rar   a  -mm     -mde  3703   136%   3662   140%       45      20     13095126
rar   a  -mm -m1 -mde  3703   136%   3663   140%       44      20     13098345
rar   a  -mm -m5 -mde  3704   136%   3662   140%       47      20     13092151
rar   a  -mm -s  -mde  3700   136%   3657   140%       47      20     13077240
rar32 a  -mm -s  -mde  3713   137%   3664   140%       54      26     13077240
sbc c -m1 -b59         3773   139%   3660   140%      126      64     12900342
sbc c -m2 -b59         3529   130%   3378   129%      168      77     11821377
sbc c -m3 -b59         3567   131%   3397   130%      189      90     11838516
sbc c -m3 -b59 -a      3603   133%   3423   131%      200      90     11926533
sbc c -m3 -b59 -on     3568   131%   3404   130%      183      91     11860847
sbc c -m3      -os     3569   131%   3379   129%      211      96     11745177
sbc c -m3 -b59 -os     3547   131%   3263   125%      316     106     11250407
UHarc a -m1            3621   133%   3336   128%      317      71     11641810
UHarc a -m2            3664   135%   3335   127%      366      70     11620323
UHarc a -m3            4024   148%   3346   128%      752      68     11531306
UHarc a -mx            4408   162%   3707   142%      778     652     10719512
UHarc a -mx -md8192    4412   162%   3711   142%      779     655     10719503
no compression         7537   277%   7537   288%        0       0     27133146

7zip  a                4440   152%   4369   157%       79      10     15666242
7zip  a -mx            4490   153%   4369   157%      134      10     15649266
alch  ---n             4709   161%   4419   159%      323      56     15594096
alch  ---n 0           4980   170%   4889   176%      100      47     17399494
alch  ---n 1           4534   155%   4365   157%      188      48     15475837
alch  ---n 2           4637   158%   4470   161%      185      48     15857298
alch  ---n 3           4662   159%   4459   161%      224      67     15736143
alch  ---n 4           4708   161%   4418   159%      322      55     15594095
arhangel a             5672   194%   4994   180%      753     737     15057230
arhangel a -mm -1      3430   117%   3200   115%      255     157     10867001
arhangel a -mm -2      3430   117%   3200   115%      255     157     10867001
arhangel a -mm -1 -2   3429   117%   3200   115%      254     157     10867001
bmf     -f             3026   103%   2953   106%       80      23     10522960
bmf     -f    -q9      3374   115%   2980   107%      437      22     10494756
bmf     -f -s          3349   114%   3047   110%      335     283      9832328
bmf     -f -s -q9      3871   132%   3100   112%      856     284      9832328
locoe  -c1             4145   142%   4121   149%       26      28     14730521
locoe  -c2             4163   142%   4135   149%       31      30     14770163
cbtpc                  4555   156%   4517   163%       42      25     16160698
lsp                    3243   111%   3199   115%       48      41     11357044
lsp    -f              3318   113%   3280   118%       42      36     11667530
lsp    -g              4244   145%   4207   152%       40      34     15011506
lsp    -fg             4294   147%   4262   154%       35      28     15232420
dc  e                  3519   120%   3338   120%      200      49     11772337
dc  e -b16300          3520   120%   3339   120%      201      49     11772337
dc  e -b16300 -mb5     3518   120%   3338   120%      199      49     11772337
display -bpng --same   4482   153%   4245   153%      263      16     15131718
imp     a -2  -s4      3806   130%   3740   135%       73      21     13365646
imp98   a              4586   157%   4528   163%       64       6     16261267
imp98   a     -m3      4591   157%   4504   162%       96       7     16156757
imp98   a -mm          4327   148%   4241   153%       95       7     15212564
imp98   a -mm -m3      4357   149%   4222   152%      150       8     15118784
imp98   a -mm -2       3797   130%   3733   134%       72      19     13345236
imp98   a -mm -s4      4314   147%   4225   152%       97       7     15154706
imp98   a -2  -s4      3804   130%   3739   135%       72      20     13365818
pkzip  -es             5528   189%   5511   199%       18       7     19812852
pkzip  -a              4658   159%   4629   167%       32       7     16630959
pkzip  -exx            4674   160%   4630   167%       48       7     16630245
pkzipc -add            4683   160%   4646   167%       40       9     16682715
pkzipc -add -max       4685   160%   4639   167%       50       9     16652375
pkzipc -add      -defl 4652   159%   4604   166%       53       9     16524036
pkzipc -add -max -defl 4667   159%   4594   166%       81       9     16481369
pngcrush -q            4822   165%   4175   150%      718       -     14772830
pngcrush -q -loco      4130   141%   3515   127%      683       -     12409745
pngcrush -q -brute     6515   223%   4313   155%    12447       -     14644577
rk   -mf1              3894   133%   3785   136%      121      85     13278736
rk   -mf2              4213   144%   3939   142%      304     244     13196628
rk   -mf3              4457   152%   3946   142%      566     233     13166528
rk   -mx1              5681   194%   4722   170%     1065    1300     11938300
rk   -mx2              6218   213%   5015   181%     1336    1613     11770288
rk   -mx3              6679   228%   5233   189%     1606    1842     11629912
rkim     c             3276   112%   3118   112%      175     211     10405925
rkim     cx            3516   120%   3067   110%      499     243      9989608
uhic   e               3264   111%   3047   110%      240     243     10013246
uhic   m               3609   123%   3229   116%      422     441      9887092
zzip a                 3736   128%   3646   131%      100      57     12889383
zzip a -mm             3770   129%   3662   132%      119      59     12933183
zzip a -mm -mx         3770   129%   3662   132%      119      59     12932662

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.

Losslessly compressed with ERI32 to 8,793,161 bytes, this set can be found
at http://artest.virtualave.net/kodak/ and http://artest1.tripod.com/kodak/


[[3]] Details
=============
are no longer put to this main text
(856 lines reporting 17081 results on 538 files in 12 sets),
but can be found in FULL version with GRAPHICS.DAT and all *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest21.zip
or http://artest1.tripod.com/artest21.zip

1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and
/image2/ , converted from Sun Raster format to Windows Bitmap,
(this conversion changes image headers only, 32 bytes
are replaced by 54 bytes, but image data is not modified)

This site www.cipr.rpi.edu is described in comp.compression FAQ,
in 29 lines of "Subject: [55] Where can I find Lenna and other images?"

Eight images in the 5th set are from the famous Waterloo Color Set,
( losslessly compressed to 2,857,560 bytes,
it can be found at http://geocities.com/eri32 )

6,7,8th image sets are from ftp://download.intel.com/pressroom/images/
They were converted from TIFF format to Windows Bitmap.

10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/

Some images were slightly renamed. See GRAPHICS.DAT inside artest21.zip
for more details. Some new images (from download.intel.com) were not added yet.


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
7-Zip 2.24    :W http://www.7-zip.com/dl/7zip224.exe                              463K
ACE32 2.02    :W ftp://ftp.forlangs.net/pub/windows/winace/ace202.exe             587K
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip            50K
BMF    1.1    :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip   132K
DC 0.98b      :W ftp://ftp.cdrom.com/.2/sac/pack/dc124.zip                         55K
ERI32 4.14fre :e http://geocities.com/eri32/eri414fr.zip                           93K
Imp     1.1   :e http://www.winimp.com/imp110d.zip                                266K
Imp-win 1.12  :W http://www.winimp.com/imp112.exe                                 122K
Pkzip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe     202K
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe                               3470K
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe              380K
RKim   1.06   :W http://rksoft.virtualave.net/downloads/rkim106.zip                57K
RAR32  2.80   :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx280.exe               269K
WinRAR 2.80   :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar280.exe               621K
SBC 0.840b    :e http://geocities.com/sbcarchiver/sbc0840b.zip                    207K
UHIC   1.0    :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip                     52K
ZZip 0.36b    :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip            34K

NK  1.0       :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP                          87K
JPEG-LS 1.00  :W http://www.hpl.hp.com/loco/jlsrefV100.zip                        325K
SPIHT  Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe            72K
BTPC   4.1    :W http://www.engr.mun.ca/~john/btpc4.1.zip                         715K
PngCrush 1.5.3:e http://download.sourceforge.net/pmt/pngcrush-1.5.3-DOS.zip       157K
Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe             811K
SEA 1.3       :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip                    705K
Alchemy 1.10  :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip                 1462K

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
Arhangel     : http://geocities.com/SiliconValley/Lab/6606
Eri32        : http://geocities.com/eri32
      mirror : http://artest1.tripod.com
RK, RKim     : http://rksoft.virtualave.net
Imp,WinImp   : http://www.technelysium.com.au
      mirror : http://www.winimp.com
ACE,WinACE   : http://www.winace.com
Ufa,777,7-Zip: http://www.7-zip.com
PkZip        : http://www.pkware.com
RAR,WinRAR   : http://www.rarsoft.com
JPEG-LS      : http://www.hpl.hp.com/loco
PngCrush     : http://pmt.sourceforge.net/pngcrush
SPIHT        : http://www.ipl.rpi.edu/research/SPIHT
BTPC         : http://www.engr.mun.ca/~john/btpc.html
Display      : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html
Alchemy      : http://www.handmadesw.com/Products/Image_Alchemy.htm
SEA          : http://www.photodex.com/products/dos
SBC          : http://geocities.com/sbcarchiver
ZZip         : http://www.zzip.f2s.com


What's new:
~~~~~~~~~~~
46 new images were added,
7 new programs tested: 7-zip 2.24, ACE 2.02, ERI32 4.14fre, SBC 0.840b,
WinRAR 2.80, RAR32 for DOS and OS/2 2.80b3, UHARC 0.3np.

Results of BTPC, IMP and Ufa1 are in the full version only, see DETAILS.DAT.
Latest beta versions of DC, UFA, UHARC are available from authors by e-mail:
DC: EdgarBinder@t-online.de
UFA: support@7-zip.com
UHARC: Uwe.Herklotz@gmx.de


WARNINGS:
~~~~~~~~~
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp,
footbal* and susie* from 2nd set, moore2.bmp from 6th.

 ESP, Rkive and some other programs are not tested any more,
 their results and links can be found in previous versions:
 ESP   - artest3...artest12
 Rkive - 3...12
 UFA   - 3...12
 777   - 13...14
 BOA   - 7...14
 UHARC - 5...10
 SEA   - 12...19
 CompuShow 2000! - 3...11

The LATEST RELEASE, and all previous versions of these tests can be found
at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/

Send your suggestions, comments to artest@inbox.ru
With best kind regards,
RAO Inc.
