Preliminary Performance Benchmarking of ACID
(Page loading time)

Host: Intel Mobile 800Mhz, 256 MB RAM
OS: Linux 2.2.16-22
Apache: 1.3.19
PHP: 4.0.5
MySQL: 3.23.32 (MyISAM tables, Unix socket)
PostgreSQL: 7.1.2 (Unix socket, fsync disabled, vacuum analyzed between runs)
DB schema: v102 (indexed as per create_mysql/postgresl in Snort v1.8b5 build 24)
ACID: 0.9.6b10 - 0.9.6b13

  • Suggestions on additional potential optimizations are highly welcome (especially from PostgreSQL gurus)
  • Is anyone's experiences highly divergent from these results?

    I. Unique Alert Listing (acid_stat_alerts.php)

    I.a. Unique Alert Listing -- MySQL 3.23.32

    # of Alerts MySQL v0.9.6b10 MySQL v0.9.6b11 MySQL v0.9.6b13 % b10>11 % b11>13 % b10>13
    103,020 15.3 12.5 11.0 18.5% 12.0% 39.4%
    206,048 31.0 22.5 17.5 27.4% 22.2% 77.1%
    309,060 47.0 35.0 26.5 25.5% 24.3% 77.4%
    412,080 66.7 47.5 34.5 28.8% 27.4% 93.2%
    515,100 78.3 51.0 43.5 34.9% 14.7% 80.1%
    619,192 95.3 68.5 56.5 28.1% 17.5% 68.7%
    824,160 125.3 67.0 71.0 46.5% -6.0% 76.5%
    1,030,200 160.0 87.5 82.0 45.3% 6.3% 95.1%
    1,555,400 286.3 206.5 131.5 27.9% 36.3% 117.7%

    I.b. Unique Alert Listing -- PostgreSQL 7.1.2

    # of Alerts PgSQL v0.9.6b10 PgSQL v0.9.6b11 PgSQL v0.9.6b13 % b10>11 % b11>12 % b10>13
    103,020 46.0 32.0   30.4%  
    206,048 216.0 186.5   13.7%  
    309,060 342.0 328.5   3.9%  
    412,080 478.5 451.0   5.7%  
    515,100 615.5 594.5   3.4%  
    619,192 784.0 796.0   -1.5%  
    824,160 1351.5 1184.5 12.4%  
    1,030,200 2220.5 1594.5 28.2%  
    1,555,400            

    II. ACID Main page (acid_main.php)

    II.a. ACID Main page -- MySQL 3.23.32

    # of Alerts v0.9.6b10 v0.9.6b11 v0.9.6b12 % b10>11 % b11>12 % b10>12
    103,020 7.0 3   57.1%  
    206,048 13.0 7   46.2%  
    309,060 17.0 10   41.2%  
    412,080 23.0 15   34.8%  
    515,100 31.0 13   58.1%  
    619,192 37.0 20   45.9%  
    824,160 47.0 19   59.6%  
    1,030,200 58.0 24.5   57.8%  
    1,555,400 83.0 49.5   40.4%    

    II.b. ACID Main page -- PostgreSQL 7.1.2

    # of Alerts v0.9.6b10 v0.9.6b11 v0.9.6b12 % b10>11 % b11>12 % b10>12
    103,020 14.5 15.0   -3.4%  
    206,048 23.0 20.5   10.9%  
    309,060 40.5 35.0   13.6%  
    412,080 49.0 48.0   2.0%  
    515,100 88.0 59.0   33.0%  
    619,192 109.0 64.0   41.3%  
    824,160 160.5 96.5   39.9%  
    1,030,200 215.0 131.5   38.8%  
    1,555,400 236.0 160.0   32.2%    

    III. Alert Event Cache Maintenance (acid_maintenance.php)

      MySQL 3.23.32 PostgreSQL 7.1.2 MySQL 3.23.32 PostgreSQL 7.1.2
    # of Alerts (s) (s) (min) (min)
    103,020 57.0 408 1.0 6.8 Caching time
    206,048 134.0 599 2.2 10.0 MySQL: 1234.6 alerts/sec
    309,060 204.0 1054 3.4 17.6 PostgreSQL: 240.7 alerts/sec
    412,080 276.0 1721 4.6 28.7
    515,100 378.0 2639 6.3 44.0
    619,192 458.0 7.6  
    824,160 624.0 10.4  
    1,030,200 772.0 12.9  
    1,555,400 1612.0   26.9