FreeBSD Java® Project: Performance Comparison
Introduction:
Much has been talked about recently with Sun's decision to release an official port of Java for Linux. This study was done to compare the actual performance of the Blackdown Linux Port with the FreeBSD Port of the JDK®.
Summary:
The Linux port is faster than the FreeBSD port, even when the JITs are taken into account. For graphic intensive applications, all the FreeBSD tests are faster than the Linux, with FreeBSD/TYA being the fastest overall. Comparing the Linux port with the FreeBSD port, each with no JIT running, FreeBSD is faster. We may conclude that, when running on FreeBSD, the JIT design makes the difference in speed.
Testing Methods:
All tests were run on FreeBSD 3.4-RC (Tue Dec 7 09:14:51 EST 1999) on a Dual Pentium 200 SMP machine with 128 Megs RAM. Tests were conducted with Pendragon Software's Caffeine Mark 3.0 software using the "Run all tests locally" option.
Software Versions:
The following is a list of the software used in this test:
FreeBSD JDK 1.1.8
Blackdown's JDK 1.2.2-RC3 (under Linux emulation)
ShuJIT 0.3.13
TYA 1.5
Summary Results
Test 1 | Test 2 | Test 3 | Test 4 | Test 5 | Average | |
---|---|---|---|---|---|---|
Linux JDK 1.2.2/no JIT | 222 | 223 | 224 | 225 | 222 | 223 |
FreeBSD JDK 1.1.8/no JIT | 247 | 247 | 247 | 250 | 247 | 246 |
Linux JDK 1.2.2/standard JIT | 539 | 550 | 543 | 544 | 535 | 542 |
FreeBSD JDK 1.1.8/shujit | 373 | 376 | 369 | 374 | 373 | 373 |
FreeBSD JDK 1.1.8/TYA | 478 | 477 | 478 | 479 | 483 | 479 |
Sample Detailed Results:
Sieve | Loop | Logic | String | Float | Method | Graphics | Images | Dialog | |
---|---|---|---|---|---|---|---|---|---|
Linux JDK 1.2.2/no JIT | 380 | 434 | 433 | 489 | 363 | 337 | 306 | 25 | 40 |
FreeBSD JDK 1.1.8/no JIT | 318 | 456 | 434 | 393 | 381 | 381 | 344 | 77 | 37 |
Linux JDK 1.2.2/standard JIT | 1361 | 2005 | 3354 | 872 | 1161 | 1802 | 247 | 28 | 40 |
FreeBSD JDK 1.1.8/shujit | 800 | 1566 | 2191 | 588 | 1010 | 101 | 317 | 79 | 37 |
FreeBSD JDK 1.1.8/TYA | 712 | 1467 | 2352 | 949 | 1078 | 512 | 357 | 74 | 38 |
Conclusion:
Newer versions of the software used in the tests above been released since this test was conducted. For this reason, these tests will be run again in the near future to see if the newer JITs for FreeBSD alter the results. The same JITs will be used with the Linux JDK to test their effects as well.
Tester:
These tests were conducted by Patrick Gardella patrick@FreeBSD.org in December 1999.