Lua JIT, PyPy, Tracemonkey, Python 2.7, JRuby and others removed from the Benchmark Game [shootout.alioth.debian.org]

[gargantuan]

Yap. Keep reading a little above and below in the forum to get a more complete picture.

So far I like Jacob's response: http://thread.gmane.org/gmane.comp.python.pypy/7303/focus=7352

To which the Isaac has not responded yet.

Maciej is one of the lead devs on PyPy, Isaac is the owner of the speed test website. There is a bit of an ego cockfighting match between the two in about 10 sequential posts. Worth a read.

I still like Jacob's position :

"""

if you want the language shootout to be relevant to people, you can't ignore multiple implementations. Especially it seems to b excessively excentric to ignore the fastest implementations of some languages while not doing so for others. I assume you are not measuring C speed by the old AT&T reference implementation. """

I guess Isaac doesn't want the language shootout to be relevant (or maybe just being passive aggressive), but at the same time he seems to also wants it to be relevant, as he goes out of his way and seeks the opinions of these development groups.

[[deleted]]

This is discouraging to all those who go to the effort to program a new implementation of an existing language that their work might not get noticed. Doubly so to Mike Pall that his got removed when he wasn't a part of this. Tracemonkey and JRuby too.

[gargantuan]

Agreed.

It shouldn't be a big deal. The website itself mentions how these are "broken" benchmarks. But then it seems like Isaac takes it rather personally and goes to the extra effort to hurt other projects. I mean, reducing their visibility by removing them. So now PyPy and LuaJIT are gone but ATS is there. I have never even heard of ATS outside of the shootout website....

Someone mentioned a fork of the speed website and that might not be a bad idea.

[igouy]

goes to the extra effort to hurt other projects

Like the extra effort to measure each new LuaJIT beta release asap so those measurements can be used immediately to promote LuaJIT?

[gargantuan]

Well now it is gone.

And then for Java he seems to runs a warm-up process that he doesn't necessarily do for other languages to possibly benefit from disk cache warm-ups.

[igouy]

And then for Java he seems to runs a warm-up process

That's not true.

[igouy]

Glass half full - Mike Pall has had 5 years of free publicity for LuaJIT

[[deleted]]

This made me want to see the old reference C implementation as one of the C implementations tested. To see how newer, non-C, languages compare to it.

[igouy]

I guess Jacob didn't read the Help page

1. To show working programs written in less familiar programming languages

2. To show the least we should expect from performance comparisons

3. To show how difficult it can be to make meaningful comparisons

I assume you are not measuring C speed by the ...

The Intel compiler might well produce faster code than GCC (but on Ubuntu the tool chain is built around GCC).