6

Not too long ago the "ATS" programming language was removed from the Computer Language Benchmarks Game. You can still view the old pages via the way back machine.

Why is the ATS programming language no longer included in the Computer Language Benchmarks Game?

Stephen Kennedy
  • 20,585
  • 22
  • 95
  • 108
mrsteve
  • 4,082
  • 1
  • 26
  • 63
  • >>I assume we all know why comparing programming language is bogus and unscientific.<< Tell us why you think so. – igouy Nov 16 '14 at 17:08
  • 1
    There are hardly any cases of papers that doe the same thing. The reason is I think that it is impossible to do a fair comparison. Essentially you can cheet very easily, either intentionally or unintentionally. One unfair thing is to leave out programming languages. Another one is in the selection of the problems, which may or may not favor programming styles (functional vs lowlevel vs oop). In the past a scripting language could not be compared to haskell, because haskell used multiple cores and the scripting was single threaded. Hardware bias (AMD/ARM processors). And many more reasons. – mrsteve Nov 16 '14 at 17:59
  • >>There are hardly any cases of papers that doe the same thing.<< Nonsense. Go look. "Benchmarking implementations of functional languages with ‘Pseudoknot’, a float-intensive benchmark" Journal of Functional Programming / Volume 6 / Issue 04 / July 1996, pp 621-655. "Comparing Parallel Functional Languages: Programming and Performance" Journal Higher-Order and Symbolic Computation archive, Volume 16 Issue 3, September 2003, pp 203-251. – igouy Nov 16 '14 at 22:06
  • >>One unfair thing is to leave out programming languages.<< Comparisons simply have nothing to say about language implementations that are not compared. >>Another one is in the selection of the problems<< Comparisons simply have nothing to say about problems that are not compared. >>Hardware bias (AMD/ARM processors).<< Comparisons simply have nothing to say about hardware that was not used. – igouy Nov 16 '14 at 22:08
  • >>In the past a scripting language could not be compared to haskell, because haskell used multiple cores and the scripting was single threaded.<< The programs can be forced onto one core and compared. The programs can be compared on multi core and show the deficiency of not being able to use multi core. – igouy Nov 16 '14 at 22:09
  • At 1.5k rep you should know that this is not an acceptable question for stackoverflow. – JK. Nov 17 '14 at 22:11

1 Answers1

5

According to this post by the maintainer:

Unfortunately, there was no effective way to make sure that contributed ATS programs were comparable to the other programs that had been contributed. There are not enough ATS experts.

interjay
  • 107,303
  • 21
  • 270
  • 254
  • 2
    More correctly, that's the answer to why ATS2 was not included. The ATS programs were removed because when ATS2 was released those programs did not work with ATS2; and months later when there was an opportunity to gather new programs for ATS2, I re-assessed how the inclusion of ATS had worked-out. – igouy Nov 16 '14 at 19:20