GSOC 2017 - Long Running Ruby and Rails Benchmarks

[sam]

GSOC Project : Improving RubyBench

Note, just going to mention this here. I think the bisecting stuff is very interesting and important, however feel that the most important thing is getting our benchmarks in order. I feel there is a huge gap around our Rails benchmarks, in particular have a look at say: https://rubybench.org/rails/rails/commits?result_type=activerecord/mysql2_scope_all_with_default_scope&display_count=200 What if this was implemented raw against the mysql gem, how fast would it be? How many objects would b…

to me is still the #1 #2 and #3 issues I want sorted, our benchmarks are not honest enough, there is no way to tell how much performance is being left on the table.