Ability to easily download and run benchmarks locally

6

Noah you may want to have a play with this, just head to any bench on the site and follow the breadcrumbs :slight_smile:

@osama some feedback on:

rubybench_runner run rails/bm_activerecord_scope_all_over_select.rb

Cannot find rails at /home/sam/rails.Perhaps try:

Missing a newline.

I want to hack on this script so it would be nice to have:

run <repo_name>/<script_name> OR localscript so I can run locally, that way I can measure memory and so on.

What is this thing doing to my DB? What database is it going to create? It should be very specific with verbose output about all the DB fiddeling it is doing (especially any createdb statements it runs)

EG:

rubybench_runner run rails/bm_activerecord_scope_all_over_select.rb --rails=`pwd` --db postgres
Using the 'postgres' gem...
Checking dependencies...
Warning: rubybench.org is currently running version 9.6 of PostgreSQL, you're running version .
Installing gems...
Checking database... (using rubybench_local) <-- something like that.
Downloading script to /tmp/rubybench/script.name <-- something like that. 
Running benchmarks...
Rails version 6.1.0.alpha
Results (1 runs):

- run 1:
    iterations_per_second: 91.71
    iterations_per_second_standard_deviation: 3.27
    total_allocated_objects_per_iteration: 25081

Also, perhaps we can do:

rubybench_runner run rails/bm_activerecord_scope_all_over_select.rb --create-standalone-script > run_bench.rb

That will help us remove 100% of the magic here if we wish.