Proposals on Admin UI


#1

Hey guys,

Recently, I’ve added support for manually running benchmark suite for last number of commits.
https://github.com/ruby-bench/ruby-bench-web/pull/210

Currently, ManualRunner can be used from production console although it’s not convenient way to do it. So as @tgxworld proposed, admin UI could be handy.

Therefore I’ve created dedicated topic to hear some suggestions what do you find handy having in admin UI?

Maybe being able to see suite logs (without ssh to server) could make our lives easier when some error with running suite occurs? Storing logs for last 10 runs would be sufficient.

Please feel free to share proposals :slight_smile:


#2

I’m intentionally not being too demanding with most of your time right now – I think Sam’s goal of measuring framework overhead is an excellent one, and I don’t want to interfere.

But at some point, I’m strongly in favor of not only a “last X commits” admin UI, but more specificially a “run against this commit in this (potentially new) repo” admin UI so that we can run the full RubyBench suite easily against new patches, such as Shyouhei’s deopt branch or Vladimir Makarov’s MJIT branch.


#3

:thumbsup: for this as well and this was something @sam has wanted for quite some time. It’ll also be helpful for people submitting performance patches to Ruby.


#4

@bmarkons I just tested the admin UI and it works really well :+1:

I sort of hacked in a pattern fields today in order to quickly backfill the new Ruby benchmarks

Another thing we want to add is to be able to backfill based on the version as well.


#5

Great @tgxworld!

That was next thing on my list :ok_hand:

Another thing we want to add is to be able to backfill based on the version as well.

I wonder, do you maintain any board with TODOs? I think it could be handy to sync work.
We could use Projects · ruby-bench/ruby-bench-web · GitHub or something like trello board.

WDYT?


#6

Sure I’ve added a board :slight_smile: Do you have access to it?


#7

Please provide me with access on RubyBench board :slight_smile:

Update:

I see it now :+1: GSOC 2017 · GitHub