Lighthouse has a new layout. Prefer the old one? Return to the old layout, and switch back any time from the link at the top of each page.

Download job stats as CSV?

#15

For development/testing it would be nice to be able to download the stats for a given job - essentially dump out the data on the jobs/1 page. If there was also info on the node (small, medium) that would be nice so we could see performance for each type of node and be able to compile the results, etc.

I had a medium head node and one small worker node and the worker took around 40s per 200 spectra (USP dataset) and the head node was around 10 secs - around 4x as fast at 4x the cost. If only we could save this data between incarnations of ViPDAC, we could get some very handy information over time. In the meantime, having a way to dump it out would at least allow it to persist in excel.

S

Reported by simont · January 30th, 2009 @ 03:06 PM

State: open
Milestone: feature
Assigned to: jgeiger jgeiger

Activity

  1. simont
    simont

    In the short term it is possible to just copy the table of data from the page and paste into Excel so that would work just fine to get the data out.

    It still might be nice to know if a node was Small or Medium on that jobs table but in the near term we can certainly go back to the Nodes page and figure it out if we need to.

    January 30th, 2009 @ 04:16 PM

  2. jgeiger
    jgeiger
    • Tag set to analysis, data, performance
    • State changed from new to open

    This is basing the assumption that you're running on a single node. It does give you the instance id and process id of the worker that processed the chunk. It would be possible to associate that information with the node size in the future, but at the moment it isn't doing that. Also, for my original data, I was just copy/pasting.

    January 30th, 2009 @ 04:22 PM

  3. jgeiger
    jgeiger
    • Tag changed from analysis, data, performance to analysis, data, performance, statistics
    • Milestone set to feature

    February 3rd, 2009 @ 11:02 AM

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.