Download job stats as CSV?
Reported by simont | January 30th, 2009 @ 03:06 PM | in feature
For development/testing it would be nice to be able to download the stats for a given job - essentially dump out the data on the jobs/1 page. If there was also info on the node (small, medium) that would be nice so we could see performance for each type of node and be able to compile the results, etc.
I had a medium head node and one small worker node and the worker took around 40s per 200 spectra (USP dataset) and the head node was around 10 secs - around 4x as fast at 4x the cost. If only we could save this data between incarnations of ViPDAC, we could get some very handy information over time. In the meantime, having a way to dump it out would at least allow it to persist in excel.
S
Comments and changes to this ticket
-
simont January 30th, 2009 @ 04:16 PM
In the short term it is possible to just copy the table of data from the page and paste into Excel so that would work just fine to get the data out.
It still might be nice to know if a node was Small or Medium on that jobs table but in the near term we can certainly go back to the Nodes page and figure it out if we need to.
-
jgeiger January 30th, 2009 @ 04:22 PM
- Tag set to “analysis, data, performance”
- State changed from “new” to “open”
This is basing the assumption that you're running on a single node. It does give you the instance id and process id of the worker that processed the chunk. It would be possible to associate that information with the node size in the future, but at the moment it isn't doing that. Also, for my original data, I was just copy/pasting.
-
jgeiger February 3rd, 2009 @ 11:02 AM
- Tag changed from “analysis, data, performance” to “analysis, data, performance, statistics”
- Milestone set to “feature”
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Virtual Proteomics Data Analysis Cluster
jgeiger
simont