Message boards : Number crunching : Report work units with unusual amount of credits granted
Author | Message |
---|---|
Mod.DE Volunteer moderator Send message Joined: 23 Aug 06 Posts: 78 Credit: 0 RAC: 0 |
This thread is supposed to be a collecting point of work units, which got an unusual amount of credits granted. It has a similar function like the "Report Problems with Rosetta Version XXX" thread, where you can report work units which produce an error. Please don't discuss the credit system as a whole in this thread, just report the work unit, for which you think the granted credits are inappropriate. I am a forum moderator! Am I? |
anders n Send message Joined: 19 Sep 05 Posts: 403 Credit: 537,991 RAC: 0 |
Any thoughts to when a WU gets to much or to little? Is it 20-30% up or down or is it the wu-s with 0 or very much? Anders n |
Mod.DE Volunteer moderator Send message Joined: 23 Aug 06 Posts: 78 Credit: 0 RAC: 0 |
Any thoughts to when a WU gets to much or to little? That is up to you to decide. A variation of 10% is certainly nothing to report and even 20% seems not way off for me (if there is no pattern). This thread is just meant to collect "suspicious" WU and then we will see if it is a "natural" variation or something to bugfix. I am a forum moderator! Am I? |
anders n Send message Joined: 19 Sep 05 Posts: 403 Credit: 537,991 RAC: 0 |
Then I think this one got to much credit. https://boinc.bakerlab.org/rosetta/result.php?resultid=34074163 Anders n |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
Then I think this one got to much credit. That's well within the tollerances of this new system. That variation was seen over at Raplh. the the code for working it out has changed I wouldn't expect the variation to have altered that much. All you credits seem to be on average higher. Team mauisun.org |
anders n Send message Joined: 19 Sep 05 Posts: 403 Credit: 537,991 RAC: 0 |
That's well within the tollerances of this new system. Well I don´t think ~55% is within the tollerance. As for getting higher credit it must be the optimized clients pushing the average up. Anders n Edit Spelling |
Aaron Finney Send message Joined: 8 Oct 05 Posts: 52 Credit: 109,589 RAC: 0 |
This thread is supposed to be a collecting point of work units, which got an unusual amount of credits granted. Rosetta shouldn't be your testing ground. You have RALPH for that. If what you are saying is that the credit system you implemented with NO WARNING, still needs more testing.... I fear for this project. |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
That's well within the tollerances of this new system. Well that's was up to the implementers to decide, not me :-) and we'll have to live with it. Yep, the optimised clients push the average up, though the linux users with srock bring it down. (though I think overall it'll certainly be up) The idea they are hoping is you'll also get a -45% granted credit. Though they've never shown the sort of distribution and error from mean results. Mind they've only just implemented it using Rosetta with a rolling avererage as the scoring methed as opposed to using it from Ralph and a fixed average as the scoring method. Team mauisun.org |
adrianxw Send message Joined: 18 Sep 05 Posts: 653 Credit: 11,840,739 RAC: 10 |
If what you are saying is that the credit system you implemented with NO WARNING, still needs more testing.... The boards here have been discussing the new credit system for months now, and it had been stated repeatedly that the new credit system would not be introduced until CASP finished. CASP finished. I believe ample "warning" was given. As for testing, a testbed can isolate obvious errors, but unless you run every wu on the testbed before running it on a production service, you will never be able to categorically say it works 100%. Therefore, the project has created a place where you can point out dubious looking results, and have them checked to make sure there isn't a lurking problem. Testing every wu would be futile. I see this as positive, rather then negative, and to be applauded. To get back to the topic in hand, I found this one somewhat suprising. It is one of mine crunched with standard clients and cores, as all of mine are. It was before we were being actually credited with the enhanced score however, so although I was "granted" 204, in fact my credit for that day shows I actually received 76. I don't know if that is significant, but it certainly is a big markup. *** EDIT *** It's only been there a couple of minutes and already somebody gives me a "minus". Ho hum. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
RedQueen Send message Joined: 15 Jun 06 Posts: 9 Credit: 163,610 RAC: 0 |
https://boinc.bakerlab.org/rosetta/result.php?resultid=33631759 Every other work unit I have done averages about 30 credit on that machine, for the same amount of time |
Mod.DE Volunteer moderator Send message Joined: 23 Aug 06 Posts: 78 Credit: 0 RAC: 0 |
https://boinc.bakerlab.org/rosetta/result.php?resultid=33631759 The ...SRAMAN... WU were already identified as not in line and corrected. That was before the new credit system went live. But thanks for reportint it anyway. But in future please only WU granted credit on August, 23rd or later. I am a forum moderator! Am I? |
J D K Send message Joined: 23 Sep 05 Posts: 168 Credit: 101,266 RAC: 0 |
Interesting Result ID Work unit ID Sent Time reported or deadline explain Server state explain Outcome explain Client state explain CPU time (sec) claimed credit granted credit 34204684 29727119 24 Aug 2006 8:58:52 UTC 24 Aug 2006 19:02:22 UTC Over Success Done 20,660.52 53.13 68.35 34163312 29687812 24 Aug 2006 2:41:40 UTC 24 Aug 2006 13:16:09 UTC Over Success Done 20,244.34 53.33 74.88 34111383 28656790 23 Aug 2006 18:38:58 UTC 24 Aug 2006 7:07:53 UTC Over Success Done 21,405.50 56.39 132.10 34090014 29620260 23 Aug 2006 15:29:11 UTC 24 Aug 2006 1:08:47 UTC Over Success Done 20,311.30 53.51 61.03 BOINC Wiki |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
Both 'J D K' and 'ted3' seem to have encountered the same situation, and two factors seem to be unique to these results compared to their other recent results. 1. Most or all of the results shown in comaprison to the apparent "outlying" point values are for CASP Refinement targets for protein "t370", while the two higher values are for protein "t362". 2. In addition--and perhaps more importantly--each of the "t362" WUs were originally sent out on Aug. 16 at around 16:00UTC and 17:06UTC. The first computer getting each of those "t362" targets did not reply, so when the seven-day time deadline was reached on Aug. 23, the targets were sent out to 'J D K' and 'ted3' at that time. As a result, these WUs generated before the credit system switchover was processed after the switchover. Since other recent results for these two crunchers seem to correlate very well, it seems to me that a simpler explanation for the apparent anomaly in Granted Credit might be either (1) the different protein target (even though the number of residues is about the same), or (2) some glitch in point counting in the new point system when processing a WU that was generated before the new system was in place. In the latter case, the effect would be only temporary. Perhaps a Project representative will be able to comment. Serene crunching! P.S. Thanks much to 'J D K' and 'ted3' for having their computers visible! |
Buffalo Bill Send message Joined: 25 Mar 06 Posts: 71 Credit: 1,630,458 RAC: 0 |
I also got a high credit for a single T362 WU. Most of my credits are higher now as I always used the standard client but this one is quite a bit higher. https://boinc.bakerlab.org/rosetta/result.php?resultid=34125114 Bill |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
I also got a high credit for a single T362 WU. Most of my credits are higher now as I always used the standard client but this one is quite a bit higher. Thanks for the info! The WU, #28669731 was also a re-send originally sent out on Aug. 16. Nice to have some more confirmation. |
Mod.DE Volunteer moderator Send message Joined: 23 Aug 06 Posts: 78 Credit: 0 RAC: 0 |
I moved several posts from the discussion thread over here, since they are dealing with specific WU and may help the project staff in finding bugs. Yes the average for t362 is much higher than for other WU. This can happen due to initial overclaimed credit. The question is, why does it not correct soon? It still seems that new results of t362 get significantly more credit than other WU. In theory the ratio should get down quite quickly to the average of all other WU. I am a forum moderator! Am I? |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
I moved several posts from the discussion thread over here, since they are dealing with specific WU and may help the project staff in finding bugs. And that's when cherry picking starts, people dump the 370 and try until they get 362's Hopefully this is just a blip of the transition over to the newer system. Given used two different system the use Ralph for the credit value (older ones) & the use Rosetta for the credit value (newer ones) Team mauisun.org |
[DPC]Division_Brabant~OldButNotSoWise Send message Joined: 23 Jan 06 Posts: 42 Credit: 371,797 RAC: 0 |
Spoken about a unfair creditsystem LOL. I'll put half of my CPU power on D2OL now, the other stay's for another week on rosetta. If nothing changed with this strange creditsystem, then I'll thank you all for the fun I had in rosetta before this. :) (no hard feelings) |
BennyRop Send message Joined: 17 Dec 05 Posts: 555 Credit: 140,800 RAC: 0 |
[DPC]Division_Brabant~OldButNotSoWise: graph the credit/time for each of WUs on a machine (as I've started to do here.) and see if you don't have a fairly smooth graph with just a few WUs that pop up that should be reported here. For unusual credit reports: https://boinc.bakerlab.org/rosetta/result.php?resultid=33516118 FRA_t367_CASPR_hom001_6_t367_4_1wolA_IGNORE_THE_REST_1504_1076_84_1 1.5x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33628586 t000__BOINC_SRAMAN_periLABRELAX_SAVE_ALL_OUT__1178_6433_0 2.5x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33945090 FRA_t322_CASPR_hom001_6_t322_3_1u1zA_IGNORE_THE_REST_202_1079_87_1 1.5x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=34123801 FRA_t362_CASPR_hom001_6_t362_6_1s5uA_IGNORE_THE_REST_54_1080_96_1 1.5x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33458306 FRA_t367_CASPR_hom001_6_t367_4_1o3uA_IGNORE_THE_REST_396_1076_73_1 1.5x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33384283 FRA_t367_CASPR_hom001_6_t367_4_1o3uA_IGNORE_THE_REST_1227_1076_48_1 3x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33628390 t000__BOINC_SRAMAN_periLABRELAX_SAVE_ALL_OUT__1178_6239_0 3x score. https://boinc.bakerlab.org/rosetta/result.php?resultid=33233227 t314__CASP7_FOLLOWUP_ABRELAX_SAVE_ALL_OUT_BARCODE_perfectss__1066_252546_0 2/3rds score. |
Ananas Send message Joined: 1 Jan 06 Posts: 232 Credit: 752,471 RAC: 0 |
@Benny : I think they want to see reports about unusual granted credits, which would point out flaws in the new credits system |
Message boards :
Number crunching :
Report work units with unusual amount of credits granted
©2024 University of Washington
https://www.bakerlab.org