Problems and Technical Issues with Rosetta@home
Message boards : Number crunching : Problems and Technical Issues with Rosetta@home
Previous · 1 . . . 133 · 134 · 135 · 136 · 137 · 138 · 139 . . . 300 · Next
| Author | Message |
|---|---|
 Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
Because a lot of our work is now going to the AI Neural network. Admin doesn't care either. He hasn't responded to either one of my messages about Python and the dysfunctional web set up. It seems to be a take it as it is or leave it attitude now. Which is a shame. This project started out really caring. Now its a thing to dump on. |
|
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1673 Credit: 17,596,129 RAC: 22,414 
|
I'm getting "No VBox installed" messages again along with no new work when reporting completed work, and the Ready to send number has taken a dive, so i'm guessing we've already finished off that last batch of Rosetta 4.20 work. Grant Darwin NT |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2117 Credit: 41,140,182 RAC: 15,917 
|
I'm getting "No VBox installed" messages again along with no new work when reporting completed work, and the Ready to send number has taken a dive, so i'm guessing we've already finished off that last batch of Rosetta 4.20 work. Confirmed here... <sigh>  
|
gemini8 Send message Joined: 25 Feb 12 Posts: 5 Credit: 3,021,303 RAC: 4,880 
|
I am out, until someone can confirm that the pythons are working correctly, and I can select them. Part one of that is no problem. I returned at least two proper results before the one I was complaining about. Unfortunately I can't show them off anymore, as the db seems to have taken them out by now. vbox can be a hassle on every project, and I encountered similar problems elsewhere. Dealing with projects that have nothing except vbox apps is one thing, but Rosetta isn't one of those. So the possibility to unselect those monsters should obviously and absolutely be existing! - - - - - - - - - - - - - - - Greetings, Jens |
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,132,201 RAC: 5,104
|
I am out, until someone can confirm that the pythons are working correctly, and I can select them. I can confirm that the Python tasks work just fine on my Windows 11 beta testing laptop, I am running ver 6.1.26 of VBox and ver 7.16.20 of Boinc: 1450357706 1293408677 4767328 17 Nov 2021, 0:09:28 UTC 20 Nov 2021, 0:09:28 UTC In progress --- --- --- rosetta python projects v1.03 (vbox64) windows_x86_64 1450297317 1293408267 4767328 17 Nov 2021, 0:09:28 UTC 20 Nov 2021, 0:09:28 UTC In progress --- --- --- rosetta python projects v1.03 (vbox64) windows_x86_64 1450357611 1293408634 4767328 17 Nov 2021, 0:08:51 UTC 17 Nov 2021, 12:13:59 UTC Cancelled by server 0.00 0.00 --- rosetta python projects v1.03 (vbox64) windows_x86_64 1450286960 1293407997 4767328 17 Nov 2021, 0:08:03 UTC 20 Nov 2021, 0:08:03 UTC In progress --- --- --- rosetta python projects v1.03 (vbox64) windows_x86_64 1450357628 1293408478 4767328 17 Nov 2021, 0:08:03 UTC 20 Nov 2021, 0:08:03 UTC In progress --- --- --- rosetta python projects v1.03 (vbox64) windows_x86_64 1449564483 1293454887 4767328 15 Nov 2021, 23:25:48 UTC 17 Nov 2021, 12:12:47 UTC Completed and validated 22,488.82 20,606.27 185.74 rosetta python projects v1.03 (vbox64) windows_x86_64 1449564347 1293454813 4767328 15 Nov 2021, 23:25:48 UTC 18 Nov 2021, 23:25:48 UTC In progress --- --- --- rosetta python projects v1.03 (vbox64) windows_x86_64 1449486504 1293416591 4767328 14 Nov 2021, 3:21:18 UTC 17 Nov 2021, 5:45:55 UTC Completed and validated 34,804.85 31,782.95 441.35 rosetta python projects v1.03 (vbox64) windows_x86_64 1449487643 1293416839 4767328 14 Nov 2021, 3:20:38 UTC 16 Nov 2021, 13:32:46 UTC Completed and validated 40,661.08 40,217.94 515.61 rosetta python projects v1.03 (vbox64) windows_x86_64 1449487583 1293416824 4767328 14 Nov 2021, 3:20:38 UTC 16 Nov 2021, 19:56:35 UTC Completed and validated 22,768.22 20,693.41 186.15 rosetta python projects v1.03 (vbox64) windows_x86_64 |
|
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
I returned at least two proper results before the one I was complaining about. Most of my pythons work too. But the ones that fail hang up the machine for long periods of time. That is not acceptable to me. I will leave to those willing to attend to it. |
|
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,523,781 RAC: 8,309
|
I pointed that out about a year ago when MIP on WCG (which uses Rosetta) went in-house. They didn't need the crunchers any more. I don't think so. In-house HPC needs some points: - a lot of performative hardware - a big and prepared IT team - simulations as much as possible homogeneous Rosetta@Home has not these points. WCG (when it was IBM) has. When IPD/BakerLab needs great computational power that cannot split on Boinc, they always use external source: AWS, Azure, TACC, etc. But, maybe i'm wrong..... |
|
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Rosetta@Home has not these points. WCG (when it was IBM) has. You are probably right. It is a question of "when" they need it. I expect it won't be so often now. However, whether they do or not, they still have periodic shortages, usually in the summer or holiday season. That says they don't have enough work to carry them through. So they don't need so many crunchers. They will still get the same amount of work done over a period of time. I prefer to put my machines where most needed. It is just a personal preference. |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2117 Credit: 41,140,182 RAC: 15,917
|
I'm getting "No VBox installed" messages again along with no new work when reporting completed work, and the Ready to send number has taken a dive, so i'm guessing we've already finished off that last batch of Rosetta 4.20 work. A load came through a few hours ago and a few more a short while ago, but seems to have run out again
|
|
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
I'm getting "No VBox installed" messages again along with no new work when reporting completed work, and the Ready to send number has taken a dive, so i'm guessing we've already finished off that last batch of Rosetta 4.20 work. At the time of this message its 0. 4986 python if you can manage to get any. |
|
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
I pointed that out about a year ago when MIP on WCG (which uses Rosetta) went in-house. They didn't need the crunchers any more. I wondered where TACC got their BOINC stuff. It's so spotty there, not worth wasting you time. It might be time to say goodbye to RAH. All this BS that is going on, it's starting to make me rethink staying here. I've been grinding a long time for them, its a shame to leave. |
|
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
I am out, until someone can confirm that the pythons are working correctly, and I can select them. I'm on 6.1.28 Vbox and 7.16.20 BOINC and not getting anything Python. So weird. |
|
MStenholm Send message Joined: 18 Apr 20 Posts: 18 Credit: 25,821,080 RAC: 16,471
|
I can see the number 4986 but I can't see that it's a pythron unit. Is it an assumption or do I look the wrong place (Computing drop down menu, Server status)? |
|
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 3,710
|
Scroll down on the Server Status page to "Tasks by Application" - Rosetta Python Projects. |
|
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
I am out, until someone can confirm that the pythons are working correctly, and I can select them. Can confirm, Windows 11 + VB 6.1.28 + BOINC 7.16.20 and Python tasks run okay. Any hangups have been resolved by quitting and restarting BOINC Manager. My only complaint is that I can only run one python tasks at a time on my setup and BOINC won't download more tasks to meet by CPU usage settings unless I pause the "waiting to run" Python tasks. |
|
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1673 Credit: 17,596,129 RAC: 22,414
|
My only complaint is that I can only run one python tasks at a time on my setup and BOINC won't download more tasks to meet by CPU usage settings unless I pause the "waiting to run" Python tasks.You've got 16GB of RAM on a system with 12 cores/threads. That would cause issues even with some Rosetta 4.20 Tasks, let alone the extreme RAM requirements for Python Tasks. Edit- Having said that, has anyone checked how much RAM is being used by VirtualBox in Windows Task Manager? The Python Tasks themselves only use a few hundred MB of RAM, but they do appear to need 8GB+ of storage space. Has anyone tried giving BOINC 100GB of disk space (for a 6c/12t system) & seeing if those Waiting to run Python Tasks start running? Grant Darwin NT |
|
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
My only complaint is that I can only run one python tasks at a time on my setup and BOINC won't download more tasks to meet by CPU usage settings unless I pause the "waiting to run" Python tasks.You've got 16GB of RAM on a system with 12 cores/threads. That would cause issues even with some Rosetta 4.20 Tasks, let alone the extreme RAM requirements for Python Tasks. Yeah, you're right, I need way more ram. Python tasks need like what? 6Gib of RAM each? BTW, how do I know when to abort a Python task? I may have spoken too soon about W11 playing nicely with Python tasks on my end. |
|
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
My only complaint is that I can only run one python tasks at a time on my setup and BOINC won't download more tasks to meet by CPU usage settings unless I pause the "waiting to run" Python tasks.You've got 16GB of RAM on a system with 12 cores/threads. That would cause issues even with some Rosetta 4.20 Tasks, let alone the extreme RAM requirements for Python Tasks. I've given BOINC 280GB of free disc space. I'll check the actual ram usage of VB Python tasks, it's not that high IIRC. I may have gotten a bad batch of Python tasks that need to be aborted... Update: Aborted one task that obviously wasn't running right (0% CPU and 0 RAM usage). boinc_cages_IL_2727241_31732_0 uses 30.5MB of RAM. |
|
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1673 Credit: 17,596,129 RAC: 22,414
|
Yeah, you're right, I need way more ram.Maybe... I'm thinking that's what they insist on to start, and so VBox will take it from the OS and reserve it for that Task. But from the looks of several of your completed Python Tasks, their actual RAM usage is less than 100MB. So in theory, it should be possible for many of them to run at the same time. VBox reserves 8GB for one Task, it doesn't need it all so when the next Task tries to start, it only needs to pull another 100MB from the OS for two Tasks to be running, with 8GB still available between them. Another Task starts up, only another 100MB is needed from the OS, etc, etc. (Of course i haven't the slightest idea if that's how VBox actually works). What each Task does require (according to your completed Tasks), is 7.5GB+ of storage space. It looks like each Task needs it's own copy of the VM image in order to run (i'm wondering if this is a repeat of the previous issue with Rosetta 4.xx Tasks when they ran copying all the support files every time a new one started & then deleting them when done instead of just linking to them, or if it's a issue with how VirtualBox works). I've given BOINC 280GB of free disc space. I'll check the actual ram usage of VB Python tasks, it's not that high IIRCThanks for that. While each Task doesn't use much RAM in it's Virtual Machine, i'm curious as to how much RAM VBox is actually taking from the OS to run them. Likewise disk usage- 8GB+ for every VM (Python Task) that is running isn't good either. Edit- boinc_cages_IL_2727241_31732_0 uses 30.5MB of RAM.As reported by Windows Task Manager? What about the Virtual Box files that are running (i think there are 3 of them- VirtualBox Manager, VirtualBox Interface, VirtualBox Global Interface) How much RAM are they using? Grant Darwin NT |
|
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,523,781 RAC: 8,309
|
I wondered where TACC got their BOINC stuff. TACC simply gives you an access to their hw (and some implementation support). But the code is up to you. They also have a native boinc project, that gives an interface from HPC to volunteers client It might be time to say goodbye to RAH.I've been grinding a long time for them, its a shame to leave. It's a pity.... |
Message boards :
Number crunching :
Problems and Technical Issues with Rosetta@home
©2024 University of Washington
https://www.bakerlab.org