Message boards : Number crunching : Problems and Technical Issues with Rosetta@home
Previous · 1 . . . 123 · 124 · 125 · 126 · 127 · 128 · 129 . . . 300 · Next
Author | Message |
---|---|
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
But it is not a issue for Linux machines because your running the native environment of the task. Sid Celery is already sending emails to Baker Lab, but they are a M-F office hours only project. There is no dedicated IT person that monitors the forums, at least not that we have seen. The only way they know if there is a problem is if the researcher of this specific project sees a lot of failures in his data. Other than that, your SOL. You were in a conversation with Mikey who showed you how to isolate python tasks so you could limit the cores. The only thing further (which i don't know the commands for) is to "block" the specific task type. Maybe Mikey can help you with that in that other thread. Your not alone with this MD5 issue, A windows user in Italy is also having the exact same problem. So far everything we know to try and make this disappear has failed. So its something back in Seattle on their system that is causing this. Now why some windows machines and not others is a mystery, because I am cranking through these just fine. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
You were in a conversation with Mikey who showed you how to isolate python tasks so you could limit the cores. The only thing further (which i don't know the commands for) is to "block" the specific task type. Maybe Mikey can help you with that in that other thread. I am not sure what you are referring to on MW. If it is "max concurrent" (or "project max concurrent") in an app_config, that causes a problem with excessive downloads. I have posted on it already here. But that appears to be irrelevant to the present MD5 issue anyway. And I am seeing the same thing on Ubuntu as the Windows users, just a slightly different message. https://boinc.bakerlab.org/rosetta/results.php?hostid=6143731&offset=0&show_names=0&state=6&appid= I am trying a new version of BOINC. I was on 7.16.11, the released version from Ubuntu. Now it is 7.16.17 from Locutus-of-Borg. That solved a problem on QuChemPedIA, but not necessarily here. Seattle certainly needs to fix it. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
I am trying a new version of BOINC. I was on 7.16.11, the released version from Ubuntu. Now it is 7.16.17 from Locutus-of-Borg. The new BOINC 7.16.17 didn't fix it. It is something they have to do. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
You were in a conversation with Mikey who showed you how to isolate python tasks so you could limit the cores. The only thing further (which i don't know the commands for) is to "block" the specific task type. Maybe Mikey can help you with that in that other thread. But it is weird, MD5 shows up on your machine and the Italian machine, but not on mine and not that many others are talking about it. But is it all python tasks or just certain specific strings that are affected? |
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
I also have the MD5 issue on Rosetta Python tasks. Presently it's been a 100% fail rate, error while downloading. aaaf-IDC_pp-FPR_pp-mNHM_pp-NMBEN3_pp_0_1737815_2_1 <core_client_version>7.16.11</core_client_version> <![CDATA[ <message> WU download error: couldn't get input files: <file_xfer_error> <file_name>AIMNet_vm_v2.vdi</file_name> <error_code>-119 (md5 checksum failed for file)</error_code> <error_message>MD5 check failed</error_message> </file_xfer_error> </message> ]]> aaaf-IDC_pp-SAR-AIB_pp-NMBEN3_pp_0_1737353_4_0 <core_client_version>7.16.11</core_client_version> <![CDATA[ <message> WU download error: couldn't get input files: <file_xfer_error> <file_name>AIMNet_vm_v2.vdi</file_name> <error_code>-119 (md5 checksum failed for file)</error_code> <error_message>MD5 check failed</error_message> </file_xfer_error> </message> ]]> aaaf-mAZE_pp-NMALA_pp-mNMVAL_pp-NMBEN3_pp_0_1736941_7_0 <core_client_version>7.16.11</core_client_version> <![CDATA[ <message> WU download error: couldn't get input files: <file_xfer_error> <file_name>AIMNet_vm_v2.vdi</file_name> <error_code>-119 (md5 checksum failed for file)</error_code> <error_message>MD5 check failed</error_message> </file_xfer_error> </message> ]]> I see you have had good luck with these Python tasks, what's your vBox setup? |
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
Good lord, I just checked my Virtual Box and all the failed tasks apear to still be in there. I'm using 6.1.12, the version supplied on the BOINC website, with the Oracle VM VirtualBox Extension Pack installed on Windows 10. Visualization extensions have been enabled in the BIOS. Should I use the latest version (6.1.26) or the one supplied by BOINC? What about extensions, should I install any? |
Pegasus Send message Joined: 22 Oct 06 Posts: 5 Credit: 6,837,701 RAC: 0 |
I received an odd message today: Rosetta@home: Notice from server VirtualBox is not installed 9/19/2021 6:01:50 PM It is correct that I do not have VirtualBox installed, and I have not used VirtualBox to run BOINC programs. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1673 Credit: 17,589,473 RAC: 22,408 |
That means you will get no work at all, even though there are just under 13 million Rosetta 4.20 Tasks available.How can I make it stop? I have been a long time supporter of RH, but will disconnect from the project if it keeps wasting my bandwidth with 2GB failed downloads. Grant Darwin NT |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1673 Credit: 17,589,473 RAC: 22,408 |
I received an odd message today:That was sorted out yesterday. It started on the 18th & when it did, it stopped those without VirtualBox from getting any Rosetta work- even that which doesn't need VirtualBox. Once they fixed it, there were no more notices about a lack of VirtualBox in Event logs, and work started flowing again- as can be seen in the Graph below. In particular, the big dip on the 18th. Grant Darwin NT |
Admin Project administrator Send message Joined: 1 Jul 05 Posts: 4805 Credit: 0 RAC: 0 |
There is a researcher in the group that has submitted a large batch of VM jobs that requires Virtual Box. More information is provided at https://boinc.berkeley.edu/wiki/VirtualBox. This is the first large batch of "rosetta_python_projects" VM jobs but we hope to have more in the future. Since this is our first attempt at using BOINC's VM option, we will undoubtedly run into issues as we scale up. Please be patient as we try to resolve these issues. Our standard rosetta application is still being used but the number of available jobs can fluctuate as it has before depending on the computing demand from our researchers. The VM app feature allows researchers much more flexibility to run scientific software that otherwise would not be possible on R@h. For example, the "rosetta_python_projects" app allows researchers to run deep learning based structure prediction pipelines including RoseTTAFold and AlphaFold2, and other python based sofware packages like AIMNet which is being used in the current batch of VM jobs to minimize potential microcycle therapeutics. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
This is the first large batch of "rosetta_python_projects" VM jobs but we hope to have more in the future. Very good. I have several machines with lots of memory waiting to do them. BUT: You need to make them selectable from the regular Rosettas. A simple checkbox would do, but even better would be the ability to select the number downloaded (or running) at at time. See LHC, or Cosmology, or WCG for examples. |
Ole Pettersen Send message Joined: 4 Dec 10 Posts: 7 Credit: 11,663,827 RAC: 4,003 |
It is just an informational message, hoping that you will install VBox to crunch more tasks. Thanks. |
Sid Celery Send message Joined: 11 Feb 08 Posts: 2117 Credit: 41,138,406 RAC: 16,288 |
There is a researcher in the group that has submitted a large batch of VM jobs that requires Virtual Box. More information is provided at https://boinc.berkeley.edu/wiki/VirtualBox Virtualization and BOINC Oh! So it's that thing I've been ignoring for several years... #Doh Download BOINC + VirtualBox |
Tomcat雄猫 Send message Joined: 20 Dec 14 Posts: 180 Credit: 5,386,173 RAC: 0 |
aaaf-IDC_pp-FPR_pp-mNHM_pp-NMBEN3_pp_0_1737815_2_1 <core_client_version>7.16.11</core_client_version> <![CDATA[ <message> WU download error: couldn't get input files: <file_xfer_error> <file_name>AIMNet_vm_v2.vdi</file_name> <error_code>-119 (md5 checksum failed for file)</error_code> <error_message>MD5 check failed</error_message> </file_xfer_error> </message> ]]> There goes another one. I have yet to encounter a Python task that doesn't error out. Is it something wrong with my setup, or is there a problem with these tasks? I've tried the version bundled with BOINC and the latest version, still 100% error rate. |
lazyacevw Send message Joined: 18 Mar 20 Posts: 12 Credit: 93,576,463 RAC: 0 |
I feel like I am missing out on some new information or something. Do these new "rosetta_python_projects" run native on Linux? Virtualbox is only needed on Windows and Mac, correct? I was under the impression that all Windows BOINC installations were already containers or VMs on Windows or Macs. |
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 3,710 |
I feel like I am missing out on some new information or something. Do these new "rosetta_python_projects" run native on Linux? Virtualbox is only needed on Windows and Mac, correct? I was under the impression that all Windows BOINC installations were already containers or VMs on Windows or Macs. The applications page says: Linux running on an AMD x86_64 or Intel EM64T CPU 1.03 (vbox64) Same as Windows and MacOS. No mention of a native app. |
dcdc Send message Joined: 3 Nov 05 Posts: 1831 Credit: 119,508,345 RAC: 9,552 |
I'm pretty sure it uses VBox regardless of the host OS. I guess that way it can ship with the correct dependancies etc. |
lazyacevw Send message Joined: 18 Mar 20 Posts: 12 Credit: 93,576,463 RAC: 0 |
Interesting. I took a look at the applications page https://boinc.bakerlab.org/rosetta/apps.php and the VirtualBox page https://boinc.berkeley.edu/wiki/VirtualBox but I don't see anything that would indicate a definitive answer. My Linux systems do not have VirtualBox installed. The apps page does indicate they are running on Linux systems but they don't indicate if VirtualBox is or needs to be installed. The same goes for Windows in the apps page. It was my understanding that Rosetta tasks were already written for Linux environments and so it was just easier to containerize Linux on Windows than re-write everything for Windows or Macs. I haven't seen anything in my logs about downloading AIMNet_vm_v2.vdi and when I check out my boinc directory, I see minirosetta and 4.20 executables but I don't see anything about vbox64 or python. I have 671 tasks in progress and I am showing 0 rosetta python tasks. I was just curious if there is anything I need to do to keep my systems up to date so that they can maximize processing capability for Rosetta. |
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 3,710 |
If Virtualbox isn't installed, your system won't download any work units or executables related to the vbox app. This "1.03 (vbox64)" indicates the need of the pyrosetta app for virtualbox. |
YAG Send message Joined: 13 Oct 19 Posts: 7 Credit: 13,015,426 RAC: 0 |
Hello, Why could I receive the message "Communication with VM Hipervisor failed"? In the VBox register appears the error «Failed to create the VirtualBox object! NS_ERROR_SOCKET_FAIL (0xC1F30200) IPC Daemon socket error.» I have the Boinc version 7.16.16 and the VirtualBox 6.1.26 r145957 running on Debian GNU/Linux 11 (bullseye) [5.10.0-8-amd64|libc 2.31 (Debian GLIBC 2.31-13)]. The boinc user is added to the vboxusers, vboxguests and libvirt groups. Any clue about what could be happening? I have no experience with VirtualBox, I installed it just as a Rosetta@home requirement. |
Message boards :
Number crunching :
Problems and Technical Issues with Rosetta@home
©2024 University of Washington
https://www.bakerlab.org