Memory required by WUProp
log in |
Message boards : Number crunching : Memory required by WUProp
Author | Message |
---|---|
I use Boinc Tasks, and recently I added column with Virtual Memory size for tasks. Today I noticed that on one hosts WUProp uses 90 GB of memory - that's a lot! On other hosts usually this is below 100MB. What is more interesting, this particular host runs 4 CPU and 5 NCI tasks only. Look like some bug for me. | |
ID: 5457 · Rating: 0 · rate: / Reply Quote | |
Wow thats a lot, especially for so few tasks running. | |
ID: 5458 · Rating: 0 · rate: / Reply Quote | |
I have collected coredump from running process (90GB file). Now I am compressing it, xz should do good job here. Seb, you will have a lot of data to analyse :) | |
ID: 5459 · Rating: 0 · rate: / Reply Quote | |
Yesterday's WU finished successfully. Today I have another one with 90GB of memory allocated on this machine. Something fishy is going there. I suspect massive memory leak. | |
ID: 5460 · Rating: 0 · rate: / Reply Quote | |
..."90GB of memory" does not sound right. I see you are running Linux on a 32-core PC. The Windows version of Wuprop does not report back about memory usage on the task detail page. | |
ID: 5462 · Rating: 0 · rate: / Reply Quote | |
..."90GB of memory" does not sound right. I see you are running Linux on a 32-core PC. The Windows version of Wuprop does not report back about memory usage on the task detail page. Please check again. I have one Windows machine, and both BoincTasks and BoincMgr reports virtual memory size for WUProp - in my case about 10MB. ____________ | |
ID: 5463 · Rating: 0 · rate: / Reply Quote | |
That is interesting. I did a quick check of my systems using Process Explorer and found for most hosts the virtual memory size was ~50-60MB. However I did find on one of my hosts it was 33GB. I closed BOINC and relaunched it. The virtual size was still 33GB for the data collect app. I restarted the system size it had been up for about 45 days & the virtual memory size was still 33GB for the data collect app on the host. | |
ID: 5464 · Rating: 0 · rate: / Reply Quote | |
It is strange. Today memory usage dropped to 38MB. What is more interesting this happened not only for this one host, it look like it dropped on other too. I am sure about one other, which was using 1GB - I do not see this number anymore. Other ones also looks smaller to me. I checked app list and I do not see any new app version added there recently, so most probably Seb changed something on server side (probably params passed to app on start). I suspect he recently changed something to get more data and ban more cheaters. Seb, could you tell us more what was going on recently? | |
ID: 5471 · Rating: 0 · rate: / Reply Quote | |
I didn't make any changes on the server. | |
ID: 5472 · Rating: 0 · rate: / Reply Quote | |
I didn't make any changes on the server. I saw some CUDA threads in coredump, so it might be. However this does not explain why this memory consumption suddenly dropped to reasonable level. Also that machine where WUProp used 1GB is mysterious, it was either my Windows box or one of ARM devices without Nvidia GPU. I will monitor this memory consumption to see if it will go up again or stay low. ____________ | |
ID: 5473 · Rating: 0 · rate: / Reply Quote | |
I didn't make any changes on the server. My Windows 7 host has stayed consistent at 33GB and I just checked the notebook I use for work, which I didn't check previously, and it is reporting 2TB in Windows 10. Since my other machines with Radeon or Intel GPUs and are not exhibiting this behavior it does seem likely to be related to Nvidia GPUs or maybe some implementations of OpenCL. | |
ID: 5483 · Rating: 0 · rate: / Reply Quote | |
Message boards :
Number crunching :
Memory required by WUProp