Only half (50%) elapsed time registered

log in

Advanced search

Message boards : Number crunching : Only half (50%) elapsed time registered

Previous · 1 · 2 · 3 · Next
Author Message
Dr Who Fan
     
Avatar
Send message
Joined: 29 Jul 11
Posts: 316
Credit: 1,154,691
RAC: 361
Total hours: 1,595,922
Message 5332 - Posted: 6 Jul 2017, 13:21:23 UTC

THINGS STILL HAVE NOT CHANGED ON THE PC VERSION EITHER.

TRACKED HOURS ARE STILL A FRACTION OF WHAT THEY SHOULD BE.

I HAVE LOST HUNDREDS - MAYBE THOUSANDS OF HOURS TO THE "feature".

THIS "feature" NEEDS TO BE FIXED ASAP!
____________

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5333 - Posted: 6 Jul 2017, 14:37:26 UTC

Getting full hours here. Currently with 860 GCC hours in past 24 hours. That is 35.8 clients and I have 37 running. GCC doesn't always send another task right away and some get download errors. Plus 2 are tablets. So pretty dang close to being spot on.

Dirk Broer
       
Avatar
Send message
Joined: 3 Nov 10
Posts: 109
Credit: 2,973,179
RAC: 819
Total hours: 8,222,370
Message 5334 - Posted: 6 Jul 2017, 14:49:26 UTC - in response to Message 5333.

Getting full hours here. Currently with 860 GCC hours in past 24 hours. That is 35.8 clients and I have 37 running. GCC doesn't always send another task right away and some get download errors. Plus 2 are tablets. So pretty dang close to being spot on.


It has nothing to do with GCC. On my Raspberry Pi I noticed I wasn't getting full hours when only running the QCN projects and WUProp (I was getting 24/7 hours a day for each application). I decided to run GCC as well and the figures for hrs/day got still even lower: 24/11.
____________

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5335 - Posted: 6 Jul 2017, 15:58:49 UTC - in response to Message 5334.

Getting full hours here. Currently with 860 GCC hours in past 24 hours. That is 35.8 clients and I have 37 running. GCC doesn't always send another task right away and some get download errors. Plus 2 are tablets. So pretty dang close to being spot on.


It has nothing to do with GCC. On my Raspberry Pi I noticed I wasn't getting full hours when only running the QCN projects and WUProp (I was getting 24/7 hours a day for each application). I decided to run GCC as well and the figures for hrs/day got still even lower: 24/11.


GCC is a way to measure hours since GCC runs on every client. I do not have all other NCI apps running on all my clients. If I was getting partial hours from a client it would be applied to ALL apps running including GCC.

Profile [AF>WildWildWest] Sebastien
     
Dictator
Avatar
Send message
Joined: 28 Mar 10
Posts: 2677
Credit: 513,719
RAC: 95
Total hours: 1,427,338
Message 5342 - Posted: 7 Jul 2017, 16:58:04 UTC - in response to Message 5332.

THINGS STILL HAVE NOT CHANGED ON THE PC VERSION EITHER.

TRACKED HOURS ARE STILL A FRACTION OF WHAT THEY SHOULD BE.

I HAVE LOST HUNDREDS - MAYBE THOUSANDS OF HOURS TO THE "feature".

THIS "feature" NEEDS TO BE FIXED ASAP!

I spend a hundred euros every month for this project.
Why should I go on? You are always complaining that hours are not counted or that an application is not added quickly enough.
If you are not happy, leave this project and create yours.

But before you complain, you should check why your machine (4 cores) runs simultaneously a multithreaded workunit (4 cores) and 3 cpu workunits.
____________

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5344 - Posted: 7 Jul 2017, 19:38:36 UTC

lol ... give um hell Wild man ... ;)

Dr Who Fan
     
Avatar
Send message
Joined: 29 Jul 11
Posts: 316
Credit: 1,154,691
RAC: 361
Total hours: 1,595,922
Message 5345 - Posted: 7 Jul 2017, 19:42:35 UTC - in response to Message 5342.

But before you complain, you should check why your machine (4 cores) runs simultaneously a multithreaded workunit (4 cores) and 3 cpu workunits.

IT DOES NOT!

Could it possibly be a problem with how BOINC and/or your project counts CPU's on real + virtual "VBOX" or Multi-Thread/Core when one or more NCI Apps are running at the same time?

From what I can see the problems show up ONLY on my Multi-Core/Multi-Thread PC's but have yet to see it on my old single thread/core PC.

Based on the Stderr output messages from each run that we can see on our results page, it appears the problems ONLY arise when ANY of the Multi-Core/Multi-Thread PC's runs a Multi-Core/Thread VBOX project* or when a Multi-Core/Thread CPU projects** AND 4 NCI Grid computing center Monkeys are running simultaneously with either of those.

Below are TWO DIFFERENT examples from Computer 89002 (4 Core/Thread CPU) ---
Task 72579597 Ran ONE or MORE Multi-Core/Thread app or a Multi-Core/Thread VBOX app + 4 NCI Monkey apps during the 6 hour WuProp also ran:
Stderr output

<core_client_version>7.7.2</core_client_version>
<![CDATA[
<stderr_txt>
No NVIDIA library found
No ATI library found.
Erreur assignation taille wu
Erreur assignation taille application
23:38:46 (4740): facteur correction: 0.571429 (4/7.050000)
01:33:48 (4740): facteur correction: 0.571429 (4/7.050000)
Erreur assignation taille wu
Erreur assignation taille application
02:26:49 (4740): facteur correction: 0.571429 (4/7.050000)
Erreur assignation taille wu
Erreur assignation taille wu
Erreur assignation taille wu
05:17:52 (4740): called boinc_finish

</stderr_txt>
]]>


Task 61636560 Ran NO Multi-Core/Thread app or NO Multi-Core/Thread VBOX app + 4 NCI Monkey apps during the 6 hour WuProp also ran:
Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
No NVIDIA library found
No ATI library found.
10:00:37 (3396): called boinc_finish

</stderr_txt>
]]>



NOTES:
* Multi-Core/Thread VBOX projects I currently or have recently run:
LHC@home / CMS Simulation
duchamp / Duchamp Sourcefinder
Cosmology@Home / camb_boinc2docker (beta test)
Cosmology@Home / CAMB


** Multi-Core/Thread CPU projects projects I currently or have recently run:
XANSONS for COD / XaNSoNS BOINC for CPU (multi-threaded)
yafu / YAFU for small composites
Amicable Numbers / Amicable Numbers up to 2^64
Milkyway@Home / MilkyWay@Home N-Body Simulation

I welcome other users that have complained here about the reduction in hours to also verify my findings.
____________

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5346 - Posted: 7 Jul 2017, 21:33:25 UTC

From what I can tell WUProp only counts the elapsed time, not CPU time. One can run 2 clients on the same computer and get 48 hours per day per CPU thread.

Default setup for QNC apps say 0.025 hours but we still get 24 hours so elapsed time is not multiplied by that. So for MT apps it's not multiplied by 4t, 8t or however many threads it is using to get hours.

I am running duchamp which is single threaded and I seem to be getting full hours. Same when I was running LHC and LHV-dev on the same machine.

What does your activity hours show? I have a mixed bag of Asteroids which ran on GPU and CPU so I can't separate the hours.

Profile [AF>WildWildWest] Sebastien
     
Dictator
Avatar
Send message
Joined: 28 Mar 10
Posts: 2677
Credit: 513,719
RAC: 95
Total hours: 1,427,338
Message 5347 - Posted: 7 Jul 2017, 21:41:05 UTC - in response to Message 5345.

You didn't lost any hours. There is a problem with activity host page.
Some hours are not displayed but all hours are counted.

I'll try to fix the problem this week-end.
____________

Profile Conan
       
Avatar
Send message
Joined: 28 Mar 10
Posts: 565
Credit: 1,173,779
RAC: 186
Total hours: 3,241,764
Message 5348 - Posted: 7 Jul 2017, 23:05:57 UTC
Last modified: 7 Jul 2017, 23:06:12 UTC

I am not buying into this argument, but I am going to say thank you Sebastien for keeping this project running and your downtime to almost zero.

It is a fun project and I like doing it.

Sebastien says all hours are counted, that will do me, he will sort it out when he gets time.

Thanks again Sebastien for all your hard work.

Conan
____________

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5349 - Posted: 8 Jul 2017, 9:13:43 UTC - in response to Message 5346.

From what I can tell WUProp only counts the elapsed time, not CPU time. One can run 2 clients on the same computer and get 48 hours per day per CPU thread.


Not complaining here but this just isn't true, at least not on my Double Client PC's. I still think I'm only getting Hr's Credited according to how much CPU Usage each Core is using. Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5350 - Posted: 8 Jul 2017, 13:48:21 UTC - in response to Message 5349.
Last modified: 8 Jul 2017, 13:48:53 UTC

From what I can tell WUProp only counts the elapsed time, not CPU time. One can run 2 clients on the same computer and get 48 hours per day per CPU thread.


Not complaining here but this just isn't true, at least not on my Double Client PC's. I still think I'm only getting Hr's Credited according to how much CPU Usage each Core is using. Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.


It is true. I am running 2 clients doing CPU work on my 2P 2670v1s and I currently have over 1300 CPU hours in the past day on 32 threads, not including NCI hours. Xansons is set to single thread. A full 32 threads in one day is 768 hours.

http://wuprop.boinc-af.org/activity.py?hostid=131071&preselect=day
Asteroids@home Period Search Application 514,18 (58,10%)
NFS@Home 14e Lattice Sieve 111,93 (12,65%)
NFS@Home 15e Lattice Sieve 105,32 (11,90%)
yafu YAFU for small composites 27,20 (3,07%)
Radioactive@Home Radioactivity Monitor 23,92 (2,70%)
Grid computing center Monkeys v4 (NCI) - Seeker/Word seed 23,83 (2,69%)
Grid computing center Monkeys v3 (NCI) - Generator/Word seed 23,82 (2,69%)
Grid computing center Monkeys v2 (NCI) - Seeker/1 seed 23,82 (2,69%)
Grid computing center Monkeys v1 (NCI) - Generator/1 seed 23,75 (2,68%)
World Community Grid OpenZika 6,02 (0,68%)
SRBase Sierpinski / Riesel Base - average 1,28 (0,14%)



http://wuprop.boinc-af.org/activity.py?hostid=122461&preselect=day
Asteroids@home Period Search Application 566,72 (73,99%)
Quake-Catcher Network Continual EMSC / SCEM QCN Continual Monitoring Program 17,82 (2,33%)
Quake-Catcher Network QCN Sensor 17,82 (2,33%)
Quake-Catcher Network EMSC / CSEM QCN Continual Monitoring Program 17,82 (2,33%)
QCN Continual QCN Continual Sensor Reporting 17,82 (2,33%)
Quake-Catcher Network (Taiwan) QCN - Taiwan 17,82 (2,33%)
Quake-Catcher Network Continual (Taiwan) QCN Continual - Taiwan 17,82 (2,33%)
Radioactive@Home Radioactivity Monitor 17,80 (2,32%)
Grid computing center Monkeys v2 (NCI) - Seeker/1 seed 17,78 (2,32%)
Grid computing center Monkeys v4 (NCI) - Seeker/Word seed 17,77 (2,32%)
Grid computing center Monkeys v1 (NCI) - Generator/1 seed 17,77 (2,32%)
Grid computing center Monkeys v3 (NCI) - Generator/Word seed 17,75 (2,32%)
XANSONS for COD XaNSoNS BOINC for CPU (multi-threaded) 3,42 (0,45%)

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5351 - Posted: 8 Jul 2017, 14:02:18 UTC

I said in my previous Post

Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.


I don't know how it works, I'm running 4 Core 3700 CPU in HT Mode & with Dual Clients, could be the way the Clients are set up, maybe different than yours ? but I see nothing close to getting a full 24 Hr's off of each core.

16x24 would be 384 Hr's x the 19 Clients I have running now would be 6156 Hr's Per day not counting NCI or GPU Hr's. I'm usually lucky to see about 4000 Hr's per day, the usual 66% I've always seen, no where's near the 100% you say you get ...

Profile skgiven
       
Avatar
Send message
Joined: 7 Sep 10
Posts: 453
Credit: 945,109
RAC: 0
Total hours: 2,101,570
Message 5354 - Posted: 8 Jul 2017, 17:44:10 UTC - in response to Message 5351.

SSD vs hard drive might make a difference here, as might chipset, cache, GPU usage, OS, Boinc versions, VM's, MT, setup...

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5355 - Posted: 8 Jul 2017, 20:40:30 UTC - in response to Message 5351.
Last modified: 8 Jul 2017, 20:41:56 UTC

I said in my previous Post

Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.


I don't know how it works, I'm running 4 Core 3700 CPU in HT Mode & with Dual Clients, could be the way the Clients are set up, maybe different than yours ? but I see nothing close to getting a full 24 Hr's off of each core.

16x24 would be 384 Hr's x the 19 Clients I have running now would be 6156 Hr's Per day not counting NCI or GPU Hr's. I'm usually lucky to see about 4000 Hr's per day, the usual 66% I've always seen, no where's near the 100% you say you get ...


You say you don't know how it works then deny it works when I show proof. Maybe it's just your setup.

Getting 4k hours shows it is at least possible by your own numbers. Maybe it's just mt apps that screw it up. Just don't deny it and say it's not true at all.

I would make sure to have all the WUProp app_config files setup with the correct gui_rpc_port.

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5356 - Posted: 8 Jul 2017, 20:46:02 UTC

Yeah I'm just lying about the whole thing just because it's Sunday & I'm bored ...

Profile [AF>WildWildWest] Sebastien
     
Dictator
Avatar
Send message
Joined: 28 Mar 10
Posts: 2677
Credit: 513,719
RAC: 95
Total hours: 1,427,338
Message 5360 - Posted: 9 Jul 2017, 13:16:13 UTC - in response to Message 5351.

I said in my previous Post

Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.


I don't know how it works, I'm running 4 Core 3700 CPU in HT Mode & with Dual Clients, could be the way the Clients are set up, maybe different than yours ? but I see nothing close to getting a full 24 Hr's off of each core.

16x24 would be 384 Hr's x the 19 Clients I have running now would be 6156 Hr's Per day not counting NCI or GPU Hr's. I'm usually lucky to see about 4000 Hr's per day, the usual 66% I've always seen, no where's near the 100% you say you get ...

I counted 20 active clients, so 20 clients x 8 cores x 24 hours = 3840 hours.
Last 24 hours, you get 3836.62 hours from CPU applications. You lost only 0.08%
____________

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5361 - Posted: 9 Jul 2017, 14:58:58 UTC - in response to Message 5360.

I said in my previous Post

Maybe it's different for others but this is what I see when I check the Hr's for a turned in WuProp Wu.


I don't know how it works, I'm running 4 Core 3700 CPU in HT Mode & with Dual Clients, could be the way the Clients are set up, maybe different than yours ? but I see nothing close to getting a full 24 Hr's off of each core.

16x24 would be 384 Hr's x the 19 Clients I have running now would be 6156 Hr's Per day not counting NCI or GPU Hr's. I'm usually lucky to see about 4000 Hr's per day, the usual 66% I've always seen, no where's near the 100% you say you get ...

I counted 20 active clients, so 20 clients x 8 cores x 24 hours = 3840 hours.
Last 24 hours, you get 3836.62 hours from CPU applications. You lost only 0.08%


If I run 1 Project for 6 Hr's (Length that a WuProp Wu Runs) on 8 Cores I should get 48 Hr's Credit by my figuring, correct me if I'm wrong.

Many times when I check a few Min's after a WuProp Wu is turned in running 1 Project for the last 6 Hr's all I see is 24-30 Hr's in gained Hr's for that Project. I don't check ever Wu turned in for the Hr's gained but I've see the only 24-30 Hr's gained enough times to make me think that's all I get on them all.

Again I'm not complaining just trying to explain what I see, I like the Project & this Project is the only real reason I keep running or interested in BOINC so keep up the good work ...

mmonnin
       
Send message
Joined: 22 Aug 16
Posts: 417
Credit: 1,927,925
RAC: 706
Total hours: 9,130,576
Message 5362 - Posted: 9 Jul 2017, 15:11:06 UTC - in response to Message 5361.

If I run 1 Project for 6 Hr's (Length that a WuProp Wu Runs) on 8 Cores I should get 48 Hr's Credit by my figuring, correct me if I'm wrong.

Many times when I check a few Min's after a WuProp Wu is turned in running 1 Project for the last 6 Hr's all I see is 24-30 Hr's in gained Hr's for that Project. I don't check ever Wu turned in for the Hr's gained but I've see the only 24-30 Hr's gained enough times to make me think that's all I get on them all.

Again I'm not complaining just trying to explain what I see, I like the Project & this Project is the only real reason I keep running or interested in BOINC so keep up the good work ...


That's what I expect too. What was running during that time? You've got all your stuff hidden.

Have you gone back through your most recent set of tasks to see if the factorization comment is in the results of any client? Or checked the last day's activity for each client to see which one is missing hours?

After I had setup my extra clients I had missed a couple of the app_config edits to use the correct gui_rpc_port and ended up missing hours.

Profile STE\/E
           
Avatar
Send message
Joined: 28 Mar 10
Posts: 642
Credit: 3,866,295
RAC: 462
Total hours: 20,094,848
Message 5363 - Posted: 9 Jul 2017, 15:36:04 UTC

I had missed a couple of the app_config edits to use the correct gui_rpc_port and ended up missing hours.


If I didn't have the correct qui rpc port I wouldn't think I would even get any Wu's to the client ???

Previous · 1 · 2 · 3 · Next
Post to thread

Message boards : Number crunching : Only half (50%) elapsed time registered


Home | My Account | Message Boards | Results


Copyright © 2024 Sebastien