Several crashed WUs

Moderators: Site Moderators, FAHC Science Team

Post Reply
ThatsUsername
Posts: 4
Joined: Sat Apr 18, 2020 8:46 am

Several crashed WUs

Post by ThatsUsername »

Hi,
my first month of folding is done and fist time there are some crashes and Bad WU in the Log.

Log refreshed, Follow off for copy.
I shorted some "Completed" and 481 Lines of "WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists."
The German Part: "Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird:"
In English: "The process cannot access the file because it is in use by another process:"

Code: Select all

16:57:51:WU01:FS00:Starting
16:57:51:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
16:57:51:WU01:FS00:Started FahCore on PID 13128
16:57:51:WU01:FS00:Core PID:10392
16:57:51:WU01:FS00:FahCore 0xa7 started
16:57:52:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T16:57:51Z ***********************
16:57:52:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:57:52:WU01:FS00:0xa7:       Type: 0xa7
16:57:52:WU01:FS00:0xa7:       Core: Gromacs
16:57:52:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 13128 -checkpoint 15 -np
16:57:52:WU01:FS00:0xa7:             11
16:57:52:WU01:FS00:0xa7:************************************ CBang *************************************
16:57:52:WU01:FS00:0xa7:       Date: Oct 26 2019
16:57:52:WU01:FS00:0xa7:       Time: 01:38:25
16:57:52:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
16:57:52:WU01:FS00:0xa7:     Branch: master
16:57:52:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
16:57:52:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:57:52:WU01:FS00:0xa7:   Platform: win32 10
16:57:52:WU01:FS00:0xa7:       Bits: 64
16:57:52:WU01:FS00:0xa7:       Mode: Release
16:57:52:WU01:FS00:0xa7:************************************ System ************************************
16:57:52:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
16:57:52:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
16:57:52:WU01:FS00:0xa7:       CPUs: 12
16:57:52:WU01:FS00:0xa7:     Memory: 15.95GiB
16:57:52:WU01:FS00:0xa7:Free Memory: 13.50GiB
16:57:52:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
16:57:52:WU01:FS00:0xa7: OS Version: 6.2
16:57:52:WU01:FS00:0xa7:Has Battery: false
16:57:52:WU01:FS00:0xa7: On Battery: false
16:57:52:WU01:FS00:0xa7: UTC Offset: 2
16:57:52:WU01:FS00:0xa7:        PID: 10392
16:57:52:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
16:57:52:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
16:57:52:WU01:FS00:0xa7:    Version: 0.0.18
16:57:52:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:57:52:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
16:57:52:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
16:57:52:WU01:FS00:0xa7:       Date: Oct 26 2019
16:57:52:WU01:FS00:0xa7:       Time: 01:52:30
16:57:52:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
16:57:52:WU01:FS00:0xa7:     Branch: master
16:57:52:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
16:57:52:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:57:52:WU01:FS00:0xa7:   Platform: win32 10
16:57:52:WU01:FS00:0xa7:       Bits: 64
16:57:52:WU01:FS00:0xa7:       Mode: Release
16:57:52:WU01:FS00:0xa7:************************************ Build *************************************
16:57:52:WU01:FS00:0xa7:       SIMD: avx_256
16:57:52:WU01:FS00:0xa7:********************************************************************************
16:57:52:WU01:FS00:0xa7:Project: 14307 (Run 2, Clone 51, Gen 50)
16:57:52:WU01:FS00:0xa7:Unit: 0x000000379bf7a4d55e655ee9b5b1c68e
16:57:52:WU01:FS00:0xa7:Reading tar file core.xml
16:57:52:WU01:FS00:0xa7:Reading tar file frame50.tpr
16:57:52:WU01:FS00:0xa7:Digital signatures verified
16:57:52:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
16:57:52:WU01:FS00:0xa7:Calling: mdrun -s frame50.tpr -o frame50.trr -cpt 15 -nt 10
16:57:52:WU01:FS00:0xa7:Steps: first=25000000 total=500000
16:57:52:WU01:FS00:0xa7:Completed 1 out of 500000 steps (0%)
16:57:57:WU00:FS00:Upload 62.87%
16:58:00:WU00:FS00:Upload complete
16:58:00:WU00:FS00:Server responded WORK_ACK (400)
16:58:00:WU00:FS00:Final credit estimate, 2372.00 points
16:58:00:WU00:FS00:Cleaning up
16:58:35:WU01:FS00:0xa7:Completed 5000 out of 500000 steps (1%)
16:59:17:WU01:FS00:0xa7:Completed 10000 out of 500000 steps (2%)
16:59:59:WU01:FS00:0xa7:Completed 15000 out of 500000 steps (3%)
17:00:42:WU01:FS00:0xa7:Completed 20000 out of 500000 steps (4%)
17:01:24:WU01:FS00:0xa7:Completed 25000 out of 500000 steps (5%)
17:02:07:WU01:FS00:0xa7:Completed 30000 out of 500000 steps (6%)
17:02:49:WU01:FS00:0xa7:Completed 35000 out of 500000 steps (7%)
17:03:31:WU01:FS00:0xa7:Completed 40000 out of 500000 steps (8%)
17:04:13:WU01:FS00:0xa7:Completed 45000 out of 500000 steps (9%)
17:04:56:WU01:FS00:0xa7:Completed 50000 out of 500000 steps (10%)
17:05:38:WU01:FS00:0xa7:Completed 55000 out of 500000 steps (11%)
17:06:20:WU01:FS00:0xa7:Completed 60000 out of 500000 steps (12%)
17:07:03:WU01:FS00:0xa7:Completed 65000 out of 500000 steps (13%)
17:07:45:WU01:FS00:0xa7:Completed 70000 out of 500000 steps (14%)
17:08:27:WU01:FS00:0xa7:Completed 75000 out of 500000 steps (15%)
17:09:10:WU01:FS00:0xa7:Completed 80000 out of 500000 steps (16%)
17:09:52:WU01:FS00:0xa7:Completed 85000 out of 500000 steps (17%)
17:10:35:WU01:FS00:0xa7:Completed 90000 out of 500000 steps (18%)
17:11:17:WU01:FS00:0xa7:Completed 95000 out of 500000 steps (19%)
17:11:59:WU01:FS00:0xa7:Completed 100000 out of 500000 steps (20%)
17:12:41:WU01:FS00:0xa7:Completed 105000 out of 500000 steps (21%)
17:13:23:WU01:FS00:0xa7:Completed 110000 out of 500000 steps (22%)
17:14:05:WU01:FS00:0xa7:Completed 115000 out of 500000 steps (23%)
17:14:48:WU01:FS00:0xa7:Completed 120000 out of 500000 steps (24%)
17:15:30:WU01:FS00:0xa7:Completed 125000 out of 500000 steps (25%)
17:16:12:WU01:FS00:0xa7:Completed 130000 out of 500000 steps (26%)
17:16:53:WU01:FS00:0xa7:Completed 135000 out of 500000 steps (27%)
17:17:35:WU01:FS00:0xa7:Completed 140000 out of 500000 steps (28%)
17:18:17:WU01:FS00:0xa7:Completed 145000 out of 500000 steps (29%)
17:18:59:WU01:FS00:0xa7:Completed 150000 out of 500000 steps (30%)
17:19:42:WU01:FS00:0xa7:Completed 155000 out of 500000 steps (31%)
17:20:05:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
17:20:05:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073741819 = 0xc0000005)
17:20:05:WU01:FS00:Starting
17:20:05:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
17:20:05:WU01:FS00:Started FahCore on PID 6712
17:20:05:WU01:FS00:Core PID:13140
17:20:05:WU01:FS00:FahCore 0xa7 started
17:20:05:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T17:20:05Z ***********************
17:20:05:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:20:05:WU01:FS00:0xa7:       Type: 0xa7
17:20:05:WU01:FS00:0xa7:       Core: Gromacs
17:20:05:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 6712 -checkpoint 15 -np
17:20:05:WU01:FS00:0xa7:             11
17:20:05:WU01:FS00:0xa7:************************************ CBang *************************************
17:20:05:WU01:FS00:0xa7:       Date: Oct 26 2019
17:20:05:WU01:FS00:0xa7:       Time: 01:38:25
17:20:05:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:20:05:WU01:FS00:0xa7:     Branch: master
17:20:05:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:20:05:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:20:05:WU01:FS00:0xa7:   Platform: win32 10
17:20:05:WU01:FS00:0xa7:       Bits: 64
17:20:05:WU01:FS00:0xa7:       Mode: Release
17:20:05:WU01:FS00:0xa7:************************************ System ************************************
17:20:06:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
17:20:06:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
17:20:06:WU01:FS00:0xa7:       CPUs: 12
17:20:06:WU01:FS00:0xa7:     Memory: 15.95GiB
17:20:06:WU01:FS00:0xa7:Free Memory: 13.06GiB
17:20:06:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
17:20:06:WU01:FS00:0xa7: OS Version: 6.2
17:20:06:WU01:FS00:0xa7:Has Battery: false
17:20:06:WU01:FS00:0xa7: On Battery: false
17:20:06:WU01:FS00:0xa7: UTC Offset: 2
17:20:06:WU01:FS00:0xa7:        PID: 13140
17:20:06:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
17:20:06:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:20:06:WU01:FS00:0xa7:    Version: 0.0.18
17:20:06:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:20:06:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:20:06:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:20:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:20:06:WU01:FS00:0xa7:       Time: 01:52:30
17:20:06:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:20:06:WU01:FS00:0xa7:     Branch: master
17:20:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:20:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:20:06:WU01:FS00:0xa7:   Platform: win32 10
17:20:06:WU01:FS00:0xa7:       Bits: 64
17:20:06:WU01:FS00:0xa7:       Mode: Release
17:20:06:WU01:FS00:0xa7:************************************ Build *************************************
17:20:06:WU01:FS00:0xa7:       SIMD: avx_256
17:20:06:WU01:FS00:0xa7:********************************************************************************
17:20:06:WU01:FS00:0xa7:Project: 14307 (Run 2, Clone 51, Gen 50)
17:20:06:WU01:FS00:0xa7:Unit: 0x000000379bf7a4d55e655ee9b5b1c68e
17:20:06:WU01:FS00:0xa7:Digital signatures verified
17:20:06:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:20:06:WU01:FS00:0xa7:Calling: mdrun -s frame50.tpr -o frame50.trr -cpi state.cpt -cpt 15 -nt 10
17:20:06:WU01:FS00:0xa7:ERROR:Guru Meditation #ac0aa2977442226a.3001129badf46e06 (921.1080) '01/01/pullx.xvg'
17:20:06:WU01:FS00:0xa7:WARNING:Unexpected exit() call
17:20:06:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
17:20:06:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
17:20:06:WU01:FS00:0xa7:Saving result file frame50.trr
17:20:06:WU01:FS00:0xa7:Saving result file md.log
17:20:06:WU01:FS00:0xa7:Saving result file pullf.xvg
17:20:06:WU01:FS00:0xa7:ERROR:Guru Meditation #b5a0ce613e8956dc.6b13a85c8b99ba30 (522.597) '01/01/pullf.xvg'
17:20:06:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
17:20:06:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
17:21:05:WU01:FS00:Starting
17:21:05:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
17:21:05:WU01:FS00:Started FahCore on PID 7328
17:21:05:WU01:FS00:Core PID:8536
17:21:05:WU01:FS00:FahCore 0xa7 started
17:21:06:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T17:21:05Z ***********************
17:21:06:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:21:06:WU01:FS00:0xa7:       Type: 0xa7
17:21:06:WU01:FS00:0xa7:       Core: Gromacs
17:21:06:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 7328 -checkpoint 15 -np
17:21:06:WU01:FS00:0xa7:             11
17:21:06:WU01:FS00:0xa7:************************************ CBang *************************************
17:21:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:21:06:WU01:FS00:0xa7:       Time: 01:38:25
17:21:06:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:21:06:WU01:FS00:0xa7:     Branch: master
17:21:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:21:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:21:06:WU01:FS00:0xa7:   Platform: win32 10
17:21:06:WU01:FS00:0xa7:       Bits: 64
17:21:06:WU01:FS00:0xa7:       Mode: Release
17:21:06:WU01:FS00:0xa7:************************************ System ************************************
17:21:06:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
17:21:06:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
17:21:06:WU01:FS00:0xa7:       CPUs: 12
17:21:06:WU01:FS00:0xa7:     Memory: 15.95GiB
17:21:06:WU01:FS00:0xa7:Free Memory: 13.07GiB
17:21:06:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
17:21:06:WU01:FS00:0xa7: OS Version: 6.2
17:21:06:WU01:FS00:0xa7:Has Battery: false
17:21:06:WU01:FS00:0xa7: On Battery: false
17:21:06:WU01:FS00:0xa7: UTC Offset: 2
17:21:06:WU01:FS00:0xa7:        PID: 8536
17:21:06:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
17:21:06:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:21:06:WU01:FS00:0xa7:    Version: 0.0.18
17:21:06:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:21:06:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:21:06:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:21:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:21:06:WU01:FS00:0xa7:       Time: 01:52:30
17:21:06:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:21:06:WU01:FS00:0xa7:     Branch: master
17:21:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:21:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:21:06:WU01:FS00:0xa7:   Platform: win32 10
17:21:06:WU01:FS00:0xa7:       Bits: 64
17:21:06:WU01:FS00:0xa7:       Mode: Release
17:21:06:WU01:FS00:0xa7:************************************ Build *************************************
17:21:06:WU01:FS00:0xa7:       SIMD: avx_256
17:21:06:WU01:FS00:0xa7:********************************************************************************
17:21:06:WU01:FS00:0xa7:Project: 14307 (Run 2, Clone 51, Gen 50)
17:21:06:WU01:FS00:0xa7:Unit: 0x000000379bf7a4d55e655ee9b5b1c68e
17:21:06:WU01:FS00:0xa7:Digital signatures verified
17:21:06:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:21:06:WU01:FS00:0xa7:Calling: mdrun -s frame50.tpr -o frame50.trr -cpi state.cpt -cpt 15 -nt 10
17:21:06:WU01:FS00:0xa7:ERROR:Guru Meditation #ac0aa2977442226a.3001129badf46e06 (921.1080) '01/01/pullx.xvg'
17:21:06:WU01:FS00:0xa7:WARNING:Unexpected exit() call
17:21:06:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
17:21:06:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
17:21:06:WU01:FS00:0xa7:Saving result file frame50.trr
17:21:06:WU01:FS00:0xa7:Saving result file md.log
17:21:06:WU01:FS00:0xa7:Saving result file pullf.xvg
17:21:06:WU01:FS00:0xa7:ERROR:Guru Meditation #b5a0ce613e8956dc.6b13a85c8b99ba30 (522.597) '01/01/pullf.xvg'
17:21:06:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
17:21:06:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
17:22:05:WU01:FS00:Starting
17:22:05:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
17:22:05:WU01:FS00:Started FahCore on PID 1068
17:22:05:WU01:FS00:Core PID:4848
17:22:05:WU01:FS00:FahCore 0xa7 started
17:22:06:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T17:22:05Z ***********************
17:22:06:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:22:06:WU01:FS00:0xa7:       Type: 0xa7
17:22:06:WU01:FS00:0xa7:       Core: Gromacs
17:22:06:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 1068 -checkpoint 15 -np
17:22:06:WU01:FS00:0xa7:             11
17:22:06:WU01:FS00:0xa7:************************************ CBang *************************************
17:22:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:22:06:WU01:FS00:0xa7:       Time: 01:38:25
17:22:06:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:22:06:WU01:FS00:0xa7:     Branch: master
17:22:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:22:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:22:06:WU01:FS00:0xa7:   Platform: win32 10
17:22:06:WU01:FS00:0xa7:       Bits: 64
17:22:06:WU01:FS00:0xa7:       Mode: Release
17:22:06:WU01:FS00:0xa7:************************************ System ************************************
17:22:06:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
17:22:06:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
17:22:06:WU01:FS00:0xa7:       CPUs: 12
17:22:06:WU01:FS00:0xa7:     Memory: 15.95GiB
17:22:06:WU01:FS00:0xa7:Free Memory: 13.03GiB
17:22:06:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
17:22:06:WU01:FS00:0xa7: OS Version: 6.2
17:22:06:WU01:FS00:0xa7:Has Battery: false
17:22:06:WU01:FS00:0xa7: On Battery: false
17:22:06:WU01:FS00:0xa7: UTC Offset: 2
17:22:06:WU01:FS00:0xa7:        PID: 4848
17:22:06:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
17:22:06:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:22:06:WU01:FS00:0xa7:    Version: 0.0.18
17:22:06:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:22:06:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:22:06:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:22:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:22:06:WU01:FS00:0xa7:       Time: 01:52:30
17:22:06:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:22:06:WU01:FS00:0xa7:     Branch: master
17:22:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:22:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:22:06:WU01:FS00:0xa7:   Platform: win32 10
17:22:06:WU01:FS00:0xa7:       Bits: 64
17:22:06:WU01:FS00:0xa7:       Mode: Release
17:22:06:WU01:FS00:0xa7:************************************ Build *************************************
17:22:06:WU01:FS00:0xa7:       SIMD: avx_256
17:22:06:WU01:FS00:0xa7:********************************************************************************
17:22:06:WU01:FS00:0xa7:Project: 14307 (Run 2, Clone 51, Gen 50)
17:22:06:WU01:FS00:0xa7:Unit: 0x000000379bf7a4d55e655ee9b5b1c68e
17:22:06:WU01:FS00:0xa7:Digital signatures verified
17:22:06:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:22:06:WU01:FS00:0xa7:Calling: mdrun -s frame50.tpr -o frame50.trr -cpi state.cpt -cpt 15 -nt 10
17:22:06:WU01:FS00:0xa7:ERROR:Guru Meditation #ac0aa2977442226a.3001129badf46e06 (921.1080) '01/01/pullx.xvg'
17:22:06:WU01:FS00:0xa7:WARNING:Unexpected exit() call
17:22:06:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
17:22:06:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
17:22:06:WU01:FS00:0xa7:Saving result file frame50.trr
17:22:06:WU01:FS00:0xa7:Saving result file md.log
17:22:06:WU01:FS00:0xa7:Saving result file pullf.xvg
17:22:06:WU01:FS00:0xa7:ERROR:Guru Meditation #b5a0ce613e8956dc.6b13a85c8b99ba30 (522.597) '01/01/pullf.xvg'
17:22:06:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
17:22:06:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
17:23:05:WU01:FS00:Starting
17:23:05:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
17:23:05:WU01:FS00:Started FahCore on PID 976
17:23:05:WU01:FS00:Core PID:9132
17:23:05:WU01:FS00:FahCore 0xa7 started
17:23:06:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T17:23:05Z ***********************
17:23:06:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:23:06:WU01:FS00:0xa7:       Type: 0xa7
17:23:06:WU01:FS00:0xa7:       Core: Gromacs
17:23:06:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 976 -checkpoint 15 -np 11
17:23:06:WU01:FS00:0xa7:************************************ CBang *************************************
17:23:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:23:06:WU01:FS00:0xa7:       Time: 01:38:25
17:23:06:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:23:06:WU01:FS00:0xa7:     Branch: master
17:23:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:23:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:23:06:WU01:FS00:0xa7:   Platform: win32 10
17:23:06:WU01:FS00:0xa7:       Bits: 64
17:23:06:WU01:FS00:0xa7:       Mode: Release
17:23:06:WU01:FS00:0xa7:************************************ System ************************************
17:23:06:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
17:23:06:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
17:23:06:WU01:FS00:0xa7:       CPUs: 12
17:23:06:WU01:FS00:0xa7:     Memory: 15.95GiB
17:23:06:WU01:FS00:0xa7:Free Memory: 12.91GiB
17:23:06:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
17:23:06:WU01:FS00:0xa7: OS Version: 6.2
17:23:06:WU01:FS00:0xa7:Has Battery: false
17:23:06:WU01:FS00:0xa7: On Battery: false
17:23:06:WU01:FS00:0xa7: UTC Offset: 2
17:23:06:WU01:FS00:0xa7:        PID: 9132
17:23:06:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
17:23:06:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:23:06:WU01:FS00:0xa7:    Version: 0.0.18
17:23:06:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:23:06:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:23:06:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:23:06:WU01:FS00:0xa7:       Date: Oct 26 2019
17:23:06:WU01:FS00:0xa7:       Time: 01:52:30
17:23:06:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:23:06:WU01:FS00:0xa7:     Branch: master
17:23:06:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
17:23:06:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:23:06:WU01:FS00:0xa7:   Platform: win32 10
17:23:06:WU01:FS00:0xa7:       Bits: 64
17:23:06:WU01:FS00:0xa7:       Mode: Release
17:23:06:WU01:FS00:0xa7:************************************ Build *************************************
17:23:06:WU01:FS00:0xa7:       SIMD: avx_256
17:23:06:WU01:FS00:0xa7:********************************************************************************
17:23:06:WU01:FS00:0xa7:Project: 14307 (Run 2, Clone 51, Gen 50)
17:23:06:WU01:FS00:0xa7:Unit: 0x000000379bf7a4d55e655ee9b5b1c68e
17:23:06:WU01:FS00:0xa7:Digital signatures verified
17:23:06:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:23:06:WU01:FS00:0xa7:Calling: mdrun -s frame50.tpr -o frame50.trr -cpi state.cpt -cpt 15 -nt 10
17:23:06:WU01:FS00:0xa7:ERROR:Guru Meditation #ac0aa2977442226a.3001129badf46e06 (921.1080) '01/01/pullx.xvg'
17:23:06:WU01:FS00:0xa7:WARNING:Unexpected exit() call
17:23:06:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
17:23:06:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
17:23:06:WU01:FS00:0xa7:Saving result file frame50.trr
17:23:06:WU01:FS00:0xa7:Saving result file md.log
17:23:06:WU01:FS00:0xa7:Saving result file pullf.xvg
17:23:06:WU01:FS00:0xa7:ERROR:Guru Meditation #b5a0ce613e8956dc.6b13a85c8b99ba30 (522.597) '01/01/pullf.xvg'
17:23:06:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
17:23:06:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
17:23:06:WARNING:WU01:FS00:Too many errors, failing
17:23:06:WU01:FS00:Sending unit results: id:01 state:SEND error:FAILED project:14307 run:2 clone:51 gen:50 core:0xa7 unit:0x000000379bf7a4d55e655ee9b5b1c68e
17:23:06:WU01:FS00:Uploading 608.50KiB to 155.247.164.213
17:23:06:WU01:FS00:Connecting to 155.247.164.213:8080
17:23:07:WU00:FS00:Connecting to 65.254.110.245:80
17:23:07:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:23:07:WU00:FS00:Connecting to 18.218.241.186:80
17:23:08:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:23:08:WU00:FS00:Connecting to 65.254.110.245:80
17:23:08:WU01:FS00:Upload complete
17:23:08:WU01:FS00:Server responded WORK_QUIT (404)
17:23:08:WARNING:WU01:FS00:Server did not like results, dumping
17:23:08:WU01:FS00:Cleaning up
17:23:08:WU00:FS00:Assigned to work server 69.94.66.7
17:23:08:WU00:FS00:Requesting new work unit for slot 00: READY cpu:11 from 69.94.66.7
17:23:08:WU00:FS00:Connecting to 69.94.66.7:8080
17:23:09:ERROR:WU00:FS00:Exception: Server did not assign work unit
17:23:09:WU00:FS00:Connecting to 65.254.110.245:80
17:23:09:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:23:09:WU00:FS00:Connecting to 18.218.241.186:80
17:23:10:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:23:10:WU00:FS00:Connecting to 65.254.110.245:80
17:23:10:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:23:10:WU00:FS00:Connecting to 18.218.241.186:80
17:23:11:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:23:11:ERROR:WU00:FS00:Exception: Could not get an assignment
17:24:09:WU00:FS00:Connecting to 65.254.110.245:80
17:24:10:WU00:FS00:Assigned to work server 155.247.164.213
17:24:10:WU00:FS00:Requesting new work unit for slot 00: READY cpu:11 from 155.247.164.213
17:24:10:WU00:FS00:Connecting to 155.247.164.213:8080
17:24:10:ERROR:WU00:FS00:Exception: Server did not assign work unit
17:25:46:WU00:FS00:Connecting to 65.254.110.245:80
17:25:47:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:25:47:WU00:FS00:Connecting to 18.218.241.186:80
17:25:47:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:25:47:WU00:FS00:Connecting to 65.254.110.245:80
17:25:48:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:25:48:WU00:FS00:Connecting to 18.218.241.186:80
17:25:48:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:25:48:ERROR:WU00:FS00:Exception: Could not get an assignment
17:28:23:WU00:FS00:Connecting to 65.254.110.245:80
17:28:24:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:28:24:WU00:FS00:Connecting to 18.218.241.186:80
17:28:24:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
17:28:24:WU00:FS00:Connecting to 65.254.110.245:80
17:28:25:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
17:28:25:WU00:FS00:Connecting to 18.218.241.186:80
17:28:26:WU00:FS00:Assigned to work server 40.121.152.108
17:28:26:WU00:FS00:Requesting new work unit for slot 00: READY cpu:11 from 40.121.152.108
17:28:26:WU00:FS00:Connecting to 40.121.152.108:8080
17:28:26:WU00:FS00:Downloading 2.82MiB
17:28:28:WU00:FS00:Download complete
17:28:28:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14619 run:624 clone:4 gen:34 core:0xa7 unit:0x000000252879986c5e88901768e8cd59
17:28:28:WU00:FS00:Starting
17:28:28:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
17:28:28:WU00:FS00:Started FahCore on PID 10288
17:28:28:WU00:FS00:Core PID:9532
17:28:28:WU00:FS00:FahCore 0xa7 started
17:28:28:WU00:FS00:0xa7:*********************** Log Started 2020-04-23T17:28:28Z ***********************
17:28:28:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:28:28:WU00:FS00:0xa7:       Type: 0xa7
17:28:28:WU00:FS00:0xa7:       Core: Gromacs
17:28:28:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 10288 -checkpoint 15 -np
17:28:28:WU00:FS00:0xa7:             11
17:28:28:WU00:FS00:0xa7:************************************ CBang *************************************
17:28:28:WU00:FS00:0xa7:       Date: Oct 26 2019
17:28:28:WU00:FS00:0xa7:       Time: 01:38:25
17:28:28:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:28:28:WU00:FS00:0xa7:     Branch: master
17:28:28:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
17:28:28:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:28:28:WU00:FS00:0xa7:   Platform: win32 10
17:28:28:WU00:FS00:0xa7:       Bits: 64
17:28:28:WU00:FS00:0xa7:       Mode: Release
17:28:28:WU00:FS00:0xa7:************************************ System ************************************
17:28:28:WU00:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
17:28:28:WU00:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
17:28:28:WU00:FS00:0xa7:       CPUs: 12
17:28:28:WU00:FS00:0xa7:     Memory: 15.95GiB
17:28:28:WU00:FS00:0xa7:Free Memory: 12.82GiB
17:28:28:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
17:28:28:WU00:FS00:0xa7: OS Version: 6.2
17:28:28:WU00:FS00:0xa7:Has Battery: false
17:28:28:WU00:FS00:0xa7: On Battery: false
17:28:28:WU00:FS00:0xa7: UTC Offset: 2
17:28:28:WU00:FS00:0xa7:        PID: 9532
17:28:28:WU00:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
17:28:28:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
17:28:28:WU00:FS00:0xa7:    Version: 0.0.18
17:28:28:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:28:28:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:28:28:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
17:28:28:WU00:FS00:0xa7:       Date: Oct 26 2019
17:28:28:WU00:FS00:0xa7:       Time: 01:52:30
17:28:28:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:28:28:WU00:FS00:0xa7:     Branch: master
17:28:28:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
17:28:28:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:28:28:WU00:FS00:0xa7:   Platform: win32 10
17:28:28:WU00:FS00:0xa7:       Bits: 64
17:28:28:WU00:FS00:0xa7:       Mode: Release
17:28:28:WU00:FS00:0xa7:************************************ Build *************************************
17:28:28:WU00:FS00:0xa7:       SIMD: avx_256
17:28:28:WU00:FS00:0xa7:********************************************************************************
17:28:28:WU00:FS00:0xa7:Project: 14619 (Run 624, Clone 4, Gen 34)
17:28:28:WU00:FS00:0xa7:Unit: 0x000000252879986c5e88901768e8cd59
17:28:28:WU00:FS00:0xa7:Reading tar file core.xml
17:28:28:WU00:FS00:0xa7:Reading tar file frame34.tpr
17:28:29:WU00:FS00:0xa7:Digital signatures verified
17:28:29:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:28:29:WU00:FS00:0xa7:Calling: mdrun -s frame34.tpr -o frame34.trr -cpt 15 -nt 10
17:28:29:WU00:FS00:0xa7:Steps: first=0 total=250000
17:28:30:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
17:29:58:WU00:FS00:0xa7:Completed 2500 out of 250000 steps (1%)

[...]

19:51:40:WU00:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
19:51:41:WU01:FS00:Connecting to 65.254.110.245:80
19:51:41:WU01:FS00:Assigned to work server 128.252.203.2
19:51:41:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:11 from 128.252.203.2
19:51:41:WU01:FS00:Connecting to 128.252.203.2:8080
19:52:02:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
19:52:02:WU01:FS00:Connecting to 128.252.203.2:80
19:52:23:ERROR:WU01:FS00:Exception: Failed to connect to 128.252.203.2:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
19:52:24:WU01:FS00:Connecting to 65.254.110.245:80
19:52:24:WU01:FS00:Assigned to work server 150.136.14.110
19:52:24:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:11 from 150.136.14.110
19:52:24:WU01:FS00:Connecting to 150.136.14.110:8080
19:52:25:WU01:FS00:Downloading 2.81MiB
19:52:26:WU01:FS00:Download complete
19:52:26:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:16429 run:0 clone:2919 gen:18 core:0xa7 unit:0x0000001696880e6e5e924bd8f1b6401d
19:53:07:WU00:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
19:53:09:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
19:53:09:WU00:FS00:0xa7:Saving result file dhdl.xvg
19:53:09:WU00:FS00:0xa7:Saving result file frame34.trr
19:53:09:WU00:FS00:0xa7:Saving result file md.log
19:53:09:WU00:FS00:0xa7:Saving result file pullf.xvg
19:53:09:WU00:FS00:0xa7:Saving result file pullx.xvg
19:53:09:WU00:FS00:0xa7:Saving result file science.log
19:53:09:WU00:FS00:0xa7:Saving result file traj_comp.xtc
19:53:09:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
19:53:09:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:53:09:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14619 run:624 clone:4 gen:34 core:0xa7 unit:0x000000252879986c5e88901768e8cd59
19:53:09:WU00:FS00:Uploading 6.45MiB to 40.121.152.108
19:53:09:WU00:FS00:Connecting to 40.121.152.108:8080
19:53:09:WU01:FS00:Starting
19:53:09:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
19:53:09:WU01:FS00:Started FahCore on PID 12124
19:53:09:WU01:FS00:Core PID:11764
19:53:09:WU01:FS00:FahCore 0xa7 started
19:53:09:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T19:53:09Z ***********************
19:53:09:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
19:53:09:WU01:FS00:0xa7:       Type: 0xa7
19:53:09:WU01:FS00:0xa7:       Core: Gromacs
19:53:09:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 12124 -checkpoint 15 -np
19:53:09:WU01:FS00:0xa7:             11
19:53:09:WU01:FS00:0xa7:************************************ CBang *************************************
19:53:09:WU01:FS00:0xa7:       Date: Oct 26 2019
19:53:09:WU01:FS00:0xa7:       Time: 01:38:25
19:53:09:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
19:53:09:WU01:FS00:0xa7:     Branch: master
19:53:09:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:53:09:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:53:09:WU01:FS00:0xa7:   Platform: win32 10
19:53:09:WU01:FS00:0xa7:       Bits: 64
19:53:09:WU01:FS00:0xa7:       Mode: Release
19:53:09:WU01:FS00:0xa7:************************************ System ************************************
19:53:09:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
19:53:09:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
19:53:09:WU01:FS00:0xa7:       CPUs: 12
19:53:09:WU01:FS00:0xa7:     Memory: 15.95GiB
19:53:09:WU01:FS00:0xa7:Free Memory: 12.52GiB
19:53:09:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
19:53:09:WU01:FS00:0xa7: OS Version: 6.2
19:53:09:WU01:FS00:0xa7:Has Battery: false
19:53:09:WU01:FS00:0xa7: On Battery: false
19:53:09:WU01:FS00:0xa7: UTC Offset: 2
19:53:09:WU01:FS00:0xa7:        PID: 11764
19:53:09:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
19:53:09:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
19:53:09:WU01:FS00:0xa7:    Version: 0.0.18
19:53:09:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:53:09:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
19:53:09:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
19:53:09:WU01:FS00:0xa7:       Date: Oct 26 2019
19:53:09:WU01:FS00:0xa7:       Time: 01:52:30
19:53:09:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
19:53:09:WU01:FS00:0xa7:     Branch: master
19:53:09:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:53:09:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:53:09:WU01:FS00:0xa7:   Platform: win32 10
19:53:09:WU01:FS00:0xa7:       Bits: 64
19:53:10:WU01:FS00:0xa7:       Mode: Release
19:53:10:WU01:FS00:0xa7:************************************ Build *************************************
19:53:10:WU01:FS00:0xa7:       SIMD: avx_256
19:53:10:WU01:FS00:0xa7:********************************************************************************
19:53:10:WU01:FS00:0xa7:Project: 16429 (Run 0, Clone 2919, Gen 18)
19:53:10:WU01:FS00:0xa7:Unit: 0x0000001696880e6e5e924bd8f1b6401d
19:53:10:WU01:FS00:0xa7:Reading tar file core.xml
19:53:10:WU01:FS00:0xa7:Reading tar file frame18.tpr
19:53:10:WU01:FS00:0xa7:Digital signatures verified
19:53:10:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
19:53:10:WU01:FS00:0xa7:Calling: mdrun -s frame18.tpr -o frame18.trr -x frame18.xtc -cpt 15 -nt 10
19:53:10:WU01:FS00:0xa7:Steps: first=9000000 total=500000
19:53:12:WU01:FS00:0xa7:Completed 1 out of 500000 steps (0%)
19:53:15:WU00:FS00:Upload 52.36%
19:53:20:WU00:FS00:Upload complete
19:53:20:WU00:FS00:Server responded WORK_ACK (400)
19:53:20:WU00:FS00:Final credit estimate, 4273.00 points
19:53:20:WU00:FS00:Cleaning up
19:56:00:WU01:FS00:0xa7:Completed 5000 out of 500000 steps (1%)

[...]

21:07:25:WU01:FS00:0xa7:Completed 130000 out of 500000 steps (26%)
21:08:59:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
21:09:00:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073741819 = 0xc0000005)
21:09:00:WU01:FS00:Starting
21:09:00:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
21:09:00:WU01:FS00:Started FahCore on PID 13192
21:09:00:WU01:FS00:Core PID:5168
21:09:00:WU01:FS00:FahCore 0xa7 started
21:09:00:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T21:09:00Z ***********************
21:09:00:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
21:09:00:WU01:FS00:0xa7:       Type: 0xa7
21:09:00:WU01:FS00:0xa7:       Core: Gromacs
21:09:00:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 13192 -checkpoint 15 -np
21:09:00:WU01:FS00:0xa7:             11
21:09:00:WU01:FS00:0xa7:************************************ CBang *************************************
21:09:00:WU01:FS00:0xa7:       Date: Oct 26 2019
21:09:00:WU01:FS00:0xa7:       Time: 01:38:25
21:09:00:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c
5a435f66777f62f
21:09:00:WU01:FS00:0xa7:     Branch: master
21:09:00:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:09:00:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:09:00:WU01:FS00:0xa7:   Platform: win32 10
21:09:00:WU01:FS00:0xa7:       Bits: 64
21:09:00:WU01:FS00:0xa7:       Mode: Release
21:09:00:WU01:FS00:0xa7:************************************ System ************************************
21:09:00:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
21:09:00:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
21:09:00:WU01:FS00:0xa7:       CPUs: 12
21:09:00:WU01:FS00:0xa7:     Memory: 15.95GiB
21:09:00:WU01:FS00:0xa7:Free Memory: 13.01GiB
21:09:00:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
21:09:00:WU01:FS00:0xa7: OS Version: 6.2
21:09:00:WU01:FS00:0xa7:Has Battery: false
21:09:00:WU01:FS00:0xa7: On Battery: false
21:09:00:WU01:FS00:0xa7: UTC Offset: 2
21:09:00:WU01:FS00:0xa7:        PID: 5168
21:09:00:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
21:09:00:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
21:09:00:WU01:FS00:0xa7:    Version: 0.0.18
21:09:00:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:09:00:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
21:09:00:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
21:09:00:WU01:FS00:0xa7:       Date: Oct 26 2019
21:09:00:WU01:FS00:0xa7:       Time: 01:52:30
21:09:00:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
21:09:00:WU01:FS00:0xa7:     Branch: master
21:09:00:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:09:00:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:09:00:WU01:FS00:0xa7:   Platform: win32 10
21:09:00:WU01:FS00:0xa7:       Bits: 64
21:09:00:WU01:FS00:0xa7:       Mode: Release
21:09:00:WU01:FS00:0xa7:************************************ Build *************************************
21:09:00:WU01:FS00:0xa7:       SIMD: avx_256
21:09:00:WU01:FS00:0xa7:********************************************************************************
21:09:00:WU01:FS00:0xa7:Project: 16429 (Run 0, Clone 2919, Gen 18)
21:09:00:WU01:FS00:0xa7:Unit: 0x0000001696880e6e5e924bd8f1b6401d
21:09:00:WU01:FS00:0xa7:Digital signatures verified
21:09:00:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
21:09:00:WU01:FS00:0xa7:Calling: mdrun -s frame18.tpr -o frame18.trr -x frame18.xtc -cpi state.cpt -cpt 15 -nt 10
21:09:00:WU01:FS00:0xa7:Steps: first=9000000 total=500000
21:09:02:WU01:FS00:0xa7:Completed 131311 out of 500000 steps (26%)

[...]

23:20:57:WU01:FS00:0xa7:Completed 360000 out of 500000 steps (72%)
23:23:33:WU01:FS00:0xa7:ERROR:Win32: 0xc0000005: Exception access violation
23:23:33:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
23:23:33:WU01:FS00:0xa7:Saving result file frame18.trr
23:23:33:WU01:FS00:0xa7:Saving result file frame18.xtc
23:23:33:WU01:FS00:0xa7:Saving result file md.log
23:23:33:WU01:FS00:0xa7:Saving result file science.log
23:23:33:WU01:FS00:0xa7:WARNING:While cleaning up: boost::filesystem::remove: Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird: "01/ener.edr"
23:23:33:WU01:FS00:0xa7:Folding@home Core Shutdown: BAD_WORK_UNIT
23:23:33:WU01:FS00:0xa7:ERROR:std::exception: Bad dynamic_cast!
23:23:33:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.
23:23:33:WU01:FS00:0xa7:ERROR:std::exception: Bad dynamic_cast!
23:23:33:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.
23:23:33:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.
23:23:33:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.
23:23:33:WU01:FS00:0xa7:ERROR:std::exception: Bad dynamic_cast!
23:23:33:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.


[481 Lines of: "WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists."]


23:23:34:WU01:FS00:0xa7:ERROR:Exception: Core instance does not exists.
23:23:34:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
23:23:34:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
23:23:34:WU01:FS00:Starting
23:23:34:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
23:23:34:WU01:FS00:Started FahCore on PID 7872
23:23:34:WU01:FS00:Core PID:7372
23:23:34:WU01:FS00:FahCore 0xa7 started
23:23:35:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T23:23:34Z ***********************
23:23:35:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
23:23:35:WU01:FS00:0xa7:       Type: 0xa7
23:23:35:WU01:FS00:0xa7:       Core: Gromacs
23:23:35:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 7872 -checkpoint 15 -np
23:23:35:WU01:FS00:0xa7:             11
23:23:35:WU01:FS00:0xa7:************************************ CBang *************************************
23:23:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:23:35:WU01:FS00:0xa7:       Time: 01:38:25
23:23:35:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
23:23:35:WU01:FS00:0xa7:     Branch: master
23:23:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:23:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:23:35:WU01:FS00:0xa7:   Platform: win32 10
23:23:35:WU01:FS00:0xa7:       Bits: 64
23:23:35:WU01:FS00:0xa7:       Mode: Release
23:23:35:WU01:FS00:0xa7:************************************ System ************************************
23:23:35:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
23:23:35:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
23:23:35:WU01:FS00:0xa7:       CPUs: 12
23:23:35:WU01:FS00:0xa7:     Memory: 15.95GiB
23:23:35:WU01:FS00:0xa7:Free Memory: 12.58GiB
23:23:35:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
23:23:35:WU01:FS00:0xa7: OS Version: 6.2
23:23:35:WU01:FS00:0xa7:Has Battery: false
23:23:35:WU01:FS00:0xa7: On Battery: false
23:23:35:WU01:FS00:0xa7: UTC Offset: 2
23:23:35:WU01:FS00:0xa7:        PID: 7372
23:23:35:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
23:23:35:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
23:23:35:WU01:FS00:0xa7:    Version: 0.0.18
23:23:35:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:23:35:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
23:23:35:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
23:23:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:23:35:WU01:FS00:0xa7:       Time: 01:52:30
23:23:35:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
23:23:35:WU01:FS00:0xa7:     Branch: master
23:23:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:23:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:23:35:WU01:FS00:0xa7:   Platform: win32 10
23:23:35:WU01:FS00:0xa7:       Bits: 64
23:23:35:WU01:FS00:0xa7:       Mode: Release
23:23:35:WU01:FS00:0xa7:************************************ Build *************************************
23:23:35:WU01:FS00:0xa7:       SIMD: avx_256
23:23:35:WU01:FS00:0xa7:********************************************************************************
23:23:35:WU01:FS00:0xa7:Project: 16429 (Run 0, Clone 2919, Gen 18)
23:23:35:WU01:FS00:0xa7:Unit: 0x0000001696880e6e5e924bd8f1b6401d
23:23:35:WU01:FS00:0xa7:Reading tar file core.xml
23:23:35:WU01:FS00:0xa7:Reading tar file frame18.tpr
23:23:35:WU01:FS00:0xa7:Digital signatures verified
23:23:35:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
23:23:35:WU01:FS00:0xa7:Calling: mdrun -s frame18.tpr -o frame18.trr -x frame18.xtc -cpi state.cpt -cpt 15 -nt 10
23:23:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/state.cpt'
23:23:35:WU01:FS00:0xa7:WARNING:Unexpected exit() call
23:23:35:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
23:23:35:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
23:23:35:WU01:FS00:0xa7:Saving result file frame18.trr
23:23:35:WU01:FS00:0xa7:Saving result file frame18.xtc
23:23:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/frame18.xtc'
23:23:36:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
23:23:36:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
23:24:35:WU01:FS00:Starting
23:24:35:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
23:24:35:WU01:FS00:Started FahCore on PID 7232
23:24:35:WU01:FS00:Core PID:10148
23:24:35:WU01:FS00:FahCore 0xa7 started
23:24:35:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T23:24:35Z ***********************
23:24:35:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
23:24:35:WU01:FS00:0xa7:       Type: 0xa7
23:24:35:WU01:FS00:0xa7:       Core: Gromacs
23:24:35:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 7232 -checkpoint 15 -np
23:24:35:WU01:FS00:0xa7:             11
23:24:35:WU01:FS00:0xa7:************************************ CBang *************************************
23:24:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:24:35:WU01:FS00:0xa7:       Time: 01:38:25
23:24:35:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
23:24:35:WU01:FS00:0xa7:     Branch: master
23:24:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:24:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:24:35:WU01:FS00:0xa7:   Platform: win32 10
23:24:35:WU01:FS00:0xa7:       Bits: 64
23:24:35:WU01:FS00:0xa7:       Mode: Release
23:24:35:WU01:FS00:0xa7:************************************ System ************************************
23:24:35:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
23:24:35:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
23:24:35:WU01:FS00:0xa7:       CPUs: 12
23:24:35:WU01:FS00:0xa7:     Memory: 15.95GiB
23:24:35:WU01:FS00:0xa7:Free Memory: 12.50GiB
23:24:35:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
23:24:35:WU01:FS00:0xa7: OS Version: 6.2
23:24:35:WU01:FS00:0xa7:Has Battery: false
23:24:35:WU01:FS00:0xa7: On Battery: false
23:24:35:WU01:FS00:0xa7: UTC Offset: 2
23:24:35:WU01:FS00:0xa7:        PID: 10148
23:24:35:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
23:24:35:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
23:24:35:WU01:FS00:0xa7:    Version: 0.0.18
23:24:35:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:24:35:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
23:24:35:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
23:24:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:24:35:WU01:FS00:0xa7:       Time: 01:52:30
23:24:35:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
23:24:35:WU01:FS00:0xa7:     Branch: master
23:24:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:24:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:24:35:WU01:FS00:0xa7:   Platform: win32 10
23:24:35:WU01:FS00:0xa7:       Bits: 64
23:24:35:WU01:FS00:0xa7:       Mode: Release
23:24:35:WU01:FS00:0xa7:************************************ Build *************************************
23:24:35:WU01:FS00:0xa7:       SIMD: avx_256
23:24:35:WU01:FS00:0xa7:********************************************************************************
23:24:35:WU01:FS00:0xa7:Project: 16429 (Run 0, Clone 2919, Gen 18)
23:24:35:WU01:FS00:0xa7:Unit: 0x0000001696880e6e5e924bd8f1b6401d
23:24:35:WU01:FS00:0xa7:Reading tar file core.xml
23:24:35:WU01:FS00:0xa7:Reading tar file frame18.tpr
23:24:35:WU01:FS00:0xa7:Digital signatures verified
23:24:35:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
23:24:35:WU01:FS00:0xa7:Calling: mdrun -s frame18.tpr -o frame18.trr -x frame18.xtc -cpi state.cpt -cpt 15 -nt 10
23:24:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/state.cpt'
23:24:35:WU01:FS00:0xa7:WARNING:Unexpected exit() call
23:24:35:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
23:24:35:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
23:24:35:WU01:FS00:0xa7:Saving result file frame18.trr
23:24:35:WU01:FS00:0xa7:Saving result file frame18.xtc
23:24:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/frame18.xtc'
23:24:35:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
23:24:35:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
23:25:35:WU01:FS00:Starting
23:25:35:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\x\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 4476 -checkpoint 15 -np 11
23:25:35:WU01:FS00:Started FahCore on PID 1604
23:25:35:WU01:FS00:Core PID:11768
23:25:35:WU01:FS00:FahCore 0xa7 started
23:25:35:WU01:FS00:0xa7:*********************** Log Started 2020-04-23T23:25:35Z ***********************
23:25:35:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
23:25:35:WU01:FS00:0xa7:       Type: 0xa7
23:25:35:WU01:FS00:0xa7:       Core: Gromacs
23:25:35:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 1604 -checkpoint 15 -np
23:25:35:WU01:FS00:0xa7:             11
23:25:35:WU01:FS00:0xa7:************************************ CBang *************************************
23:25:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:25:35:WU01:FS00:0xa7:       Time: 01:38:25
23:25:35:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
23:25:35:WU01:FS00:0xa7:     Branch: master
23:25:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:25:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:25:35:WU01:FS00:0xa7:   Platform: win32 10
23:25:35:WU01:FS00:0xa7:       Bits: 64
23:25:35:WU01:FS00:0xa7:       Mode: Release
23:25:35:WU01:FS00:0xa7:************************************ System ************************************
23:25:35:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
23:25:35:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
23:25:35:WU01:FS00:0xa7:       CPUs: 12
23:25:35:WU01:FS00:0xa7:     Memory: 15.95GiB
23:25:35:WU01:FS00:0xa7:Free Memory: 13.47GiB
23:25:35:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
23:25:35:WU01:FS00:0xa7: OS Version: 6.2
23:25:35:WU01:FS00:0xa7:Has Battery: false
23:25:35:WU01:FS00:0xa7: On Battery: false
23:25:35:WU01:FS00:0xa7: UTC Offset: 2
23:25:35:WU01:FS00:0xa7:        PID: 11768
23:25:35:WU01:FS00:0xa7:        CWD: C:\Users\x\AppData\Roaming\FAHClient\work
23:25:35:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
23:25:35:WU01:FS00:0xa7:    Version: 0.0.18
23:25:35:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:25:35:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
23:25:35:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
23:25:35:WU01:FS00:0xa7:       Date: Oct 26 2019
23:25:35:WU01:FS00:0xa7:       Time: 01:52:30
23:25:35:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
23:25:35:WU01:FS00:0xa7:     Branch: master
23:25:35:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
23:25:35:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
23:25:35:WU01:FS00:0xa7:   Platform: win32 10
23:25:35:WU01:FS00:0xa7:       Bits: 64
23:25:35:WU01:FS00:0xa7:       Mode: Release
23:25:35:WU01:FS00:0xa7:************************************ Build *************************************
23:25:35:WU01:FS00:0xa7:       SIMD: avx_256
23:25:35:WU01:FS00:0xa7:********************************************************************************
23:25:35:WU01:FS00:0xa7:Project: 16429 (Run 0, Clone 2919, Gen 18)
23:25:35:WU01:FS00:0xa7:Unit: 0x0000001696880e6e5e924bd8f1b6401d
23:25:35:WU01:FS00:0xa7:Reading tar file core.xml
23:25:35:WU01:FS00:0xa7:Reading tar file frame18.tpr
23:25:35:WU01:FS00:0xa7:Digital signatures verified
23:25:35:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
23:25:35:WU01:FS00:0xa7:Calling: mdrun -s frame18.tpr -o frame18.trr -x frame18.xtc -cpi state.cpt -cpt 15 -nt 10
23:25:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/state.cpt'
23:25:35:WU01:FS00:0xa7:WARNING:Unexpected exit() call
23:25:35:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
23:25:35:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
23:25:35:WU01:FS00:0xa7:Saving result file frame18.trr
23:25:35:WU01:FS00:0xa7:Saving result file frame18.xtc
23:25:35:WU01:FS00:0xa7:ERROR:Guru Meditation: not checked '01/01/frame18.xtc'
23:25:36:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
23:25:36:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
23:25:36:WARNING:WU01:FS00:Too many errors, failing
23:25:36:WU01:FS00:Sending unit results: id:01 state:SEND error:FAILED project:16429 run:0 clone:2919 gen:18 core:0xa7 unit:0x0000001696880e6e5e924bd8f1b6401d
23:25:36:WU01:FS00:Connecting to 150.136.14.110:8080
23:25:36:WU00:FS00:Connecting to 65.254.110.245:80
23:25:36:WU01:FS00:Server responded WORK_ACK (400)
23:25:36:WU01:FS00:Cleaning up
Top
OldFolderGuy
Posts: 2
Joined: Tue Mar 31, 2020 4:36 pm

Re: Several crashed WUs

Post by OldFolderGuy »

NOT Trying to hijack the thread, but I have similar issue.

I have also experienced issues as well this week. I have both VMWare boxes and the Host box running the F@Home client. The issues occur on the W10 Host on the CPU WU side, but the GPU seems to be working fine (no crashes).

Code: Select all

00:06:25:WU01:FS00:0xa7:Calling: mdrun -s frame40.tpr -o frame40.trr -x frame40.xtc -e frame40.edr -cpt 15 -nt 10
00:16:28:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
00:16:28:WARNING:WU01:FS00:FahCore returned: WU_STALLED (127 = 0x7f)
00:16:28:WU01:FS00:Starting
00:16:28:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 49112 -checkpoint 15 -np 11
00:16:28:WU01:FS00:Started FahCore on PID 34464
00:16:28:WU01:FS00:Core PID:9060
00:16:28:WU01:FS00:FahCore 0xa7 started
00:16:29:WU01:FS00:0xa7:*********************** Log Started 2020-04-24T00:16:28Z ***********************
00:16:29:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
00:16:29:WU01:FS00:0xa7:       Type: 0xa7
00:16:29:WU01:FS00:0xa7:       Core: Gromacs
00:16:29:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 34464 -checkpoint 15 -np
00:16:29:WU01:FS00:0xa7:             11
00:16:29:WU01:FS00:0xa7:************************************ CBang *************************************
00:16:29:WU01:FS00:0xa7:       Date: Oct 26 2019
00:16:29:WU01:FS00:0xa7:       Time: 01:38:25
00:16:29:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
00:16:29:WU01:FS00:0xa7:     Branch: master
00:16:29:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
00:16:29:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:16:29:WU01:FS00:0xa7:   Platform: win32 10
00:16:29:WU01:FS00:0xa7:       Bits: 64
00:16:29:WU01:FS00:0xa7:       Mode: Release
00:16:29:WU01:FS00:0xa7:************************************ System ************************************
00:16:29:WU01:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz
00:16:29:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
00:16:29:WU01:FS00:0xa7:       CPUs: 12
00:16:29:WU01:FS00:0xa7:     Memory: 63.81GiB
00:16:29:WU01:FS00:0xa7:Free Memory: 34.76GiB
00:16:29:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
00:16:29:WU01:FS00:0xa7: OS Version: 6.2
00:16:29:WU01:FS00:0xa7:Has Battery: false
00:16:29:WU01:FS00:0xa7: On Battery: false
00:16:29:WU01:FS00:0xa7: UTC Offset: -4
00:16:29:WU01:FS00:0xa7:        PID: 9060
00:16:29:WU01:FS00:0xa7:        CWD: E:\FAHClient\work
00:16:29:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
00:16:29:WU01:FS00:0xa7:    Version: 0.0.18
00:16:29:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:16:29:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
00:16:29:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
00:16:29:WU01:FS00:0xa7:       Date: Oct 26 2019
00:16:29:WU01:FS00:0xa7:       Time: 01:52:30
00:16:29:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
00:16:29:WU01:FS00:0xa7:     Branch: master
00:16:29:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
00:16:29:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:16:29:WU01:FS00:0xa7:   Platform: win32 10
00:16:29:WU01:FS00:0xa7:       Bits: 64
00:16:29:WU01:FS00:0xa7:       Mode: Release
00:16:29:WU01:FS00:0xa7:************************************ Build *************************************
00:16:29:WU01:FS00:0xa7:       SIMD: avx_256
00:16:29:WU01:FS00:0xa7:********************************************************************************
00:16:29:WU01:FS00:0xa7:Project: 13850 (Run 0, Clone 13181, Gen 40)
00:16:29:WU01:FS00:0xa7:Unit: 0x00000039287234c95e7303c9e8617e23
00:16:29:WU01:FS00:0xa7:Reading tar file core.xml
00:16:29:WU01:FS00:0xa7:Reading tar file frame40.tpr
00:16:29:WU01:FS00:0xa7:Digital signatures verified
00:16:29:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
00:16:29:WU01:FS00:0xa7:Calling: mdrun -s frame40.tpr -o frame40.trr -x frame40.xtc -e frame40.edr -cpt 15 -nt 10
00:26:32:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
00:26:32:WARNING:WU01:FS00:FahCore returned: WU_STALLED (127 = 0x7f)
00:26:32:WU01:FS00:Starting
00:26:32:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 49112 -checkpoint 15 -np 11
00:26:32:WU01:FS00:Started FahCore on PID 51860
00:26:32:WU01:FS00:Core PID:52832
00:26:32:WU01:FS00:FahCore 0xa7 started
00:26:33:WU01:FS00:0xa7:*********************** Log Started 2020-04-24T00:26:32Z ***********************
00:26:33:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
00:26:33:WU01:FS00:0xa7:       Type: 0xa7
00:26:33:WU01:FS00:0xa7:       Core: Gromacs
00:26:33:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 51860 -checkpoint 15 -np
00:26:33:WU01:FS00:0xa7:             11
00:26:33:WU01:FS00:0xa7:************************************ CBang *************************************
00:26:33:WU01:FS00:0xa7:       Date: Oct 26 2019
00:26:33:WU01:FS00:0xa7:       Time: 01:38:25
00:26:33:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
00:26:33:WU01:FS00:0xa7:     Branch: master
00:26:33:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
00:26:33:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:26:33:WU01:FS00:0xa7:   Platform: win32 10
00:26:33:WU01:FS00:0xa7:       Bits: 64
00:26:33:WU01:FS00:0xa7:       Mode: Release
00:26:33:WU01:FS00:0xa7:************************************ System ************************************
00:26:33:WU01:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz
00:26:33:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
00:26:33:WU01:FS00:0xa7:       CPUs: 12
00:26:33:WU01:FS00:0xa7:     Memory: 63.81GiB
00:26:33:WU01:FS00:0xa7:Free Memory: 34.23GiB
00:26:33:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
00:26:33:WU01:FS00:0xa7: OS Version: 6.2
00:26:33:WU01:FS00:0xa7:Has Battery: false
00:26:33:WU01:FS00:0xa7: On Battery: false
00:26:33:WU01:FS00:0xa7: UTC Offset: -4
00:26:33:WU01:FS00:0xa7:        PID: 52832
00:26:33:WU01:FS00:0xa7:        CWD: E:\FAHClient\work
00:26:33:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
00:26:33:WU01:FS00:0xa7:    Version: 0.0.18
00:26:33:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:26:33:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
00:26:33:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
00:26:33:WU01:FS00:0xa7:       Date: Oct 26 2019
00:26:33:WU01:FS00:0xa7:       Time: 01:52:30
00:26:33:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
00:26:33:WU01:FS00:0xa7:     Branch: master
00:26:33:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
00:26:33:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:26:33:WU01:FS00:0xa7:   Platform: win32 10
00:26:33:WU01:FS00:0xa7:       Bits: 64
00:26:33:WU01:FS00:0xa7:       Mode: Release
00:26:33:WU01:FS00:0xa7:************************************ Build *************************************
00:26:33:WU01:FS00:0xa7:       SIMD: avx_256
00:26:33:WU01:FS00:0xa7:********************************************************************************
00:26:33:WU01:FS00:0xa7:Project: 13850 (Run 0, Clone 13181, Gen 40)
00:26:33:WU01:FS00:0xa7:Unit: 0x00000039287234c95e7303c9e8617e23
00:26:33:WU01:FS00:0xa7:Reading tar file core.xml
00:26:33:WU01:FS00:0xa7:Reading tar file frame40.tpr
00:26:33:WU01:FS00:0xa7:Digital signatures verified
00:26:33:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
00:26:33:WU01:FS00:0xa7:Calling: mdrun -s frame40.tpr -o frame40.trr -x frame40.xtc -e frame40.edr -cpt 15 -nt 10
00:36:33:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
00:36:33:WARNING:WU01:FS00:FahCore returned: WU_STALLED (127 = 0x7f)
00:36:33:WARNING:WU01:FS00:Too many errors, failing
00:36:34:WU01:FS00:Sending unit results: id:01 state:SEND error:FAILED project:13850 run:0 clone:13181 gen:40 core:0xa7 unit:0x00000039287234c95e7303c9e8617e23
00:36:34:WU01:FS00:Connecting to 40.114.52.201:8080
00:36:34:WU01:FS00:Server responded WORK_ACK (400)
00:36:34:WU01:FS00:Cleaning up
00:36:34:WU00:FS00:Connecting to 65.254.110.245:8080
00:36:34:WU00:FS00:Assigned to work server 155.247.164.214
00:36:34:WU00:FS00:Requesting new work unit for slot 00: READY cpu:11 from 155.247.164.214


Host Box specs:
i7-8700 @ 3.20GHz
6 core HT (12)
64 GB Ram
Win10 Pro
NVidia GeForce GTX 1060 - 6GB memory

I run VMWare Workstation (15 Pro) for Virtualization Support:

2 of the VM's are:
2 core 2 threads per for 4 cores
16GB Ram
Centos7

1 VM is:
1 core 2 thread for 2 cores
8 GB Ram
Centos7


Just thought I'd mention it as I have had many successful runs until recently. I noticed that the estimated times have jumped from 20 hours or so to 2.4 days (current view). on the Host WU processes, but the VM's don't have any problems.

Any thoughts or suggestions would help.
Top
Joe_H
Site Admin
Posts: 7870
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Several crashed WUs

Post by Joe_H »

Estimated times for the first WU of a project that gets folded on your client are based on the Timeout and Deadline values. Once the WU has completed a couple of percent, then the estimates are based on actual processing time. If your client has worked on another WU from a specific project, then the estimates can be better at the start.

What you are seeing is that many of the early projects being issued during the COVID-19 rush had 1 day Timeouts. Now there are newer and larger WUs, they are getting longer Timeout values.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
OldFolderGuy
Posts: 2
Joined: Tue Mar 31, 2020 4:36 pm

Re: Several crashed WUs

Post by OldFolderGuy »

So basically, it is a "Don't Panic!" situation. I noticed it was making some progress on the new package, so I guess I'll monitor it and see. I was concerned about the log entry of a possible crash, but it didn't halt, so that's a good thing.

Wonder if that was due to the latest Windoze updates.... umm.. Feature Additions?...

Thanks!
Top
Post Reply

Return to “Issues with a specific WU”