14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Moderators: Site Moderators, FAHC Science Team

14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby NRT_AntiKytherA » Tue May 26, 2020 8:25 pm

Probably been jinxed given the earlier discussion today with PantherX about numbers of threads. PantherX mentioned some WU don't like 10 cores, maybe this is one of them? Note the system was not shutdown, did not overheat and has been folding fine until this particular CPU work unit this evening. That says to me it's possibly the unit rather than my machine.

Indeed the core kept crashing with an unknown error code after 35% completed:

18:58:46:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
18:58:46:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073741819 = 0xc0000005)

Full WU log:
Code: Select all
18:00:19:WU01:FS00:Connecting to assign1.foldingathome.org:80
18:00:19:WU01:FS00:Assigned to work server 155.247.164.213
18:00:19:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:10 from 155.247.164.213
18:00:19:WU01:FS00:Connecting to 155.247.164.213:8080
18:00:20:WU01:FS00:Downloading 2.81MiB
18:00:21:WU01:FS00:Download complete
18:00:21:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14723 run:2539 clone:2 gen:20 core:0xa7 unit:0x000000169bf7a4d55ea24c984e4f6e00
18:02:01:WU00:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
18:02:02:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
18:02:02:WU00:FS00:0xa7:Saving result file dhdl.xvg
18:02:02:WU00:FS00:0xa7:Saving result file frame17.trr
18:02:02:WU00:FS00:0xa7:Saving result file md.log
18:02:03:WU00:FS00:0xa7:Saving result file pullf.xvg
18:02:03:WU00:FS00:0xa7:Saving result file pullx.xvg
18:02:03:WU00:FS00:0xa7:Saving result file science.log
18:02:03:WU00:FS00:0xa7:Saving result file traj_comp.xtc
18:02:03:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
18:02:03:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:02:03:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14824 run:1991 clone:3 gen:17 core:0xa7 unit:0x000000119bf7a4d55ea345adb49e45d4
18:02:03:WU00:FS00:Uploading 6.80MiB to 155.247.164.213
18:02:03:WU00:FS00:Connecting to 155.247.164.213:8080
18:02:03:WU01:FS00:Starting
18:02:03:WU01:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
18:02:03:WU01:FS00:Started FahCore on PID 412
18:02:03:WU01:FS00:Core PID:3908
18:02:03:WU01:FS00:FahCore 0xa7 started
18:02:04:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T18:02:03Z ***********************
18:02:04:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
18:02:04:WU01:FS00:0xa7:       Type: 0xa7
18:02:04:WU01:FS00:0xa7:       Core: Gromacs
18:02:04:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 412 -checkpoint 15 -np 10
18:02:04:WU01:FS00:0xa7:************************************ CBang *************************************
18:02:04:WU01:FS00:0xa7:       Date: Oct 26 2019
18:02:04:WU01:FS00:0xa7:       Time: 01:38:25
18:02:04:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
18:02:04:WU01:FS00:0xa7:     Branch: master
18:02:04:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:02:04:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:02:04:WU01:FS00:0xa7:   Platform: win32 10
18:02:04:WU01:FS00:0xa7:       Bits: 64
18:02:04:WU01:FS00:0xa7:       Mode: Release
18:02:04:WU01:FS00:0xa7:************************************ System ************************************
18:02:04:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
18:02:04:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
18:02:04:WU01:FS00:0xa7:       CPUs: 12
18:02:04:WU01:FS00:0xa7:     Memory: 31.96GiB
18:02:04:WU01:FS00:0xa7:Free Memory: 26.60GiB
18:02:04:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
18:02:04:WU01:FS00:0xa7: OS Version: 6.2
18:02:04:WU01:FS00:0xa7:Has Battery: true
18:02:04:WU01:FS00:0xa7: On Battery: false
18:02:04:WU01:FS00:0xa7: UTC Offset: 1
18:02:04:WU01:FS00:0xa7:        PID: 3908
18:02:04:WU01:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
18:02:04:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
18:02:04:WU01:FS00:0xa7:    Version: 0.0.18
18:02:04:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:02:04:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
18:02:04:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
18:02:04:WU01:FS00:0xa7:       Date: Oct 26 2019
18:02:04:WU01:FS00:0xa7:       Time: 01:52:30
18:02:04:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
18:02:04:WU01:FS00:0xa7:     Branch: master
18:02:04:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:02:04:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:02:04:WU01:FS00:0xa7:   Platform: win32 10
18:02:04:WU01:FS00:0xa7:       Bits: 64
18:02:04:WU01:FS00:0xa7:       Mode: Release
18:02:04:WU01:FS00:0xa7:************************************ Build *************************************
18:02:04:WU01:FS00:0xa7:       SIMD: avx_256
18:02:04:WU01:FS00:0xa7:********************************************************************************
18:02:04:WU01:FS00:0xa7:Project: 14723 (Run 2539, Clone 2, Gen 20)
18:02:04:WU01:FS00:0xa7:Unit: 0x000000169bf7a4d55ea24c984e4f6e00
18:02:04:WU01:FS00:0xa7:Reading tar file core.xml
18:02:04:WU01:FS00:0xa7:Reading tar file frame20.tpr
18:02:04:WU01:FS00:0xa7:Digital signatures verified
18:02:04:WU01:FS00:0xa7:Calling: mdrun -s frame20.tpr -o frame20.trr -cpt 15 -nt 10
18:02:04:WU01:FS00:0xa7:Steps: first=0 total=250000
18:02:05:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
18:02:09:WU00:FS00:Upload 47.78%
18:02:15:WU00:FS00:Upload complete
18:02:15:WU00:FS00:Server responded WORK_ACK (400)
18:02:15:WU00:FS00:Final credit estimate, 4346.00 points
18:02:15:WU00:FS00:Cleaning up
18:03:42:WU01:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
18:05:20:WU01:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
18:06:58:WU01:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
18:08:38:WU01:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
18:10:20:WU01:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
18:12:01:WU01:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
18:13:43:WU01:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
18:15:21:WU01:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
18:17:02:WU01:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
18:18:43:WU01:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
18:20:21:WU01:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
18:21:57:WU01:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
18:23:35:WU01:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
18:25:11:WU01:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
18:26:48:WU01:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
18:28:24:WU01:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
18:30:00:WU01:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
18:31:38:WU01:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
18:33:17:WU01:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
18:34:51:WU01:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
18:36:29:WU01:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
18:38:07:WU01:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
18:39:42:WU01:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
18:41:17:WU01:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
18:42:53:WU01:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
18:44:29:WU01:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
18:46:05:WU01:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
18:47:44:WU01:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
18:49:22:WU01:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
18:50:59:WU01:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
18:52:35:WU01:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
18:54:13:WU01:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
18:54:55:FS00:Finishing
18:55:45:WU01:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
18:57:11:WU01:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
18:58:35:WU01:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
18:58:46:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
18:58:46:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073741819 = 0xc0000005)
18:58:46:WU01:FS00:Starting
18:58:46:WU01:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
18:58:46:WU01:FS00:Started FahCore on PID 4320
18:58:46:WU01:FS00:Core PID:13908
18:58:46:WU01:FS00:FahCore 0xa7 started
18:58:46:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T18:58:46Z ***********************
18:58:46:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
18:58:46:WU01:FS00:0xa7:       Type: 0xa7
18:58:46:WU01:FS00:0xa7:       Core: Gromacs
18:58:46:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 4320 -checkpoint 15 -np
18:58:46:WU01:FS00:0xa7:             10
18:58:46:WU01:FS00:0xa7:************************************ CBang *************************************
18:58:46:WU01:FS00:0xa7:       Date: Oct 26 2019
18:58:46:WU01:FS00:0xa7:       Time: 01:38:25
18:58:46:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
18:58:46:WU01:FS00:0xa7:     Branch: master
18:58:46:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:58:46:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:58:46:WU01:FS00:0xa7:   Platform: win32 10
18:58:46:WU01:FS00:0xa7:       Bits: 64
18:58:46:WU01:FS00:0xa7:       Mode: Release
18:58:46:WU01:FS00:0xa7:************************************ System ************************************
18:58:46:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
18:58:46:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
18:58:46:WU01:FS00:0xa7:       CPUs: 12
18:58:46:WU01:FS00:0xa7:     Memory: 31.96GiB
18:58:46:WU01:FS00:0xa7:Free Memory: 26.81GiB
18:58:46:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
18:58:46:WU01:FS00:0xa7: OS Version: 6.2
18:58:46:WU01:FS00:0xa7:Has Battery: true
18:58:46:WU01:FS00:0xa7: On Battery: false
18:58:46:WU01:FS00:0xa7: UTC Offset: 1
18:58:46:WU01:FS00:0xa7:        PID: 13908
18:58:46:WU01:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
18:58:46:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
18:58:46:WU01:FS00:0xa7:    Version: 0.0.18
18:58:46:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:58:46:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
18:58:46:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
18:58:46:WU01:FS00:0xa7:       Date: Oct 26 2019
18:58:47:WU01:FS00:0xa7:       Time: 01:52:30
18:58:47:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
18:58:47:WU01:FS00:0xa7:     Branch: master
18:58:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:58:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:58:47:WU01:FS00:0xa7:   Platform: win32 10
18:58:47:WU01:FS00:0xa7:       Bits: 64
18:58:47:WU01:FS00:0xa7:       Mode: Release
18:58:47:WU01:FS00:0xa7:************************************ Build *************************************
18:58:47:WU01:FS00:0xa7:       SIMD: avx_256
18:58:47:WU01:FS00:0xa7:********************************************************************************
18:58:47:WU01:FS00:0xa7:Project: 14723 (Run 2539, Clone 2, Gen 20)
18:58:47:WU01:FS00:0xa7:Unit: 0x000000169bf7a4d55ea24c984e4f6e00
18:58:47:WU01:FS00:0xa7:Digital signatures verified
18:58:47:WU01:FS00:0xa7:Calling: mdrun -s frame20.tpr -o frame20.trr -cpi state.cpt -cpt 15 -nt 10
18:58:47:WU01:FS00:0xa7:ERROR:Guru Meditation #7ebe166835ccf11c.fc2c5bbe67a4697 (10583.11482) '01/01/pullx.xvg'
18:58:47:WU01:FS00:0xa7:WARNING:Unexpected exit() call
18:58:47:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
18:58:47:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
18:58:47:WU01:FS00:0xa7:Saving result file dhdl.xvg
18:58:47:WU01:FS00:0xa7:Saving result file frame20.trr
18:58:47:WU01:FS00:0xa7:Saving result file md.log
18:58:47:WU01:FS00:0xa7:Saving result file pullf.xvg
18:58:47:WU01:FS00:0xa7:ERROR:Guru Meditation #69b2de978613ad24.3871958ad5573db4 (5104.5527) '01/01/pullf.xvg'
18:58:48:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
18:58:48:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
18:59:46:WU01:FS00:Starting
18:59:46:WU01:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
18:59:46:WU01:FS00:Started FahCore on PID 9116
18:59:46:WU01:FS00:Core PID:13620
18:59:46:WU01:FS00:FahCore 0xa7 started
18:59:46:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T18:59:46Z ***********************
18:59:46:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
18:59:46:WU01:FS00:0xa7:       Type: 0xa7
18:59:46:WU01:FS00:0xa7:       Core: Gromacs
18:59:46:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 9116 -checkpoint 15 -np
18:59:46:WU01:FS00:0xa7:             10
18:59:46:WU01:FS00:0xa7:************************************ CBang *************************************
18:59:46:WU01:FS00:0xa7:       Date: Oct 26 2019
18:59:47:WU01:FS00:0xa7:       Time: 01:38:25
18:59:47:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
18:59:47:WU01:FS00:0xa7:     Branch: master
18:59:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:59:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:59:47:WU01:FS00:0xa7:   Platform: win32 10
18:59:47:WU01:FS00:0xa7:       Bits: 64
18:59:47:WU01:FS00:0xa7:       Mode: Release
18:59:47:WU01:FS00:0xa7:************************************ System ************************************
18:59:47:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
18:59:47:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
18:59:47:WU01:FS00:0xa7:       CPUs: 12
18:59:47:WU01:FS00:0xa7:     Memory: 31.96GiB
18:59:47:WU01:FS00:0xa7:Free Memory: 26.83GiB
18:59:47:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
18:59:47:WU01:FS00:0xa7: OS Version: 6.2
18:59:47:WU01:FS00:0xa7:Has Battery: true
18:59:47:WU01:FS00:0xa7: On Battery: false
18:59:47:WU01:FS00:0xa7: UTC Offset: 1
18:59:47:WU01:FS00:0xa7:        PID: 13620
18:59:47:WU01:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
18:59:47:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
18:59:47:WU01:FS00:0xa7:    Version: 0.0.18
18:59:47:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:59:47:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
18:59:47:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
18:59:47:WU01:FS00:0xa7:       Date: Oct 26 2019
18:59:47:WU01:FS00:0xa7:       Time: 01:52:30
18:59:47:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
18:59:47:WU01:FS00:0xa7:     Branch: master
18:59:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
18:59:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:59:47:WU01:FS00:0xa7:   Platform: win32 10
18:59:47:WU01:FS00:0xa7:       Bits: 64
18:59:47:WU01:FS00:0xa7:       Mode: Release
18:59:47:WU01:FS00:0xa7:************************************ Build *************************************
18:59:47:WU01:FS00:0xa7:       SIMD: avx_256
18:59:47:WU01:FS00:0xa7:********************************************************************************
18:59:47:WU01:FS00:0xa7:Project: 14723 (Run 2539, Clone 2, Gen 20)
18:59:47:WU01:FS00:0xa7:Unit: 0x000000169bf7a4d55ea24c984e4f6e00
18:59:47:WU01:FS00:0xa7:Digital signatures verified
18:59:47:WU01:FS00:0xa7:Calling: mdrun -s frame20.tpr -o frame20.trr -cpi state.cpt -cpt 15 -nt 10
18:59:47:WU01:FS00:0xa7:ERROR:Guru Meditation #7ebe166835ccf11c.fc2c5bbe67a4697 (10583.11482) '01/01/pullx.xvg'
18:59:47:WU01:FS00:0xa7:WARNING:Unexpected exit() call
18:59:47:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
18:59:47:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
18:59:47:WU01:FS00:0xa7:Saving result file dhdl.xvg
18:59:47:WU01:FS00:0xa7:Saving result file frame20.trr
18:59:47:WU01:FS00:0xa7:Saving result file md.log
18:59:47:WU01:FS00:0xa7:Saving result file pullf.xvg
18:59:47:WU01:FS00:0xa7:ERROR:Guru Meditation #69b2de978613ad24.3871958ad5573db4 (5104.5527) '01/01/pullf.xvg'
18:59:48:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
18:59:48:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
19:00:46:WU01:FS00:Starting
19:00:46:WU01:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
19:00:46:WU01:FS00:Started FahCore on PID 10544
19:00:46:WU01:FS00:Core PID:14040
19:00:46:WU01:FS00:FahCore 0xa7 started
19:00:47:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T19:00:46Z ***********************
19:00:47:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
19:00:47:WU01:FS00:0xa7:       Type: 0xa7
19:00:47:WU01:FS00:0xa7:       Core: Gromacs
19:00:47:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 10544 -checkpoint 15 -np
19:00:47:WU01:FS00:0xa7:             10
19:00:47:WU01:FS00:0xa7:************************************ CBang *************************************
19:00:47:WU01:FS00:0xa7:       Date: Oct 26 2019
19:00:47:WU01:FS00:0xa7:       Time: 01:38:25
19:00:47:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
19:00:47:WU01:FS00:0xa7:     Branch: master
19:00:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:00:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:00:47:WU01:FS00:0xa7:   Platform: win32 10
19:00:47:WU01:FS00:0xa7:       Bits: 64
19:00:47:WU01:FS00:0xa7:       Mode: Release
19:00:47:WU01:FS00:0xa7:************************************ System ************************************
19:00:47:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
19:00:47:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
19:00:47:WU01:FS00:0xa7:       CPUs: 12
19:00:47:WU01:FS00:0xa7:     Memory: 31.96GiB
19:00:47:WU01:FS00:0xa7:Free Memory: 26.81GiB
19:00:47:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
19:00:47:WU01:FS00:0xa7: OS Version: 6.2
19:00:47:WU01:FS00:0xa7:Has Battery: true
19:00:47:WU01:FS00:0xa7: On Battery: false
19:00:47:WU01:FS00:0xa7: UTC Offset: 1
19:00:47:WU01:FS00:0xa7:        PID: 14040
19:00:47:WU01:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
19:00:47:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
19:00:47:WU01:FS00:0xa7:    Version: 0.0.18
19:00:47:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:00:47:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
19:00:47:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
19:00:47:WU01:FS00:0xa7:       Date: Oct 26 2019
19:00:47:WU01:FS00:0xa7:       Time: 01:52:30
19:00:47:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
19:00:47:WU01:FS00:0xa7:     Branch: master
19:00:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:00:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:00:47:WU01:FS00:0xa7:   Platform: win32 10
19:00:47:WU01:FS00:0xa7:       Bits: 64
19:00:47:WU01:FS00:0xa7:       Mode: Release
19:00:47:WU01:FS00:0xa7:************************************ Build *************************************
19:00:47:WU01:FS00:0xa7:       SIMD: avx_256
19:00:47:WU01:FS00:0xa7:********************************************************************************
19:00:47:WU01:FS00:0xa7:Project: 14723 (Run 2539, Clone 2, Gen 20)
19:00:47:WU01:FS00:0xa7:Unit: 0x000000169bf7a4d55ea24c984e4f6e00
19:00:47:WU01:FS00:0xa7:Digital signatures verified
19:00:47:WU01:FS00:0xa7:Calling: mdrun -s frame20.tpr -o frame20.trr -cpi state.cpt -cpt 15 -nt 10
19:00:47:WU01:FS00:0xa7:ERROR:Guru Meditation #7ebe166835ccf11c.fc2c5bbe67a4697 (10583.11482) '01/01/pullx.xvg'
19:00:47:WU01:FS00:0xa7:WARNING:Unexpected exit() call
19:00:47:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
19:00:47:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
19:00:47:WU01:FS00:0xa7:Saving result file dhdl.xvg
19:00:47:WU01:FS00:0xa7:Saving result file frame20.trr
19:00:47:WU01:FS00:0xa7:Saving result file md.log
19:00:47:WU01:FS00:0xa7:Saving result file pullf.xvg
19:00:47:WU01:FS00:0xa7:ERROR:Guru Meditation #69b2de978613ad24.3871958ad5573db4 (5104.5527) '01/01/pullf.xvg'
19:00:48:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
19:00:48:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
19:01:46:WU01:FS00:Starting
19:01:46:WU01:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
19:01:46:WU01:FS00:Started FahCore on PID 5136
19:01:46:WU01:FS00:Core PID:9788
19:01:46:WU01:FS00:FahCore 0xa7 started
19:01:47:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T19:01:46Z ***********************
19:01:47:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
19:01:47:WU01:FS00:0xa7:       Type: 0xa7
19:01:47:WU01:FS00:0xa7:       Core: Gromacs
19:01:47:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 5136 -checkpoint 15 -np
19:01:47:WU01:FS00:0xa7:             10
19:01:47:WU01:FS00:0xa7:************************************ CBang *************************************
19:01:47:WU01:FS00:0xa7:       Date: Oct 26 2019
19:01:47:WU01:FS00:0xa7:       Time: 01:38:25
19:01:47:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
19:01:47:WU01:FS00:0xa7:     Branch: master
19:01:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:01:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:01:47:WU01:FS00:0xa7:   Platform: win32 10
19:01:47:WU01:FS00:0xa7:       Bits: 64
19:01:47:WU01:FS00:0xa7:       Mode: Release
19:01:47:WU01:FS00:0xa7:************************************ System ************************************
19:01:47:WU01:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
19:01:47:WU01:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
19:01:47:WU01:FS00:0xa7:       CPUs: 12
19:01:47:WU01:FS00:0xa7:     Memory: 31.96GiB
19:01:47:WU01:FS00:0xa7:Free Memory: 26.83GiB
19:01:47:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
19:01:47:WU01:FS00:0xa7: OS Version: 6.2
19:01:47:WU01:FS00:0xa7:Has Battery: true
19:01:47:WU01:FS00:0xa7: On Battery: false
19:01:47:WU01:FS00:0xa7: UTC Offset: 1
19:01:47:WU01:FS00:0xa7:        PID: 9788
19:01:47:WU01:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
19:01:47:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
19:01:47:WU01:FS00:0xa7:    Version: 0.0.18
19:01:47:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:01:47:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
19:01:47:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
19:01:47:WU01:FS00:0xa7:       Date: Oct 26 2019
19:01:47:WU01:FS00:0xa7:       Time: 01:52:30
19:01:47:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
19:01:47:WU01:FS00:0xa7:     Branch: master
19:01:47:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
19:01:47:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:01:47:WU01:FS00:0xa7:   Platform: win32 10
19:01:47:WU01:FS00:0xa7:       Bits: 64
19:01:47:WU01:FS00:0xa7:       Mode: Release
19:01:47:WU01:FS00:0xa7:************************************ Build *************************************
19:01:47:WU01:FS00:0xa7:       SIMD: avx_256
19:01:47:WU01:FS00:0xa7:********************************************************************************
19:01:47:WU01:FS00:0xa7:Project: 14723 (Run 2539, Clone 2, Gen 20)
19:01:47:WU01:FS00:0xa7:Unit: 0x000000169bf7a4d55ea24c984e4f6e00
19:01:47:WU01:FS00:0xa7:Digital signatures verified
19:01:47:WU01:FS00:0xa7:Calling: mdrun -s frame20.tpr -o frame20.trr -cpi state.cpt -cpt 15 -nt 10
19:01:47:WU01:FS00:0xa7:ERROR:Guru Meditation #7ebe166835ccf11c.fc2c5bbe67a4697 (10583.11482) '01/01/pullx.xvg'
19:01:47:WU01:FS00:0xa7:WARNING:Unexpected exit() call
19:01:47:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
19:01:47:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
19:01:47:WU01:FS00:0xa7:Saving result file dhdl.xvg
19:01:47:WU01:FS00:0xa7:Saving result file frame20.trr
19:01:47:WU01:FS00:0xa7:Saving result file md.log
19:01:47:WU01:FS00:0xa7:Saving result file pullf.xvg
19:01:47:WU01:FS00:0xa7:ERROR:Guru Meditation #69b2de978613ad24.3871958ad5573db4 (5104.5527) '01/01/pullf.xvg'
19:01:48:WARNING:WU01:FS00:FahCore returned an unknown error code which probably indicates that it crashed
19:01:48:WARNING:WU01:FS00:FahCore returned: UNKNOWN_ENUM (-1073740791 = 0xc0000409)
19:01:48:WARNING:WU01:FS00:Too many errors, failing
19:01:48:WU01:FS00:Sending unit results: id:01 state:SEND error:FAILED project:14723 run:2539 clone:2 gen:20 core:0xa7 unit:0x000000169bf7a4d55ea24c984e4f6e00
19:01:48:WU01:FS00:Uploading 2.46MiB to 155.247.164.213
19:01:48:WU01:FS00:Connecting to 155.247.164.213:8080
19:01:52:WU01:FS00:Upload complete
19:01:52:WU01:FS00:Server responded WORK_QUIT (404)
19:01:52:WARNING:WU01:FS00:Server did not like results, dumping
19:01:52:WU01:FS00:Cleaning up


1st 100ish lines of current log file:
Code: Select all
*********************** Log Started 2020-05-26T10:10:22Z ***********************
10:10:22:Trying to access database...
10:10:22:Successfully acquired database lock
10:10:22:Read GPUs.txt
10:10:23:Enabled folding slot 00: READY cpu:10
10:10:23:Enabled folding slot 01: READY gpu:0:GP102 [GeForce GTX 1080 Ti] 11380
10:10:23:****************************** FAHClient ******************************
10:10:23:        Version: 7.6.13
10:10:23:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:10:23:      Copyright: 2020 foldingathome.org
10:10:23:       Homepage: https://foldingathome.org/
10:10:23:           Date: Apr 27 2020
10:10:23:           Time: 21:21:01
10:10:23:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
10:10:23:         Branch: master
10:10:23:       Compiler: Visual C++ 2008
10:10:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:10:23:       Platform: win32 10
10:10:23:           Bits: 32
10:10:23:           Mode: Release
10:10:23:         Config: E:\Users\micsi\AppData\Roaming\FAHClient\config.xml
10:10:23:******************************** CBang ********************************
10:10:23:           Date: Apr 24 2020
10:10:23:           Time: 17:07:55
10:10:23:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
10:10:23:         Branch: master
10:10:23:       Compiler: Visual C++ 2008
10:10:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:10:23:       Platform: win32 10
10:10:23:           Bits: 32
10:10:23:           Mode: Release
10:10:23:******************************* System ********************************
10:10:23:            CPU: AMD Ryzen 5 1600 Six-Core Processor
10:10:23:         CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
10:10:23:           CPUs: 12
10:10:23:         Memory: 31.96GiB
10:10:23:    Free Memory: 29.57GiB
10:10:23:        Threads: WINDOWS_THREADS
10:10:23:     OS Version: 6.2
10:10:23:    Has Battery: true
10:10:23:     On Battery: false
10:10:23:     UTC Offset: 1
10:10:23:            PID: 11136
10:10:23:            CWD: E:\Users\micsi\AppData\Roaming\FAHClient
10:10:23:  Win32 Service: false
10:10:23:             OS: Windows 10 Home
10:10:23:        OS Arch: AMD64
10:10:23:           GPUs: 1
10:10:23:          GPU 0: Bus:38 Slot:0 Func:0 NVIDIA:8 GP102 [GeForce GTX 1080 Ti] 11380
10:10:23:  CUDA Device 0: Platform:0 Device:0 Bus:38 Slot:0 Compute:6.1 Driver:11.0
10:10:23:OpenCL Device 0: Platform:0 Device:0 Bus:38 Slot:0 Compute:1.2 Driver:445.87
10:10:23:******************************* libFAH ********************************
10:10:23:           Date: Apr 15 2020
10:10:23:           Time: 14:53:14
10:10:23:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
10:10:23:         Branch: master
10:10:23:       Compiler: Visual C++ 2008
10:10:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:10:23:       Platform: win32 10
10:10:23:           Bits: 32
10:10:23:           Mode: Release
10:10:23:***********************************************************************
10:10:23:<config>
10:10:23:  <!-- Network -->
10:10:23:  <proxy v=':8080'/>
10:10:23:
10:10:23:  <!-- Slot Control -->
10:10:23:  <power v='medium'/>
10:10:23:
10:10:23:  <!-- User Information -->
10:10:23:  <passkey v='*****'/>
10:10:23:  <team v='45032'/>
10:10:23:  <user v='NRT_AntiKytherA'/>
10:10:23:
10:10:23:  <!-- Folding Slots -->
10:10:23:  <slot id='0' type='CPU'/>
10:10:23:  <slot id='1' type='GPU'/>
10:10:23:</config>
10:10:24:WU00:FS00:Connecting to assign1.foldingathome.org:80
10:10:24:WU01:FS01:Connecting to assign1.foldingathome.org:80
10:10:25:WU00:FS00:Assigned to work server 40.114.52.201
10:10:25:WU00:FS00:Requesting new work unit for slot 00: READY cpu:10 from 40.114.52.201
10:10:25:WU00:FS00:Connecting to 40.114.52.201:8080
10:10:25:WARNING:WU01:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
10:10:25:WU01:FS01:Connecting to assign2.foldingathome.org:80
10:10:26:WARNING:WU01:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
10:10:26:WU01:FS01:Connecting to assign3.foldingathome.org:80
10:10:26:WU00:FS00:Downloading 2.14MiB
10:10:26:WU00:FS00:Download complete
10:10:26:WARNING:WU01:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
10:10:26:WU01:FS01:Connecting to assign4.foldingathome.org:80
10:10:27:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13851 run:0 clone:36385 gen:126 core:0xa7 unit:0x0000009a287234c95e787ebcc50a4704
10:10:27:WU00:FS00:Starting
10:10:27:WU00:FS00:Running FahCore: "E:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:\Users\micsi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 11136 -checkpoint 15 -np 10
10:10:27:WU00:FS00:Started FahCore on PID 9992
10:10:27:WU00:FS00:Core PID:2324
10:10:27:WU00:FS00:FahCore 0xa7 started
10:10:27:WU00:FS00:0xa7:*********************** Log Started 2020-05-26T10:10:27Z ***********************
10:10:27:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
10:10:27:WU00:FS00:0xa7:       Type: 0xa7
10:10:27:WU00:FS00:0xa7:       Core: Gromacs
10:10:27:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 9992 -checkpoint 15 -np
10:10:27:WU00:FS00:0xa7:             10
10:10:27:WU00:FS00:0xa7:************************************ CBang *************************************
10:10:27:WU00:FS00:0xa7:       Date: Oct 26 2019
10:10:27:WU00:FS00:0xa7:       Time: 01:38:25
10:10:27:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
10:10:27:WU00:FS00:0xa7:     Branch: master
10:10:27:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
10:10:27:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:10:27:WU00:FS00:0xa7:   Platform: win32 10
10:10:27:WU00:FS00:0xa7:       Bits: 64
10:10:27:WU00:FS00:0xa7:       Mode: Release
10:10:27:WU00:FS00:0xa7:************************************ System ************************************
10:10:27:WU00:FS00:0xa7:        CPU: AMD Ryzen 5 1600 Six-Core Processor
10:10:27:WU00:FS00:0xa7:     CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
10:10:27:WU00:FS00:0xa7:       CPUs: 12
10:10:27:WU00:FS00:0xa7:     Memory: 31.96GiB
10:10:27:WU00:FS00:0xa7:Free Memory: 29.30GiB
10:10:27:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
10:10:27:WU00:FS00:0xa7: OS Version: 6.2
10:10:27:WU00:FS00:0xa7:Has Battery: true
10:10:27:WU00:FS00:0xa7: On Battery: false
10:10:27:WU00:FS00:0xa7: UTC Offset: 1
10:10:27:WU00:FS00:0xa7:        PID: 2324
10:10:27:WU00:FS00:0xa7:        CWD: E:\Users\micsi\AppData\Roaming\FAHClient\work
10:10:27:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
10:10:27:WU00:FS00:0xa7:    Version: 0.0.18
10:10:27:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:10:27:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
10:10:27:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
10:10:27:WU00:FS00:0xa7:       Date: Oct 26 2019
10:10:27:WU00:FS00:0xa7:       Time: 01:52:30
10:10:27:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
10:10:27:WU00:FS00:0xa7:     Branch: master
10:10:27:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
10:10:27:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:10:27:WU00:FS00:0xa7:   Platform: win32 10
10:10:27:WU00:FS00:0xa7:       Bits: 64
10:10:27:WU00:FS00:0xa7:       Mode: Release
10:10:27:WU00:FS00:0xa7:************************************ Build *************************************
10:10:27:WU00:FS00:0xa7:       SIMD: avx_256
10:10:27:WU00:FS00:0xa7:********************************************************************************
10:10:27:WU00:FS00:0xa7:Project: 13851 (Run 0, Clone 36385, Gen 126)
10:10:27:WU00:FS00:0xa7:Unit: 0x0000009a287234c95e787ebcc50a4704
10:10:27:WU00:FS00:0xa7:Reading tar file core.xml
10:10:27:WU00:FS00:0xa7:Reading tar file frame126.tpr
10:10:27:WU00:FS00:0xa7:Digital signatures verified
10:10:27:WU00:FS00:0xa7:Calling: mdrun -s frame126.tpr -o frame126.trr -x frame126.xtc -e frame126.edr -cpt 15 -nt 10
10:10:27:WU00:FS00:0xa7:Steps: first=63000000 total=500000
NRT_AntiKytherA
 
Posts: 111
Joined: Mon May 11, 2020 12:50 am

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby Joe_H » Tue May 26, 2020 11:21 pm

Looking up the error code, that is a Windows memory error code, as best as I can tell associated with lack of memory. Was something else running o the system using up RAM? Lack of swap space would also lead to that, or space to write the work and log files.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 6451
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby NRT_AntiKytherA » Tue May 26, 2020 11:45 pm

For the system to run out of RAM there would have to be a massive memory leak, there's 32GB installed. The only errors in Windows Event viewer relate to FAH at times flagged in the fah logs when the crashes happened. As for other running programs, I had a game open but that uses minimal resources. It is an old 32-bit game from the noughties called TrackMania United Forever, it can use a maximum 4GB but doesn't come close to that cap since it is designed to run on very old low powered systems. I have been able to play that and fold with no issues multiple times a week for a couple of hours in the early evenings around that time since I have been folding.

Requirements:
OS : WINDOWS XP SP2/VISTA SP1/WINDOWS 7
CPU: Pentium IV 1.6GHz / AthlonXP 1600+
Memory: 256 MB (512 MB with Vista)
Video Memory: 3D accelerator 16 MB DirectX 9.0c compatible
HDD: 1.5 GB
DirectX: 9.0c

As for space to write logs, neither the system drive nor the data drive where FAH is installed are anywhere near being full. There's 107GB free of the 500GB nvme drive hosting the system and larger more demanding games and 507GB free of the second SSD drive used for other games and user data (FAH inclusive).

The drives are also healthy, no errors reported. Swap is dynamically managed by W10, it's 4864MB apparently
NRT_AntiKytherA
 
Posts: 111
Joined: Mon May 11, 2020 12:50 am

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby PantherX » Wed May 27, 2020 5:43 am

NRT_AntiKytherA wrote:Probably been jinxed given the earlier discussion today with PantherX about numbers of threads. PantherX mentioned some WU don't like 10 cores, maybe this is one of them? Note the system was not shutdown, did not overheat and has been folding fine until this particular CPU work unit this evening. That says to me it's possibly the unit rather than my machine....

If the WU doesn't like the CPU value, it will fail to fold at the start. It will be unable to make any progress. The error would be related to domain decomposition like this:
Code: Select all
00:38:43:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1268 -checkpoint 15 -np 11
00:38:43:WU01:FS00:Started FahCore on PID 113671
00:38:43:WU01:FS00:Core PID:113675
00:38:43:WU01:FS00:FahCore 0xa7 started
00:38:44:WU01:FS00:0xa7:*********************** Log Started 2020-04-26T00:38:43Z ***********************
00:38:44:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
00:38:44:WU01:FS00:0xa7:       Type: 0xa7
00:38:44:WU01:FS00:0xa7:       Core: Gromacs
00:38:44:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 113671 -checkpoint 15 -np
00:38:44:WU01:FS00:0xa7:             11
00:38:44:WU01:FS00:0xa7:************************************ CBang *************************************
00:38:44:WU01:FS00:0xa7:       Date: Nov 5 2019
00:38:44:WU01:FS00:0xa7:       Time: 06:06:57
00:38:44:WU01:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
00:38:44:WU01:FS00:0xa7:     Branch: master
00:38:44:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
00:38:44:WU01:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
00:38:44:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
00:38:44:WU01:FS00:0xa7:       Bits: 64
00:38:44:WU01:FS00:0xa7:       Mode: Release
00:38:44:WU01:FS00:0xa7:************************************ System ************************************
00:38:44:WU01:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz
00:38:44:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
00:38:44:WU01:FS00:0xa7:       CPUs: 12
00:38:44:WU01:FS00:0xa7:     Memory: 46.97GiB
00:38:44:WU01:FS00:0xa7:Free Memory: 1.69GiB
00:38:44:WU01:FS00:0xa7:    Threads: POSIX_THREADS
00:38:44:WU01:FS00:0xa7: OS Version: 5.4
00:38:44:WU01:FS00:0xa7:Has Battery: false
00:38:44:WU01:FS00:0xa7: On Battery: false
00:38:44:WU01:FS00:0xa7: UTC Offset: 10
00:38:44:WU01:FS00:0xa7:        PID: 113675
00:38:44:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
00:38:44:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
00:38:44:WU01:FS00:0xa7:    Version: 0.0.18
00:38:44:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:38:44:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
00:38:44:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
00:38:44:WU01:FS00:0xa7:       Date: Nov 5 2019
00:38:44:WU01:FS00:0xa7:       Time: 06:13:26
00:38:44:WU01:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
00:38:44:WU01:FS00:0xa7:     Branch: master
00:38:44:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
00:38:44:WU01:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
00:38:44:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
00:38:44:WU01:FS00:0xa7:       Bits: 64
00:38:44:WU01:FS00:0xa7:       Mode: Release
00:38:44:WU01:FS00:0xa7:************************************ Build *************************************
00:38:44:WU01:FS00:0xa7:       SIMD: avx_256
00:38:44:WU01:FS00:0xa7:********************************************************************************
00:38:44:WU01:FS00:0xa7:Project: 14524 (Run 982, Clone 0, Gen 14)
00:38:44:WU01:FS00:0xa7:Unit: 0x0000001e80fccb0a5e459b8d0f57e0fa
00:38:44:WU01:FS00:0xa7:Reading tar file core.xml
00:38:44:WU01:FS00:0xa7:Reading tar file frame14.tpr
00:38:44:WU01:FS00:0xa7:Digital signatures verified
00:38:44:WU01:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
00:38:44:WU01:FS00:0xa7:Calling: mdrun -s frame14.tpr -o frame14.trr -x frame14.xtc -cpt 15 -nt 10
00:38:44:WU01:FS00:0xa7:Steps: first=3500000 total=250000
00:38:44:WU01:FS00:0xa7:ERROR:
00:38:44:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
00:38:44:WU01:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
00:38:44:WU01:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
00:38:44:WU01:FS00:0xa7:ERROR:
00:38:44:WU01:FS00:0xa7:ERROR:Fatal error:
00:38:44:WU01:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.4227 nm
00:38:44:WU01:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rcon or -dds or your LINCS settings
00:38:44:WU01:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
00:38:44:WU01:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
00:38:44:WU01:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
00:38:44:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
00:38:49:WU01:FS00:0xa7:WARNING:Unexpected exit() call
00:38:49:WU01:FS00:0xa7:WARNING:Unexpected exit from science code
00:38:49:WU01:FS00:0xa7:Saving result file ../logfile_01.txt
00:38:49:WU01:FS00:0xa7:Saving result file md.log
00:38:49:WU01:FS00:0xa7:Saving result file science.log
00:38:49:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
User avatar
PantherX
Site Moderator
 
Posts: 6345
Joined: Wed Dec 23, 2009 10:33 am
Location: Land Of The Long White Cloud

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby NRT_AntiKytherA » Wed May 27, 2020 8:55 am

Fair enough, if it happens again with another unit I will look into the stability of my system a little further* but the above really does seem to be the exception (pardon the pun) to the rule so far.

*I'm not concerned about a lack of resources or RAM stability but will test the modules for errors if need be. The system components are not overclocked any further than they were by the manufacturers (GPU), they are well within working tolerances too and voltages are correct.
NRT_AntiKytherA
 
Posts: 111
Joined: Mon May 11, 2020 12:50 am

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby Joe_H » Wed May 27, 2020 10:11 pm

One other place to check, the Windows error logs. There might be a report there for the matching time, it may give you some idea what caused the error.
Joe_H
Site Admin
 
Posts: 6451
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby NRT_AntiKytherA » Thu May 28, 2020 9:03 am

I already checked Event Viewer as posted above and there is nothing else reported in any category around that time in Event Viewer. Also there's been no errors since with any WU on either slot so I still feel it was specific to this one data set in-particular actually causing the affected core process to crash, thanks very much for your reading time and input though.
NRT_AntiKytherA
 
Posts: 111
Joined: Mon May 11, 2020 12:50 am

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby bruce » Sun May 31, 2020 4:42 am

You missed the real error.
18:58:47:WU01:FS00:0xa7:ERROR:Guru Meditation #7ebe166835ccf11c.fc2c5bbe67a4697 (10583.11482) '01/01/pullx.xvg'
18:58:47:WU01:FS00:0xa7:WARNING:Unexpected exit() call
18:58:47:WU01:FS00:0xa7:WARNING:Unexpected exit from science code

The other errors 0xc0000409 and 0xc0000005 are Windows just trying to recover from a corrupt checkpoint file -- which is what GURU MEDITATION means. Unfortunately, that's a known bug that nobody is fixing (yet).
bruce
 
Posts: 19701
Joined: Thu Nov 29, 2007 11:13 pm
Location: So. Cal.

Re: 14723 (Run 2539, Clone 2, Gen 20) - Guru Meditation

Postby NRT_AntiKytherA » Sun May 31, 2020 9:03 am

thanks for the info :)
NRT_AntiKytherA
 
Posts: 111
Joined: Mon May 11, 2020 12:50 am


Return to Issues with a specific WU

Who is online

Users browsing this forum: No registered users and 3 guests

cron