bad WU's from server 155.247.166.219

Moderators: Site Moderators, FAHC Science Team

bad WU's from server 155.247.166.219

Postby goodyca » Thu Jan 30, 2020 7:04 pm

For several days I have been receiving bad CPU WU's from the subject server. CPU WU's from other server run without a problem.

I have received two bad WU's from this server so far this morning. The bad WU's are:
Project: 14316 (Run 3, Clone 4, Gen 47)
Project: 14317 (Run 2, Clone 15, Gen 60)

An example log file for a failed WU is:
Code: Select all
17:31:19:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
17:31:19:WU00:FS00:Started FahCore on PID 138678
17:31:19:WU00:FS00:Core PID:138682
17:31:19:WU00:FS00:FahCore 0xa7 started
17:31:20:WU00:FS00:0xa7:*********************** Log Started 2020-01-30T17:31:19Z ***********************
17:31:20:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:31:20:WU00:FS00:0xa7:       Type: 0xa7
17:31:20:WU00:FS00:0xa7:       Core: Gromacs
17:31:20:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 138678 -checkpoint 15 -np
17:31:20:WU00:FS00:0xa7:             11
17:31:20:WU00:FS00:0xa7:************************************ CBang *************************************
17:31:20:WU00:FS00:0xa7:       Date: Nov 5 2019
17:31:20:WU00:FS00:0xa7:       Time: 06:06:57
17:31:20:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
17:31:20:WU00:FS00:0xa7:     Branch: master
17:31:20:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
17:31:20:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
17:31:20:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:31:20:WU00:FS00:0xa7:       Bits: 6417:31:19:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
17:31:19:WU00:FS00:Started FahCore on PID 138678
17:31:19:WU00:FS00:Core PID:138682
17:31:19:WU00:FS00:FahCore 0xa7 started
17:31:20:WU00:FS00:0xa7:*********************** Log Started 2020-01-30T17:31:19Z ***********************
17:31:20:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:31:20:WU00:FS00:0xa7:       Type: 0xa7
17:31:20:WU00:FS00:0xa7:       Core: Gromacs
17:31:20:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 138678 -checkpoint 15 -np
17:31:20:WU00:FS00:0xa7:             11
17:31:20:WU00:FS00:0xa7:************************************ CBang *************************************
17:31:20:WU00:FS00:0xa7:       Date: Nov 5 2019
17:31:20:WU00:FS00:0xa7:       Time: 06:06:57
17:31:20:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
17:31:20:WU00:FS00:0xa7:     Branch: master
17:31:20:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
17:31:20:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
17:31:20:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:31:20:WU00:FS00:0xa7:       Bits: 64
17:31:20:WU00:FS00:0xa7:       Mode: Release
17:31:20:WU00:FS00:0xa7:************************************ System ************************************
17:31:20:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
17:31:20:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
17:31:20:WU00:FS00:0xa7:       CPUs: 12
17:31:20:WU00:FS00:0xa7:     Memory: 7.70GiB
17:31:20:WU00:FS00:0xa7:Free Memory: 1.17GiB
17:31:20:WU00:FS00:0xa7:    Threads: POSIX_THREADS
17:31:20:WU00:FS00:0xa7: OS Version: 5.4
17:31:20:WU00:FS00:0xa7:Has Battery: false
17:31:20:WU00:FS00:0xa7: On Battery: false
17:31:20:WU00:FS00:0xa7: UTC Offset: -6
17:31:20:WU00:FS00:0xa7:        PID: 138682
17:31:20:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
17:31:20:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
17:31:20:WU00:FS00:0xa7:    Version: 0.0.18
17:31:20:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:31:20:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:31:20:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
17:31:20:WU00:FS00:0xa7:       Date: Nov 5 2019
17:31:20:WU00:FS00:0xa7:       Time: 06:13:26
17:31:20:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
17:31:20:WU00:FS00:0xa7:     Branch: master
17:31:20:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
17:31:20:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
17:31:20:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:31:20:WU00:FS00:0xa7:       Bits: 64
17:31:20:WU00:FS00:0xa7:       Mode: Release
17:31:20:WU00:FS00:0xa7:************************************ Build *************************************
17:31:20:WU00:FS00:0xa7:       SIMD: avx_256
17:31:20:WU00:FS00:0xa7:********************************************************************************
17:31:20:WU00:FS00:0xa7:Project: 14316 (Run 3, Clone 4, Gen 47)
17:31:20:WU00:FS00:0xa7:Unit: 0x0000003c0002894b5df7b4f37056dd0d
17:31:20:WU00:FS00:0xa7:Reading tar file core.xml
17:31:20:WU00:FS00:0xa7:Reading tar file frame47.tpr
17:31:20:WU00:FS00:0xa7:Digital signatures verified
17:31:20:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
17:31:20:WU00:FS00:0xa7:Calling: mdrun -s frame47.tpr -o frame47.trr -cpt 15 -nt 10
17:31:20:WU00:FS00:0xa7:Steps: first=23500000 total=500000
17:31:20:WU00:FS00:0xa7:ERROR:
17:31:20:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
17:31:20:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
17:31:20:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
17:31:20:WU00:FS00:0xa7:ERROR:
17:31:20:WU00:FS00:0xa7:ERROR:Fatal error:
17:31:20:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 2.00161 nm
17:31:20:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
17:31:20:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
17:31:20:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
17:31:20:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
17:31:20:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
17:31:24:WU00:FS00:0xa7:WARNING:Unexpected exit() call
17:31:24:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
17:31:24:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
17:31:24:WU00:FS00:0xa7:Saving result file md.log
17:31:24:WU00:FS00:0xa7:Saving result file science.log
17:31:25:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
goodyca
 
Posts: 171
Joined: Sun Dec 02, 2007 1:36 pm

Re: bad WU's from server 155.247.166.219

Postby bruce » Thu Jan 30, 2020 8:28 pm

With a single report from a single client, it's very difficult to distinguish between a WU that somehow has been inherently corrupted and a WU that simply won't run on a single system. We can't tell if the single system is overclocked or somehow defective, and while is possible to diagnose that possibility, the easiest way to proceed is to wait for the WU to be retried on another system. (and that method is automated.)

Your system reported the error of Project: 14317 (Run 2, Clone 15, Gen 60) to the server and it has been reassigned. Now we have to wait for the second system to report whether it, too, finds the WU corrupt or it completes it successfully. That second report has not yet been returned yet.

For some reason, the error from Project: 14316 (Run 3, Clone 4, Gen 47) was not reported to the server (yet). If you somehow blocked that report, that prevents the server from diagnosing WUs that are genuinely corrupt as well as delaying the progress of the completion of that trajectory.
bruce
 
Posts: 19649
Joined: Thu Nov 29, 2007 11:13 pm
Location: So. Cal.

Re: bad WU's from server 155.247.166.219

Postby Joe_H » Thu Jan 30, 2020 8:46 pm

The one possible issue I coud see from the excerpt from your log, the error reported was from the WU failing to be able to decompose to a thread setting of 10. Some projects have issues with multiples of 5, and sometimes individual WU's within projects experience that problem.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 6435
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: bad WU's from server 155.247.166.219

Postby goodyca » Fri Jan 31, 2020 1:49 pm

Here is another one:
Project 14312 (Run 3, Clone 4, Gen 54)
Code: Select all
12:12:26:WU00:FS00:0xa7:     Branch: master
12:12:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:12:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:12:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:12:26:WU00:FS00:0xa7:       Bits: 64
12:12:26:WU00:FS00:0xa7:       Mode: Release
12:12:26:WU00:FS00:0xa7:************************************ Build *************************************
12:12:26:WU00:FS00:0xa7:       SIMD: avx_256
12:12:26:WU00:FS00:0xa7:********************************************************************************
12:12:26:WU00:FS00:0xa7::Project 14312 (Run 3, Clone 4, Gen 54)
12:12:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:12:26:WU00:FS00:0xa7:Reading tar file core.xml
12:12:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:12:26:WU00:FS00:0xa7:Digital signatures verified
12:12:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:12:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:12:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:12:26:WU00:FS00:0xa7:ERROR:
12:12:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:12:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:12:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:12:26:WU00:FS00:0xa7:ERROR:
12:12:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:12:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:12:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:12:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:12:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:12:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:12:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:12:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:12:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:12:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:12:31:WU00:FS00:0xa7:Saving result file md.log
12:12:31:WU00:FS00:0xa7:Saving result file science.log
12:12:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
...
12:18:26:WU00:FS00:Starting
12:18:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-114625.txt'
12:18:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:18:26:WU00:FS00:Started FahCore on PID 288419
12:18:26:WU00:FS00:Core PID:288423
12:18:26:WU00:FS00:FahCore 0xa7 started
12:18:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:18:26Z ***********************
12:18:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:18:26:WU00:FS00:0xa7:       Type: 0xa7
12:18:26:WU00:FS00:0xa7:       Core: Gromacs
12:18:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288419 -checkpoint 15 -np
12:18:26:WU00:FS00:0xa7:             11
12:18:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:18:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:18:26:WU00:FS00:0xa7:       Time: 06:06:57
12:18:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:18:26:WU00:FS00:0xa7:     Branch: master
12:18:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:18:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:18:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:18:26:WU00:FS00:0xa7:       Bits: 64
12:18:26:WU00:FS00:0xa7:       Mode: Release
12:18:26:WU00:FS00:0xa7:************************************ System ************************************
12:18:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:18:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:18:26:WU00:FS00:0xa7:       CPUs: 12
12:18:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:18:26:WU00:FS00:0xa7:Free Memory: 873.91MiB
12:18:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:18:26:WU00:FS00:0xa7: OS Version: 5.4
12:18:26:WU00:FS00:0xa7:Has Battery: false
12:18:26:WU00:FS00:0xa7: On Battery: false
12:18:26:WU00:FS00:0xa7: UTC Offset: -6
12:18:26:WU00:FS00:0xa7:        PID: 288423
12:18:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:18:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:18:26:WU00:FS00:0xa7:    Version: 0.0.18
12:18:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:18:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:18:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:18:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:18:26:WU00:FS00:0xa7:       Time: 06:13:26
12:18:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:18:26:WU00:FS00:0xa7:     Branch: master
12:18:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:18:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:18:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:18:26:WU00:FS00:0xa7:       Bits: 64
12:18:26:WU00:FS00:0xa7:       Mode: Release
12:18:26:WU00:FS00:0xa7:************************************ Build *************************************
12:18:26:WU00:FS00:0xa7:       SIMD: avx_256
12:18:26:WU00:FS00:0xa7:********************************************************************************
12:18:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:18:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:18:26:WU00:FS00:0xa7:Reading tar file core.xml
12:18:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:18:26:WU00:FS00:0xa7:Digital signatures verified
12:18:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:18:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:18:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:18:26:WU00:FS00:0xa7:ERROR:
12:18:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:18:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:18:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:18:26:WU00:FS00:0xa7:ERROR:
12:18:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:18:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:18:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:18:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:18:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:18:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:18:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:18:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:18:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:18:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:18:31:WU00:FS00:0xa7:Saving result file md.log
12:18:31:WU00:FS00:0xa7:Saving result file science.log
12:18:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:19:26:WU00:FS00:Starting
12:19:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-114725.txt'
12:19:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:19:26:WU00:FS00:Started FahCore on PID 288446
12:19:26:WU00:FS00:Core PID:288450
12:19:26:WU00:FS00:FahCore 0xa7 started
12:19:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:19:26Z ***********************
12:19:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:19:26:WU00:FS00:0xa7:       Type: 0xa7
12:19:26:WU00:FS00:0xa7:       Core: Gromacs
12:19:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288446 -checkpoint 15 -np
12:19:26:WU00:FS00:0xa7:             11
12:19:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:19:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:19:26:WU00:FS00:0xa7:       Time: 06:06:57
12:19:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:19:26:WU00:FS00:0xa7:     Branch: master
12:19:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:19:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:19:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:19:26:WU00:FS00:0xa7:       Bits: 64
12:19:26:WU00:FS00:0xa7:       Mode: Release
12:19:26:WU00:FS00:0xa7:************************************ System ************************************
12:19:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:19:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:19:26:WU00:FS00:0xa7:       CPUs: 12
12:19:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:19:26:WU00:FS00:0xa7:Free Memory: 872.06MiB
12:19:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:19:26:WU00:FS00:0xa7: OS Version: 5.4
12:19:26:WU00:FS00:0xa7:Has Battery: false
12:19:26:WU00:FS00:0xa7: On Battery: false
12:19:26:WU00:FS00:0xa7: UTC Offset: -6
12:19:26:WU00:FS00:0xa7:        PID: 288450
12:19:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:19:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:19:26:WU00:FS00:0xa7:    Version: 0.0.18
12:19:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:19:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:19:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:19:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:19:26:WU00:FS00:0xa7:       Time: 06:13:26
12:19:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:19:26:WU00:FS00:0xa7:     Branch: master
12:19:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:19:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:19:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:19:26:WU00:FS00:0xa7:       Bits: 64
12:19:26:WU00:FS00:0xa7:       Mode: Release
12:19:26:WU00:FS00:0xa7:************************************ Build *************************************
12:19:26:WU00:FS00:0xa7:       SIMD: avx_256
12:19:26:WU00:FS00:0xa7:********************************************************************************
12:19:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:19:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:19:26:WU00:FS00:0xa7:Reading tar file core.xml
12:19:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:19:26:WU00:FS00:0xa7:Digital signatures verified
12:19:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:19:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:19:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:19:26:WU00:FS00:0xa7:ERROR:
12:19:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:19:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:19:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:19:26:WU00:FS00:0xa7:ERROR:
12:19:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:19:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:19:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:19:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:19:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:19:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:19:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:19:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:19:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:19:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:19:31:WU00:FS00:0xa7:Saving result file md.log
12:19:31:WU00:FS00:0xa7:Saving result file science.log
12:19:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:20:26:WU00:FS00:Starting
12:20:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-114825.txt'
12:20:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:20:26:WU00:FS00:Started FahCore on PID 288482
12:20:26:WU00:FS00:Core PID:288486
12:20:26:WU00:FS00:FahCore 0xa7 started
12:20:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:20:26Z ***********************
12:20:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:20:26:WU00:FS00:0xa7:       Type: 0xa7
12:20:26:WU00:FS00:0xa7:       Core: Gromacs
12:20:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288482 -checkpoint 15 -np
12:20:26:WU00:FS00:0xa7:             11
12:20:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:20:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:20:26:WU00:FS00:0xa7:       Time: 06:06:57
12:20:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:20:26:WU00:FS00:0xa7:     Branch: master
12:20:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:20:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:20:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:20:26:WU00:FS00:0xa7:       Bits: 64
12:20:26:WU00:FS00:0xa7:       Mode: Release
12:20:26:WU00:FS00:0xa7:************************************ System ************************************
12:20:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:20:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:20:26:WU00:FS00:0xa7:       CPUs: 12
12:20:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:20:26:WU00:FS00:0xa7:Free Memory: 870.62MiB
12:20:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:20:26:WU00:FS00:0xa7: OS Version: 5.4
12:20:26:WU00:FS00:0xa7:Has Battery: false
12:20:26:WU00:FS00:0xa7: On Battery: false
12:20:26:WU00:FS00:0xa7: UTC Offset: -6
12:20:26:WU00:FS00:0xa7:        PID: 288486
12:20:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:20:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:20:26:WU00:FS00:0xa7:    Version: 0.0.18
12:20:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:20:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:20:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:20:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:20:26:WU00:FS00:0xa7:       Time: 06:13:26
12:20:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:20:26:WU00:FS00:0xa7:     Branch: master
12:20:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:20:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:20:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:20:26:WU00:FS00:0xa7:       Bits: 64
12:20:26:WU00:FS00:0xa7:       Mode: Release
12:20:26:WU00:FS00:0xa7:************************************ Build *************************************
12:20:26:WU00:FS00:0xa7:       SIMD: avx_256
12:20:26:WU00:FS00:0xa7:********************************************************************************
12:20:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:20:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:20:26:WU00:FS00:0xa7:Reading tar file core.xml
12:20:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:20:26:WU00:FS00:0xa7:Digital signatures verified
12:20:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:20:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:20:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:20:26:WU00:FS00:0xa7:ERROR:
12:20:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:20:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:20:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:20:26:WU00:FS00:0xa7:ERROR:
12:20:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:20:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:20:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:20:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:20:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:20:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:20:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:20:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:20:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:20:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:20:31:WU00:FS00:0xa7:Saving result file md.log
12:20:31:WU00:FS00:0xa7:Saving result file science.log
12:20:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:21:26:WU00:FS00:Starting
12:21:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-114925.txt'
12:21:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:21:26:WU00:FS00:Started FahCore on PID 288519
12:21:26:WU00:FS00:Core PID:288523
12:21:26:WU00:FS00:FahCore 0xa7 started
12:21:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:21:26Z ***********************
12:21:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:21:26:WU00:FS00:0xa7:       Type: 0xa7
12:21:26:WU00:FS00:0xa7:       Core: Gromacs
12:21:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288519 -checkpoint 15 -np
12:21:26:WU00:FS00:0xa7:             11
12:21:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:21:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:21:26:WU00:FS00:0xa7:       Time: 06:06:57
12:21:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:21:26:WU00:FS00:0xa7:     Branch: master
12:21:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:21:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:21:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:21:26:WU00:FS00:0xa7:       Bits: 64
12:21:26:WU00:FS00:0xa7:       Mode: Release
12:21:26:WU00:FS00:0xa7:************************************ System ************************************
12:21:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:21:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:21:26:WU00:FS00:0xa7:       CPUs: 12
12:21:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:21:26:WU00:FS00:0xa7:Free Memory: 869.91MiB
12:21:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:21:26:WU00:FS00:0xa7: OS Version: 5.4
12:21:26:WU00:FS00:0xa7:Has Battery: false
12:21:26:WU00:FS00:0xa7: On Battery: false
12:21:26:WU00:FS00:0xa7: UTC Offset: -6
12:21:26:WU00:FS00:0xa7:        PID: 288523
12:21:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:21:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:21:26:WU00:FS00:0xa7:    Version: 0.0.18
12:21:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:21:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:21:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:21:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:21:26:WU00:FS00:0xa7:       Time: 06:13:26
12:21:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:21:26:WU00:FS00:0xa7:     Branch: master
12:21:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:21:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:21:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:21:26:WU00:FS00:0xa7:       Bits: 64
12:21:26:WU00:FS00:0xa7:       Mode: Release
12:21:26:WU00:FS00:0xa7:************************************ Build *************************************
12:21:26:WU00:FS00:0xa7:       SIMD: avx_256
12:21:26:WU00:FS00:0xa7:********************************************************************************
12:21:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:21:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:21:26:WU00:FS00:0xa7:Reading tar file core.xml
12:21:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:21:26:WU00:FS00:0xa7:Digital signatures verified
12:21:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:21:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:21:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:21:26:WU00:FS00:0xa7:ERROR:
12:21:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:21:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:21:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:21:26:WU00:FS00:0xa7:ERROR:
12:21:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:21:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:21:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:21:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:21:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:21:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:21:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:21:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:21:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:21:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:21:31:WU00:FS00:0xa7:Saving result file md.log
12:21:31:WU00:FS00:0xa7:Saving result file science.log
12:21:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:22:26:WU00:FS00:Starting
12:22:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-115025.txt'
12:22:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:22:26:WU00:FS00:Started FahCore on PID 288544
12:22:26:WU00:FS00:Core PID:288548
12:22:26:WU00:FS00:FahCore 0xa7 started
12:22:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:22:26Z ***********************
12:22:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:22:26:WU00:FS00:0xa7:       Type: 0xa7
12:22:26:WU00:FS00:0xa7:       Core: Gromacs
12:22:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288544 -checkpoint 15 -np
12:22:26:WU00:FS00:0xa7:             11
12:22:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:22:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:22:26:WU00:FS00:0xa7:       Time: 06:06:57
12:22:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:22:26:WU00:FS00:0xa7:     Branch: master
12:22:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:22:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:22:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:22:26:WU00:FS00:0xa7:       Bits: 64
12:22:26:WU00:FS00:0xa7:       Mode: Release
12:22:26:WU00:FS00:0xa7:************************************ System ************************************
12:22:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:22:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:22:26:WU00:FS00:0xa7:       CPUs: 12
12:22:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:22:26:WU00:FS00:0xa7:Free Memory: 871.27MiB
12:22:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:22:26:WU00:FS00:0xa7: OS Version: 5.4
12:22:26:WU00:FS00:0xa7:Has Battery: false
12:22:26:WU00:FS00:0xa7: On Battery: false
12:22:26:WU00:FS00:0xa7: UTC Offset: -6
12:22:26:WU00:FS00:0xa7:        PID: 288548
12:22:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:22:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:22:26:WU00:FS00:0xa7:    Version: 0.0.18
12:22:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:22:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:22:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:22:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:22:26:WU00:FS00:0xa7:       Time: 06:13:26
12:22:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:22:26:WU00:FS00:0xa7:     Branch: master
12:22:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:22:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:22:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:22:26:WU00:FS00:0xa7:       Bits: 64
12:22:26:WU00:FS00:0xa7:       Mode: Release
12:22:26:WU00:FS00:0xa7:************************************ Build *************************************
12:22:26:WU00:FS00:0xa7:       SIMD: avx_256
12:22:26:WU00:FS00:0xa7:********************************************************************************
12:22:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:22:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:22:26:WU00:FS00:0xa7:Reading tar file core.xml
12:22:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:22:26:WU00:FS00:0xa7:Digital signatures verified
12:22:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:22:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:22:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:22:26:WU00:FS00:0xa7:ERROR:
12:22:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:22:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:22:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:22:26:WU00:FS00:0xa7:ERROR:
12:22:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:22:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:22:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:22:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:22:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:22:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:22:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:22:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:22:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:22:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:22:31:WU00:FS00:0xa7:Saving result file md.log
12:22:31:WU00:FS00:0xa7:Saving result file science.log
12:22:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:23:26:WU00:FS00:Starting
12:23:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-115125.txt'
12:23:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:23:26:WU00:FS00:Started FahCore on PID 288587
12:23:26:WU00:FS00:Core PID:288591
12:23:26:WU00:FS00:FahCore 0xa7 started
12:23:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:23:26Z ***********************
12:23:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:23:26:WU00:FS00:0xa7:       Type: 0xa7
12:23:26:WU00:FS00:0xa7:       Core: Gromacs
12:23:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288587 -checkpoint 15 -np
12:23:26:WU00:FS00:0xa7:             11
12:23:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:23:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:23:26:WU00:FS00:0xa7:       Time: 06:06:57
12:23:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:23:26:WU00:FS00:0xa7:     Branch: master
12:23:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:23:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:23:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:23:26:WU00:FS00:0xa7:       Bits: 64
12:23:26:WU00:FS00:0xa7:       Mode: Release
12:23:26:WU00:FS00:0xa7:************************************ System ************************************
12:23:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:23:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:23:26:WU00:FS00:0xa7:       CPUs: 12
12:23:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:23:26:WU00:FS00:0xa7:Free Memory: 859.56MiB
12:23:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:23:26:WU00:FS00:0xa7: OS Version: 5.4
12:23:26:WU00:FS00:0xa7:Has Battery: false
12:23:26:WU00:FS00:0xa7: On Battery: false
12:23:26:WU00:FS00:0xa7: UTC Offset: -6
12:23:26:WU00:FS00:0xa7:        PID: 288591
12:23:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:23:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:23:26:WU00:FS00:0xa7:    Version: 0.0.18
12:23:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:23:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:23:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:23:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:23:26:WU00:FS00:0xa7:       Time: 06:13:26
12:23:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:23:26:WU00:FS00:0xa7:     Branch: master
12:23:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:23:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:23:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:23:26:WU00:FS00:0xa7:       Bits: 64
12:23:26:WU00:FS00:0xa7:       Mode: Release
12:23:26:WU00:FS00:0xa7:************************************ Build *************************************
12:23:26:WU00:FS00:0xa7:       SIMD: avx_256
12:23:26:WU00:FS00:0xa7:********************************************************************************
12:23:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:23:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:23:26:WU00:FS00:0xa7:Reading tar file core.xml
12:23:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:23:26:WU00:FS00:0xa7:Digital signatures verified
12:23:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:23:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:23:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:23:26:WU00:FS00:0xa7:ERROR:
12:23:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:23:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:23:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:23:26:WU00:FS00:0xa7:ERROR:
12:23:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:23:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:23:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:23:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:23:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:23:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:23:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:23:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:23:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:23:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:23:31:WU00:FS00:0xa7:Saving result file md.log
12:23:31:WU00:FS00:0xa7:Saving result file science.log
12:23:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:24:26:WU00:FS00:Starting
12:24:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-115225.txt'
12:24:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:24:26:WU00:FS00:Started FahCore on PID 288629
12:24:26:WU00:FS00:Core PID:288633
12:24:26:WU00:FS00:FahCore 0xa7 started
12:24:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:24:26Z ***********************
12:24:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:24:26:WU00:FS00:0xa7:       Type: 0xa7
12:24:26:WU00:FS00:0xa7:       Core: Gromacs
12:24:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288629 -checkpoint 15 -np
12:24:26:WU00:FS00:0xa7:             11
12:24:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:24:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:24:26:WU00:FS00:0xa7:       Time: 06:06:57
12:24:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:24:26:WU00:FS00:0xa7:     Branch: master
12:24:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:24:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:24:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:24:26:WU00:FS00:0xa7:       Bits: 64
12:24:26:WU00:FS00:0xa7:       Mode: Release
12:24:26:WU00:FS00:0xa7:************************************ System ************************************
12:24:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:24:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:24:26:WU00:FS00:0xa7:       CPUs: 12
12:24:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:24:26:WU00:FS00:0xa7:Free Memory: 838.66MiB
12:24:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:24:26:WU00:FS00:0xa7: OS Version: 5.4
12:24:26:WU00:FS00:0xa7:Has Battery: false
12:24:26:WU00:FS00:0xa7: On Battery: false
12:24:26:WU00:FS00:0xa7: UTC Offset: -6
12:24:26:WU00:FS00:0xa7:        PID: 288633
12:24:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:24:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:24:26:WU00:FS00:0xa7:    Version: 0.0.18
12:24:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:24:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:24:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:24:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:24:26:WU00:FS00:0xa7:       Time: 06:13:26
12:24:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:24:26:WU00:FS00:0xa7:     Branch: master
12:24:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:24:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:24:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:24:26:WU00:FS00:0xa7:       Bits: 64
12:24:26:WU00:FS00:0xa7:       Mode: Release
12:24:26:WU00:FS00:0xa7:************************************ Build *************************************
12:24:26:WU00:FS00:0xa7:       SIMD: avx_256
12:24:26:WU00:FS00:0xa7:********************************************************************************
12:24:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:24:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:24:26:WU00:FS00:0xa7:Reading tar file core.xml
12:24:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:24:26:WU00:FS00:0xa7:Digital signatures verified
12:24:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:24:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:24:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:24:26:WU00:FS00:0xa7:ERROR:
12:24:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:24:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:24:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:24:26:WU00:FS00:0xa7:ERROR:
12:24:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:24:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:24:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:24:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:24:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:24:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:24:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:24:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:24:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:24:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:24:31:WU00:FS00:0xa7:Saving result file md.log
12:24:31:WU00:FS00:0xa7:Saving result file science.log
12:24:32:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
******************************* Date: 2020-01-31 *******************************
12:25:26:WU00:FS00:Starting
12:25:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-115325.txt'
12:25:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:25:26:WU00:FS00:Started FahCore on PID 288952
12:25:26:WU00:FS00:Core PID:288956
12:25:26:WU00:FS00:FahCore 0xa7 started
12:25:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:25:26Z ***********************
12:25:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:25:26:WU00:FS00:0xa7:       Type: 0xa7
12:25:26:WU00:FS00:0xa7:       Core: Gromacs
12:25:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288952 -checkpoint 15 -np
12:25:26:WU00:FS00:0xa7:             11
12:25:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:25:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:25:26:WU00:FS00:0xa7:       Time: 06:06:57
12:25:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:25:26:WU00:FS00:0xa7:     Branch: master
12:25:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:25:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:25:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:25:26:WU00:FS00:0xa7:       Bits: 64
12:25:26:WU00:FS00:0xa7:       Mode: Release
12:25:26:WU00:FS00:0xa7:************************************ System ************************************
12:25:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:25:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:25:26:WU00:FS00:0xa7:       CPUs: 12
12:25:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:25:26:WU00:FS00:0xa7:Free Memory: 627.32MiB
12:25:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:25:26:WU00:FS00:0xa7: OS Version: 5.4
12:25:26:WU00:FS00:0xa7:Has Battery: false
12:25:26:WU00:FS00:0xa7: On Battery: false
12:25:26:WU00:FS00:0xa7: UTC Offset: -6
12:25:26:WU00:FS00:0xa7:        PID: 288956
12:25:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:25:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:25:26:WU00:FS00:0xa7:    Version: 0.0.18
12:25:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:25:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:25:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:25:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:25:26:WU00:FS00:0xa7:       Time: 06:13:26
12:25:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:25:26:WU00:FS00:0xa7:     Branch: master
12:25:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:25:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:25:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:25:26:WU00:FS00:0xa7:       Bits: 64
12:25:26:WU00:FS00:0xa7:       Mode: Release
12:25:26:WU00:FS00:0xa7:************************************ Build *************************************
12:25:26:WU00:FS00:0xa7:       SIMD: avx_256
12:25:26:WU00:FS00:0xa7:********************************************************************************
12:25:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:25:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:25:26:WU00:FS00:0xa7:Reading tar file core.xml
12:25:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:25:26:WU00:FS00:0xa7:Digital signatures verified
12:25:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:25:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:25:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:25:26:WU00:FS00:0xa7:ERROR:
12:25:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:25:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:25:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:25:26:WU00:FS00:0xa7:ERROR:
12:25:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:25:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:25:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:25:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:25:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:25:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:25:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:25:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:25:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:25:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:25:31:WU00:FS00:0xa7:Saving result file md.log
12:25:31:WU00:FS00:0xa7:Saving result file science.log
12:25:32:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:26:26:WU00:FS00:Starting
12:26:26:WU00:FS00:Removing old file './work/00/logfile_01-20200131-115425.txt'
12:26:26:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:26:26:WU00:FS00:Started FahCore on PID 288982
12:26:26:WU00:FS00:Core PID:288986
12:26:26:WU00:FS00:FahCore 0xa7 started
12:26:26:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:26:26Z ***********************
12:26:26:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:26:26:WU00:FS00:0xa7:       Type: 0xa7
12:26:26:WU00:FS00:0xa7:       Core: Gromacs
12:26:26:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 288982 -checkpoint 15 -np
12:26:26:WU00:FS00:0xa7:             11
12:26:26:WU00:FS00:0xa7:************************************ CBang *************************************
12:26:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:26:26:WU00:FS00:0xa7:       Time: 06:06:57
12:26:26:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:26:26:WU00:FS00:0xa7:     Branch: master
12:26:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:26:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:26:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:26:26:WU00:FS00:0xa7:       Bits: 64
12:26:26:WU00:FS00:0xa7:       Mode: Release
12:26:26:WU00:FS00:0xa7:************************************ System ************************************
12:26:26:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:26:26:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:26:26:WU00:FS00:0xa7:       CPUs: 12
12:26:26:WU00:FS00:0xa7:     Memory: 7.70GiB
12:26:26:WU00:FS00:0xa7:Free Memory: 707.77MiB
12:26:26:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:26:26:WU00:FS00:0xa7: OS Version: 5.4
12:26:26:WU00:FS00:0xa7:Has Battery: false
12:26:26:WU00:FS00:0xa7: On Battery: false
12:26:26:WU00:FS00:0xa7: UTC Offset: -6
12:26:26:WU00:FS00:0xa7:        PID: 288986
12:26:26:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:26:26:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:26:26:WU00:FS00:0xa7:    Version: 0.0.18
12:26:26:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:26:26:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:26:26:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:26:26:WU00:FS00:0xa7:       Date: Nov 5 2019
12:26:26:WU00:FS00:0xa7:       Time: 06:13:26
12:26:26:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:26:26:WU00:FS00:0xa7:     Branch: master
12:26:26:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:26:26:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:26:26:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:26:26:WU00:FS00:0xa7:       Bits: 64
12:26:26:WU00:FS00:0xa7:       Mode: Release
12:26:26:WU00:FS00:0xa7:************************************ Build *************************************
12:26:26:WU00:FS00:0xa7:       SIMD: avx_256
12:26:26:WU00:FS00:0xa7:********************************************************************************
12:26:26:WU00:FS00:0xa7:Project: 14312 (Run 3, Clone 4, Gen 54)
12:26:26:WU00:FS00:0xa7:Unit: 0x0000003f0002894b5df7b52329c1b4cf
12:26:26:WU00:FS00:0xa7:Reading tar file core.xml
12:26:26:WU00:FS00:0xa7:Reading tar file frame54.tpr
12:26:26:WU00:FS00:0xa7:Digital signatures verified
12:26:26:WU00:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
12:26:26:WU00:FS00:0xa7:Calling: mdrun -s frame54.tpr -o frame54.trr -cpt 15 -nt 10
12:26:26:WU00:FS00:0xa7:Steps: first=27000000 total=500000
12:26:26:WU00:FS00:0xa7:ERROR:
12:26:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:26:26:WU00:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
12:26:26:WU00:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
12:26:26:WU00:FS00:0xa7:ERROR:
12:26:26:WU00:FS00:0xa7:ERROR:Fatal error:
12:26:26:WU00:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.72472 nm
12:26:26:WU00:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
12:26:26:WU00:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
12:26:26:WU00:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
12:26:26:WU00:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
12:26:26:WU00:FS00:0xa7:ERROR:-------------------------------------------------------
12:26:31:WU00:FS00:0xa7:WARNING:Unexpected exit() call
12:26:31:WU00:FS00:0xa7:WARNING:Unexpected exit from science code
12:26:31:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:26:31:WU00:FS00:0xa7:Saving result file md.log
12:26:31:WU00:FS00:0xa7:Saving result file science.log
12:26:32:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:26:55:FS00:Paused
12:28:01:FS00:Unpaused
12:28:01:WU00:FS00:Starting
12:28:01:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 1488 -checkpoint 15 -np 11
12:28:01:WU00:FS00:Started FahCore on PID 289016
12:28:01:WU00:FS00:Core PID:289020
12:28:01:WU00:FS00:FahCore 0xa7 started
12:28:02:WU00:FS00:0xa7:*********************** Log Started 2020-01-31T12:28:01Z ***********************
12:28:02:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:28:02:WU00:FS00:0xa7:       Type: 0xa7
12:28:02:WU00:FS00:0xa7:       Core: Gromacs
12:28:02:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 289016 -checkpoint 15 -np
12:28:02:WU00:FS00:0xa7:             11
12:28:02:WU00:FS00:0xa7:************************************ CBang *************************************
12:28:02:WU00:FS00:0xa7:       Date: Nov 5 2019
12:28:02:WU00:FS00:0xa7:       Time: 06:06:57
12:28:02:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:28:02:WU00:FS00:0xa7:     Branch: master
12:28:02:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:28:02:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:28:02:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:28:02:WU00:FS00:0xa7:       Bits: 64
12:28:02:WU00:FS00:0xa7:       Mode: Release
12:28:02:WU00:FS00:0xa7:************************************ System ************************************
12:28:02:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
12:28:02:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
12:28:02:WU00:FS00:0xa7:       CPUs: 12
12:28:02:WU00:FS00:0xa7:     Memory: 7.70GiB
12:28:02:WU00:FS00:0xa7:Free Memory: 712.67MiB
12:28:02:WU00:FS00:0xa7:    Threads: POSIX_THREADS
12:28:02:WU00:FS00:0xa7: OS Version: 5.4
12:28:02:WU00:FS00:0xa7:Has Battery: false
12:28:02:WU00:FS00:0xa7: On Battery: false
12:28:02:WU00:FS00:0xa7: UTC Offset: -6
12:28:02:WU00:FS00:0xa7:        PID: 289020
12:28:02:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:28:02:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
12:28:02:WU00:FS00:0xa7:    Version: 0.0.18
12:28:02:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:28:02:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:28:02:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
12:28:02:WU00:FS00:0xa7:       Date: Nov 5 2019
12:28:02:WU00:FS00:0xa7:       Time: 06:13:26
12:28:02:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:28:02:WU00:FS00:0xa7:     Branch: master
12:28:02:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
12:28:02:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:28:02:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:28:02:WU00:FS00:0xa7:       Bits: 64
12:28:02:WU00:FS00:0xa7:       Mode: Release
12:28:02:WU00:FS00:0xa7:************************************ Build *************************************
12:28:02:WU00:FS00:0xa7:       SIMD: avx_256
12:28:02:WU00:FS00:0xa7:********************************************************************************
12:28:02:WU00:FS00:0xa7:ERROR:Failed to open '../wudata_01.dat': Failed to open '../wudata_01.dat': No such file or directory: iostream error: No such file or directory
12:28:02:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
12:28:02:WU00:FS00:0xa7:Folding@home Core Shutdown: BAD_WORK_UNIT
12:28:02:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
12:28:02:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:14312 run:3 clone:4 gen:54 core:0xa7 unit:0x0000003f0002894b5df7b52329c1b4cf
12:28:02:WU00:FS00:Uploading 4.00KiB to 155.247.166.219
12:28:02:WU00:FS00:Connecting to 155.247.166.219:8080
12:28:02:WU00:FS00:Upload complete
12:28:03:WU00:FS00:Server responded WORK_QUIT (404)
12:28:03:WARNING:WU00:FS00:Server did not like results, dumping
12:28:03:WU00:FS00:Cleaning up
goodyca
 
Posts: 171
Joined: Sun Dec 02, 2007 1:36 pm

Re: bad WU's from server 155.247.166.219

Postby goodyca » Fri Jan 31, 2020 2:14 pm

bruce wrote:For some reason, the error from Project: 14316 (Run 3, Clone 4, Gen 47) was not reported to the server (yet). If you somehow blocked that report, that prevents the server from diagnosing WUs that are genuinely corrupt as well as delaying the progress of the completion of that trajectory.

The upload of the failed WU was not blocked.
goodyca
 
Posts: 171
Joined: Sun Dec 02, 2007 1:36 pm

Re: bad WU's from server 155.247.166.219

Postby goodyca » Sat Feb 01, 2020 4:01 pm

Here is another WU from the subject server that is bad. It was downloaded this morning.

Project: 14318 (Run 1, Clone 4, Gen 27)
Code: Select all
14:43:33:WU02:FS00:Starting
14:43:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:43:33:WU02:FS00:Started FahCore on PID 138096
14:43:33:WU02:FS00:Core PID:138100
14:43:33:WU02:FS00:FahCore 0xa7 started
14:43:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:43:33Z ***********************
14:43:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:43:33:WU02:FS00:0xa7:       Type: 0xa7
14:43:33:WU02:FS00:0xa7:       Core: Gromacs
14:43:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138096 -checkpoint 15 -np
14:43:33:WU02:FS00:0xa7:             11
14:43:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:43:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:43:33:WU02:FS00:0xa7:       Time: 06:06:57
14:43:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:43:33:WU02:FS00:0xa7:     Branch: master
14:43:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:43:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:43:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:43:33:WU02:FS00:0xa7:       Bits: 64
14:43:33:WU02:FS00:0xa7:       Mode: Release
14:43:33:WU02:FS00:0xa7:************************************ System ************************************
14:43:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:43:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:43:33:WU02:FS00:0xa7:       CPUs: 12
14:43:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:43:33:WU02:FS00:0xa7:Free Memory: 1.16GiB
14:43:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:43:33:WU02:FS00:0xa7: OS Version: 5.4
14:43:33:WU02:FS00:0xa7:Has Battery: false
14:43:33:WU02:FS00:0xa7: On Battery: false
14:43:33:WU02:FS00:0xa7: UTC Offset: -6
14:43:33:WU02:FS00:0xa7:        PID: 138100
14:43:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:43:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:43:33:WU02:FS00:0xa7:    Version: 0.0.18
14:43:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:43:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:43:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:43:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:43:33:WU02:FS00:0xa7:       Time: 06:13:26
14:43:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:43:33:WU02:FS00:0xa7:     Branch: master
14:43:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:43:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:43:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:43:33:WU02:FS00:0xa7:       Bits: 64
14:43:33:WU02:FS00:0xa7:       Mode: Release
14:43:33:WU02:FS00:0xa7:************************************ Build *************************************
14:43:33:WU02:FS00:0xa7:       SIMD: avx_256
14:43:33:WU02:FS00:0xa7:********************************************************************************
14:43:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:43:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:43:33:WU02:FS00:0xa7:Reading tar file core.xml
14:43:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:43:33:WU02:FS00:0xa7:Digital signatures verified
14:43:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:43:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:43:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:43:33:WU02:FS00:0xa7:ERROR:
14:43:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:43:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:43:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:43:33:WU02:FS00:0xa7:ERROR:
14:43:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:43:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:43:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:43:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:43:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:43:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:43:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:43:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:43:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:43:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:43:38:WU02:FS00:0xa7:Saving result file md.log
14:43:38:WU02:FS00:0xa7:Saving result file science.log
14:43:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:44:33:WU02:FS00:Starting
14:44:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:44:33:WU02:FS00:Started FahCore on PID 138121
14:44:33:WU02:FS00:Core PID:138125
14:44:33:WU02:FS00:FahCore 0xa7 started
14:44:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:44:33Z ***********************
14:44:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:44:33:WU02:FS00:0xa7:       Type: 0xa7
14:44:33:WU02:FS00:0xa7:       Core: Gromacs
14:44:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138121 -checkpoint 15 -np
14:44:33:WU02:FS00:0xa7:             11
14:44:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:44:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:44:33:WU02:FS00:0xa7:       Time: 06:06:57
14:44:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:44:33:WU02:FS00:0xa7:     Branch: master
14:44:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:44:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:44:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:44:33:WU02:FS00:0xa7:       Bits: 64
14:44:33:WU02:FS00:0xa7:       Mode: Release
14:44:33:WU02:FS00:0xa7:************************************ System ************************************
14:44:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:44:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:44:33:WU02:FS00:0xa7:       CPUs: 12
14:44:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:44:33:WU02:FS00:0xa7:Free Memory: 1.16GiB
14:44:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:44:33:WU02:FS00:0xa7: OS Version: 5.4
14:44:33:WU02:FS00:0xa7:Has Battery: false
14:44:33:WU02:FS00:0xa7: On Battery: false
14:44:33:WU02:FS00:0xa7: UTC Offset: -6
14:44:33:WU02:FS00:0xa7:        PID: 138125
14:44:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:44:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:44:33:WU02:FS00:0xa7:    Version: 0.0.18
14:44:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:44:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:44:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:44:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:44:33:WU02:FS00:0xa7:       Time: 06:13:26
14:44:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:44:33:WU02:FS00:0xa7:     Branch: master
14:44:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:44:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:44:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:44:33:WU02:FS00:0xa7:       Bits: 64
14:44:33:WU02:FS00:0xa7:       Mode: Release
14:44:33:WU02:FS00:0xa7:************************************ Build *************************************
14:44:33:WU02:FS00:0xa7:       SIMD: avx_256
14:44:33:WU02:FS00:0xa7:********************************************************************************
14:44:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:44:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:44:33:WU02:FS00:0xa7:Reading tar file core.xml
14:44:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:44:33:WU02:FS00:0xa7:Digital signatures verified
14:44:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:44:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:44:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:44:33:WU02:FS00:0xa7:ERROR:
14:44:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:44:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:44:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:44:33:WU02:FS00:0xa7:ERROR:
14:44:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:44:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:44:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:44:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:44:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:44:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:44:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:44:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:44:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:44:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:44:38:WU02:FS00:0xa7:Saving result file md.log
14:44:38:WU02:FS00:0xa7:Saving result file science.log
14:44:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:45:33:WU02:FS00:Starting
14:45:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:45:33:WU02:FS00:Started FahCore on PID 138147
14:45:33:WU02:FS00:Core PID:138151
14:45:33:WU02:FS00:FahCore 0xa7 started
14:45:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:45:33Z ***********************
14:45:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:45:33:WU02:FS00:0xa7:       Type: 0xa7
14:45:33:WU02:FS00:0xa7:       Core: Gromacs
14:45:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138147 -checkpoint 15 -np
14:45:33:WU02:FS00:0xa7:             11
14:45:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:45:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:45:33:WU02:FS00:0xa7:       Time: 06:06:57
14:45:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:45:33:WU02:FS00:0xa7:     Branch: master
14:45:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:45:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:45:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:45:33:WU02:FS00:0xa7:       Bits: 64
14:45:33:WU02:FS00:0xa7:       Mode: Release
14:45:33:WU02:FS00:0xa7:************************************ System ************************************
14:45:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:45:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:45:33:WU02:FS00:0xa7:       CPUs: 12
14:45:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:45:33:WU02:FS00:0xa7:Free Memory: 1.16GiB
14:45:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:45:33:WU02:FS00:0xa7: OS Version: 5.4
14:45:33:WU02:FS00:0xa7:Has Battery: false
14:45:33:WU02:FS00:0xa7: On Battery: false
14:45:33:WU02:FS00:0xa7: UTC Offset: -6
14:45:33:WU02:FS00:0xa7:        PID: 138151
14:45:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:45:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:45:33:WU02:FS00:0xa7:    Version: 0.0.18
14:45:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:45:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:45:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:45:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:45:33:WU02:FS00:0xa7:       Time: 06:13:26
14:45:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:45:33:WU02:FS00:0xa7:     Branch: master
14:45:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:45:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:45:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:45:33:WU02:FS00:0xa7:       Bits: 64
14:45:33:WU02:FS00:0xa7:       Mode: Release
14:45:33:WU02:FS00:0xa7:************************************ Build *************************************
14:45:33:WU02:FS00:0xa7:       SIMD: avx_256
14:45:33:WU02:FS00:0xa7:********************************************************************************
14:45:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:45:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:45:33:WU02:FS00:0xa7:Reading tar file core.xml
14:45:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:45:33:WU02:FS00:0xa7:Digital signatures verified
14:45:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:45:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:45:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:45:33:WU02:FS00:0xa7:ERROR:
14:45:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:45:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:45:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:45:33:WU02:FS00:0xa7:ERROR:
14:45:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:45:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:45:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:45:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:45:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:45:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:45:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:45:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:45:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:45:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:45:38:WU02:FS00:0xa7:Saving result file md.log
14:45:38:WU02:FS00:0xa7:Saving result file science.log
14:45:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:46:33:WU02:FS00:Starting
14:46:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:46:33:WU02:FS00:Started FahCore on PID 138173
14:46:33:WU02:FS00:Core PID:138177
14:46:33:WU02:FS00:FahCore 0xa7 started
14:46:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:46:33Z ***********************
14:46:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:46:33:WU02:FS00:0xa7:       Type: 0xa7
14:46:33:WU02:FS00:0xa7:       Core: Gromacs
14:46:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138173 -checkpoint 15 -np
14:46:33:WU02:FS00:0xa7:             11
14:46:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:46:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:46:33:WU02:FS00:0xa7:       Time: 06:06:57
14:46:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:46:33:WU02:FS00:0xa7:     Branch: master
14:46:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:46:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:46:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:46:33:WU02:FS00:0xa7:       Bits: 64
14:46:33:WU02:FS00:0xa7:       Mode: Release
14:46:33:WU02:FS00:0xa7:************************************ System ************************************
14:46:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:46:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:46:33:WU02:FS00:0xa7:       CPUs: 12
14:46:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:46:33:WU02:FS00:0xa7:Free Memory: 1.16GiB
14:46:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:46:33:WU02:FS00:0xa7: OS Version: 5.4
14:46:33:WU02:FS00:0xa7:Has Battery: false
14:46:33:WU02:FS00:0xa7: On Battery: false
14:46:33:WU02:FS00:0xa7: UTC Offset: -6
14:46:33:WU02:FS00:0xa7:        PID: 138177
14:46:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:46:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:46:33:WU02:FS00:0xa7:    Version: 0.0.18
14:46:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:46:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:46:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:46:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:46:33:WU02:FS00:0xa7:       Time: 06:13:26
14:46:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:46:33:WU02:FS00:0xa7:     Branch: master
14:46:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:46:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:46:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:46:33:WU02:FS00:0xa7:       Bits: 64
14:46:33:WU02:FS00:0xa7:       Mode: Release
14:46:33:WU02:FS00:0xa7:************************************ Build *************************************
14:46:33:WU02:FS00:0xa7:       SIMD: avx_256
14:46:33:WU02:FS00:0xa7:********************************************************************************
14:46:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:46:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:46:33:WU02:FS00:0xa7:Reading tar file core.xml
14:46:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:46:33:WU02:FS00:0xa7:Digital signatures verified
14:46:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:46:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:46:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:46:33:WU02:FS00:0xa7:ERROR:
14:46:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:46:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:46:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:46:33:WU02:FS00:0xa7:ERROR:
14:46:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:46:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:46:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:46:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:46:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:46:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:46:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:46:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:46:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:46:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:46:38:WU02:FS00:0xa7:Saving result file md.log
14:46:38:WU02:FS00:0xa7:Saving result file science.log
14:46:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:47:33:WU02:FS00:Starting
14:47:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:47:33:WU02:FS00:Started FahCore on PID 138199
14:47:33:WU02:FS00:Core PID:138203
14:47:33:WU02:FS00:FahCore 0xa7 started
14:47:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:47:33Z ***********************
14:47:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:47:33:WU02:FS00:0xa7:       Type: 0xa7
14:47:33:WU02:FS00:0xa7:       Core: Gromacs
14:47:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138199 -checkpoint 15 -np
14:47:33:WU02:FS00:0xa7:             11
14:47:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:47:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:47:33:WU02:FS00:0xa7:       Time: 06:06:57
14:47:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:47:33:WU02:FS00:0xa7:     Branch: master
14:47:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:47:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:47:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:47:33:WU02:FS00:0xa7:       Bits: 64
14:47:33:WU02:FS00:0xa7:       Mode: Release
14:47:33:WU02:FS00:0xa7:************************************ System ************************************
14:47:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:47:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:47:33:WU02:FS00:0xa7:       CPUs: 12
14:47:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:47:33:WU02:FS00:0xa7:Free Memory: 1.16GiB
14:47:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:47:33:WU02:FS00:0xa7: OS Version: 5.4
14:47:33:WU02:FS00:0xa7:Has Battery: false
14:47:33:WU02:FS00:0xa7: On Battery: false
14:47:33:WU02:FS00:0xa7: UTC Offset: -6
14:47:33:WU02:FS00:0xa7:        PID: 138203
14:47:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:47:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:47:33:WU02:FS00:0xa7:    Version: 0.0.18
14:47:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:47:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:47:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:47:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:47:33:WU02:FS00:0xa7:       Time: 06:13:26
14:47:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:47:33:WU02:FS00:0xa7:     Branch: master
14:47:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:47:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:47:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:47:33:WU02:FS00:0xa7:       Bits: 64
14:47:33:WU02:FS00:0xa7:       Mode: Release
14:47:33:WU02:FS00:0xa7:************************************ Build *************************************
14:47:33:WU02:FS00:0xa7:       SIMD: avx_256
14:47:33:WU02:FS00:0xa7:********************************************************************************
14:47:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:47:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:47:33:WU02:FS00:0xa7:Reading tar file core.xml
14:47:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:47:33:WU02:FS00:0xa7:Digital signatures verified
14:47:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:47:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:47:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:47:33:WU02:FS00:0xa7:ERROR:
14:47:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:47:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:47:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:47:33:WU02:FS00:0xa7:ERROR:
14:47:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:47:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:47:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:47:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:47:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:47:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:47:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:47:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:47:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:47:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:47:38:WU02:FS00:0xa7:Saving result file md.log
14:47:38:WU02:FS00:0xa7:Saving result file science.log
14:47:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:48:33:WU02:FS00:Starting
14:48:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:48:33:WU02:FS00:Started FahCore on PID 138224
14:48:33:WU02:FS00:Core PID:138228
14:48:33:WU02:FS00:FahCore 0xa7 started
14:48:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:48:33Z ***********************
14:48:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:48:33:WU02:FS00:0xa7:       Type: 0xa7
14:48:33:WU02:FS00:0xa7:       Core: Gromacs
14:48:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138224 -checkpoint 15 -np
14:48:33:WU02:FS00:0xa7:             11
14:48:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:48:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:48:33:WU02:FS00:0xa7:       Time: 06:06:57
14:48:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:48:33:WU02:FS00:0xa7:     Branch: master
14:48:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:48:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:48:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:48:33:WU02:FS00:0xa7:       Bits: 64
14:48:33:WU02:FS00:0xa7:       Mode: Release
14:48:33:WU02:FS00:0xa7:************************************ System ************************************
14:48:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:48:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:48:33:WU02:FS00:0xa7:       CPUs: 12
14:48:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:48:33:WU02:FS00:0xa7:Free Memory: 1.17GiB
14:48:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:48:33:WU02:FS00:0xa7: OS Version: 5.4
14:48:33:WU02:FS00:0xa7:Has Battery: false
14:48:33:WU02:FS00:0xa7: On Battery: false
14:48:33:WU02:FS00:0xa7: UTC Offset: -6
14:48:33:WU02:FS00:0xa7:        PID: 138228
14:48:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:48:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:48:33:WU02:FS00:0xa7:    Version: 0.0.18
14:48:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:48:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:48:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:48:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:48:33:WU02:FS00:0xa7:       Time: 06:13:26
14:48:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:48:33:WU02:FS00:0xa7:     Branch: master
14:48:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:48:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:48:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:48:33:WU02:FS00:0xa7:       Bits: 64
14:48:33:WU02:FS00:0xa7:       Mode: Release
14:48:33:WU02:FS00:0xa7:************************************ Build *************************************
14:48:33:WU02:FS00:0xa7:       SIMD: avx_256
14:48:33:WU02:FS00:0xa7:********************************************************************************
14:48:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:48:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:48:33:WU02:FS00:0xa7:Reading tar file core.xml
14:48:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:48:33:WU02:FS00:0xa7:Digital signatures verified
14:48:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:48:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:48:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:48:33:WU02:FS00:0xa7:ERROR:
14:48:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:48:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:48:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:48:33:WU02:FS00:0xa7:ERROR:
14:48:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:48:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:48:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:48:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:48:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:48:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:48:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:48:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:48:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:48:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:48:38:WU02:FS00:0xa7:Saving result file md.log
14:48:38:WU02:FS00:0xa7:Saving result file science.log
14:48:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:49:33:WU02:FS00:Starting
14:49:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:49:33:WU02:FS00:Started FahCore on PID 138251
14:49:33:WU02:FS00:Core PID:138255
14:49:33:WU02:FS00:FahCore 0xa7 started
14:49:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:49:33Z ***********************
14:49:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:49:33:WU02:FS00:0xa7:       Type: 0xa7
14:49:33:WU02:FS00:0xa7:       Core: Gromacs
14:49:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138251 -checkpoint 15 -np
14:49:33:WU02:FS00:0xa7:             11
14:49:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:49:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:49:33:WU02:FS00:0xa7:       Time: 06:06:57
14:49:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:49:33:WU02:FS00:0xa7:     Branch: master
14:49:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:49:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:49:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:49:33:WU02:FS00:0xa7:       Bits: 64
14:49:33:WU02:FS00:0xa7:       Mode: Release
14:49:33:WU02:FS00:0xa7:************************************ System ************************************
14:49:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:49:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:49:33:WU02:FS00:0xa7:       CPUs: 12
14:49:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:49:33:WU02:FS00:0xa7:Free Memory: 1.17GiB
14:49:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:49:33:WU02:FS00:0xa7: OS Version: 5.4
14:49:33:WU02:FS00:0xa7:Has Battery: false
14:49:33:WU02:FS00:0xa7: On Battery: false
14:49:33:WU02:FS00:0xa7: UTC Offset: -6
14:49:33:WU02:FS00:0xa7:        PID: 138255
14:49:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:49:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:49:33:WU02:FS00:0xa7:    Version: 0.0.18
14:49:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:49:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:49:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:49:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:49:33:WU02:FS00:0xa7:       Time: 06:13:26
14:49:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:49:33:WU02:FS00:0xa7:     Branch: master
14:49:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:49:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:49:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:49:33:WU02:FS00:0xa7:       Bits: 64
14:49:33:WU02:FS00:0xa7:       Mode: Release
14:49:33:WU02:FS00:0xa7:************************************ Build *************************************
14:49:33:WU02:FS00:0xa7:       SIMD: avx_256
14:49:33:WU02:FS00:0xa7:********************************************************************************
14:49:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:49:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:49:33:WU02:FS00:0xa7:Reading tar file core.xml
14:49:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:49:33:WU02:FS00:0xa7:Digital signatures verified
14:49:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:49:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:49:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:49:33:WU02:FS00:0xa7:ERROR:
14:49:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:49:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:49:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:49:33:WU02:FS00:0xa7:ERROR:
14:49:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:49:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:49:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:49:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:49:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:49:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:49:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:49:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:49:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:49:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:49:38:WU02:FS00:0xa7:Saving result file md.log
14:49:38:WU02:FS00:0xa7:Saving result file science.log
14:49:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:50:33:WU02:FS00:Starting
14:50:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:50:33:WU02:FS00:Started FahCore on PID 138386
14:50:33:WU02:FS00:Core PID:138390
14:50:33:WU02:FS00:FahCore 0xa7 started
14:50:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:50:33Z ***********************
14:50:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:50:33:WU02:FS00:0xa7:       Type: 0xa7
14:50:33:WU02:FS00:0xa7:       Core: Gromacs
14:50:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138386 -checkpoint 15 -np
14:50:33:WU02:FS00:0xa7:             11
14:50:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:50:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:50:33:WU02:FS00:0xa7:       Time: 06:06:57
14:50:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:50:33:WU02:FS00:0xa7:     Branch: master
14:50:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:50:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:50:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:50:33:WU02:FS00:0xa7:       Bits: 64
14:50:33:WU02:FS00:0xa7:       Mode: Release
14:50:33:WU02:FS00:0xa7:************************************ System ************************************
14:50:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:50:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:50:33:WU02:FS00:0xa7:       CPUs: 12
14:50:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:50:33:WU02:FS00:0xa7:Free Memory: 1.15GiB
14:50:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:50:33:WU02:FS00:0xa7: OS Version: 5.4
14:50:33:WU02:FS00:0xa7:Has Battery: false
14:50:33:WU02:FS00:0xa7: On Battery: false
14:50:33:WU02:FS00:0xa7: UTC Offset: -6
14:50:33:WU02:FS00:0xa7:        PID: 138390
14:50:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:50:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:50:33:WU02:FS00:0xa7:    Version: 0.0.18
14:50:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:50:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:50:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:50:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:50:33:WU02:FS00:0xa7:       Time: 06:13:26
14:50:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:50:33:WU02:FS00:0xa7:     Branch: master
14:50:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:50:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:50:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:50:33:WU02:FS00:0xa7:       Bits: 64
14:50:33:WU02:FS00:0xa7:       Mode: Release
14:50:33:WU02:FS00:0xa7:************************************ Build *************************************
14:50:33:WU02:FS00:0xa7:       SIMD: avx_256
14:50:33:WU02:FS00:0xa7:********************************************************************************
14:50:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:50:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:50:33:WU02:FS00:0xa7:Reading tar file core.xml
14:50:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:50:33:WU02:FS00:0xa7:Digital signatures verified
14:50:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:50:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:50:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:50:33:WU02:FS00:0xa7:ERROR:
14:50:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:50:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:50:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:50:33:WU02:FS00:0xa7:ERROR:
14:50:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:50:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:50:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:50:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:50:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:50:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:50:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:50:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:50:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:50:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:50:38:WU02:FS00:0xa7:Saving result file md.log
14:50:38:WU02:FS00:0xa7:Saving result file science.log
14:50:39:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:51:33:WU02:FS00:Starting
14:51:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:51:33:WU02:FS00:Started FahCore on PID 138419
14:51:33:WU02:FS00:Core PID:138423
14:51:33:WU02:FS00:FahCore 0xa7 started
14:51:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:51:33Z ***********************
14:51:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:51:33:WU02:FS00:0xa7:       Type: 0xa7
14:51:33:WU02:FS00:0xa7:       Core: Gromacs
14:51:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138419 -checkpoint 15 -np
14:51:33:WU02:FS00:0xa7:             11
14:51:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:51:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:51:33:WU02:FS00:0xa7:       Time: 06:06:57
14:51:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:51:33:WU02:FS00:0xa7:     Branch: master
14:51:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:51:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:51:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:51:33:WU02:FS00:0xa7:       Bits: 64
14:51:33:WU02:FS00:0xa7:       Mode: Release
14:51:33:WU02:FS00:0xa7:************************************ System ************************************
14:51:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:51:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:51:33:WU02:FS00:0xa7:       CPUs: 12
14:51:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:51:33:WU02:FS00:0xa7:Free Memory: 1.15GiB
14:51:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:51:33:WU02:FS00:0xa7: OS Version: 5.4
14:51:33:WU02:FS00:0xa7:Has Battery: false
14:51:33:WU02:FS00:0xa7: On Battery: false
14:51:33:WU02:FS00:0xa7: UTC Offset: -6
14:51:33:WU02:FS00:0xa7:        PID: 138423
14:51:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:51:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:51:33:WU02:FS00:0xa7:    Version: 0.0.18
14:51:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:51:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:51:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:51:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:51:33:WU02:FS00:0xa7:       Time: 06:13:26
14:51:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:51:33:WU02:FS00:0xa7:     Branch: master
14:51:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:51:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:51:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:51:33:WU02:FS00:0xa7:       Bits: 64
14:51:33:WU02:FS00:0xa7:       Mode: Release
14:51:33:WU02:FS00:0xa7:************************************ Build *************************************
14:51:33:WU02:FS00:0xa7:       SIMD: avx_256
14:51:33:WU02:FS00:0xa7:********************************************************************************
14:51:33:WU02:FS00:0xa7:Project: 14318 (Run 1, Clone 4, Gen 27)
14:51:33:WU02:FS00:0xa7:Unit: 0x000000220002894b5df7b4e4c16e55e9
14:51:33:WU02:FS00:0xa7:Reading tar file core.xml
14:51:33:WU02:FS00:0xa7:Reading tar file frame27.tpr
14:51:33:WU02:FS00:0xa7:Digital signatures verified
14:51:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:51:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10
14:51:33:WU02:FS00:0xa7:Steps: first=13500000 total=500000
14:51:33:WU02:FS00:0xa7:ERROR:
14:51:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:51:33:WU02:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
14:51:33:WU02:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/domdec.c, line: 6902
14:51:33:WU02:FS00:0xa7:ERROR:
14:51:33:WU02:FS00:0xa7:ERROR:Fatal error:
14:51:33:WU02:FS00:0xa7:ERROR:There is no domain decomposition for 10 ranks that is compatible with the given box and a minimum cell size of 1.61833 nm
14:51:33:WU02:FS00:0xa7:ERROR:Change the number of ranks or mdrun option -rdd or -dds
14:51:33:WU02:FS00:0xa7:ERROR:Look in the log file for details on the domain decomposition
14:51:33:WU02:FS00:0xa7:ERROR:For more information and tips for troubleshooting, please check the GROMACS
14:51:33:WU02:FS00:0xa7:ERROR:website at http://www.gromacs.org/Documentation/Errors
14:51:33:WU02:FS00:0xa7:ERROR:-------------------------------------------------------
14:51:38:WU02:FS00:0xa7:WARNING:Unexpected exit() call
14:51:38:WU02:FS00:0xa7:WARNING:Unexpected exit from science code
14:51:38:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:51:38:WU02:FS00:0xa7:Saving result file md.log
14:51:38:WU02:FS00:0xa7:Saving result file science.log
14:51:38:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:52:33:WU02:FS00:Starting
14:52:33:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/avx/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 1483 -checkpoint 15 -np 11
14:52:33:WU02:FS00:Started FahCore on PID 138447
14:52:33:WU02:FS00:Core PID:138451
14:52:33:WU02:FS00:FahCore 0xa7 started
14:52:33:WU02:FS00:0xa7:*********************** Log Started 2020-02-01T14:52:33Z ***********************
14:52:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:52:33:WU02:FS00:0xa7:       Type: 0xa7
14:52:33:WU02:FS00:0xa7:       Core: Gromacs
14:52:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 138447 -checkpoint 15 -np
14:52:33:WU02:FS00:0xa7:             11
14:52:33:WU02:FS00:0xa7:************************************ CBang *************************************
14:52:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:52:33:WU02:FS00:0xa7:       Time: 06:06:57
14:52:33:WU02:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:52:33:WU02:FS00:0xa7:     Branch: master
14:52:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:52:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:52:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:52:33:WU02:FS00:0xa7:       Bits: 64
14:52:33:WU02:FS00:0xa7:       Mode: Release
14:52:33:WU02:FS00:0xa7:************************************ System ************************************
14:52:33:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
14:52:33:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
14:52:33:WU02:FS00:0xa7:       CPUs: 12
14:52:33:WU02:FS00:0xa7:     Memory: 7.70GiB
14:52:33:WU02:FS00:0xa7:Free Memory: 1.15GiB
14:52:33:WU02:FS00:0xa7:    Threads: POSIX_THREADS
14:52:33:WU02:FS00:0xa7: OS Version: 5.4
14:52:33:WU02:FS00:0xa7:Has Battery: false
14:52:33:WU02:FS00:0xa7: On Battery: false
14:52:33:WU02:FS00:0xa7: UTC Offset: -6
14:52:33:WU02:FS00:0xa7:        PID: 138451
14:52:33:WU02:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:52:33:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:52:33:WU02:FS00:0xa7:    Version: 0.0.18
14:52:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:52:33:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:52:33:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:52:33:WU02:FS00:0xa7:       Date: Nov 5 2019
14:52:33:WU02:FS00:0xa7:       Time: 06:13:26
14:52:33:WU02:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:52:33:WU02:FS00:0xa7:     Branch: master
14:52:33:WU02:FS00:0xa7:   Compiler: GNU 8.3.0
14:52:33:WU02:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:52:33:WU02:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:52:33:WU02:FS00:0xa7:       Bits: 64
14:52:33:WU02:FS00:0xa7:       Mode: Release
14:52:33:WU02:FS00:0xa7:************************************ Build *************************************
14:52:33:WU02:FS00:0xa7:       SIMD: avx_256
14:52:33:WU02:FS00:0xa7:********************************************************************************
14:52:33:WU02:FS00:0xa7:ERROR:Failed to open '../wudata_01.dat': Failed to open '../wudata_01.dat': No such file or directory: iostream error: No such file or directory
14:52:33:WU02:FS00:0xa7:Saving result file ../logfile_01.txt
14:52:33:WU02:FS00:0xa7:Folding@home Core Shutdown: BAD_WORK_UNIT
14:52:34:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
14:52:34:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:14318 run:1 clone:4 gen:27 core:0xa7 unit:0x000000220002894b5df7b4e4c16e55e9
14:52:34:WU02:FS00:Uploading 4.00KiB to 155.247.166.219
14:52:34:WU02:FS00:Connecting to 155.247.166.219:8080
14:52:34:WU02:FS00:Upload complete
14:52:34:WU02:FS00:Server responded WORK_QUIT (404)
14:52:34:WARNING:WU02:FS00:Server did not like results, dumping
14:52:34:WU02:FS00:Cleaning up
goodyca
 
Posts: 171
Joined: Sun Dec 02, 2007 1:36 pm

Re: bad WU's from server 155.247.166.219

Postby JimboPalmer » Sat Feb 01, 2020 4:28 pm

As I read your logs, you are trying to use 11 CPU threads. (You may have a 12 core CPU and one Graphics Card, F@H reserves one CPU per Graphics Card)

14:43:33:WU02:FS00:0xa7: Args: -dir 02 -suffix 01 -version 705 -lifeline 138096 -checkpoint 15 -np 11

F@H is bad at 'large' prime numbers and their multiples. 11 is Prime, and 'large'. (5 is sometimes large, every Prime larger is always large)

14:43:33:WU02:FS00:0xa7:Reducing thread count from 11 to 10 to avoid domain decomposition by a prime number > 3
14:43:33:WU02:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpt 15 -nt 10

The client is downshifting to 10 CPU Threads as it knows 11 is hopeless. But 5 is sometimes 'large' and sometimes not. If you set CPUs to 9, you may have less errors, as 3 is never 'large'.

Just my 2 cents. (2 is also never 'large')
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
JimboPalmer
 
Posts: 1954
Joined: Mon Feb 16, 2009 5:12 am
Location: Greenwood MS USA

Re: bad WU's from server 155.247.166.219

Postby bruce » Sun Feb 02, 2020 12:50 am

JimboPalmer wrote:(2 is also never 'large')

Like most Always/Never statemes there may be exceptions.

The domain is always factored into 3 factors, one for each of X Y and Z. 12 is a good example: 3*2*2 (all very small) but what about 16 which is 4*2*2. There may be borderline cases where 2 and 3 are not large, but the factor 4 might become"large" in rare cases and there's no opportunity to split 4 into 2*2. When we call them "large prime" factors, I think it would be more accurate to simply drop the word "prime"

If 5 is a borderline case ... rather rare ... then failures with 4 will be even rarer, but still possible.
bruce
 
Posts: 19649
Joined: Thu Nov 29, 2007 11:13 pm
Location: So. Cal.

Re: bad WU's from server 155.247.166.219

Postby goodyca » Sun Feb 02, 2020 7:16 pm

I received another WU from the subject server that would not fold this morning. I changed the CPU count to 9 and the WU ran successfully.
goodyca
 
Posts: 171
Joined: Sun Dec 02, 2007 1:36 pm

Re: bad WU's from server 155.247.166.219

Postby JimboPalmer » Sun Feb 02, 2020 7:35 pm

Thank you for reporting back! it is nice to hear that our theories have some practical basis.
JimboPalmer
 
Posts: 1954
Joined: Mon Feb 16, 2009 5:12 am
Location: Greenwood MS USA


Return to Issues with a specific server

Who is online

Users browsing this forum: No registered users and 7 guests

cron