FAH Core A7 Stopped Runing on CentOS

Moderators: Site Moderators, FAHC Science Team

wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

FAH Core A7 Stopped Runing on CentOS

Post by wdanwatts »

Mod edit: split from old, unrelated topic -j

It looks like my Centos system has stopped running the a7 core. What is up?
JimboPalmer
Posts: 2573
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: FAH won't run, "Waiting for core update"

Post by JimboPalmer »

If you start a new thread and include the first 100 lines of you log where it describes your setup and a log where it is having issues, we could make informed guesses.

viewtopic.php?f=24&t=26036
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: FAH won't run, "Waiting for core update"

Post by bruce »

Most likely there's a security setting preventing FAHClient from downloading the core ... but it's only a guess until you provide enough data for us to diagnose the problem.
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH won't run, "Waiting for core update"

Post by wdanwatts »

Thanks. I'll try.

Code: Select all

*********************** Log Started 2019-03-01T08:37:39Z ***********************
08:37:39:************************* Folding@home Client *************************
08:37:39:    Website: https://foldingathome.org/
08:37:39:  Copyright: (c) 2009-2018 foldingathome.org
08:37:39:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:37:39:       Args: --child --lifeline 5214 /etc/fahclient/config.xml --run-as
08:37:39:             fahclient --pid-file=/var/run/fahclient.pid --daemon
08:37:39:     Config: /etc/fahclient/config.xml
08:37:39:******************************** Build ********************************
08:37:39:    Version: 7.5.1
08:37:39:       Date: May 12 2018
08:37:39:       Time: 22:51:07
08:37:39: Repository: Git
08:37:39:   Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
08:37:39:     Branch: master
08:37:39:   Compiler: GNU 4.4.7 20120313 (Red Hat 4.4.7-18)
08:37:39:    Options: -std=gnu++98 -O3 -funroll-loops
08:37:39:   Platform: linux2 4.14.0-3-amd64
08:37:39:       Bits: 64
08:37:39:       Mode: Release
08:37:39:******************************* System ********************************
08:37:39:        CPU: Intel(R) Core(TM) i5-4310U CPU @ 2.00GHz
08:37:39:     CPU ID: GenuineIntel Family 6 Model 69 Stepping 1
08:37:39:       CPUs: 4
08:37:39:     Memory: 15.42GiB
08:37:39:Free Memory: 14.87GiB
08:37:39:    Threads: POSIX_THREADS
08:37:39: OS Version: 3.10
08:37:39:Has Battery: true
08:37:39: On Battery: false
08:37:39: UTC Offset: -6
08:37:39:        PID: 5219
08:37:39:        CWD: /var/lib/fahclient
08:37:39:         OS: Linux 3.10.0-957.5.1.el7.x86_64 x86_64
08:37:39:    OS Arch: AMD64
08:37:39:       GPUs: 0
08:37:39:       CUDA: Not detected: Failed to open dynamic library 'libcuda.so':
08:37:39:             libcuda.so: cannot open shared object file: No such file or
08:37:39:             directory
08:37:39:***********************************************************************
08:37:39:<config>
08:37:39:  <!-- Client Control -->
08:37:39:  <client-threads v='6'/>
08:37:39:  <cycle-rate v='4'/>
08:37:39:  <cycles v='-1'/>
08:37:39:  <data-directory v='.'/>
08:37:39:  <disable-sleep-when-active v='true'/>
08:37:39:  <exec-directory v='/usr/bin'/>
08:37:39:  <exit-when-done v='false'/>
08:37:39:  <fold-anon v='false'/>
08:37:39:  <idle-seconds v='300'/>
08:37:39:  <open-web-control v='false'/>
08:37:39:
08:37:39:  <!-- Configuration -->
08:37:39:  <config-rotate v='true'/>
08:37:39:  <config-rotate-dir v='configs'/>
08:37:39:  <config-rotate-max v='16'/>
08:37:39:
08:37:39:  <!-- Debugging -->
08:37:39:  <assignment-servers>
08:37:39:    assign1.foldingathome.org:8080 assign2.foldingathome.org:80
08:37:39:  </assignment-servers>
08:37:39:  <auth-as v='true'/>
08:37:39:  <capture-directory v='capture'/>
08:37:39:  <capture-on-error v='false'/>
08:37:39:  <capture-packets v='false'/>
08:37:39:  <capture-requests v='false'/>
08:37:39:  <capture-responses v='false'/>
08:37:39:  <capture-sockets v='false'/>
08:37:39:  <core-exec v='FahCore_$type'/>
08:37:39:  <core-wrapper-exec v='FAHCoreWrapper'/>
08:37:39:  <debug-sockets v='false'/>
08:37:39:  <exception-locations v='true'/>
08:37:39:  <stack-traces v='false'/>
08:37:39:
08:37:39:  <!-- Error Handling -->
08:37:39:  <max-slot-errors v='10'/>
08:37:39:  <max-unit-errors v='5'/>
08:37:39:
08:37:39:  <!-- Folding Core -->
08:37:39:  <checkpoint v='15'/>
08:37:39:  <core-dir v='cores'/>
08:37:39:  <core-priority v='idle'/>
08:37:39:  <cpu-affinity v='false'/>
08:37:39:  <cpu-usage v='100'/>
08:37:39:  <gpu-usage v='100'/>
08:37:39:  <no-assembly v='false'/>
08:37:39:
08:37:39:  <!-- Folding Slot Configuration -->
08:37:39:  <cause v='ANY'/>
08:37:39:  <client-subtype v='LINUX'/>
08:37:39:  <client-type v='normal'/>
08:37:39:  <cpu-species v='X86_PENTIUM_II'/>
08:37:39:  <cpu-type v='AMD64'/>
08:37:39:  <cpus v='-1'/>
08:37:39:  <disable-viz v='false'/>
08:37:39:  <gpu v='false'/>
08:37:39:  <max-packet-size v='normal'/>
08:37:39:  <os-species v='UNKNOWN'/>
08:37:39:  <os-type v='LINUX'/>
08:37:39:  <project-key v='0'/>
08:37:39:  <smp v='true'/>
08:37:39:
08:37:39:  <!-- GUI -->
08:37:39:  <gui-enabled v='true'/>
08:37:39:
08:37:39:  <!-- HTTP Server -->
08:37:39:  <allow v='127.0.0.1'/>
08:37:39:  <connection-timeout v='60'/>
08:37:39:  <deny v='0/0'/>
08:37:39:  <http-addresses v='0:7396'/>
08:37:39:  <https-addresses v=''/>
08:37:39:  <max-connect-time v='900'/>
08:37:39:  <max-connections v='800'/>
08:37:39:  <max-request-length v='52428800'/>
08:37:39:  <min-connect-time v='300'/>
08:37:39:
08:37:39:  <!-- Logging -->
08:37:39:  <log v='log.txt'/>
08:37:39:  <log-color v='true'/>
08:37:39:  <log-crlf v='false'/>
08:37:39:  <log-date v='false'/>
08:37:39:  <log-date-periodically v='21600'/>
08:37:39:  <log-domain v='false'/>
08:37:39:  <log-header v='true'/>
08:37:39:  <log-level v='true'/>
08:37:39:  <log-no-info-header v='true'/>
08:37:39:  <log-redirect v='false'/>
08:37:39:  <log-rotate v='true'/>
08:37:39:  <log-rotate-dir v='logs'/>
08:37:39:  <log-rotate-max v='16'/>
08:37:39:  <log-short-level v='false'/>
08:37:39:  <log-simple-domains v='true'/>
08:37:39:  <log-thread-id v='false'/>
08:37:39:  <log-thread-prefix v='true'/>
08:37:39:  <log-time v='true'/>
08:37:39:  <log-to-screen v='true'/>
08:37:39:  <log-truncate v='false'/>
08:37:39:  <verbosity v='5'/>
08:37:39:
08:37:39:  <!-- Network -->
08:37:39:  <proxy v=':8080'/>
08:37:39:  <proxy-enable v='false'/>
08:37:39:  <proxy-pass v=''/>
08:37:39:  <proxy-user v=''/>
08:37:39:
08:37:39:  <!-- Process Control -->
08:37:39:  <child v='true'/>
08:37:39:  <daemon v='true'/>
08:37:39:  <fork v='false'/>
08:37:39:  <pid v='false'/>
08:37:39:  <pid-file v='/var/run/fahclient.pid'/>
08:37:39:  <respawn v='false'/>
08:37:39:  <service v='false'/>
08:37:39:
08:37:39:  <!-- Remote Command Server -->
08:37:39:  <command-address v='0.0.0.0'/>
08:37:39:  <command-allow-no-pass v='127.0.0.1'/>
08:37:39:  <command-deny-no-pass v='0/0'/>
08:37:39:  <command-enable v='true'/>
08:37:39:  <command-port v='36330'/>
08:37:39:
08:37:39:  <!-- Slot Control -->
08:37:39:  <idle v='false'/>
08:37:39:  <max-shutdown-wait v='60'/>
08:37:39:  <pause-on-battery v='true'/>
08:37:39:  <pause-on-start v='false'/>
08:37:39:  <paused v='false'/>
08:37:39:  <power v='full'/>
08:37:39:
08:37:39:  <!-- User Information -->
08:37:39:  <machine-id v='0'/>
08:37:39:  <passkey v='********************************'/>
08:37:39:  <team v='59478'/>
08:37:39:  <user v='wdw'/>
08:37:39:
08:37:39:  <!-- Web Server -->
08:37:39:  <web-allow v='127.0.0.1'/>
08:37:39:  <web-deny v='0/0'/>
08:37:39:  <web-enable v='true'/>
08:37:39:
08:37:39:  <!-- Web Server Sessions -->
08:37:39:  <session-cookie v='sid'/>
08:37:39:  <session-lifetime v='86400'/>
08:37:39:  <session-timeout v='3600'/>
08:37:39:
08:37:39:  <!-- Work Unit Control -->
08:37:39:  <dump-after-deadline v='true'/>
08:37:39:  <max-queue v='16'/>
08:37:39:  <max-units v='0'/>
08:37:39:  <next-unit-percentage v='99'/>
08:37:39:  <stall-detection-enabled v='false'/>
08:37:39:  <stall-percent v='5'/>
08:37:39:  <stall-timeout v='1800'/>
08:37:39:
08:37:39:  <!-- Folding Slots -->
08:37:39:  <slot id='0' type='CPU'/>
08:37:39:  <slot id='1' type='CPU'/>
08:37:39:  <slot id='2' type='CPU'/>
08:37:39:  <slot id='3' type='CPU'/>
08:37:39:</config>
08:37:39:Switching to user fahclient
08:37:39:Started thread 1 on PID 5219
08:37:39:Trying to access database...
08:37:39:Successfully acquired database lock
08:37:39:Enabled folding slot 00: READY cpu:1
08:37:39:Enabled folding slot 01: READY cpu:1
08:37:39:Enabled folding slot 02: READY cpu:1
08:37:39:Enabled folding slot 03: READY cpu:1
08:37:39:Started thread 5 on PID 5219
08:37:39:WU01:FS00:Downloading core from http://cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah
08:37:39:WU01:FS00:Connecting to cores.foldingathome.org:80
08:37:39:ERROR:WU01:FS00:Exception: Could not get IP address for cores.foldingathome.org: Name or service not known
08:37:39:WU03:FS03:Starting
08:37:39:WU03:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 03 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:37:39:WU03:FS03:Started FahCore on PID 5239
08:37:39:Started thread 7 on PID 5219
08:37:39:Started thread 6 on PID 5219
08:37:39:Started thread 10 on PID 5219
08:37:39:Started thread 8 on PID 5219
08:37:39:Started thread 11 on PID 5219
08:37:39:Started thread 9 on PID 5219
08:37:39:WU03:FS03:Core PID:5266
08:37:39:WU03:FS03:FahCore 0xa4 started
08:37:40:WU03:FS03:0xa4:
08:37:40:WU03:FS03:0xa4:*------------------------------*
08:37:40:WU03:FS03:0xa4:Folding@Home Gromacs GB Core
08:37:40:WU03:FS03:0xa4:Version 2.27 (Dec. 15, 2010)
08:37:40:WU03:FS03:0xa4:
08:37:40:WU03:FS03:0xa4:Preparing to commence simulation
08:37:40:WU03:FS03:0xa4:- Looking at optimizations...
08:37:40:WU03:FS03:0xa4:- Files status OK
08:37:40:WU03:FS03:0xa4:- Expanded 825118 -> 1398040 (decompressed 169.4 percent)
08:37:40:WU03:FS03:0xa4:Called DecompressByteArray: compressed_data_size=825118 data_size=1398040, decompressed_data_size=1398040 diff=0
08:37:40:WU03:FS03:0xa4:- Digital signature verified
08:37:40:WU03:FS03:0xa4:
08:37:40:WU03:FS03:0xa4:Project: 9039 (Run 22, Clone 2, Gen 723)
08:37:40:WU03:FS03:0xa4:
08:37:40:WU03:FS03:0xa4:Assembly optimizations on if available.
08:37:40:WU03:FS03:0xa4:Entering M.D.
08:37:46:WU03:FS03:0xa4:Using Gromacs checkpoints
08:37:46:WU03:FS03:0xa4:Resuming from checkpoint
08:37:46:WU03:FS03:0xa4:Verified 03/wudata_01.log
08:37:46:WU03:FS03:0xa4:Verified 03/wudata_01.trr
08:37:46:WU03:FS03:0xa4:Verified 03/wudata_01.xtc
08:37:46:WU03:FS03:0xa4:Verified 03/wudata_01.edr
08:37:47:WU03:FS03:0xa4:Completed 196740 out of 250000 steps  (78%)
08:38:01:Started thread 12 on PID 5219
08:38:39:WU01:FS00:Downloading core from http://cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah
08:38:39:WU01:FS00:Connecting to cores.foldingathome.org:80
08:38:39:WU01:FS00:FahCore a7: Downloading 8.71MiB
08:38:41:WU01:FS00:FahCore a7: Download complete
08:38:41:WU01:FS00:Valid core signature
08:38:41:WU01:FS00:Unpacked 20.19MiB to cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7
08:38:41:WU01:FS00:Starting
08:38:41:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:41:WU01:FS00:Started FahCore on PID 16739
08:38:41:Started thread 13 on PID 5219
08:38:41:WU01:FS00:Core PID:16743
08:38:41:WU01:FS00:FahCore 0xa7 started
08:38:41:WU04:FS02:Starting
08:38:41:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:41:WU04:FS02:Started FahCore on PID 16744
08:38:41:Started thread 14 on PID 5219
08:38:41:WU04:FS02:Core PID:16748
08:38:41:WU04:FS02:FahCore 0xa7 started
08:38:41:WU00:FS01:Starting
08:38:41:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:41:WU00:FS01:Started FahCore on PID 16749
08:38:41:Started thread 15 on PID 5219
08:38:41:WU00:FS01:Core PID:16753
08:38:41:WU00:FS01:FahCore 0xa7 started
08:38:42:WARNING:WU01:FS00:FahCore returned: FAILED_2 (1 = 0x1)
08:38:42:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:38:42:WARNING:WU04:FS02:Too many errors, failing
08:38:42:WU04:FS02:Sending unit results: id:04 state:SEND error:FAILED project:13814 run:0 clone:897 gen:267 core:0xa7 unit:0x0000015180fccb025ae08fa731737243
08:38:42:WU01:FS00:Starting
08:38:42:WU04:FS02:Connecting to 128.252.203.2:8080
08:38:42:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:42:WU01:FS00:Started FahCore on PID 16754
08:38:42:Started thread 16 on PID 5219
08:38:42:WU01:FS00:Core PID:16758
08:38:42:WU01:FS00:FahCore 0xa7 started
08:38:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:38:42:WU00:FS01:Starting
08:38:42:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:42:WU00:FS01:Started FahCore on PID 16759
08:38:42:Started thread 17 on PID 5219
08:38:42:WU00:FS01:Core PID:16763
08:38:42:WU00:FS01:FahCore 0xa7 started
08:38:42:WU04:FS02:Server responded WORK_ACK (400)
08:38:42:WU02:FS02:Connecting to 65.254.110.245:8080
08:38:42:WU04:FS02:Cleaning up
08:38:42:WARNING:WU01:FS00:FahCore returned: FAILED_2 (1 = 0x1)
08:38:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:38:43:WU02:FS02:Assigned to work server 155.247.166.219
08:38:43:WU02:FS02:Requesting new work unit for slot 02: READY cpu:1 from 155.247.166.219
08:38:43:WU02:FS02:Connecting to 155.247.166.219:8080
08:38:45:WU02:FS02:Downloading 2.52MiB
08:38:47:WU02:FS02:Download complete
08:38:47:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14096 run:19 clone:9 gen:32 core:0xa7 unit:0x000000320002894b5b7da5b2c70bd857
08:38:47:WU02:FS02:Starting
08:38:47:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:47:WU02:FS02:Started FahCore on PID 16765
08:38:47:Started thread 18 on PID 5219
08:38:47:WU02:FS02:Core PID:16769
08:38:47:WU02:FS02:FahCore 0xa7 started
08:38:48:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:38:48:WU02:FS02:Starting
08:38:48:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:38:48:WU02:FS02:Started FahCore on PID 16770
08:38:48:Started thread 19 on PID 5219
08:38:48:WU02:FS02:Core PID:16774
08:38:48:WU02:FS02:FahCore 0xa7 started
08:38:48:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:39:42:WU01:FS00:Starting
08:39:42:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:39:42:WU01:FS00:Started FahCore on PID 16778
08:39:42:Started thread 20 on PID 5219
08:39:42:WU01:FS00:Core PID:16782
08:39:42:WU01:FS00:FahCore 0xa7 started
08:39:42:WU00:FS01:Starting
08:39:42:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:39:42:WU00:FS01:Started FahCore on PID 16783
08:39:42:Started thread 21 on PID 5219
08:39:42:WU00:FS01:Core PID:16787
08:39:42:WU00:FS01:FahCore 0xa7 started
08:39:42:WARNING:WU01:FS00:FahCore returned: FAILED_2 (1 = 0x1)
08:39:42:WARNING:WU01:FS00:Too many errors, failing
08:39:42:WU01:FS00:Sending unit results: id:01 state:SEND error:FAILED project:13814 run:0 clone:128 gen:206 core:0xa7 unit:0x0000011680fccb025ae08fe75769c397
08:39:42:WU01:FS00:Connecting to 128.252.203.2:8080
08:39:42:WU01:FS00:Server responded WORK_ACK (400)
08:39:42:WU01:FS00:Cleaning up
08:39:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:39:43:WU01:FS00:Connecting to 65.254.110.245:8080
08:39:43:WU01:FS00:Assigned to work server 171.67.108.158
08:39:43:WU01:FS00:Requesting new work unit for slot 00: READY cpu:1 from 171.67.108.158
08:39:43:WU01:FS00:Connecting to 171.67.108.158:8080
08:39:44:WU01:FS00:Downloading 807.17KiB
08:39:45:WU01:FS00:Download complete
08:39:45:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9037 run:786 clone:0 gen:822 core:0xa4 unit:0x000003a3ab436c9e56982aa7a3b3015e
08:39:45:WU01:FS00:Starting
08:39:45:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:39:45:WU01:FS00:Started FahCore on PID 16821
08:39:45:Started thread 22 on PID 5219
08:39:45:WU01:FS00:Core PID:16825
08:39:45:WU01:FS00:FahCore 0xa4 started
08:39:45:WU01:FS00:0xa4:
08:39:45:WU01:FS00:0xa4:*------------------------------*
08:39:45:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
08:39:45:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
08:39:45:WU01:FS00:0xa4:
08:39:45:WU01:FS00:0xa4:Preparing to commence simulation
08:39:45:WU01:FS00:0xa4:- Looking at optimizations...
08:39:45:WU01:FS00:0xa4:- Created dyn
08:39:45:WU01:FS00:0xa4:- Files status OK
08:39:45:WU01:FS00:0xa4:- Expanded 826025 -> 1403472 (decompressed 169.9 percent)
08:39:45:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826025 data_size=1403472, decompressed_data_size=1403472 diff=0
08:39:45:WU01:FS00:0xa4:- Digital signature verified
08:39:45:WU01:FS00:0xa4:
08:39:45:WU01:FS00:0xa4:Project: 9037 (Run 786, Clone 0, Gen 822)
08:39:45:WU01:FS00:0xa4:
08:39:45:WU01:FS00:0xa4:Assembly optimizations on if available.
08:39:45:WU01:FS00:0xa4:Entering M.D.
08:39:48:WU02:FS02:Starting
08:39:48:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:39:48:WU02:FS02:Started FahCore on PID 16829
08:39:48:Started thread 23 on PID 5219
08:39:48:WU02:FS02:Core PID:16833
08:39:48:WU02:FS02:FahCore 0xa7 started
08:39:48:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:39:52:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
08:39:57:WU03:FS03:0xa4:Completed 197500 out of 250000 steps  (79%)
08:40:42:WU00:FS01:Starting
08:40:42:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:40:42:WU00:FS01:Started FahCore on PID 16861
08:40:42:Started thread 24 on PID 5219
08:40:42:WU00:FS01:Core PID:16865
08:40:42:WU00:FS01:FahCore 0xa7 started
08:40:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:40:48:WU02:FS02:Starting
08:40:48:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:40:48:WU02:FS02:Started FahCore on PID 16866
08:40:48:Started thread 25 on PID 5219
08:40:48:WU02:FS02:Core PID:16870
08:40:48:WU02:FS02:FahCore 0xa7 started
08:40:48:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:41:42:WU00:FS01:Starting
08:41:42:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:42:WU00:FS01:Started FahCore on PID 16872
08:41:42:Started thread 26 on PID 5219
08:41:42:WU00:FS01:Core PID:16876
08:41:42:WU00:FS01:FahCore 0xa7 started
08:41:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:41:42:WARNING:WU00:FS01:Too many errors, failing
08:41:43:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:14153 run:15 clone:313 gen:10 core:0xa7 unit:0x0000000e0002894b5c6e8ef4e71ee4c3
08:41:43:WU00:FS01:Connecting to 155.247.166.219:8080
08:41:43:WU00:FS01:Server responded WORK_ACK (400)
08:41:43:WU00:FS01:Cleaning up
08:41:43:WU00:FS01:Connecting to 65.254.110.245:8080
08:41:43:WU00:FS01:Assigned to work server 155.247.166.219
08:41:43:WU00:FS01:Requesting new work unit for slot 01: READY cpu:1 from 155.247.166.219
08:41:43:WU00:FS01:Connecting to 155.247.166.219:8080
08:41:45:WU00:FS01:Downloading 1.45MiB
08:41:48:WU00:FS01:Download complete
08:41:48:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14137 run:6 clone:101 gen:32 core:0xa7 unit:0x000000280002894b5c00476407d59845
08:41:48:WU00:FS01:Starting
08:41:48:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:48:WU00:FS01:Started FahCore on PID 16877
08:41:48:Started thread 27 on PID 5219
08:41:48:WU00:FS01:Core PID:16881
08:41:48:WU00:FS01:FahCore 0xa7 started
08:41:48:WU02:FS02:Starting
08:41:48:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:48:WU02:FS02:Started FahCore on PID 16882
08:41:48:Started thread 28 on PID 5219
08:41:48:WU02:FS02:Core PID:16886
08:41:48:WU02:FS02:FahCore 0xa7 started
08:41:49:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:41:49:WARNING:WU02:FS02:Too many errors, failing
08:41:49:WU02:FS02:Sending unit results: id:02 state:SEND error:FAILED project:14096 run:19 clone:9 gen:32 core:0xa7 unit:0x000000320002894b5b7da5b2c70bd857
08:41:49:WU02:FS02:Connecting to 155.247.166.219:8080
08:41:49:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:41:49:WU00:FS01:Starting
08:41:49:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:49:WU00:FS01:Started FahCore on PID 16887
08:41:49:Started thread 29 on PID 5219
08:41:49:WU00:FS01:Core PID:16891
08:41:49:WU00:FS01:FahCore 0xa7 started
08:41:49:WU04:FS02:Connecting to 65.254.110.245:8080
08:41:49:WU02:FS02:Server responded WORK_ACK (400)
08:41:49:WU02:FS02:Cleaning up
08:41:49:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:41:50:WU04:FS02:Assigned to work server 128.252.203.2
08:41:50:WU04:FS02:Requesting new work unit for slot 02: READY cpu:1 from 128.252.203.2
08:41:50:WU04:FS02:Connecting to 128.252.203.2:8080
08:41:50:WU04:FS02:Downloading 4.55MiB
08:41:52:WU04:FS02:Download complete
08:41:52:WU04:FS02:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13814 run:0 clone:675 gen:235 core:0xa7 unit:0x0000012d80fccb025ae08fb902ee23e8
08:41:52:WU04:FS02:Starting
08:41:52:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:52:WU04:FS02:Started FahCore on PID 16892
08:41:52:Started thread 30 on PID 5219
08:41:52:WU04:FS02:Core PID:16896
08:41:52:WU04:FS02:FahCore 0xa7 started
08:41:53:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:41:53:WU04:FS02:Starting
08:41:53:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:41:53:WU04:FS02:Started FahCore on PID 16897
08:41:53:Started thread 31 on PID 5219
08:41:53:WU04:FS02:Core PID:16901
08:41:53:WU04:FS02:FahCore 0xa7 started
08:41:53:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:42:49:WU00:FS01:Starting
08:42:49:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:42:49:WU00:FS01:Started FahCore on PID 16903
08:42:49:Started thread 32 on PID 5219
08:42:49:WU00:FS01:Core PID:16907
08:42:49:WU00:FS01:FahCore 0xa7 started
08:42:50:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:42:53:WU04:FS02:Starting
08:42:53:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:42:53:WU04:FS02:Started FahCore on PID 16908
08:42:53:Started thread 33 on PID 5219
08:42:53:WU04:FS02:Core PID:16912
08:42:53:WU04:FS02:FahCore 0xa7 started
08:42:54:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:43:49:WU00:FS01:Starting
08:43:49:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:43:49:WU00:FS01:Started FahCore on PID 16946
08:43:49:Started thread 34 on PID 5219
08:43:49:WU00:FS01:Core PID:16950
08:43:49:WU00:FS01:FahCore 0xa7 started
08:43:50:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:43:53:WU04:FS02:Starting
08:43:53:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:43:53:WU04:FS02:Started FahCore on PID 16951
08:43:53:Started thread 35 on PID 5219
08:43:53:WU04:FS02:Core PID:16955
08:43:53:WU04:FS02:FahCore 0xa7 started
08:43:54:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:44:49:WU00:FS01:Starting
08:44:49:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:44:49:WU00:FS01:Started FahCore on PID 16961
08:44:49:Started thread 36 on PID 5219
08:44:49:WU00:FS01:Core PID:16965
08:44:49:WU00:FS01:FahCore 0xa7 started
08:44:50:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:44:50:WARNING:WU00:FS01:Too many errors, failing
08:44:50:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:14137 run:6 clone:101 gen:32 core:0xa7 unit:0x000000280002894b5c00476407d59845
08:44:50:WU00:FS01:Connecting to 155.247.166.219:8080
08:44:50:WU00:FS01:Server responded WORK_ACK (400)
08:44:50:WU00:FS01:Cleaning up
08:44:50:WU00:FS01:Connecting to 65.254.110.245:8080
08:44:51:WU00:FS01:Assigned to work server 155.247.166.220
08:44:51:WU00:FS01:Requesting new work unit for slot 01: READY cpu:1 from 155.247.166.220
08:44:51:WU00:FS01:Connecting to 155.247.166.220:8080
08:44:51:ERROR:WU00:FS01:Exception: Server did not assign work unit
08:44:51:WU00:FS01:Connecting to 65.254.110.245:8080
08:44:51:WU00:FS01:Assigned to work server 155.247.166.219
08:44:51:WU00:FS01:Requesting new work unit for slot 01: READY cpu:1 from 155.247.166.219
08:44:51:WU00:FS01:Connecting to 155.247.166.219:8080
08:44:53:WU00:FS01:Downloading 1.45MiB
08:44:54:WU00:FS01:Download complete
08:44:54:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14137 run:21 clone:57 gen:36 core:0xa7 unit:0x0000002c0002894b5bd0cc3898262551
08:46:27:WU04:FS02:Downloading core from http://cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah
08:46:27:WU04:FS02:Connecting to cores.foldingathome.org:80
08:46:27:WU04:FS02:FahCore a7: Downloading 8.71MiB
08:46:28:WU04:FS02:FahCore a7: Download complete
08:46:28:WU04:FS02:Valid core signature
08:46:28:WARNING:WU04:FS02:FahCore has not changed since last download, aborting core update
08:46:28:WU04:FS02:Starting
08:46:28:WU04:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:46:28:WU04:FS02:Started FahCore on PID 16969
08:46:28:Started thread 37 on PID 5219
08:46:28:WU04:FS02:Core PID:16973
08:46:28:WU04:FS02:FahCore 0xa7 started
08:46:28:WU00:FS01:Starting
08:46:28:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:46:28:WU00:FS01:Started FahCore on PID 16974
08:46:28:Started thread 38 on PID 5219
08:46:28:WU00:FS01:Core PID:16978
08:46:28:WU00:FS01:FahCore 0xa7 started
08:46:29:WARNING:WU04:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:46:29:WARNING:WU04:FS02:Too many errors, failing
08:46:29:WU04:FS02:Sending unit results: id:04 state:SEND error:FAILED project:13814 run:0 clone:675 gen:235 core:0xa7 unit:0x0000012d80fccb025ae08fb902ee23e8
08:46:29:WU04:FS02:Connecting to 128.252.203.2:8080
08:46:29:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:46:29:WU00:FS01:Starting
08:46:29:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:46:29:WU00:FS01:Started FahCore on PID 16979
08:46:29:Started thread 39 on PID 5219
08:46:29:WU00:FS01:Core PID:16983
08:46:29:WU00:FS01:FahCore 0xa7 started
08:46:29:WU02:FS02:Connecting to 65.254.110.245:8080
08:46:29:WU04:FS02:Server responded WORK_ACK (400)
08:46:29:WU04:FS02:Cleaning up
08:46:30:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:46:30:WU02:FS02:Assigned to work server 155.247.166.219
08:46:30:WU02:FS02:Requesting new work unit for slot 02: READY cpu:1 from 155.247.166.219
08:46:30:WU02:FS02:Connecting to 155.247.166.219:8080
08:46:31:WU02:FS02:Downloading 293.00KiB
08:46:32:WU02:FS02:Download complete
08:46:32:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14153 run:8 clone:345 gen:11 core:0xa7 unit:0x0000000e0002894b5c6e8efa2d00e9ad
08:46:32:WU02:FS02:Starting
08:46:32:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:46:32:WU02:FS02:Started FahCore on PID 16984
08:46:32:Started thread 40 on PID 5219
08:46:32:WU02:FS02:Core PID:16988
08:46:32:WU02:FS02:FahCore 0xa7 started
08:46:32:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:46:33:WU02:FS02:Starting
08:46:33:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:46:33:WU02:FS02:Started FahCore on PID 16989
08:46:33:Started thread 41 on PID 5219
08:46:33:WU02:FS02:Core PID:16993
08:46:33:WU02:FS02:FahCore 0xa7 started
08:46:33:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:47:04:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
08:47:06:WU03:FS03:0xa4:Completed 200000 out of 250000 steps  (80%)
08:47:29:WU00:FS01:Starting
08:47:29:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:47:29:WU00:FS01:Started FahCore on PID 17001
08:47:29:Started thread 42 on PID 5219
08:47:29:WU00:FS01:Core PID:17005
08:47:29:WU00:FS01:FahCore 0xa7 started
08:47:30:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:47:33:WU02:FS02:Starting
08:47:33:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:47:33:WU02:FS02:Started FahCore on PID 17008
08:47:33:Started thread 43 on PID 5219
08:47:33:WU02:FS02:Core PID:17012
08:47:33:WU02:FS02:FahCore 0xa7 started
08:47:33:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:48:29:WU00:FS01:Starting
08:48:29:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:48:29:WU00:FS01:Started FahCore on PID 17016
08:48:29:Started thread 44 on PID 5219
08:48:29:WU00:FS01:Core PID:17020
08:48:29:WU00:FS01:FahCore 0xa7 started
08:48:30:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:48:33:WU02:FS02:Starting
08:48:33:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:48:33:WU02:FS02:Started FahCore on PID 17021
08:48:33:Started thread 45 on PID 5219
08:48:33:WU02:FS02:Core PID:17025
08:48:33:WU02:FS02:FahCore 0xa7 started
08:48:33:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:49:29:WU00:FS01:Starting
08:49:29:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:29:WU00:FS01:Started FahCore on PID 17029
08:49:29:Started thread 46 on PID 5219
08:49:29:WU00:FS01:Core PID:17033
08:49:29:WU00:FS01:FahCore 0xa7 started
08:49:30:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:49:30:WARNING:WU00:FS01:Too many errors, failing
08:49:30:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:14137 run:21 clone:57 gen:36 core:0xa7 unit:0x0000002c0002894b5bd0cc3898262551
08:49:30:WU00:FS01:Connecting to 155.247.166.219:8080
08:49:30:WU00:FS01:Server responded WORK_ACK (400)
08:49:30:WU00:FS01:Cleaning up
08:49:30:WU04:FS01:Connecting to 65.254.110.245:8080
08:49:31:WU04:FS01:Assigned to work server 128.252.203.2
08:49:31:WU04:FS01:Requesting new work unit for slot 01: READY cpu:1 from 128.252.203.2
08:49:31:WU04:FS01:Connecting to 128.252.203.2:8080
08:49:31:WU04:FS01:Downloading 4.57MiB
08:49:33:WU02:FS02:Starting
08:49:33:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 02 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:33:WU02:FS02:Started FahCore on PID 17040
08:49:33:Started thread 47 on PID 5219
08:49:33:WU02:FS02:Core PID:17044
08:49:33:WU02:FS02:FahCore 0xa7 started
08:49:33:WU04:FS01:Download complete
08:49:33:WU04:FS01:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13812 run:0 clone:1149 gen:418 core:0xa7 unit:0x0000020380fccb025ac12c6f5ed1aaf0
08:49:33:WU04:FS01:Starting
08:49:33:WU04:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:33:WU04:FS01:Started FahCore on PID 17045
08:49:33:Started thread 48 on PID 5219
08:49:33:WU04:FS01:Core PID:17049
08:49:33:WU04:FS01:FahCore 0xa7 started
08:49:33:WARNING:WU02:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:49:33:WARNING:WU02:FS02:Too many errors, failing
08:49:33:WU02:FS02:Sending unit results: id:02 state:SEND error:FAILED project:14153 run:8 clone:345 gen:11 core:0xa7 unit:0x0000000e0002894b5c6e8efa2d00e9ad
08:49:33:WU02:FS02:Connecting to 155.247.166.219:8080
08:49:34:WARNING:WU04:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:49:34:WU02:FS02:Server responded WORK_ACK (400)
08:49:34:WU02:FS02:Cleaning up
08:49:34:WU04:FS01:Starting
08:49:34:WU04:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:34:WU04:FS01:Started FahCore on PID 17050
08:49:34:Started thread 49 on PID 5219
08:49:34:WU04:FS01:Core PID:17054
08:49:34:WU04:FS01:FahCore 0xa7 started
08:49:34:WU00:FS02:Connecting to 65.254.110.245:8080
08:49:34:WARNING:WU04:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:49:35:WU00:FS02:Assigned to work server 155.247.166.219
08:49:35:WU00:FS02:Requesting new work unit for slot 02: READY cpu:1 from 155.247.166.219
08:49:35:WU00:FS02:Connecting to 155.247.166.219:8080
08:49:35:WU00:FS02:Downloading 293.09KiB
08:49:36:WU00:FS02:Download complete
08:49:36:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14153 run:5 clone:371 gen:9 core:0xa7 unit:0x0000000b0002894b5c6fca927bb10776
08:49:36:WU00:FS02:Starting
08:49:36:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:36:WU00:FS02:Started FahCore on PID 17055
08:49:36:Started thread 50 on PID 5219
08:49:36:WU00:FS02:Core PID:17059
08:49:36:WU00:FS02:FahCore 0xa7 started
08:49:36:WARNING:WU00:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:49:36:WU00:FS02:Starting
08:49:36:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:49:36:WU00:FS02:Started FahCore on PID 17060
08:49:36:Started thread 51 on PID 5219
08:49:36:WU00:FS02:Core PID:17064
08:49:36:WU00:FS02:FahCore 0xa7 started
08:49:37:WARNING:WU00:FS02:FahCore returned: FAILED_2 (1 = 0x1)
08:50:34:WU04:FS01:Starting
08:50:34:WU04:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 04 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:50:34:WU04:FS01:Started FahCore on PID 17103
08:50:34:Started thread 52 on PID 5219
08:50:34:WU04:FS01:Core PID:17107
08:50:34:WU04:FS01:FahCore 0xa7 started
08:50:34:WARNING:WU04:FS01:FahCore returned: FAILED_2 (1 = 0x1)
08:50:36:WU00:FS02:Starting
08:50:36:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 705 -lifeline 5219 -checkpoint 15 -np 1
08:50:36:WU00:FS02:Started FahCore on PID 17108
08:50:36:Started thread 53 on PID 5219
08:50:36:WU00:FS02:Core PID:17112
08:50:36:WU00:FS02:FahCore 0xa7 started
08:50:37:WARNING:WU00:FS02:FahCore returned: FAILED_2 (1 = 0x1)
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH won't run, "Waiting for core update"

Post by wdanwatts »

wdanwatts wrote:Thanks. I'll try.

Code: Select all

*********************** Log Started 2019-03-01T08:37:39Z **************....
Was that enough to figure it out? What else would be helpful?
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: FAH won't run, "Waiting for core update"

Post by Joe_H »

There is not quite enough information, and in one case too much information, to figure this out. First, return the logging verbosity back to the default of 3. The extra information give by the verbosity setting of 5 just gets in the way.

One thing that is obvious, Your client is set up in an inefficient way. It is better to have one CPU slot and fold using all 4 CPU cores on a single WU than have four slots folding on one core each.

Your client is not having issues downloading or updating the A7 core. What is being reported is the following error:

Code: Select all

08:38:42:WARNING:WU00:FS01:FahCore returned: FAILED_2 (1 = 0x1)
That usually points to a missing or incorrectly installed support module needed by the program. Doing a little research, that may be either related to glibc or python. Not familiar enough with linux internals to go much further on that. Which version of CentOS are you running?

CentOS is a supported OS for folding, so at some point I will move your topic to the subforum for 7.5.1 installations.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
JimboPalmer
Posts: 2573
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

FAH won't run, "Waiting for core update"

Post by JimboPalmer »

Let me summarize:
You are not on 7.4.4, You do not have a Waiting for Core Update error, I think you have altered the verbosity of your log from 3, so it contains lines I have never seen.

Since you did not start a new thread, most 'helpers' won't even see your issue.

If you were to post a new thread in the right place, you would get help from real experts, they will want verbosity of 3.

WARNING:WU01:FS00:FahCore returned: FAILED_2 (1 = 0x1) Is I think the error you DO have. It is possible Window Event Viewer will have more clues.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH won't run, "Waiting for core update"

Post by wdanwatts »

Thank you. I will modify my box accordingly.
Sorry for posting here. I was getting the 'Waiting for Core Update' error and only searched on those words, but I rebooted in order to get the head part of the log and never got the "Waiting" report again.
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: FAH won't run, "Waiting for core update"

Post by bruce »

Joe_H wrote:...That usually points to a missing or incorrectly installed support module needed by the program. Doing a little research, that may be either related to glibc or python. Not familiar enough with linux internals to go much further on that. Which version of CentOS are you running?
This might help you diagnose the problem.
First, pause the client's slot.

Then, from a terminal window, go to the directory where FAHCore has been downloaded. In your case, see:
/usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7

Execute that core manually and read the messages.

> cd /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah
> ./FahCore_a7

It shouldn't do anything except initialize and then shut down but the messages might tell you what's wrong.
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH won't run, "Waiting for core update"

Post by wdanwatts »

CentOS Linux release 7.6.1810
The two subsequent commands seem contradictory.
I did:

>cd /usr/bin
>./FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/Linux/AMD64/AVX/Core_a7.fah

and it replied

'Started core on PID 22105'

and no other response in the command window. Also, I saw no FahCore_a7 from a 'top' page.
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH won't run, "Waiting for core update"

Post by wdanwatts »

Joe_H wrote:One thing that is obvious, Your client is set up in an inefficient way. It is better to have one CPU slot and fold using all 4 CPU cores on a single WU than have four slots folding on one core each.
The a4 core TPF went from 10 min to 6 min when it was set to use only one core (and -1 to let the system choose how many cores to use). Perhaps it uses two cores on a4.
JimboPalmer
Posts: 2573
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: FAH won't run, "Waiting for core update"

Post by JimboPalmer »

I think I got an email that got caught in my spam folder about where this should be.

viewforum.php?f=106
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
wdanwatts
Posts: 65
Joined: Wed Oct 22, 2008 4:46 pm

Re: FAH Core A7 Stopped Runing on CentOS

Post by wdanwatts »

My Dell laptop (4 core 16gb ram, 500gb ssd, no GPU) running CentOS 7.6.1810 keeps giving "WARNING:WU01:FS00:FahCore returned: FAILED_2 (1 = 0x1) " when it attempts to run an a7 core. What should I look at to find out what is wrong?
ChristianVirtual
Posts: 1596
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: FAH Core A7 Stopped Runing on CentOS

Post by ChristianVirtual »

have a look here: viewtopic.php?p=290002

maybe again a little too new lib linked to the core ... CentOS is very conservative compared to newer A7 builds / GROMACS needs ?

Had that several time in the past and the developer needed to recompile with a bit older versions of the libs.
ImageImage
Please contribute your logs to http://ppd.fahmm.net
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: FAH Core A7 Stopped Runing on CentOS

Post by Joe_H »

It is not clear from your posts if the A7 core used to work for you then stopped, or never worked on this system. Which is the case here?

If it used to work, what has been changed since then? That would be updates, changing your linux kernel and so on.

If it never worked, is this an install of this version of CentOS from scratch, or was it upgraded from an older version?

As for this:
wdanwatts wrote:The a4 core TPF went from 10 min to 6 min when it was set to use only one core (and -1 to let the system choose how many cores to use). Perhaps it uses two cores on a4.
are you comparing TPF times for WU's from the same project, or did the project change between? The run times of different projects are not the same. And there is no perhaps, the A4 core actively uses one core per thread set, no more.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Post Reply