Page 2 of 2

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 3:36 pm
by klasseng
I've got the same problem on a 2008, 8 Core MacPro.
FAH 7.3.6.
P9009 R1066 C0 G0

Code: Select all

*********************** Log Started 2014-06-13T15:29:16Z ***********************
15:29:16:************************* Folding@home Client *************************
15:29:16:    Website: http://folding.stanford.edu/
15:29:16:  Copyright: (c) 2009-2013 Stanford University
15:29:16:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:29:16:       Args: 
15:29:16:     Config: /Library/Application Support/FAHClient/config.xml
15:29:16:******************************** Build ********************************
15:29:16:    Version: 7.3.6
15:29:16:       Date: Feb 18 2013
15:29:16:       Time: 15:24:11
15:29:16:    SVN Rev: 3923
15:29:16:     Branch: fah/trunk/client
15:29:16:   Compiler: GNU 4.2.1 (Apple Inc. build 5666) (dot 3)
15:29:16:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
15:29:16:             -fno-unsafe-math-optimizations -msse3 -arch x86_64
15:29:16:             -mmacosx-version-min=10.5 -isysroot /Developer/SDKs/MacOSX10.5.sdk
15:29:16:   Platform: darwin 10.8.0
15:29:16:       Bits: 64
15:29:16:       Mode: Release
15:29:16:******************************* System ********************************
15:29:16:        CPU: Intel(R) Xeon(R) CPU X5365 @ 3.00GHz
15:29:16:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 7
15:29:16:       CPUs: 8
15:29:16:     Memory: 9.00GiB
15:29:16:Free Memory: 7.49GiB
15:29:16:    Threads: POSIX_THREADS
15:29:16:Has Battery: false
15:29:16: On Battery: false
15:29:16: UTC offset: -5
15:29:16:        PID: 375
15:29:16:        CWD: /Library/Application Support/FAHClient
15:29:16:         OS: Darwin 11.4.2 i386
15:29:16:    OS Arch: AMD64
15:29:16:       GPUs: 1
15:29:16:      GPU 0: UNSUPPORTED: G73 [GeForce 7300 GT]
15:29:16:       CUDA: Not detected
15:29:16:***********************************************************************
15:29:16:<config>
15:29:16:  <!-- Folding Core -->
15:29:16:  <checkpoint v='30'/>
15:29:16:
15:29:16:  <!-- Folding Slot Configuration -->
15:29:16:  <power v='full'/>
15:29:16:
15:29:16:  <!-- Network -->
15:29:16:  <proxy v=':8080'/>
15:29:16:
15:29:16:  <!-- User Information -->
15:29:16:  <passkey v='********************************'/>
15:29:16:  <team v='1971'/>
15:29:16:  <user v='klasseng'/>
15:29:16:
15:29:16:  <!-- Folding Slots -->
15:29:16:  <slot id='0' type='CPU'/>
15:29:16:</config>
15:29:16:Trying to access database...
15:29:16:Successfully acquired database lock
15:29:16:Enabled folding slot 00: READY cpu:8
15:29:16:WU01:FS00:Starting
15:29:16:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145451.txt'
15:29:16:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:16:WU01:FS00:Started FahCore on PID 376
15:29:16:WU01:FS00:Core PID:379
15:29:16:WU01:FS00:FahCore 0xa4 started
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:*------------------------------*
15:29:17:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:17:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:Preparing to commence simulation
15:29:17:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:26:WU01:FS00:0xa4:- Looking at optimizations...
15:29:26:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:26:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:26:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:26:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:26:WU01:FS00:0xa4:- Digital signature verified
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Entering M.D.
15:29:32:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:32:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:29:33:WU01:FS00:Starting
15:29:33:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145551.txt'
15:29:33:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:33:WU01:FS00:Started FahCore on PID 380
15:29:33:WU01:FS00:Core PID:381
15:29:33:WU01:FS00:FahCore 0xa4 started
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:*------------------------------*
15:29:34:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:34:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:Preparing to commence simulation
15:29:34:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:43:WU01:FS00:0xa4:- Looking at optimizations...
15:29:43:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:43:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:43:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:43:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:43:WU01:FS00:0xa4:- Digital signature verified
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Entering M.D.
15:29:49:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:49:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
Same WU, same "INTERRUPTED (102 = 0x66)" repeats ad nauseum.
As one of the lines shows:"Examination of work files indicates 8 consecutive improper terminations of core"

Finally:
Manually Paused
Manually Deleted WU from "Work" folder
Manually "Force Quit" the FAH Client process
Restarted with new WU, Folding now continuing apace.

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 3:55 pm
by TomJohnson
After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again.
klasseng wrote:I've got the same problem on a 2008, 8 Core MacPro.
FAH 7.3.6.
P9009 R1066 C0 G0

Code: Select all

*********************** Log Started 2014-06-13T15:29:16Z ***********************
15:29:16:************************* Folding@home Client *************************
15:29:16:    Website: http://folding.stanford.edu/
15:29:16:  Copyright: (c) 2009-2013 Stanford University
15:29:16:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:29:16:       Args: 
15:29:16:     Config: /Library/Application Support/FAHClient/config.xml
15:29:16:******************************** Build ********************************
15:29:16:    Version: 7.3.6
15:29:16:       Date: Feb 18 2013
15:29:16:       Time: 15:24:11
15:29:16:    SVN Rev: 3923
15:29:16:     Branch: fah/trunk/client
15:29:16:   Compiler: GNU 4.2.1 (Apple Inc. build 5666) (dot 3)
15:29:16:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
15:29:16:             -fno-unsafe-math-optimizations -msse3 -arch x86_64
15:29:16:             -mmacosx-version-min=10.5 -isysroot /Developer/SDKs/MacOSX10.5.sdk
15:29:16:   Platform: darwin 10.8.0
15:29:16:       Bits: 64
15:29:16:       Mode: Release
15:29:16:******************************* System ********************************
15:29:16:        CPU: Intel(R) Xeon(R) CPU X5365 @ 3.00GHz
15:29:16:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 7
15:29:16:       CPUs: 8
15:29:16:     Memory: 9.00GiB
15:29:16:Free Memory: 7.49GiB
15:29:16:    Threads: POSIX_THREADS
15:29:16:Has Battery: false
15:29:16: On Battery: false
15:29:16: UTC offset: -5
15:29:16:        PID: 375
15:29:16:        CWD: /Library/Application Support/FAHClient
15:29:16:         OS: Darwin 11.4.2 i386
15:29:16:    OS Arch: AMD64
15:29:16:       GPUs: 1
15:29:16:      GPU 0: UNSUPPORTED: G73 [GeForce 7300 GT]
15:29:16:       CUDA: Not detected
15:29:16:***********************************************************************
15:29:16:<config>
15:29:16:  <!-- Folding Core -->
15:29:16:  <checkpoint v='30'/>
15:29:16:
15:29:16:  <!-- Folding Slot Configuration -->
15:29:16:  <power v='full'/>
15:29:16:
15:29:16:  <!-- Network -->
15:29:16:  <proxy v=':8080'/>
15:29:16:
15:29:16:  <!-- User Information -->
15:29:16:  <passkey v='********************************'/>
15:29:16:  <team v='1971'/>
15:29:16:  <user v='klasseng'/>
15:29:16:
15:29:16:  <!-- Folding Slots -->
15:29:16:  <slot id='0' type='CPU'/>
15:29:16:</config>
15:29:16:Trying to access database...
15:29:16:Successfully acquired database lock
15:29:16:Enabled folding slot 00: READY cpu:8
15:29:16:WU01:FS00:Starting
15:29:16:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145451.txt'
15:29:16:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:16:WU01:FS00:Started FahCore on PID 376
15:29:16:WU01:FS00:Core PID:379
15:29:16:WU01:FS00:FahCore 0xa4 started
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:*------------------------------*
15:29:17:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:17:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:Preparing to commence simulation
15:29:17:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:26:WU01:FS00:0xa4:- Looking at optimizations...
15:29:26:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:26:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:26:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:26:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:26:WU01:FS00:0xa4:- Digital signature verified
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Entering M.D.
15:29:32:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:32:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:29:33:WU01:FS00:Starting
15:29:33:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145551.txt'
15:29:33:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:33:WU01:FS00:Started FahCore on PID 380
15:29:33:WU01:FS00:Core PID:381
15:29:33:WU01:FS00:FahCore 0xa4 started
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:*------------------------------*
15:29:34:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:34:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:Preparing to commence simulation
15:29:34:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:43:WU01:FS00:0xa4:- Looking at optimizations...
15:29:43:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:43:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:43:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:43:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:43:WU01:FS00:0xa4:- Digital signature verified
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Entering M.D.
15:29:49:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:49:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
Same WU, same "INTERRUPTED (102 = 0x66)" repeats ad nauseum.
As one of the lines shows:"Examination of work files indicates 8 consecutive improper terminations of core"

Finally:
Manually Paused
Manually Deleted WU from "Work" folder
Manually "Force Quit" the FAH Client process
Restarted with new WU, Folding now continuing apace.

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 7:45 pm
by PantherX
TomJohnson wrote:After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again...
Was it the same WU or a different one? Could you please post the log file? It should be present in the logs folder since FAHClient has restarted.

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 7:55 pm
by sryckbos
It looks like the problem from 9006 was a one-off bad WU.

The ones from 9009 may be a more systematic error in the system that wasn't caught in beta testing. I'm going to stop assigning new WUs from 9009 and try to iron out the issues before putting it back up.

Sorry about this!

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 9:30 pm
by TomJohnson
My WU was -- 16:42:48:WU00:FS00:0xa4:Project: 9009 (Run 724, Clone 0, Gen 0)
Grant's WU was -- 15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
PantherX wrote:
TomJohnson wrote:After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again...
Was it the same WU or a different one? Could you please post the log file? It should be present in the logs folder since FAHClient has restarted.

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 13, 2014 9:40 pm
by PantherX
Okay, while both WUs were different, they belonged to Project 9009 which will be stopped as sryckbos mentioned above.

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Posted: Fri Jun 20, 2014 11:50 pm
by sryckbos
So I went through all the runs that have never had a successful WU, and then manually tried to run them. Some just haven't been assigned yet, but about 40 (out of ~1200) were bad. So I've removed those such that no one should get them anymore. I'm putting Project 9009 back up now. Please let me know if you have any other issues.

Sorry again! Thanks for all the feedback!