FahCore returned: INTERRUPTED (102 = 0x66)

Moderators: Site Moderators, FAHC Science Team

klasseng
Posts: 125
Joined: Thu Dec 27, 2007 6:08 am
Hardware configuration: System #1, Quad GPU:
Motherboard: Asus Rampage IV Extreme
CPU: 6 Core Intel i7 (3930K)
GPU: 4 X NVIDIA GForce GTS 450
OS: WIndows 7 Home Premium, 64-bit
RAM: 16GB

System #2:
MacPro 2,1 (Early 2007)
Dual Quad-Core Intel Xeon 3GHz (X5365)
9GB Memory
OS: Mac OS X 10.7.5
GPU: N/A
Location: Canada

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by klasseng »

I've got the same problem on a 2008, 8 Core MacPro.
FAH 7.3.6.
P9009 R1066 C0 G0

Code: Select all

*********************** Log Started 2014-06-13T15:29:16Z ***********************
15:29:16:************************* Folding@home Client *************************
15:29:16:    Website: http://folding.stanford.edu/
15:29:16:  Copyright: (c) 2009-2013 Stanford University
15:29:16:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:29:16:       Args: 
15:29:16:     Config: /Library/Application Support/FAHClient/config.xml
15:29:16:******************************** Build ********************************
15:29:16:    Version: 7.3.6
15:29:16:       Date: Feb 18 2013
15:29:16:       Time: 15:24:11
15:29:16:    SVN Rev: 3923
15:29:16:     Branch: fah/trunk/client
15:29:16:   Compiler: GNU 4.2.1 (Apple Inc. build 5666) (dot 3)
15:29:16:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
15:29:16:             -fno-unsafe-math-optimizations -msse3 -arch x86_64
15:29:16:             -mmacosx-version-min=10.5 -isysroot /Developer/SDKs/MacOSX10.5.sdk
15:29:16:   Platform: darwin 10.8.0
15:29:16:       Bits: 64
15:29:16:       Mode: Release
15:29:16:******************************* System ********************************
15:29:16:        CPU: Intel(R) Xeon(R) CPU X5365 @ 3.00GHz
15:29:16:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 7
15:29:16:       CPUs: 8
15:29:16:     Memory: 9.00GiB
15:29:16:Free Memory: 7.49GiB
15:29:16:    Threads: POSIX_THREADS
15:29:16:Has Battery: false
15:29:16: On Battery: false
15:29:16: UTC offset: -5
15:29:16:        PID: 375
15:29:16:        CWD: /Library/Application Support/FAHClient
15:29:16:         OS: Darwin 11.4.2 i386
15:29:16:    OS Arch: AMD64
15:29:16:       GPUs: 1
15:29:16:      GPU 0: UNSUPPORTED: G73 [GeForce 7300 GT]
15:29:16:       CUDA: Not detected
15:29:16:***********************************************************************
15:29:16:<config>
15:29:16:  <!-- Folding Core -->
15:29:16:  <checkpoint v='30'/>
15:29:16:
15:29:16:  <!-- Folding Slot Configuration -->
15:29:16:  <power v='full'/>
15:29:16:
15:29:16:  <!-- Network -->
15:29:16:  <proxy v=':8080'/>
15:29:16:
15:29:16:  <!-- User Information -->
15:29:16:  <passkey v='********************************'/>
15:29:16:  <team v='1971'/>
15:29:16:  <user v='klasseng'/>
15:29:16:
15:29:16:  <!-- Folding Slots -->
15:29:16:  <slot id='0' type='CPU'/>
15:29:16:</config>
15:29:16:Trying to access database...
15:29:16:Successfully acquired database lock
15:29:16:Enabled folding slot 00: READY cpu:8
15:29:16:WU01:FS00:Starting
15:29:16:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145451.txt'
15:29:16:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:16:WU01:FS00:Started FahCore on PID 376
15:29:16:WU01:FS00:Core PID:379
15:29:16:WU01:FS00:FahCore 0xa4 started
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:*------------------------------*
15:29:17:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:17:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:Preparing to commence simulation
15:29:17:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:26:WU01:FS00:0xa4:- Looking at optimizations...
15:29:26:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:26:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:26:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:26:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:26:WU01:FS00:0xa4:- Digital signature verified
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Entering M.D.
15:29:32:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:32:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:29:33:WU01:FS00:Starting
15:29:33:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145551.txt'
15:29:33:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:33:WU01:FS00:Started FahCore on PID 380
15:29:33:WU01:FS00:Core PID:381
15:29:33:WU01:FS00:FahCore 0xa4 started
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:*------------------------------*
15:29:34:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:34:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:Preparing to commence simulation
15:29:34:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:43:WU01:FS00:0xa4:- Looking at optimizations...
15:29:43:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:43:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:43:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:43:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:43:WU01:FS00:0xa4:- Digital signature verified
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Entering M.D.
15:29:49:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:49:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
Same WU, same "INTERRUPTED (102 = 0x66)" repeats ad nauseum.
As one of the lines shows:"Examination of work files indicates 8 consecutive improper terminations of core"

Finally:
Manually Paused
Manually Deleted WU from "Work" folder
Manually "Force Quit" the FAH Client process
Restarted with new WU, Folding now continuing apace.
peace,
Grant
TomJohnson
Posts: 184
Joined: Mon Dec 03, 2007 1:29 am
Hardware configuration: iMac Pro Xeon W 16 core, i7 3.20 GHz, 64 GB RAM, OS V 10.14.5, ! TB SSD
iMac i5-7500 8 core 3.4 GHz, 8 GB RAM, OS V 10.14.5, 1 TB Fusion HD
Mac Pro X5675 12 core, i7 3.06 GHz, 52 GB RAM, OS 10.13.6, 1 TB HD, Cinema 30" + 23"
Mac Pro Intel Xeon Dual Quad 3.2 GHz, 16 GB RAM, OS 10.10.5, 512 GB HD
plus 44 more
Location: Oak Harbor, WA

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by TomJohnson »

After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again.
klasseng wrote:I've got the same problem on a 2008, 8 Core MacPro.
FAH 7.3.6.
P9009 R1066 C0 G0

Code: Select all

*********************** Log Started 2014-06-13T15:29:16Z ***********************
15:29:16:************************* Folding@home Client *************************
15:29:16:    Website: http://folding.stanford.edu/
15:29:16:  Copyright: (c) 2009-2013 Stanford University
15:29:16:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:29:16:       Args: 
15:29:16:     Config: /Library/Application Support/FAHClient/config.xml
15:29:16:******************************** Build ********************************
15:29:16:    Version: 7.3.6
15:29:16:       Date: Feb 18 2013
15:29:16:       Time: 15:24:11
15:29:16:    SVN Rev: 3923
15:29:16:     Branch: fah/trunk/client
15:29:16:   Compiler: GNU 4.2.1 (Apple Inc. build 5666) (dot 3)
15:29:16:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
15:29:16:             -fno-unsafe-math-optimizations -msse3 -arch x86_64
15:29:16:             -mmacosx-version-min=10.5 -isysroot /Developer/SDKs/MacOSX10.5.sdk
15:29:16:   Platform: darwin 10.8.0
15:29:16:       Bits: 64
15:29:16:       Mode: Release
15:29:16:******************************* System ********************************
15:29:16:        CPU: Intel(R) Xeon(R) CPU X5365 @ 3.00GHz
15:29:16:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 7
15:29:16:       CPUs: 8
15:29:16:     Memory: 9.00GiB
15:29:16:Free Memory: 7.49GiB
15:29:16:    Threads: POSIX_THREADS
15:29:16:Has Battery: false
15:29:16: On Battery: false
15:29:16: UTC offset: -5
15:29:16:        PID: 375
15:29:16:        CWD: /Library/Application Support/FAHClient
15:29:16:         OS: Darwin 11.4.2 i386
15:29:16:    OS Arch: AMD64
15:29:16:       GPUs: 1
15:29:16:      GPU 0: UNSUPPORTED: G73 [GeForce 7300 GT]
15:29:16:       CUDA: Not detected
15:29:16:***********************************************************************
15:29:16:<config>
15:29:16:  <!-- Folding Core -->
15:29:16:  <checkpoint v='30'/>
15:29:16:
15:29:16:  <!-- Folding Slot Configuration -->
15:29:16:  <power v='full'/>
15:29:16:
15:29:16:  <!-- Network -->
15:29:16:  <proxy v=':8080'/>
15:29:16:
15:29:16:  <!-- User Information -->
15:29:16:  <passkey v='********************************'/>
15:29:16:  <team v='1971'/>
15:29:16:  <user v='klasseng'/>
15:29:16:
15:29:16:  <!-- Folding Slots -->
15:29:16:  <slot id='0' type='CPU'/>
15:29:16:</config>
15:29:16:Trying to access database...
15:29:16:Successfully acquired database lock
15:29:16:Enabled folding slot 00: READY cpu:8
15:29:16:WU01:FS00:Starting
15:29:16:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145451.txt'
15:29:16:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:16:WU01:FS00:Started FahCore on PID 376
15:29:16:WU01:FS00:Core PID:379
15:29:16:WU01:FS00:FahCore 0xa4 started
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:*------------------------------*
15:29:17:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:17:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:17:WU01:FS00:0xa4:
15:29:17:WU01:FS00:0xa4:Preparing to commence simulation
15:29:17:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:26:WU01:FS00:0xa4:- Looking at optimizations...
15:29:26:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:26:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:26:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:26:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:26:WU01:FS00:0xa4:- Digital signature verified
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:26:WU01:FS00:0xa4:
15:29:26:WU01:FS00:0xa4:Entering M.D.
15:29:32:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:32:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:29:33:WU01:FS00:Starting
15:29:33:WU01:FS00:Removing old file './work/01/logfile_01-20140613-145551.txt'
15:29:33:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/web.stanford.edu/~pande/OSX/AMD64/Core_a4.fah/FahCore_a4" -dir 01 -suffix 01 -version 703 -lifeline 375 -checkpoint 30 -np 8
15:29:33:WU01:FS00:Started FahCore on PID 380
15:29:33:WU01:FS00:Core PID:381
15:29:33:WU01:FS00:FahCore 0xa4 started
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:*------------------------------*
15:29:34:WU01:FS00:0xa4:Folding@Home Gromacs Core
15:29:34:WU01:FS00:0xa4:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
15:29:34:WU01:FS00:0xa4:
15:29:34:WU01:FS00:0xa4:Preparing to commence simulation
15:29:34:WU01:FS00:0xa4:- Ensuring status. Please wait.
15:29:43:WU01:FS00:0xa4:- Looking at optimizations...
15:29:43:WU01:FS00:0xa4:- Working with standard loops on this execution.
15:29:43:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
15:29:43:WU01:FS00:0xa4:- Expanded 705442 -> 1476032 (decompressed 209.2 percent)
15:29:43:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=705442 data_size=1476032, decompressed_data_size=1476032 diff=0
15:29:43:WU01:FS00:0xa4:- Digital signature verified
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
15:29:43:WU01:FS00:0xa4:
15:29:43:WU01:FS00:0xa4:Entering M.D.
15:29:49:WU01:FS00:0xa4:Mapping NT from 8 to 8 
15:29:49:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:29:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
Same WU, same "INTERRUPTED (102 = 0x66)" repeats ad nauseum.
As one of the lines shows:"Examination of work files indicates 8 consecutive improper terminations of core"

Finally:
Manually Paused
Manually Deleted WU from "Work" folder
Manually "Force Quit" the FAH Client process
Restarted with new WU, Folding now continuing apace.
iMac 15,1 27" 5K Retina Intel i7 4.0 GHz Dual Quad 24 GB RAM 1 TB Fusion OS 10.10
Mac Pro 5,1 3.06 GHz 12 Core 52 Gig RAM OS 10.9.5 -- Plus 20 more
Image
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by PantherX »

TomJohnson wrote:After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again...
Was it the same WU or a different one? Could you please post the log file? It should be present in the logs folder since FAHClient has restarted.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
sryckbos
Pande Group Member
Posts: 116
Joined: Wed Jun 26, 2013 10:23 pm

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by sryckbos »

It looks like the problem from 9006 was a one-off bad WU.

The ones from 9009 may be a more systematic error in the system that wasn't caught in beta testing. I'm going to stop assigning new WUs from 9009 and try to iron out the issues before putting it back up.

Sorry about this!
TomJohnson
Posts: 184
Joined: Mon Dec 03, 2007 1:29 am
Hardware configuration: iMac Pro Xeon W 16 core, i7 3.20 GHz, 64 GB RAM, OS V 10.14.5, ! TB SSD
iMac i5-7500 8 core 3.4 GHz, 8 GB RAM, OS V 10.14.5, 1 TB Fusion HD
Mac Pro X5675 12 core, i7 3.06 GHz, 52 GB RAM, OS 10.13.6, 1 TB HD, Cinema 30" + 23"
Mac Pro Intel Xeon Dual Quad 3.2 GHz, 16 GB RAM, OS 10.10.5, 512 GB HD
plus 44 more
Location: Oak Harbor, WA

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by TomJohnson »

My WU was -- 16:42:48:WU00:FS00:0xa4:Project: 9009 (Run 724, Clone 0, Gen 0)
Grant's WU was -- 15:29:26:WU01:FS00:0xa4:Project: 9009 (Run 1066, Clone 0, Gen 0)
PantherX wrote:
TomJohnson wrote:After 16 hours of this problem I did the same as Grant and now have my Mac Pro 5,1 Folding again...
Was it the same WU or a different one? Could you please post the log file? It should be present in the logs folder since FAHClient has restarted.
iMac 15,1 27" 5K Retina Intel i7 4.0 GHz Dual Quad 24 GB RAM 1 TB Fusion OS 10.10
Mac Pro 5,1 3.06 GHz 12 Core 52 Gig RAM OS 10.9.5 -- Plus 20 more
Image
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by PantherX »

Okay, while both WUs were different, they belonged to Project 9009 which will be stopped as sryckbos mentioned above.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
sryckbos
Pande Group Member
Posts: 116
Joined: Wed Jun 26, 2013 10:23 pm

Re: FahCore returned: INTERRUPTED (102 = 0x66)

Post by sryckbos »

So I went through all the runs that have never had a successful WU, and then manually tried to run them. Some just haven't been assigned yet, but about 40 (out of ~1200) were bad. So I've removed those such that no one should get them anymore. I'm putting Project 9009 back up now. Please let me know if you have any other issues.

Sorry again! Thanks for all the feedback!
Post Reply