GTX 1070 Suddenly Not Folding

It seems that a lot of GPU problems revolve around specific versions of drivers. Though NVidia has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
suprleg
Posts: 57
Joined: Thu Apr 26, 2012 8:30 pm

GTX 1070 Suddenly Not Folding

Post by suprleg »

Within the last three days I noticed that my GTX1070 wasn't throwing any error messages in the client logs and appeared as 'running' in the status window. However, it never passes 0% completed.
Today I installed the latest driver version, 430.86, with the same result.
Win7 Pro
F@H 7.4.4
GTX 1070

Ideas?
Top
ari2asem
Posts: 21
Joined: Sat Jun 08, 2019 1:07 am

Re: GTX 1070 Suddenly Not Folding

Post by ari2asem »

maybe updating to FAH 7.5.1 and deleteing FAH-working folder will work??
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GTX 1070 Suddenly Not Folding

Post by bruce »

ari2asem wrote:maybe updating to FAH 7.5.1 and deleteing FAH-working folder will work??
Possibly, but probably sufficient to pause the WU and the resume folding.

Post your log per the instructions below.
Top
suprleg
Posts: 57
Joined: Thu Apr 26, 2012 8:30 pm

Re: GTX 1070 Suddenly Not Folding

Post by suprleg »

First time in 13 years I've encountered this problem.
So far I've updated client to 7.5.1, NVIDIA driver to 430.68, flushed the work dir..

Code: Select all

*********************** Log Started 2019-06-27T16:32:29Z ***********************
16:32:29:************************* Folding@home Client *************************
16:32:29:        Website: https://foldingathome.org/
16:32:29:      Copyright: (c) 2009-2018 foldingathome.org
16:32:29:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:32:29:           Args: 
16:32:29:         Config: C:\Users\Kurt\AppData\Roaming\FAHClient\config.xml
16:32:29:******************************** Build ********************************
16:32:29:        Version: 7.5.1
16:32:29:           Date: May 11 2018
16:32:29:           Time: 13:06:32
16:32:29:     Repository: Git
16:32:29:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
16:32:29:         Branch: master
16:32:29:       Compiler: Visual C++ 2008
16:32:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:32:29:       Platform: win32 10
16:32:29:           Bits: 32
16:32:29:           Mode: Release
16:32:29:******************************* System ********************************
16:32:29:            CPU: Intel(R) Core(TM) i5-3450 CPU @ 3.10GHz
16:32:29:         CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
16:32:29:           CPUs: 4
16:32:29:         Memory: 15.95GiB
16:32:29:    Free Memory: 14.16GiB
16:32:29:        Threads: WINDOWS_THREADS
16:32:29:     OS Version: 6.1
16:32:29:    Has Battery: false
16:32:29:     On Battery: false
16:32:29:     UTC Offset: -7
16:32:29:            PID: 4572
16:32:29:            CWD: C:\Users\Kurt\AppData\Roaming\FAHClient
16:32:29:             OS: Windows 7 Professional
16:32:29:        OS Arch: AMD64
16:32:29:           GPUs: 1
16:32:29:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 GP104 [GeForce GTX 1070] 6463
16:32:29:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:10.2
16:32:29:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:430.86
16:32:29:  Win32 Service: false
16:32:29:***********************************************************************
16:32:29:<config>
16:32:29:  <!-- Network -->
16:32:29:  <proxy v=':8080'/>
16:32:29:
16:32:29:  <!-- Slot Control -->
16:32:29:  <power v='full'/>
16:32:29:
16:32:29:  <!-- User Information -->
16:32:29:  <passkey v='********************************'/>
16:32:29:  <team v='4'/>
16:32:29:  <user v='suprleg'/>
16:32:29:
16:32:29:  <!-- Folding Slots -->
16:32:29:  <slot id='0' type='CPU'>
16:32:29:    <client-type v='advanced'/>
16:32:29:  </slot>
16:32:29:  <slot id='1' type='GPU'>
16:32:29:    <client-type v='advanced'/>
16:32:29:  </slot>
16:32:29:</config>
16:32:29:Trying to access database...
16:32:29:Successfully acquired database lock
16:32:29:Enabled folding slot 00: READY cpu:3
16:32:29:Enabled folding slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463
16:32:29:WU00:FS00:Starting
16:32:29:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -np 3
16:32:29:WU00:FS00:Started FahCore on PID 4920
16:32:29:WU00:FS00:Core PID:4912
16:32:29:WU00:FS00:FahCore 0xa7 started
16:32:29:WU01:FS01:Starting
16:32:29:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
16:32:29:WU01:FS01:Started FahCore on PID 3160
16:32:29:WU01:FS01:Core PID:5096
16:32:29:WU01:FS01:FahCore 0x21 started
16:32:29:WU00:FS00:0xa7:*********************** Log Started 2019-06-27T16:32:29Z ***********************
16:32:29:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:32:29:WU00:FS00:0xa7:       Type: 0xa7
16:32:29:WU00:FS00:0xa7:       Core: Gromacs
16:32:29:WU00:FS00:0xa7:    Website: https://foldingathome.org/
16:32:29:WU00:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
16:32:29:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:32:29:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 4920 -checkpoint 15 -np 3
16:32:29:WU00:FS00:0xa7:     Config: <none>
16:32:29:WU00:FS00:0xa7:************************************ Build *************************************
16:32:29:WU00:FS00:0xa7:    Version: 0.0.17
16:32:29:WU00:FS00:0xa7:       Date: Apr 27 2018
16:32:29:WU00:FS00:0xa7:       Time: 16:19:36
16:32:29:WU00:FS00:0xa7: Repository: Git
16:32:29:WU00:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
16:32:29:WU00:FS00:0xa7:     Branch: master
16:32:29:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:32:29:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:32:29:WU00:FS00:0xa7:   Platform: win32 10
16:32:29:WU00:FS00:0xa7:       Bits: 64
16:32:29:WU00:FS00:0xa7:       Mode: Release
16:32:29:WU00:FS00:0xa7:       SIMD: avx_256
16:32:29:WU00:FS00:0xa7:************************************ System ************************************
16:32:29:WU00:FS00:0xa7:        CPU: Unknown
16:32:29:WU00:FS00:0xa7:     CPU ID: 
16:32:29:WU00:FS00:0xa7:       CPUs: 4
16:32:29:WU00:FS00:0xa7:     Memory: 15.95GiB
16:32:29:WU00:FS00:0xa7:Free Memory: 14.08GiB
16:32:29:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
16:32:29:WU00:FS00:0xa7: OS Version: 6.1
16:32:29:WU00:FS00:0xa7:Has Battery: false
16:32:29:WU00:FS00:0xa7: On Battery: false
16:32:29:WU00:FS00:0xa7: UTC Offset: -7
16:32:29:WU00:FS00:0xa7:        PID: 4912
16:32:29:WU00:FS00:0xa7:        CWD: C:\Users\Kurt\AppData\Roaming\FAHClient\work
16:32:29:WU00:FS00:0xa7:         OS: Windows 7 Professional Service Pack 1
16:32:29:WU00:FS00:0xa7:    OS Arch: AMD64
16:32:29:WU00:FS00:0xa7:********************************************************************************
16:32:29:WU00:FS00:0xa7:Project: 14106 (Run 17, Clone 14, Gen 88)
16:32:29:WU00:FS00:0xa7:Unit: 0x000000670002894b5c929a827ef591f7
16:32:29:WU00:FS00:0xa7:Digital signatures verified
16:32:29:WU00:FS00:0xa7:Calling: mdrun -s frame88.tpr -o frame88.trr -cpt 15 -nt 3
16:32:30:WU00:FS00:0xa7:Steps: first=110000000 total=1250000
16:32:30:WU00:FS00:0xa7:Completed 1 out of 1250000 steps (0%)
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GTX 1070 Suddenly Not Folding

Post by bruce »

You didn't pause/restart the WU yet.
Top
suprleg
Posts: 57
Joined: Thu Apr 26, 2012 8:30 pm

Re: GTX 1070 Suddenly Not Folding

Post by suprleg »

Just did:

Code: Select all

*********************** Log Started 2019-06-27T16:32:29Z ***********************
16:32:29:************************* Folding@home Client *************************
16:32:29:        Website: https://foldingathome.org/
16:32:29:      Copyright: (c) 2009-2018 foldingathome.org
16:32:29:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:32:29:           Args: 
16:32:29:         Config: C:\Users\Kurt\AppData\Roaming\FAHClient\config.xml
16:32:29:******************************** Build ********************************
16:32:29:        Version: 7.5.1
16:32:29:           Date: May 11 2018
16:32:29:           Time: 13:06:32
16:32:29:     Repository: Git
16:32:29:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
16:32:29:         Branch: master
16:32:29:       Compiler: Visual C++ 2008
16:32:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:32:29:       Platform: win32 10
16:32:29:           Bits: 32
16:32:29:           Mode: Release
16:32:29:******************************* System ********************************
16:32:29:            CPU: Intel(R) Core(TM) i5-3450 CPU @ 3.10GHz
16:32:29:         CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
16:32:29:           CPUs: 4
16:32:29:         Memory: 15.95GiB
16:32:29:    Free Memory: 14.16GiB
16:32:29:        Threads: WINDOWS_THREADS
16:32:29:     OS Version: 6.1
16:32:29:    Has Battery: false
16:32:29:     On Battery: false
16:32:29:     UTC Offset: -7
16:32:29:            PID: 4572
16:32:29:            CWD: C:\Users\Kurt\AppData\Roaming\FAHClient
16:32:29:             OS: Windows 7 Professional
16:32:29:        OS Arch: AMD64
16:32:29:           GPUs: 1
16:32:29:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 GP104 [GeForce GTX 1070] 6463
16:32:29:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:10.2
16:32:29:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:430.86
16:32:29:  Win32 Service: false
16:32:29:***********************************************************************
16:32:29:<config>
16:32:29:  <!-- Network -->
16:32:29:  <proxy v=':8080'/>
16:32:29:
16:32:29:  <!-- Slot Control -->
16:32:29:  <power v='full'/>
16:32:29:
16:32:29:  <!-- User Information -->
16:32:29:  <passkey v='********************************'/>
16:32:29:  <team v='4'/>
16:32:29:  <user v='suprleg'/>
16:32:29:
16:32:29:  <!-- Folding Slots -->
16:32:29:  <slot id='0' type='CPU'>
16:32:29:    <client-type v='advanced'/>
16:32:29:  </slot>
16:32:29:  <slot id='1' type='GPU'>
16:32:29:    <client-type v='advanced'/>
16:32:29:  </slot>
16:32:29:</config>
16:32:29:Trying to access database...
16:32:29:Successfully acquired database lock
16:32:29:Enabled folding slot 00: READY cpu:3
16:32:29:Enabled folding slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463
16:32:29:WU00:FS00:Starting
16:32:29:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -np 3
16:32:29:WU00:FS00:Started FahCore on PID 4920
16:32:29:WU00:FS00:Core PID:4912
16:32:29:WU00:FS00:FahCore 0xa7 started
16:32:29:WU01:FS01:Starting
16:32:29:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
16:32:29:WU01:FS01:Started FahCore on PID 3160
16:32:29:WU01:FS01:Core PID:5096
16:32:29:WU01:FS01:FahCore 0x21 started
16:32:29:WU00:FS00:0xa7:*********************** Log Started 2019-06-27T16:32:29Z ***********************
16:32:29:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:32:29:WU00:FS00:0xa7:       Type: 0xa7
16:32:29:WU00:FS00:0xa7:       Core: Gromacs
16:32:29:WU00:FS00:0xa7:    Website: https://foldingathome.org/
16:32:29:WU00:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
16:32:29:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:32:29:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 4920 -checkpoint 15 -np 3
16:32:29:WU00:FS00:0xa7:     Config: <none>
16:32:29:WU00:FS00:0xa7:************************************ Build *************************************
16:32:29:WU00:FS00:0xa7:    Version: 0.0.17
16:32:29:WU00:FS00:0xa7:       Date: Apr 27 2018
16:32:29:WU00:FS00:0xa7:       Time: 16:19:36
16:32:29:WU00:FS00:0xa7: Repository: Git
16:32:29:WU00:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
16:32:29:WU00:FS00:0xa7:     Branch: master
16:32:29:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:32:29:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:32:29:WU00:FS00:0xa7:   Platform: win32 10
16:32:29:WU00:FS00:0xa7:       Bits: 64
16:32:29:WU00:FS00:0xa7:       Mode: Release
16:32:29:WU00:FS00:0xa7:       SIMD: avx_256
16:32:29:WU00:FS00:0xa7:************************************ System ************************************
16:32:29:WU00:FS00:0xa7:        CPU: Unknown
16:32:29:WU00:FS00:0xa7:     CPU ID: 
16:32:29:WU00:FS00:0xa7:       CPUs: 4
16:32:29:WU00:FS00:0xa7:     Memory: 15.95GiB
16:32:29:WU00:FS00:0xa7:Free Memory: 14.08GiB
16:32:29:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
16:32:29:WU00:FS00:0xa7: OS Version: 6.1
16:32:29:WU00:FS00:0xa7:Has Battery: false
16:32:29:WU00:FS00:0xa7: On Battery: false
16:32:29:WU00:FS00:0xa7: UTC Offset: -7
16:32:29:WU00:FS00:0xa7:        PID: 4912
16:32:29:WU00:FS00:0xa7:        CWD: C:\Users\Kurt\AppData\Roaming\FAHClient\work
16:32:29:WU00:FS00:0xa7:         OS: Windows 7 Professional Service Pack 1
16:32:29:WU00:FS00:0xa7:    OS Arch: AMD64
16:32:29:WU00:FS00:0xa7:********************************************************************************
16:32:29:WU00:FS00:0xa7:Project: 14106 (Run 17, Clone 14, Gen 88)
16:32:29:WU00:FS00:0xa7:Unit: 0x000000670002894b5c929a827ef591f7
16:32:29:WU00:FS00:0xa7:Digital signatures verified
16:32:29:WU00:FS00:0xa7:Calling: mdrun -s frame88.tpr -o frame88.trr -cpt 15 -nt 3
16:32:30:WU00:FS00:0xa7:Steps: first=110000000 total=1250000
16:32:30:WU00:FS00:0xa7:Completed 1 out of 1250000 steps (0%)
16:38:27:WU00:FS00:0xa7:Completed 12500 out of 1250000 steps (1%)
16:40:33:WARNING:WU00:FS00:FahCore returned an unknown error code which probably indicates that it crashed
16:40:33:WARNING:WU00:FS00:FahCore returned: WU_STALLED (127 = 0x7f)
16:40:33:WU00:FS00:Starting
16:40:33:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -np 3
16:40:33:WU00:FS00:Started FahCore on PID 6172
16:40:33:WU00:FS00:Core PID:6432
16:40:33:WU00:FS00:FahCore 0xa7 started
16:40:34:WU00:FS00:0xa7:*********************** Log Started 2019-06-27T16:40:33Z ***********************
16:40:34:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:40:34:WU00:FS00:0xa7:       Type: 0xa7
16:40:34:WU00:FS00:0xa7:       Core: Gromacs
16:40:34:WU00:FS00:0xa7:    Website: https://foldingathome.org/
16:40:34:WU00:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
16:40:34:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:40:34:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 6172 -checkpoint 15 -np 3
16:40:34:WU00:FS00:0xa7:     Config: <none>
16:40:34:WU00:FS00:0xa7:************************************ Build *************************************
16:40:34:WU00:FS00:0xa7:    Version: 0.0.17
16:40:34:WU00:FS00:0xa7:       Date: Apr 27 2018
16:40:34:WU00:FS00:0xa7:       Time: 16:19:36
16:40:34:WU00:FS00:0xa7: Repository: Git
16:40:34:WU00:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
16:40:34:WU00:FS00:0xa7:     Branch: master
16:40:34:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:40:34:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:40:34:WU00:FS00:0xa7:   Platform: win32 10
16:40:34:WU00:FS00:0xa7:       Bits: 64
16:40:34:WU00:FS00:0xa7:       Mode: Release
16:40:34:WU00:FS00:0xa7:       SIMD: avx_256
16:40:34:WU00:FS00:0xa7:************************************ System ************************************
16:40:34:WU00:FS00:0xa7:        CPU: Unknown
16:40:34:WU00:FS00:0xa7:     CPU ID: 
16:40:34:WU00:FS00:0xa7:       CPUs: 4
16:40:34:WU00:FS00:0xa7:     Memory: 15.95GiB
16:40:34:WU00:FS00:0xa7:Free Memory: 12.89GiB
16:40:34:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
16:40:34:WU00:FS00:0xa7: OS Version: 6.1
16:40:34:WU00:FS00:0xa7:Has Battery: false
16:40:34:WU00:FS00:0xa7: On Battery: false
16:40:34:WU00:FS00:0xa7: UTC Offset: -7
16:40:34:WU00:FS00:0xa7:        PID: 6432
16:40:34:WU00:FS00:0xa7:        CWD: C:\Users\Kurt\AppData\Roaming\FAHClient\work
16:40:34:WU00:FS00:0xa7:         OS: Windows 7 Professional Service Pack 1
16:40:34:WU00:FS00:0xa7:    OS Arch: AMD64
16:40:34:WU00:FS00:0xa7:********************************************************************************
16:40:34:WU00:FS00:0xa7:Project: 14106 (Run 17, Clone 14, Gen 88)
16:40:34:WU00:FS00:0xa7:Unit: 0x000000670002894b5c929a827ef591f7
16:40:34:WU00:FS00:0xa7:Digital signatures verified
16:40:34:WU00:FS00:0xa7:Calling: mdrun -s frame88.tpr -o frame88.trr -cpt 15 -nt 3
16:40:34:WU00:FS00:0xa7:Steps: first=110000000 total=1250000
16:40:35:WU00:FS00:0xa7:Completed 1 out of 1250000 steps (0%)
16:41:24:FS00:Paused
16:41:24:FS01:Paused
16:41:24:FS00:Shutting core down
16:41:24:FS01:Shutting core down
16:41:24:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 6432
16:41:24:WU00:FS00:0xa7:Exiting, please wait. . .
16:41:24:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
16:41:25:WU00:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
16:41:25:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
16:41:38:Removing old file 'configs/config-20190106-211532.xml'
16:41:38:Saving configuration to config.xml
16:41:38:<config>
16:41:38:  <!-- Network -->
16:41:38:  <proxy v=':8080'/>
16:41:38:
16:41:38:  <!-- Slot Control -->
16:41:38:  <power v='full'/>
16:41:38:
16:41:38:  <!-- User Information -->
16:41:38:  <passkey v='********************************'/>
16:41:38:  <team v='4'/>
16:41:38:  <user v='suprleg'/>
16:41:38:
16:41:38:  <!-- Folding Slots -->
16:41:38:  <slot id='0' type='CPU'>
16:41:38:    <client-type v='advanced'/>
16:41:38:    <paused v='true'/>
16:41:38:  </slot>
16:41:38:  <slot id='1' type='GPU'>
16:41:38:    <client-type v='advanced'/>
16:41:38:    <paused v='true'/>
16:41:38:  </slot>
16:41:38:</config>
16:43:27:FS00:Unpaused
16:43:27:FS01:Unpaused
16:43:27:WU00:FS00:Starting
16:43:27:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -np 3
16:43:27:WU00:FS00:Started FahCore on PID 640
16:43:27:WU00:FS00:Core PID:2244
16:43:27:WU00:FS00:FahCore 0xa7 started
16:43:27:WU01:FS01:Starting
16:43:27:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Kurt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 705 -lifeline 4572 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
16:43:27:WU01:FS01:Started FahCore on PID 6740
16:43:27:WU01:FS01:Core PID:5740
16:43:27:WU01:FS01:FahCore 0x21 started
16:43:27:WU00:FS00:0xa7:*********************** Log Started 2019-06-27T16:43:27Z ***********************
16:43:27:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:43:27:WU00:FS00:0xa7:       Type: 0xa7
16:43:27:WU00:FS00:0xa7:       Core: Gromacs
16:43:27:WU00:FS00:0xa7:    Website: https://foldingathome.org/
16:43:27:WU00:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
16:43:27:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:43:27:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 640 -checkpoint 15 -np 3
16:43:27:WU00:FS00:0xa7:     Config: <none>
16:43:27:WU00:FS00:0xa7:************************************ Build *************************************
16:43:27:WU00:FS00:0xa7:    Version: 0.0.17
16:43:27:WU00:FS00:0xa7:       Date: Apr 27 2018
16:43:27:WU00:FS00:0xa7:       Time: 16:19:36
16:43:27:WU00:FS00:0xa7: Repository: Git
16:43:27:WU00:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
16:43:27:WU00:FS00:0xa7:     Branch: master
16:43:27:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:43:27:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:43:27:WU00:FS00:0xa7:   Platform: win32 10
16:43:27:WU00:FS00:0xa7:       Bits: 64
16:43:27:WU00:FS00:0xa7:       Mode: Release
16:43:27:WU00:FS00:0xa7:       SIMD: avx_256
16:43:27:WU00:FS00:0xa7:************************************ System ************************************
16:43:27:WU00:FS00:0xa7:        CPU: Unknown
16:43:27:WU00:FS00:0xa7:     CPU ID: 
16:43:27:WU00:FS00:0xa7:       CPUs: 4
16:43:27:WU00:FS00:0xa7:     Memory: 15.95GiB
16:43:27:WU00:FS00:0xa7:Free Memory: 13.02GiB
16:43:27:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
16:43:27:WU00:FS00:0xa7: OS Version: 6.1
16:43:27:WU00:FS00:0xa7:Has Battery: false
16:43:27:WU00:FS00:0xa7: On Battery: false
16:43:27:WU00:FS00:0xa7: UTC Offset: -7
16:43:27:WU00:FS00:0xa7:        PID: 2244
16:43:27:WU00:FS00:0xa7:        CWD: C:\Users\Kurt\AppData\Roaming\FAHClient\work
16:43:27:WU00:FS00:0xa7:         OS: Windows 7 Professional Service Pack 1
16:43:27:WU00:FS00:0xa7:    OS Arch: AMD64
16:43:27:WU00:FS00:0xa7:********************************************************************************
16:43:27:WU00:FS00:0xa7:Project: 14106 (Run 17, Clone 14, Gen 88)
16:43:27:WU00:FS00:0xa7:Unit: 0x000000670002894b5c929a827ef591f7
16:43:27:WU00:FS00:0xa7:Digital signatures verified
16:43:27:WU00:FS00:0xa7:Calling: mdrun -s frame88.tpr -o frame88.trr -cpi state.cpt -cpt 15 -nt 3
16:43:27:WU00:FS00:0xa7:Steps: first=110000000 total=1250000
16:43:28:WU00:FS00:0xa7:Completed 1772 out of 1250000 steps (0%)
16:43:40:Removing old file 'configs/config-20190107-035101.xml'
16:43:40:Saving configuration to config.xml
16:43:40:<config>
16:43:40:  <!-- Network -->
16:43:40:  <proxy v=':8080'/>
16:43:40:
16:43:40:  <!-- Slot Control -->
16:43:40:  <power v='full'/>
16:43:40:
16:43:40:  <!-- User Information -->
16:43:40:  <passkey v='********************************'/>
16:43:40:  <team v='4'/>
16:43:40:  <user v='suprleg'/>
16:43:40:
16:43:40:  <!-- Folding Slots -->
16:43:40:  <slot id='0' type='CPU'>
16:43:40:    <client-type v='advanced'/>
16:43:40:  </slot>
16:43:40:  <slot id='1' type='GPU'>
16:43:40:    <client-type v='advanced'/>
16:43:40:  </slot>
16:43:40:</config>
Top
suprleg
Posts: 57
Joined: Thu Apr 26, 2012 8:30 pm

Re: GTX 1070 Suddenly Not Folding

Post by suprleg »

Snippet from client log, 'warnings and errors:

Code: Select all

*********************** Log Started 2019-06-27T16:32:29Z ***********************
16:40:33:WARNING:WU00:FS00:FahCore returned an unknown error code which probably indicates that it crashed
16:40:33:WARNING:WU00:FS00:FahCore returned: WU_STALLED (127 = 0x7f)
16:41:24:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 6432
17:25:00:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 2244
18:39:48:WARNING:WU01:FS01:Produced no results, failing
******************************* Date: 2019-06-27 *******************************
01:46:35:WARNING:WU02:FS01:Produced no results, failing
******************************* Date: 2019-06-28 *******************************
05:31:03:WARNING:WU01:FS01:Produced no results, failing
05:31:07:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
******************************* Date: 2019-06-28 *******************************
12:59:14:WARNING:WU00:FS01:Produced no results, failing
I should mention that during this time my GTX1070 was operating at 100%...
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GTX 1070 Suddenly Not Folding

Post by bruce »

So what happened between 16:43:28 and 16:40:33? Did it run normally for 24 hours?

Are you monitoring the temperature and voltage (etc.) of that GPU? Is your GPU overclocked? When was the NVidia Driver updated to 430.86?
Top
suprleg
Posts: 57
Joined: Thu Apr 26, 2012 8:30 pm

Re: GTX 1070 Suddenly Not Folding

Post by suprleg »

bruce wrote:So what happened between 16:43:28 and 16:40:33? Did it run normally for 24 hours?

Are you monitoring the temperature and voltage (etc.) of that GPU? Is your GPU overclocked? When was the NVidia Driver updated to 430.86?
1. Nothing happened. No
2. Yes, normal
3 No
4. As stated, yesterday.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GTX 1070 Suddenly Not Folding

Post by bruce »

So during that 24 hrs, no progress was made and no messages were issued during that period and then suddenly it reported an error 23.9 hrs later?

Have you used more than one logon ID to your OS?
Top
NuovaApe
Posts: 53
Joined: Mon Jun 17, 2019 12:49 pm

Re: GTX 1070 Suddenly Not Folding

Post by NuovaApe »

Always worth looking in Windows Event Viewer / Windows Logs / Application for crash info around that time.

Windows is quite good at logging fatal app errors - just look for "!Error" in the Level column.

Here's one I made earlier...

Code: Select all

Faulting application name: FahCore_a7.exe, version: 0.0.0.0, time stamp: 0x5ae3bb5e
Faulting module name: FahCore_a7.exe, version: 0.0.0.0, time stamp: 0x5ae3bb5e
Exception code: 0xc0000409
blah blah blah
I've seen processes become unfathomably busted after patching @ work and the system needed restarting. I mean proper "loads, runs, but isn't doing anything" and involved Microsoft C/C++ libraries, which a7 Win uses...
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GTX 1070 Suddenly Not Folding

Post by bruce »

https://answers.microsoft.com/en-us/win ... 5ed718f3e3
Top
NuovaApe
Posts: 53
Joined: Mon Jun 17, 2019 12:49 pm

Re: GTX 1070 Suddenly Not Folding

Post by NuovaApe »

I had actually loaded the .dmp into WinDbg and analysed the fault, but I didn't want to bore everyone with the details :D

My PC was running red hot at the time plus flaky drivers so all bets are off...

Code: Select all

This dump file has an exception of interest stored in it.
The stored exception information can be accessed via .ecxr.
(22c4.1d0c): Security check failure or stack buffer overrun - code c0000409 (first/second chance not available)
For analysis of this file, run !analyze -v
*** WARNING: Unable to verify checksum for FAHViewer.exe
eax=00000001 ebx=006ff3cc ecx=00000007 edx=000001e0 esi=00000000 edi=01b8c360
eip=0111bd1b esp=006fd768 ebp=006fd798 iopl=0         nv up ei pl nz na po nc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00200202
FAHViewer+0x2bbd1b:
0111bd1b cd29            int     29h
0:000> .exr -1
ExceptionAddress: 0111bd1b (FAHViewer+0x002bbd1b)
   ExceptionCode: c0000409 (Security check failure or stack buffer overrun)
  ExceptionFlags: 00000001
NumberParameters: 1
   Parameter[0]: 00000007
Subcode: 0x7 FAST_FAIL_FATAL_APP_EXIT
:eugeek:

I thoroughly enjoyed this

https://channel9.msdn.com/Shows/Inside/C0000409
Top
Post Reply

Return to “Problems with NVidia drivers”