Project 13429 issued to AMD Vega 64

If you think it might be a driver problem, see viewforum.php?f=79

Moderators: Site Moderators, FAHC Science Team

FaaR
Posts: 66
Joined: Tue Aug 19, 2008 1:32 am

Project 13429 issued to AMD Vega 64

Post by FaaR »

Not sure if this is the correct forum (I tried to do an educated guess), but this project has extremely low efficiency on AMD Vega 64 (less than 200k PPD).

Is there really nothing else to give to me at the moment? I'd rather my GPUs idle than spend a lot of power folding such low-yielding work units.

Thank you. :)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Project 13429 issued to AMD Vega 64

Post by Neil-B »

I would perhaps have expected you to get the *28 Project WUs - if any (as I know sometimes AMD cards don't work well with specific projects)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
mwroggenbuck
Posts: 127
Joined: Tue Mar 24, 2020 12:47 pm

Re: Project 13429 issued to AMD Vega 64

Post by mwroggenbuck »

I have noticed the same thing on both my AMD and Nvidia cards. The GPU load is significantly lower.
JohnChodera
Pande Group Member
Posts: 470
Joined: Fri Feb 22, 2013 9:59 pm

Re: Project 13429 issued to AMD Vega 64

Post by JohnChodera »

Thanks for the heads up, folks! I've just restricted 13429 to GPUSpecies<5 for AMD so that it won't be assigned to VEGA 64 cards anymore.

~ John Chodera // MSKCC
BobWilliams757
Posts: 493
Joined: Fri Apr 03, 2020 2:22 pm
Hardware configuration: ASRock X370M PRO4
Ryzen 2400G APU
16 GB DDR4-3200
MSI GTX 1660 Super Gaming X

Re: Project 13429 issued to AMD Vega 64

Post by BobWilliams757 »

Just passing for info, but those work units seem to work fine with the Vega 11 onboard graphics. Though I had some variance in the three WU's I got, all were above normal expectations, and gave PPD as high as the 160K range. I have no idea how the APU's classify in the grand scheme of things, but they seem to eat up the smaller atom count work units.
Fold them if you get them!
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Project 13429 issued to AMD Vega 64

Post by Neil-B »

has relatively low shader count iirc so should work nicely with the smaller (odd numbered) sprint projects :)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
BobWilliams757
Posts: 493
Joined: Fri Apr 03, 2020 2:22 pm
Hardware configuration: ASRock X370M PRO4
Ryzen 2400G APU
16 GB DDR4-3200
MSI GTX 1660 Super Gaming X

Re: Project 13429 issued to AMD Vega 64

Post by BobWilliams757 »

Neil-B wrote:has relatively low shader count iirc so should work nicely with the smaller (odd numbered) sprint projects :)
That has been the case, but often fate keeps me from getting many of them. :lol:

I just fold. I do understand that people with more money and power draw invested get frustrated at point returns when they are low, but in the end it all balances out. They can't optimize all the WU's for every computer easily, and it's sort of a "win some, lose some" scenario IMHO.

I just fold them. Unless I think the input will help a researcher, or avoid people missing deadlines.... I just fold them.
Fold them if you get them!
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Project 13429 issued to AMD Vega 64

Post by Neil-B »

I hear you .. Same for me .. Fold on :)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Kebast
Posts: 386
Joined: Thu Aug 06, 2015 5:21 pm

Re: Project 13429 issued to AMD Vega 64

Post by Kebast »

Getting some insane PPD from this WU. Almost double normal range
Image
Ryzen 5900x 12T - RTX 4070 TI
NormalDiffusion
Posts: 124
Joined: Sat Apr 18, 2020 1:50 pm

Re: Project 13429 issued to AMD Vega 64

Post by NormalDiffusion »

Radeon VII and Vega are getting 13429 again, with extremely low PPD as a result.
BobWilliams757
Posts: 493
Joined: Fri Apr 03, 2020 2:22 pm
Hardware configuration: ASRock X370M PRO4
Ryzen 2400G APU
16 GB DDR4-3200
MSI GTX 1660 Super Gaming X

Re: Project 13429 issued to AMD Vega 64

Post by BobWilliams757 »

Kebast wrote:Getting some insane PPD from this WU. Almost double normal range
Same here. The little onboard Vega 11 loves them. Currently at 160K + PPD
Fold them if you get them!
belloq
Posts: 40
Joined: Thu Sep 24, 2020 12:58 pm

Re: Project 13429 issued to AMD Vega 64

Post by belloq »

I am getting WU from 13429 today on my Intel UHD 630, and they are failing. My GPU actually went into "FAILED" state in the client. I restarted it yesterday, but since then it has not successfully completed a WU. The common error is "Particle coordinate is nan." Everything was running fine on this GPU until relatively recently. No change to drivers has occurred.

Code: Select all

*********************** Log Started 2021-01-11T16:52:45Z ***********************
16:52:45:WARNING:FS01:Guessing ambiguous GPU to OpenCL device mapping for 01: gpu:0:2 CFL GT2 [UHD Graphics 630].  Consider upgrading your graphics driver or manually setting ``opencl-index`` in this slot's configuration.
16:52:45:FS01:Initialized folding slot 01: gpu:0:2 CFL GT2 [UHD Graphics 630]
16:52:48:WU01:FS01:Connecting to assign1.foldingathome.org:80
16:52:49:WU01:FS01:Assigned to work server 18.188.125.154
16:52:49:WU01:FS01:Requesting new work unit for slot 01: gpu:0:2 CFL GT2 [UHD Graphics 630] from 18.188.125.154
16:52:49:WU01:FS01:Connecting to 18.188.125.154:8080
16:52:50:WU01:FS01:Downloading 363.29KiB
16:52:50:WU01:FS01:Download complete
16:52:51:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13439 run:8753 clone:47 gen:1 core:0x22 unit:0x0000002f000000010000347f00002231
16:52:51:WU01:FS01:Starting
16:52:51:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
16:52:51:WU01:FS01:Started FahCore on PID 101668
16:52:52:WU01:FS01:Core PID:101712
16:52:52:WU01:FS01:FahCore 0x22 started
16:52:52:WU01:FS01:0x22:*********************** Log Started 2021-01-11T16:52:52Z ***********************
16:52:52:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
16:52:52:WU01:FS01:0x22:       Core: Core22
16:52:52:WU01:FS01:0x22:       Type: 0x22
16:52:52:WU01:FS01:0x22:    Version: 0.0.13
16:52:52:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:52:52:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
16:52:52:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
16:52:52:WU01:FS01:0x22:       Date: Sep 19 2020
16:52:52:WU01:FS01:0x22:       Time: 02:35:58
16:52:52:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
16:52:52:WU01:FS01:0x22:     Branch: core22-0.0.13
16:52:52:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:52:52:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:52:52:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
16:52:52:WU01:FS01:0x22:   Platform: win32 10
16:52:52:WU01:FS01:0x22:       Bits: 64
16:52:52:WU01:FS01:0x22:       Mode: Release
16:52:52:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
16:52:52:WU01:FS01:0x22:             <peastman@stanford.edu>
16:52:52:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 101668 -checkpoint 15
16:52:52:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
16:52:52:WU01:FS01:0x22:             -gpu-usage 100
16:52:52:WU01:FS01:0x22:************************************ libFAH ************************************
16:52:52:WU01:FS01:0x22:       Date: Sep 7 2020
16:52:52:WU01:FS01:0x22:       Time: 19:09:56
16:52:52:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
16:52:52:WU01:FS01:0x22:     Branch: HEAD
16:52:52:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:52:52:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:52:52:WU01:FS01:0x22:   Platform: win32 10
16:52:52:WU01:FS01:0x22:       Bits: 64
16:52:52:WU01:FS01:0x22:       Mode: Release
16:52:52:WU01:FS01:0x22:************************************ CBang *************************************
16:52:52:WU01:FS01:0x22:       Date: Sep 7 2020
16:52:52:WU01:FS01:0x22:       Time: 19:08:30
16:52:52:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
16:52:52:WU01:FS01:0x22:     Branch: HEAD
16:52:52:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:52:52:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:52:52:WU01:FS01:0x22:   Platform: win32 10
16:52:52:WU01:FS01:0x22:       Bits: 64
16:52:52:WU01:FS01:0x22:       Mode: Release
16:52:52:WU01:FS01:0x22:************************************ System ************************************
16:52:52:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
16:52:52:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
16:52:52:WU01:FS01:0x22:       CPUs: 12
16:52:52:WU01:FS01:0x22:     Memory: 31.71GiB
16:52:52:WU01:FS01:0x22:Free Memory: 15.98GiB
16:52:52:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
16:52:52:WU01:FS01:0x22: OS Version: 6.2
16:52:52:WU01:FS01:0x22:Has Battery: true
16:52:52:WU01:FS01:0x22: On Battery: false
16:52:52:WU01:FS01:0x22: UTC Offset: -8
16:52:52:WU01:FS01:0x22:        PID: 101712
16:52:52:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
16:52:52:WU01:FS01:0x22:************************************ OpenMM ************************************
16:52:52:WU01:FS01:0x22:   Revision: 189320d0
16:52:52:WU01:FS01:0x22:********************************************************************************
16:52:52:WU01:FS01:0x22:Project: 13439 (Run 8753, Clone 47, Gen 1)
16:52:52:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
16:52:52:WU01:FS01:0x22:Reading tar file core.xml
16:52:52:WU01:FS01:0x22:Reading tar file integrator.xml.bz2
16:52:52:WU01:FS01:0x22:Reading tar file state.xml.bz2
16:52:52:WU01:FS01:0x22:Reading tar file system.xml.bz2
16:52:52:WU01:FS01:0x22:Digital signatures verified
16:52:52:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
16:52:52:WU01:FS01:0x22:Version 0.0.13
16:52:53:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
16:52:53:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
16:52:53:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
16:52:53:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
16:52:53:WU01:FS01:0x22:There are 3 platforms available.
16:52:53:WU01:FS01:0x22:Platform 0: Reference
16:52:53:WU01:FS01:0x22:Platform 1: CPU
16:52:53:WU01:FS01:0x22:Platform 2: OpenCL
16:52:53:WU01:FS01:0x22:  opencl-device 0 specified
16:52:53:WU01:FS01:0x22:Attempting to create OpenCL context:
16:52:53:WU01:FS01:0x22:  Configuring platform OpenCL
16:53:14:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
16:53:14:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
16:53:14:WU01:FS01:0x22:Checkpoint completed at step 0
16:56:01:WU01:FS01:0x22:An exception occurred at step 8282: Particle coordinate is nan
16:56:01:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
16:56:01:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
16:56:01:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
16:56:01:WU01:FS01:Starting
16:56:01:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
16:56:02:WU01:FS01:Started FahCore on PID 98128
16:56:03:WU01:FS01:Core PID:59520
16:56:03:WU01:FS01:FahCore 0x22 started
16:56:04:WU01:FS01:0x22:*********************** Log Started 2021-01-11T16:56:03Z ***********************
16:56:04:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
16:56:04:WU01:FS01:0x22:       Core: Core22
16:56:04:WU01:FS01:0x22:       Type: 0x22
16:56:04:WU01:FS01:0x22:    Version: 0.0.13
16:56:04:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:56:04:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
16:56:04:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
16:56:04:WU01:FS01:0x22:       Date: Sep 19 2020
16:56:04:WU01:FS01:0x22:       Time: 02:35:58
16:56:04:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
16:56:04:WU01:FS01:0x22:     Branch: core22-0.0.13
16:56:04:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:56:04:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:56:04:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
16:56:04:WU01:FS01:0x22:   Platform: win32 10
16:56:04:WU01:FS01:0x22:       Bits: 64
16:56:04:WU01:FS01:0x22:       Mode: Release
16:56:04:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
16:56:04:WU01:FS01:0x22:             <peastman@stanford.edu>
16:56:04:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 98128 -checkpoint 15
16:56:04:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
16:56:04:WU01:FS01:0x22:             -gpu-usage 100
16:56:04:WU01:FS01:0x22:************************************ libFAH ************************************
16:56:04:WU01:FS01:0x22:       Date: Sep 7 2020
16:56:04:WU01:FS01:0x22:       Time: 19:09:56
16:56:04:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
16:56:04:WU01:FS01:0x22:     Branch: HEAD
16:56:04:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:56:04:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:56:04:WU01:FS01:0x22:   Platform: win32 10
16:56:04:WU01:FS01:0x22:       Bits: 64
16:56:04:WU01:FS01:0x22:       Mode: Release
16:56:04:WU01:FS01:0x22:************************************ CBang *************************************
16:56:04:WU01:FS01:0x22:       Date: Sep 7 2020
16:56:04:WU01:FS01:0x22:       Time: 19:08:30
16:56:04:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
16:56:04:WU01:FS01:0x22:     Branch: HEAD
16:56:04:WU01:FS01:0x22:   Compiler: Visual C++ 2015
16:56:04:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
16:56:04:WU01:FS01:0x22:   Platform: win32 10
16:56:04:WU01:FS01:0x22:       Bits: 64
16:56:04:WU01:FS01:0x22:       Mode: Release
16:56:04:WU01:FS01:0x22:************************************ System ************************************
16:56:04:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
16:56:04:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
16:56:04:WU01:FS01:0x22:       CPUs: 12
16:56:04:WU01:FS01:0x22:     Memory: 31.71GiB
16:56:04:WU01:FS01:0x22:Free Memory: 16.14GiB
16:56:04:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
16:56:04:WU01:FS01:0x22: OS Version: 6.2
16:56:04:WU01:FS01:0x22:Has Battery: true
16:56:04:WU01:FS01:0x22: On Battery: false
16:56:04:WU01:FS01:0x22: UTC Offset: -8
16:56:04:WU01:FS01:0x22:        PID: 59520
16:56:04:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
16:56:04:WU01:FS01:0x22:************************************ OpenMM ************************************
16:56:04:WU01:FS01:0x22:   Revision: 189320d0
16:56:04:WU01:FS01:0x22:********************************************************************************
16:56:04:WU01:FS01:0x22:Project: 13439 (Run 8753, Clone 47, Gen 1)
16:56:04:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
16:56:04:WU01:FS01:0x22:Digital signatures verified
16:56:04:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
16:56:04:WU01:FS01:0x22:Version 0.0.13
16:56:04:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
16:56:04:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
16:56:04:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
16:56:04:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
16:56:04:WU01:FS01:0x22:There are 3 platforms available.
16:56:04:WU01:FS01:0x22:Platform 0: Reference
16:56:04:WU01:FS01:0x22:Platform 1: CPU
16:56:04:WU01:FS01:0x22:Platform 2: OpenCL
16:56:04:WU01:FS01:0x22:  opencl-device 0 specified
16:56:06:WU01:FS01:0x22:Attempting to create OpenCL context:
16:56:06:WU01:FS01:0x22:  Configuring platform OpenCL
16:56:42:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
16:56:42:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
17:00:14:WU01:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
17:03:41:WU01:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
17:07:06:WU01:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
17:10:31:WU01:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
17:13:39:WU01:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
17:13:39:WU01:FS01:0x22:Checkpoint completed at step 50000
17:16:58:WU01:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
17:19:51:WU01:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
17:20:56:WU01:FS01:0x22:An exception occurred at step 73291: Particle coordinate is nan
17:20:56:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
17:20:56:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
17:20:56:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
17:20:57:WU01:FS01:Starting
17:20:57:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
17:20:57:WU01:FS01:Started FahCore on PID 74468
17:20:57:WU01:FS01:Core PID:101396
17:20:57:WU01:FS01:FahCore 0x22 started
17:20:58:WU01:FS01:0x22:*********************** Log Started 2021-01-11T17:20:57Z ***********************
17:20:58:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
17:20:58:WU01:FS01:0x22:       Core: Core22
17:20:58:WU01:FS01:0x22:       Type: 0x22
17:20:58:WU01:FS01:0x22:    Version: 0.0.13
17:20:58:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:20:58:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
17:20:58:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
17:20:58:WU01:FS01:0x22:       Date: Sep 19 2020
17:20:58:WU01:FS01:0x22:       Time: 02:35:58
17:20:58:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
17:20:58:WU01:FS01:0x22:     Branch: core22-0.0.13
17:20:58:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:20:58:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:20:58:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
17:20:58:WU01:FS01:0x22:   Platform: win32 10
17:20:58:WU01:FS01:0x22:       Bits: 64
17:20:58:WU01:FS01:0x22:       Mode: Release
17:20:58:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
17:20:58:WU01:FS01:0x22:             <peastman@stanford.edu>
17:20:58:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 74468 -checkpoint 15
17:20:58:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
17:20:58:WU01:FS01:0x22:             -gpu-usage 100
17:20:58:WU01:FS01:0x22:************************************ libFAH ************************************
17:20:58:WU01:FS01:0x22:       Date: Sep 7 2020
17:20:58:WU01:FS01:0x22:       Time: 19:09:56
17:20:58:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
17:20:58:WU01:FS01:0x22:     Branch: HEAD
17:20:58:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:20:58:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:20:58:WU01:FS01:0x22:   Platform: win32 10
17:20:58:WU01:FS01:0x22:       Bits: 64
17:20:58:WU01:FS01:0x22:       Mode: Release
17:20:58:WU01:FS01:0x22:************************************ CBang *************************************
17:20:58:WU01:FS01:0x22:       Date: Sep 7 2020
17:20:58:WU01:FS01:0x22:       Time: 19:08:30
17:20:58:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
17:20:58:WU01:FS01:0x22:     Branch: HEAD
17:20:58:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:20:58:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:20:58:WU01:FS01:0x22:   Platform: win32 10
17:20:58:WU01:FS01:0x22:       Bits: 64
17:20:58:WU01:FS01:0x22:       Mode: Release
17:20:58:WU01:FS01:0x22:************************************ System ************************************
17:20:58:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
17:20:58:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
17:20:58:WU01:FS01:0x22:       CPUs: 12
17:20:58:WU01:FS01:0x22:     Memory: 31.71GiB
17:20:58:WU01:FS01:0x22:Free Memory: 16.08GiB
17:20:58:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
17:20:58:WU01:FS01:0x22: OS Version: 6.2
17:20:58:WU01:FS01:0x22:Has Battery: true
17:20:58:WU01:FS01:0x22: On Battery: false
17:20:58:WU01:FS01:0x22: UTC Offset: -8
17:20:58:WU01:FS01:0x22:        PID: 101396
17:20:58:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
17:20:58:WU01:FS01:0x22:************************************ OpenMM ************************************
17:20:58:WU01:FS01:0x22:   Revision: 189320d0
17:20:58:WU01:FS01:0x22:********************************************************************************
17:20:58:WU01:FS01:0x22:Project: 13439 (Run 8753, Clone 47, Gen 1)
17:20:58:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
17:20:58:WU01:FS01:0x22:Digital signatures verified
17:20:58:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
17:20:58:WU01:FS01:0x22:Version 0.0.13
17:20:58:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
17:20:58:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
17:20:58:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
17:20:58:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
17:20:58:WU01:FS01:0x22:There are 3 platforms available.
17:20:58:WU01:FS01:0x22:Platform 0: Reference
17:20:58:WU01:FS01:0x22:Platform 1: CPU
17:20:58:WU01:FS01:0x22:Platform 2: OpenCL
17:20:58:WU01:FS01:0x22:  opencl-device 0 specified
17:20:58:WU01:FS01:0x22:Attempting to create OpenCL context:
17:20:58:WU01:FS01:0x22:  Configuring platform OpenCL
17:21:27:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
17:21:27:WU01:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
17:24:45:WU01:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
17:28:13:WU01:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
17:31:55:WU01:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
17:36:04:WU01:FS01:0x22:An exception occurred at step 89606: Particle coordinate is nan
17:36:04:WU01:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
17:36:04:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
17:36:04:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
17:36:04:WU01:FS01:0x22:Saving result file globals.csv
17:36:04:WU01:FS01:0x22:Saving result file science.log
17:36:04:WU01:FS01:0x22:Saving result file state.xml.bz2
17:36:04:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
17:36:04:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:36:04:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13439 run:8753 clone:47 gen:1 core:0x22 unit:0x0000002f000000010000347f00002231
17:36:04:WU01:FS01:Uploading 311.32KiB to 18.188.125.154
17:36:04:WU01:FS01:Connecting to 18.188.125.154:8080
17:36:05:WU02:FS01:Connecting to assign1.foldingathome.org:80
17:36:05:WU02:FS01:Assigned to work server 18.188.125.154
17:36:05:WU02:FS01:Requesting new work unit for slot 01: gpu:0:2 CFL GT2 [UHD Graphics 630] from 18.188.125.154
17:36:05:WU02:FS01:Connecting to 18.188.125.154:8080
17:36:06:WU02:FS01:Downloading 359.62KiB
17:36:06:WU02:FS01:Download complete
17:36:06:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13439 run:8755 clone:10 gen:1 core:0x22 unit:0x0000000a000000010000347f00002233
17:36:06:WU02:FS01:Starting
17:36:06:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
17:36:07:WU02:FS01:Started FahCore on PID 100104
17:36:07:WU02:FS01:Core PID:7548
17:36:07:WU02:FS01:FahCore 0x22 started
17:36:08:WU01:FS01:Upload complete
17:36:08:WU02:FS01:0x22:*********************** Log Started 2021-01-11T17:36:07Z ***********************
17:36:08:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
17:36:08:WU02:FS01:0x22:       Core: Core22
17:36:08:WU02:FS01:0x22:       Type: 0x22
17:36:08:WU02:FS01:0x22:    Version: 0.0.13
17:36:08:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:36:08:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
17:36:08:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
17:36:08:WU02:FS01:0x22:       Date: Sep 19 2020
17:36:08:WU02:FS01:0x22:       Time: 02:35:58
17:36:08:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
17:36:08:WU02:FS01:0x22:     Branch: core22-0.0.13
17:36:08:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:36:08:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:36:08:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
17:36:08:WU02:FS01:0x22:   Platform: win32 10
17:36:08:WU02:FS01:0x22:       Bits: 64
17:36:08:WU02:FS01:0x22:       Mode: Release
17:36:08:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
17:36:08:WU02:FS01:0x22:             <peastman@stanford.edu>
17:36:08:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 100104 -checkpoint 15
17:36:08:WU02:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
17:36:08:WU02:FS01:0x22:             -gpu-usage 100
17:36:08:WU02:FS01:0x22:************************************ libFAH ************************************
17:36:08:WU02:FS01:0x22:       Date: Sep 7 2020
17:36:08:WU02:FS01:0x22:       Time: 19:09:56
17:36:08:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
17:36:08:WU02:FS01:0x22:     Branch: HEAD
17:36:08:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:36:08:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:36:08:WU02:FS01:0x22:   Platform: win32 10
17:36:08:WU02:FS01:0x22:       Bits: 64
17:36:08:WU02:FS01:0x22:       Mode: Release
17:36:08:WU02:FS01:0x22:************************************ CBang *************************************
17:36:08:WU02:FS01:0x22:       Date: Sep 7 2020
17:36:08:WU02:FS01:0x22:       Time: 19:08:30
17:36:08:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
17:36:08:WU02:FS01:0x22:     Branch: HEAD
17:36:08:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:36:08:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:36:08:WU02:FS01:0x22:   Platform: win32 10
17:36:08:WU02:FS01:0x22:       Bits: 64
17:36:08:WU02:FS01:0x22:       Mode: Release
17:36:08:WU02:FS01:0x22:************************************ System ************************************
17:36:08:WU02:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
17:36:08:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
17:36:08:WU02:FS01:0x22:       CPUs: 12
17:36:08:WU02:FS01:0x22:     Memory: 31.71GiB
17:36:08:WU02:FS01:0x22:Free Memory: 16.30GiB
17:36:08:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
17:36:08:WU02:FS01:0x22: OS Version: 6.2
17:36:08:WU02:FS01:0x22:Has Battery: true
17:36:08:WU02:FS01:0x22: On Battery: false
17:36:08:WU02:FS01:0x22: UTC Offset: -8
17:36:08:WU02:FS01:0x22:        PID: 7548
17:36:08:WU02:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
17:36:08:WU02:FS01:0x22:************************************ OpenMM ************************************
17:36:08:WU02:FS01:0x22:   Revision: 189320d0
17:36:08:WU02:FS01:0x22:********************************************************************************
17:36:08:WU02:FS01:0x22:Project: 13439 (Run 8755, Clone 10, Gen 1)
17:36:08:WU02:FS01:0x22:Unit: 0x00000000000000000000000000000000
17:36:08:WU02:FS01:0x22:Reading tar file core.xml
17:36:08:WU02:FS01:0x22:Reading tar file integrator.xml.bz2
17:36:08:WU02:FS01:0x22:Reading tar file state.xml.bz2
17:36:08:WU02:FS01:0x22:Reading tar file system.xml.bz2
17:36:08:WU02:FS01:0x22:Digital signatures verified
17:36:08:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
17:36:08:WU02:FS01:0x22:Version 0.0.13
17:36:08:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
17:36:08:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
17:36:08:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
17:36:08:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
17:36:08:WU02:FS01:0x22:There are 3 platforms available.
17:36:08:WU02:FS01:0x22:Platform 0: Reference
17:36:08:WU02:FS01:0x22:Platform 1: CPU
17:36:08:WU02:FS01:0x22:Platform 2: OpenCL
17:36:08:WU02:FS01:0x22:  opencl-device 0 specified
17:36:08:WU02:FS01:0x22:Attempting to create OpenCL context:
17:36:08:WU02:FS01:0x22:  Configuring platform OpenCL
17:36:09:WU01:FS01:Server responded WORK_ACK (400)
17:36:09:WU01:FS01:Cleaning up
17:36:34:WU02:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
17:36:34:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
17:36:34:WU02:FS01:0x22:Checkpoint completed at step 0
17:40:17:WU02:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
17:43:39:WU02:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
17:46:56:WU02:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
17:47:18:WU02:FS01:0x22:An exception occurred at step 31374: Particle coordinate is nan
17:47:18:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
17:47:18:WU02:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
17:47:18:WARNING:WU02:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
17:47:18:WU02:FS01:Starting
17:47:18:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
17:47:19:WU02:FS01:Started FahCore on PID 101676
17:47:19:WU02:FS01:Core PID:96780
17:47:19:WU02:FS01:FahCore 0x22 started
17:47:20:WU02:FS01:0x22:*********************** Log Started 2021-01-11T17:47:19Z ***********************
17:47:20:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
17:47:20:WU02:FS01:0x22:       Core: Core22
17:47:20:WU02:FS01:0x22:       Type: 0x22
17:47:20:WU02:FS01:0x22:    Version: 0.0.13
17:47:20:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:47:20:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
17:47:20:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
17:47:20:WU02:FS01:0x22:       Date: Sep 19 2020
17:47:20:WU02:FS01:0x22:       Time: 02:35:58
17:47:20:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
17:47:20:WU02:FS01:0x22:     Branch: core22-0.0.13
17:47:20:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:47:20:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:47:20:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
17:47:20:WU02:FS01:0x22:   Platform: win32 10
17:47:20:WU02:FS01:0x22:       Bits: 64
17:47:20:WU02:FS01:0x22:       Mode: Release
17:47:20:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
17:47:20:WU02:FS01:0x22:             <peastman@stanford.edu>
17:47:20:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 101676 -checkpoint 15
17:47:20:WU02:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
17:47:20:WU02:FS01:0x22:             -gpu-usage 100
17:47:20:WU02:FS01:0x22:************************************ libFAH ************************************
17:47:20:WU02:FS01:0x22:       Date: Sep 7 2020
17:47:20:WU02:FS01:0x22:       Time: 19:09:56
17:47:20:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
17:47:20:WU02:FS01:0x22:     Branch: HEAD
17:47:20:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:47:20:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:47:20:WU02:FS01:0x22:   Platform: win32 10
17:47:20:WU02:FS01:0x22:       Bits: 64
17:47:20:WU02:FS01:0x22:       Mode: Release
17:47:20:WU02:FS01:0x22:************************************ CBang *************************************
17:47:20:WU02:FS01:0x22:       Date: Sep 7 2020
17:47:20:WU02:FS01:0x22:       Time: 19:08:30
17:47:20:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
17:47:20:WU02:FS01:0x22:     Branch: HEAD
17:47:20:WU02:FS01:0x22:   Compiler: Visual C++ 2015
17:47:20:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:47:20:WU02:FS01:0x22:   Platform: win32 10
17:47:20:WU02:FS01:0x22:       Bits: 64
17:47:20:WU02:FS01:0x22:       Mode: Release
17:47:20:WU02:FS01:0x22:************************************ System ************************************
17:47:20:WU02:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
17:47:20:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
17:47:20:WU02:FS01:0x22:       CPUs: 12
17:47:20:WU02:FS01:0x22:     Memory: 31.71GiB
17:47:20:WU02:FS01:0x22:Free Memory: 16.82GiB
17:47:20:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
17:47:20:WU02:FS01:0x22: OS Version: 6.2
17:47:20:WU02:FS01:0x22:Has Battery: true
17:47:20:WU02:FS01:0x22: On Battery: false
17:47:20:WU02:FS01:0x22: UTC Offset: -8
17:47:20:WU02:FS01:0x22:        PID: 96780
17:47:20:WU02:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
17:47:20:WU02:FS01:0x22:************************************ OpenMM ************************************
17:47:20:WU02:FS01:0x22:   Revision: 189320d0
17:47:20:WU02:FS01:0x22:********************************************************************************
17:47:20:WU02:FS01:0x22:Project: 13439 (Run 8755, Clone 10, Gen 1)
17:47:20:WU02:FS01:0x22:Unit: 0x00000000000000000000000000000000
17:47:20:WU02:FS01:0x22:Digital signatures verified
17:47:20:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
17:47:20:WU02:FS01:0x22:Version 0.0.13
17:47:20:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
17:47:20:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
17:47:20:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
17:47:20:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
17:47:20:WU02:FS01:0x22:There are 3 platforms available.
17:47:20:WU02:FS01:0x22:Platform 0: Reference
17:47:20:WU02:FS01:0x22:Platform 1: CPU
17:47:20:WU02:FS01:0x22:Platform 2: OpenCL
17:47:20:WU02:FS01:0x22:  opencl-device 0 specified
17:47:20:WU02:FS01:0x22:Attempting to create OpenCL context:
17:47:20:WU02:FS01:0x22:  Configuring platform OpenCL
17:47:43:WU02:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
17:47:43:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
17:49:04:WU02:FS01:0x22:An exception occurred at step 3262: Particle coordinate is nan
17:49:04:WU02:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
17:49:04:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
17:49:04:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
17:49:04:WU02:FS01:0x22:Saving result file globals.csv
17:49:04:WU02:FS01:0x22:Saving result file science.log
17:49:04:WU02:FS01:0x22:Saving result file state.xml.bz2
17:49:04:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
17:49:05:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:49:05:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13439 run:8755 clone:10 gen:1 core:0x22 unit:0x0000000a000000010000347f00002233
17:49:05:WU02:FS01:Uploading 310.26KiB to 18.188.125.154
17:49:05:WU02:FS01:Connecting to 18.188.125.154:8080
17:49:05:WU01:FS01:Connecting to assign1.foldingathome.org:80
17:49:06:WU01:FS01:Assigned to work server 18.188.125.154
17:49:06:WU01:FS01:Requesting new work unit for slot 01: gpu:0:2 CFL GT2 [UHD Graphics 630] from 18.188.125.154
17:49:06:WU01:FS01:Connecting to 18.188.125.154:8080
17:49:06:WU01:FS01:Downloading 360.31KiB
17:49:07:WU01:FS01:Download complete
17:49:07:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13439 run:8755 clone:12 gen:1 core:0x22 unit:0x0000000c000000010000347f00002233
17:49:07:WU01:FS01:Starting
17:49:07:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
17:49:07:WU01:FS01:Started FahCore on PID 91956
17:49:07:WU01:FS01:Core PID:24300
17:49:07:WU01:FS01:FahCore 0x22 started
17:49:08:WU01:FS01:0x22:*********************** Log Started 2021-01-11T17:49:07Z ***********************
17:49:08:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
17:49:08:WU01:FS01:0x22:       Core: Core22
17:49:08:WU01:FS01:0x22:       Type: 0x22
17:49:08:WU01:FS01:0x22:    Version: 0.0.13
17:49:08:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:49:08:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
17:49:08:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
17:49:08:WU01:FS01:0x22:       Date: Sep 19 2020
17:49:08:WU01:FS01:0x22:       Time: 02:35:58
17:49:08:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
17:49:08:WU01:FS01:0x22:     Branch: core22-0.0.13
17:49:08:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:49:08:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:49:08:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
17:49:08:WU01:FS01:0x22:   Platform: win32 10
17:49:08:WU01:FS01:0x22:       Bits: 64
17:49:08:WU01:FS01:0x22:       Mode: Release
17:49:08:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
17:49:08:WU01:FS01:0x22:             <peastman@stanford.edu>
17:49:08:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 91956 -checkpoint 15
17:49:08:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
17:49:08:WU01:FS01:0x22:             -gpu-usage 100
17:49:08:WU01:FS01:0x22:************************************ libFAH ************************************
17:49:08:WU01:FS01:0x22:       Date: Sep 7 2020
17:49:08:WU01:FS01:0x22:       Time: 19:09:56
17:49:08:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
17:49:08:WU01:FS01:0x22:     Branch: HEAD
17:49:08:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:49:08:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:49:08:WU01:FS01:0x22:   Platform: win32 10
17:49:08:WU01:FS01:0x22:       Bits: 64
17:49:08:WU01:FS01:0x22:       Mode: Release
17:49:08:WU01:FS01:0x22:************************************ CBang *************************************
17:49:08:WU01:FS01:0x22:       Date: Sep 7 2020
17:49:08:WU01:FS01:0x22:       Time: 19:08:30
17:49:08:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
17:49:08:WU01:FS01:0x22:     Branch: HEAD
17:49:08:WU01:FS01:0x22:   Compiler: Visual C++ 2015
17:49:08:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
17:49:08:WU01:FS01:0x22:   Platform: win32 10
17:49:08:WU01:FS01:0x22:       Bits: 64
17:49:08:WU01:FS01:0x22:       Mode: Release
17:49:08:WU01:FS01:0x22:************************************ System ************************************
17:49:08:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
17:49:08:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
17:49:08:WU01:FS01:0x22:       CPUs: 12
17:49:08:WU01:FS01:0x22:     Memory: 31.71GiB
17:49:08:WU01:FS01:0x22:Free Memory: 16.74GiB
17:49:08:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
17:49:08:WU01:FS01:0x22: OS Version: 6.2
17:49:08:WU01:FS01:0x22:Has Battery: true
17:49:08:WU01:FS01:0x22: On Battery: false
17:49:08:WU01:FS01:0x22: UTC Offset: -8
17:49:08:WU01:FS01:0x22:        PID: 24300
17:49:08:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
17:49:08:WU01:FS01:0x22:************************************ OpenMM ************************************
17:49:08:WU01:FS01:0x22:   Revision: 189320d0
17:49:08:WU01:FS01:0x22:********************************************************************************
17:49:08:WU01:FS01:0x22:Project: 13439 (Run 8755, Clone 12, Gen 1)
17:49:08:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
17:49:08:WU01:FS01:0x22:Reading tar file core.xml
17:49:08:WU01:FS01:0x22:Reading tar file integrator.xml.bz2
17:49:08:WU01:FS01:0x22:Reading tar file state.xml.bz2
17:49:08:WU01:FS01:0x22:Reading tar file system.xml.bz2
17:49:08:WU01:FS01:0x22:Digital signatures verified
17:49:08:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
17:49:08:WU01:FS01:0x22:Version 0.0.13
17:49:08:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
17:49:08:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
17:49:08:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
17:49:08:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
17:49:08:WU01:FS01:0x22:There are 3 platforms available.
17:49:08:WU01:FS01:0x22:Platform 0: Reference
17:49:08:WU01:FS01:0x22:Platform 1: CPU
17:49:08:WU01:FS01:0x22:Platform 2: OpenCL
17:49:08:WU01:FS01:0x22:  opencl-device 0 specified
17:49:08:WU02:FS01:Upload complete
17:49:08:WU01:FS01:0x22:Attempting to create OpenCL context:
17:49:08:WU01:FS01:0x22:  Configuring platform OpenCL
17:49:09:WU02:FS01:Server responded WORK_ACK (400)
17:49:09:WU02:FS01:Cleaning up
17:49:33:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
17:49:33:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
17:49:33:WU01:FS01:0x22:Checkpoint completed at step 0
17:52:44:WU01:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
17:55:45:WU01:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
17:58:59:WU01:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
18:01:55:WU01:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
18:04:42:WU01:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
18:04:43:WU01:FS01:0x22:Checkpoint completed at step 50000
18:07:28:WU01:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
18:10:24:WU01:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
18:13:05:WU01:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
18:16:03:WU01:FS01:0x22:Completed 90000 out of 1000000 steps (9%)
18:19:18:WU01:FS01:0x22:Completed 100000 out of 1000000 steps (10%)
18:19:18:WU01:FS01:0x22:Checkpoint completed at step 100000
18:22:49:WU01:FS01:0x22:Completed 110000 out of 1000000 steps (11%)
18:26:11:WU01:FS01:0x22:Completed 120000 out of 1000000 steps (12%)
18:29:40:WU01:FS01:0x22:Completed 130000 out of 1000000 steps (13%)
18:33:16:WU01:FS01:0x22:Completed 140000 out of 1000000 steps (14%)
18:36:35:WU01:FS01:0x22:Completed 150000 out of 1000000 steps (15%)
18:36:35:WU01:FS01:0x22:Checkpoint completed at step 150000
18:39:34:WU01:FS01:0x22:Completed 160000 out of 1000000 steps (16%)
18:42:40:WU01:FS01:0x22:Completed 170000 out of 1000000 steps (17%)
18:45:43:WU01:FS01:0x22:Completed 180000 out of 1000000 steps (18%)
18:48:47:WU01:FS01:0x22:Completed 190000 out of 1000000 steps (19%)
18:52:05:WU01:FS01:0x22:Completed 200000 out of 1000000 steps (20%)
18:52:05:WU01:FS01:0x22:Checkpoint completed at step 200000
18:55:18:WU01:FS01:0x22:Completed 210000 out of 1000000 steps (21%)
18:58:17:WU01:FS01:0x22:Completed 220000 out of 1000000 steps (22%)
19:01:16:WU01:FS01:0x22:Completed 230000 out of 1000000 steps (23%)
19:04:09:WU01:FS01:0x22:Completed 240000 out of 1000000 steps (24%)
19:06:50:WU01:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
19:06:51:WU01:FS01:0x22:Checkpoint completed at step 250000
19:09:39:WU01:FS01:0x22:Completed 260000 out of 1000000 steps (26%)
19:12:29:WU01:FS01:0x22:Completed 270000 out of 1000000 steps (27%)
19:15:24:WU01:FS01:0x22:Completed 280000 out of 1000000 steps (28%)
19:18:19:WU01:FS01:0x22:Completed 290000 out of 1000000 steps (29%)
19:21:06:WU01:FS01:0x22:Completed 300000 out of 1000000 steps (30%)
19:21:06:WU01:FS01:0x22:Checkpoint completed at step 300000
19:23:59:WU01:FS01:0x22:Completed 310000 out of 1000000 steps (31%)
19:26:48:WU01:FS01:0x22:Completed 320000 out of 1000000 steps (32%)
19:29:36:WU01:FS01:0x22:Completed 330000 out of 1000000 steps (33%)
19:32:30:WU01:FS01:0x22:Completed 340000 out of 1000000 steps (34%)
19:35:12:WU01:FS01:0x22:Completed 350000 out of 1000000 steps (35%)
19:35:12:WU01:FS01:0x22:Checkpoint completed at step 350000
19:37:59:WU01:FS01:0x22:Completed 360000 out of 1000000 steps (36%)
19:40:50:WU01:FS01:0x22:Completed 370000 out of 1000000 steps (37%)
19:43:36:WU01:FS01:0x22:Completed 380000 out of 1000000 steps (38%)
19:46:42:WU01:FS01:0x22:Completed 390000 out of 1000000 steps (39%)
19:49:49:WU01:FS01:0x22:Completed 400000 out of 1000000 steps (40%)
19:49:49:WU01:FS01:0x22:Checkpoint completed at step 400000
19:50:29:WU01:FS01:0x22:An exception occurred at step 401850: Particle coordinate is nan
19:50:29:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
19:50:29:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
19:50:30:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
19:50:30:WU01:FS01:Starting
19:50:30:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
19:50:30:WU01:FS01:Started FahCore on PID 102700
19:50:31:WU01:FS01:Core PID:98536
19:50:31:WU01:FS01:FahCore 0x22 started
19:50:31:WU01:FS01:0x22:*********************** Log Started 2021-01-11T19:50:31Z ***********************
19:50:31:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:50:31:WU01:FS01:0x22:       Core: Core22
19:50:31:WU01:FS01:0x22:       Type: 0x22
19:50:31:WU01:FS01:0x22:    Version: 0.0.13
19:50:31:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:50:31:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
19:50:31:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
19:50:31:WU01:FS01:0x22:       Date: Sep 19 2020
19:50:31:WU01:FS01:0x22:       Time: 02:35:58
19:50:31:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
19:50:31:WU01:FS01:0x22:     Branch: core22-0.0.13
19:50:31:WU01:FS01:0x22:   Compiler: Visual C++ 2015
19:50:31:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:50:31:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
19:50:31:WU01:FS01:0x22:   Platform: win32 10
19:50:31:WU01:FS01:0x22:       Bits: 64
19:50:31:WU01:FS01:0x22:       Mode: Release
19:50:31:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
19:50:31:WU01:FS01:0x22:             <peastman@stanford.edu>
19:50:31:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 102700 -checkpoint 15
19:50:31:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
19:50:31:WU01:FS01:0x22:             -gpu-usage 100
19:50:31:WU01:FS01:0x22:************************************ libFAH ************************************
19:50:31:WU01:FS01:0x22:       Date: Sep 7 2020
19:50:31:WU01:FS01:0x22:       Time: 19:09:56
19:50:31:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
19:50:31:WU01:FS01:0x22:     Branch: HEAD
19:50:31:WU01:FS01:0x22:   Compiler: Visual C++ 2015
19:50:31:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:50:31:WU01:FS01:0x22:   Platform: win32 10
19:50:31:WU01:FS01:0x22:       Bits: 64
19:50:31:WU01:FS01:0x22:       Mode: Release
19:50:32:WU01:FS01:0x22:************************************ CBang *************************************
19:50:32:WU01:FS01:0x22:       Date: Sep 7 2020
19:50:32:WU01:FS01:0x22:       Time: 19:08:30
19:50:32:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
19:50:32:WU01:FS01:0x22:     Branch: HEAD
19:50:32:WU01:FS01:0x22:   Compiler: Visual C++ 2015
19:50:32:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:50:32:WU01:FS01:0x22:   Platform: win32 10
19:50:32:WU01:FS01:0x22:       Bits: 64
19:50:32:WU01:FS01:0x22:       Mode: Release
19:50:32:WU01:FS01:0x22:************************************ System ************************************
19:50:32:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
19:50:32:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
19:50:32:WU01:FS01:0x22:       CPUs: 12
19:50:32:WU01:FS01:0x22:     Memory: 31.71GiB
19:50:32:WU01:FS01:0x22:Free Memory: 16.05GiB
19:50:32:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
19:50:32:WU01:FS01:0x22: OS Version: 6.2
19:50:32:WU01:FS01:0x22:Has Battery: true
19:50:32:WU01:FS01:0x22: On Battery: false
19:50:32:WU01:FS01:0x22: UTC Offset: -8
19:50:32:WU01:FS01:0x22:        PID: 98536
19:50:32:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
19:50:32:WU01:FS01:0x22:************************************ OpenMM ************************************
19:50:32:WU01:FS01:0x22:   Revision: 189320d0
19:50:32:WU01:FS01:0x22:********************************************************************************
19:50:32:WU01:FS01:0x22:Project: 13439 (Run 8755, Clone 12, Gen 1)
19:50:32:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
19:50:32:WU01:FS01:0x22:Digital signatures verified
19:50:32:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:50:32:WU01:FS01:0x22:Version 0.0.13
19:50:32:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
19:50:32:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
19:50:32:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
19:50:32:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
19:50:32:WU01:FS01:0x22:There are 3 platforms available.
19:50:32:WU01:FS01:0x22:Platform 0: Reference
19:50:32:WU01:FS01:0x22:Platform 1: CPU
19:50:32:WU01:FS01:0x22:Platform 2: OpenCL
19:50:32:WU01:FS01:0x22:  opencl-device 0 specified
19:50:33:WU01:FS01:0x22:Attempting to create OpenCL context:
19:50:33:WU01:FS01:0x22:  Configuring platform OpenCL
19:51:06:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
19:51:06:WU01:FS01:0x22:Completed 400000 out of 1000000 steps (40%)
19:54:22:WU01:FS01:0x22:Completed 410000 out of 1000000 steps (41%)
19:57:46:WU01:FS01:0x22:Completed 420000 out of 1000000 steps (42%)
20:00:54:WU01:FS01:0x22:Completed 430000 out of 1000000 steps (43%)
20:04:05:WU01:FS01:0x22:Completed 440000 out of 1000000 steps (44%)
20:07:17:WU01:FS01:0x22:Completed 450000 out of 1000000 steps (45%)
20:07:17:WU01:FS01:0x22:Checkpoint completed at step 450000
20:10:20:WU01:FS01:0x22:Completed 460000 out of 1000000 steps (46%)
20:13:26:WU01:FS01:0x22:Completed 470000 out of 1000000 steps (47%)
20:16:34:WU01:FS01:0x22:Completed 480000 out of 1000000 steps (48%)
20:19:31:WU01:FS01:0x22:Completed 490000 out of 1000000 steps (49%)
20:22:17:WU01:FS01:0x22:Completed 500000 out of 1000000 steps (50%)
20:22:17:WU01:FS01:0x22:Checkpoint completed at step 500000
20:25:01:WU01:FS01:0x22:Completed 510000 out of 1000000 steps (51%)
20:27:43:WU01:FS01:0x22:Completed 520000 out of 1000000 steps (52%)
20:30:28:WU01:FS01:0x22:Completed 530000 out of 1000000 steps (53%)
20:33:11:WU01:FS01:0x22:Completed 540000 out of 1000000 steps (54%)
20:36:04:WU01:FS01:0x22:Completed 550000 out of 1000000 steps (55%)
20:36:04:WU01:FS01:0x22:Checkpoint completed at step 550000
20:38:43:WU01:FS01:0x22:Completed 560000 out of 1000000 steps (56%)
20:41:37:WU01:FS01:0x22:Completed 570000 out of 1000000 steps (57%)
20:44:28:WU01:FS01:0x22:Completed 580000 out of 1000000 steps (58%)
20:47:31:WU01:FS01:0x22:Completed 590000 out of 1000000 steps (59%)
20:50:24:WU01:FS01:0x22:Completed 600000 out of 1000000 steps (60%)
20:50:24:WU01:FS01:0x22:Checkpoint completed at step 600000
20:53:07:WU01:FS01:0x22:Completed 610000 out of 1000000 steps (61%)
20:55:49:WU01:FS01:0x22:Completed 620000 out of 1000000 steps (62%)
20:58:40:WU01:FS01:0x22:Completed 630000 out of 1000000 steps (63%)
21:01:32:WU01:FS01:0x22:Completed 640000 out of 1000000 steps (64%)
21:04:27:WU01:FS01:0x22:Completed 650000 out of 1000000 steps (65%)
21:04:27:WU01:FS01:0x22:Checkpoint completed at step 650000
21:07:21:WU01:FS01:0x22:Completed 660000 out of 1000000 steps (66%)
21:10:27:WU01:FS01:0x22:Completed 670000 out of 1000000 steps (67%)
21:13:28:WU01:FS01:0x22:Completed 680000 out of 1000000 steps (68%)
21:16:29:WU01:FS01:0x22:Completed 690000 out of 1000000 steps (69%)
21:19:26:WU01:FS01:0x22:Completed 700000 out of 1000000 steps (70%)
21:19:26:WU01:FS01:0x22:Checkpoint completed at step 700000
21:22:20:WU01:FS01:0x22:Completed 710000 out of 1000000 steps (71%)
21:25:25:WU01:FS01:0x22:Completed 720000 out of 1000000 steps (72%)
21:28:28:WU01:FS01:0x22:Completed 730000 out of 1000000 steps (73%)
21:31:36:WU01:FS01:0x22:Completed 740000 out of 1000000 steps (74%)
21:34:31:WU01:FS01:0x22:Completed 750000 out of 1000000 steps (75%)
21:34:31:WU01:FS01:0x22:Checkpoint completed at step 750000
21:37:42:WU01:FS01:0x22:Completed 760000 out of 1000000 steps (76%)
21:40:50:WU01:FS01:0x22:Completed 770000 out of 1000000 steps (77%)
21:43:51:WU01:FS01:0x22:Completed 780000 out of 1000000 steps (78%)
21:46:50:WU01:FS01:0x22:Completed 790000 out of 1000000 steps (79%)
21:50:28:WU01:FS01:0x22:Completed 800000 out of 1000000 steps (80%)
21:50:28:WU01:FS01:0x22:Checkpoint completed at step 800000
21:53:42:WU01:FS01:0x22:Completed 810000 out of 1000000 steps (81%)
21:57:04:WU01:FS01:0x22:Completed 820000 out of 1000000 steps (82%)
22:00:26:WU01:FS01:0x22:Completed 830000 out of 1000000 steps (83%)
22:02:57:WU01:FS01:0x22:An exception occurred at step 835578: Particle coordinate is nan
22:02:57:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
22:02:57:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
22:02:57:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
22:02:57:WU01:FS01:Starting
22:02:58:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 12040 -checkpoint 15 -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0 -gpu-usage 100
22:02:58:WU01:FS01:Started FahCore on PID 89632
22:03:00:WU01:FS01:Core PID:102896
22:03:00:WU01:FS01:FahCore 0x22 started
22:03:00:WU01:FS01:0x22:*********************** Log Started 2021-01-11T22:03:00Z ***********************
22:03:00:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:03:00:WU01:FS01:0x22:       Core: Core22
22:03:00:WU01:FS01:0x22:       Type: 0x22
22:03:00:WU01:FS01:0x22:    Version: 0.0.13
22:03:00:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:03:00:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
22:03:00:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
22:03:00:WU01:FS01:0x22:       Date: Sep 19 2020
22:03:00:WU01:FS01:0x22:       Time: 02:35:58
22:03:00:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
22:03:00:WU01:FS01:0x22:     Branch: core22-0.0.13
22:03:00:WU01:FS01:0x22:   Compiler: Visual C++ 2015
22:03:00:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:03:00:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
22:03:00:WU01:FS01:0x22:   Platform: win32 10
22:03:00:WU01:FS01:0x22:       Bits: 64
22:03:00:WU01:FS01:0x22:       Mode: Release
22:03:00:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
22:03:00:WU01:FS01:0x22:             <peastman@stanford.edu>
22:03:00:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 89632 -checkpoint 15
22:03:00:WU01:FS01:0x22:             -opencl-platform 1 -opencl-device 0 -gpu-vendor intel -gpu 0
22:03:00:WU01:FS01:0x22:             -gpu-usage 100
22:03:00:WU01:FS01:0x22:************************************ libFAH ************************************
22:03:00:WU01:FS01:0x22:       Date: Sep 7 2020
22:03:00:WU01:FS01:0x22:       Time: 19:09:56
22:03:00:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
22:03:00:WU01:FS01:0x22:     Branch: HEAD
22:03:00:WU01:FS01:0x22:   Compiler: Visual C++ 2015
22:03:01:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:03:01:WU01:FS01:0x22:   Platform: win32 10
22:03:01:WU01:FS01:0x22:       Bits: 64
22:03:01:WU01:FS01:0x22:       Mode: Release
22:03:01:WU01:FS01:0x22:************************************ CBang *************************************
22:03:01:WU01:FS01:0x22:       Date: Sep 7 2020
22:03:01:WU01:FS01:0x22:       Time: 19:08:30
22:03:01:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
22:03:01:WU01:FS01:0x22:     Branch: HEAD
22:03:01:WU01:FS01:0x22:   Compiler: Visual C++ 2015
22:03:01:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:03:01:WU01:FS01:0x22:   Platform: win32 10
22:03:01:WU01:FS01:0x22:       Bits: 64
22:03:01:WU01:FS01:0x22:       Mode: Release
22:03:01:WU01:FS01:0x22:************************************ System ************************************
22:03:01:WU01:FS01:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
22:03:01:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
22:03:01:WU01:FS01:0x22:       CPUs: 12
22:03:01:WU01:FS01:0x22:     Memory: 31.71GiB
22:03:01:WU01:FS01:0x22:Free Memory: 13.95GiB
22:03:01:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
22:03:01:WU01:FS01:0x22: OS Version: 6.2
22:03:01:WU01:FS01:0x22:Has Battery: true
22:03:01:WU01:FS01:0x22: On Battery: false
22:03:01:WU01:FS01:0x22: UTC Offset: -8
22:03:01:WU01:FS01:0x22:        PID: 102896
22:03:01:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
22:03:01:WU01:FS01:0x22:************************************ OpenMM ************************************
22:03:01:WU01:FS01:0x22:   Revision: 189320d0
22:03:01:WU01:FS01:0x22:********************************************************************************
22:03:01:WU01:FS01:0x22:Project: 13439 (Run 8755, Clone 12, Gen 1)
22:03:01:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
22:03:01:WU01:FS01:0x22:Digital signatures verified
22:03:01:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:03:01:WU01:FS01:0x22:Version 0.0.13
22:03:01:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
22:03:01:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
22:03:01:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
22:03:01:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
22:03:01:WU01:FS01:0x22:There are 3 platforms available.
22:03:01:WU01:FS01:0x22:Platform 0: Reference
22:03:01:WU01:FS01:0x22:Platform 1: CPU
22:03:01:WU01:FS01:0x22:Platform 2: OpenCL
22:03:01:WU01:FS01:0x22:  opencl-device 0 specified
22:03:02:WU01:FS01:0x22:Attempting to create OpenCL context:
22:03:02:WU01:FS01:0x22:  Configuring platform OpenCL
22:03:41:WU01:FS01:0x22:  Using OpenCL on platformId 1 and gpu 0
22:03:41:WU01:FS01:0x22:Completed 800000 out of 1000000 steps (80%)
22:05:56:WU01:FS01:0x22:An exception occurred at step 803952: Particle coordinate is nan
22:05:56:WU01:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Project 13429 issued to AMD Vega 64

Post by PantherX »

Thanks for that, belloq! I have asked around so let's see what happens :)
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
belloq
Posts: 40
Joined: Thu Sep 24, 2020 12:58 pm

Re: Project 13429 issued to AMD Vega 64

Post by belloq »

PantherX wrote:Thanks for that, belloq! I have asked around so let's see what happens :)
Thank you. I am going to shut down this GPU and spin my CPU back up. The GPU has been working a lot and getting very little actual work done.
belloq
Posts: 40
Joined: Thu Sep 24, 2020 12:58 pm

Re: Project 13429 issued to AMD Vega 64

Post by belloq »

PantherX wrote:Thanks for that, belloq! I have asked around so let's see what happens :)
I started the GPU back up today and got the same project, but it finished. Looks like whatever the issue is was resolved, or it was specific to that run .... dunno. Happy to be GPU folding again.
Post Reply