CUDA Update to FAHCore_22

[psaam0001]

Giving the GT 1030 one more try after reinstalling the Windows 7 drivers, and turning off PCI Express Slot Power Management (in driver settings and in Windows Power Settings).

Paul

[HayesK]

Suspect your issue with the older cards is related to the old driver 390.138, but there could be some other issue too.
My Kepler 650Ti Boost is able to fold with core22 v0.0.13 using CUDA on Ubuntu 18.04 with ppa driver 450.66.
My Fermi 550Ti and 450 are able to fold with core22 v0.0.13, but CUDA fails to run and core falls back to OpenCL on U18.04 with ppa driver 390.138 (last driver with Fermi support).

Is there a minimum requirement for running Cuda?

Works like a charm on my GTX 1660 Super with Nvidia 450.66; Compute: 7.5; Driver: 11.0
GTX 1660 Super from 730-750k Avg. to 1mil estimated.

On my second Computer with all the old Hardware and Nvidia 390.138; Compute: 3.0; Driver: 9.1
I get the

Code: Select all

Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)

Code: Select all

20:21:19:******************************* System ********************************
20:21:19:            CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:19:         CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:19:           CPUs: 6
20:21:19:         Memory: 7.75GiB
20:21:19:    Free Memory: 7.40GiB
20:21:19:        Threads: POSIX_THREADS
20:21:19:     OS Version: 5.4
20:21:19:    Has Battery: false
20:21:19:     On Battery: false
20:21:19:     UTC Offset: 2
20:21:19:            PID: 1053
20:21:19:            CWD: /var/lib/fahclient
20:21:19:             OS: Linux 5.4.0-47-generic x86_64
20:21:19:        OS Arch: AMD64
20:21:19:           GPUs: 4
20:21:19:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 670/GTX 760Ti
20:21:19:                 OEM] 2634
20:21:19:          GPU 1: Bus:2 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 770] 3213
20:21:19:          GPU 2: Bus:3 Slot:0 Func:0 NVIDIA:3 GK106 [GeForce GTX 660]
20:21:19:          GPU 3: Bus:6 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GTX 650] 812
20:21:19:  CUDA Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:3.0 Driver:9.1
20:21:19:  CUDA Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:3.0 Driver:9.1
20:21:19:  CUDA Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:3.0 Driver:9.1
20:21:19:  CUDA Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:3.0 Driver:9.1
20:21:19:OpenCL Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:1.2 Driver:390.138

[gordonbb]

I’m impressed. Just threw together a system from parts lying around. A Asus h170m pro mobo, i5 6500, 4 GB DDR4-2400, 128GB SSD, 750W Power supply in a Veddha miner case with a GTX 1070Ti in the PCIe3 x16 slot, a 1060 6GB in the m.2 slot with an adapter and another 1060 6GB in the Chipset PCIe3 x4.

On Ubuntu 18.04.4 LTS with stock clocks and power limits the 1070ti Is yielding 1.34MPPD, the 1060s 1MPPD each .

I suspect the first set of large WUs will bring it to its knees as it’s at 3.7GB RAM used now.

[PantherX]

As someone who is considering a 3070 (and have been before the cuda update), how has the cuda update translated into the actual increased science value of completed wu's returned per day?

I don't have any 3070 numbers, but I would take an educated guess that you would could be seeing 2080 Ti performance on 3070 once the drivers have matured. I would expect that 3070 would surpass 1080 Ti without any issues.

Project 11765 on Linux:
TPF: 73s - 1080 Ti OpenCL
TPF: 57s - 1080 Ti CUDA
TPF: 49s - 2080 Ti OpenCL
TPF: 39s - 2080 Ti CUDA
TPF: 36s - 3080 OpenCL
TPF: 31s - 3080 CUDA
TPF: 30s - 3090 OpenCL
TPF: 26s - 3090 CUDA

[Foliant]

Suspect your issue with the older cards is related to the old driver 390.x

Can confirm:
I tested this with my PC at work, GTX 1050Ti (GP107) and Nvidia-390 gave me CUDA_ERROR_INVALID_PTX (218)
With Nvidia-450 no errors and working cuda.

Wow! Cuda nearly doubles the Estimated PPD at 13426!

Regards,
Patrick

[foldy]

FAH cuda core uses CUDA v9.2 and that needs nvidia driver 4xx.yy to run
https://docs.nvidia.com/cuda/cuda-toolk ... index.html

If FAH would compile cuda core to v9.0 then also >= 385.yy drivers could run it

It would be nice if FAH would show "Please update nvidia drivers to >= v4xx.yy" instead of CUDA_ERROR_INVALID_PTX only.

[psaam0001]

UPDATE: Will be reinstalling Fedora on my Dell PowerEdge T105, after installing a newer NVidia driver that was found for it using the Software Manager.... Negated the efforts I put into finally getting OpenCL working last month.

Even trying dnf install ocl-icd-devel.x86_64 did not help.

Any suggestions (that would save me from a clean reinstall)?

Paul

[foldy]

As pcie bus bandwidth usage with CUDA is only half of OpenCL, maybe minimum pcie slot needed for GPU on Windows now is lowered again.
pcie 2.0 x16 nvidia gtx 1080ti on Windows 7

[bruce]

Is there a minimum requirement for running Cuda?

Fermi vs. Kepler (and nV vs. AMD, of course)

Your Fermi will continue to use OpenCL 1.2 except for a few which only support OpenCL 1.1 which were already past their end-of-life.

[Foliant]

It would be nice if FAH would show "Please update nvidia drivers to >= v4xx.yy" instead of CUDA_ERROR_INVALID_PTX only.

CUDA has their own set of error messages. Your OS has it's own set of error messages. (etc.) and FAH does not intercept them and translate them to a more understandable message. FAH can impdrove on messages that are issued by it. In this case, we both probably have ask nV what a PTX is (or we can guess).

[Neil-B]

Parallel Thread eXecution .. Not that that is really any more understandable tbh

[JohnChodera]

> It would be nice if FAH would show "Please update nvidia drivers to >= v4xx.yy" instead of CUDA_ERROR_INVALID_PTX only.

We weren't sure this was the cause of the error until recently, but we can add this message in the next core release!

Thanks!

~ John Chodera // MSKCC

[psaam0001]

I know that posting this will not help me immediately, as I have the last WHQL certified drivers that were released for the GT 1030 using Windows 7 SP1 (Pro; x86 64-bit), but I'll post this to see if it helps NVidia/the F@H Software Team with refinements.

Code: Select all

06:24:09:WU01:FS01:0x22:Completed 840000 out of 2000000 steps (42%)
06:36:35:WU01:FS01:0x22:Completed 860000 out of 2000000 steps (43%)
06:49:15:WU01:FS01:0x22:Completed 880000 out of 2000000 steps (44%)
07:02:22:WU01:FS01:0x22:Completed 900000 out of 2000000 steps (45%)
07:03:44:WU01:FS01:0x22:Checkpoint completed at step 900000
07:20:22:WU01:FS01:0x22:Completed 920000 out of 2000000 steps (46%)
07:34:25:WU01:FS01:0x22:Completed 940000 out of 2000000 steps (47%)
******************************* Date: 2020-10-02 *******************************
07:47:45:WU01:FS01:0x22:Completed 960000 out of 2000000 steps (48%)
08:00:09:WU01:FS01:0x22:Completed 980000 out of 2000000 steps (49%)
08:12:27:WU01:FS01:0x22:Completed 1000000 out of 2000000 steps (50%)
08:13:06:WU01:FS01:0x22:Checkpoint completed at step 1000000
08:25:24:WU01:FS01:0x22:Completed 1020000 out of 2000000 steps (51%)
08:37:55:WU01:FS01:0x22:Completed 1040000 out of 2000000 steps (52%)
08:50:27:WU01:FS01:0x22:Completed 1060000 out of 2000000 steps (53%)
09:02:48:WU01:FS01:0x22:Completed 1080000 out of 2000000 steps (54%)
09:15:08:WU01:FS01:0x22:Completed 1100000 out of 2000000 steps (55%)
09:15:47:WU01:FS01:0x22:Checkpoint completed at step 1100000
09:28:42:WU01:FS01:0x22:Completed 1120000 out of 2000000 steps (56%)
09:42:11:WU01:FS01:0x22:Completed 1140000 out of 2000000 steps (57%)
09:54:31:WU01:FS01:0x22:Completed 1160000 out of 2000000 steps (58%)
10:06:50:WU01:FS01:0x22:Completed 1180000 out of 2000000 steps (59%)
10:19:09:WU01:FS01:0x22:Completed 1200000 out of 2000000 steps (60%)
10:19:48:WU01:FS01:0x22:Checkpoint completed at step 1200000
10:32:07:WU01:FS01:0x22:Completed 1220000 out of 2000000 steps (61%)
10:44:50:WU01:FS01:0x22:Completed 1240000 out of 2000000 steps (62%)
10:57:09:WU01:FS01:0x22:Completed 1260000 out of 2000000 steps (63%)
11:09:28:WU01:FS01:0x22:Completed 1280000 out of 2000000 steps (64%)
11:24:36:WU01:FS01:0x22:Completed 1300000 out of 2000000 steps (65%)
11:25:17:WU01:FS01:0x22:Checkpoint completed at step 1300000
11:40:24:WU01:FS01:0x22:Completed 1320000 out of 2000000 steps (66%)
11:54:43:WU01:FS01:0x22:Completed 1340000 out of 2000000 steps (67%)
12:08:44:WU01:FS01:0x22:Completed 1360000 out of 2000000 steps (68%)
12:24:07:WU01:FS01:0x22:Completed 1380000 out of 2000000 steps (69%)
12:41:50:WU01:FS01:0x22:Completed 1400000 out of 2000000 steps (70%)
12:42:28:WU01:FS01:0x22:Checkpoint completed at step 1400000
12:54:49:WU01:FS01:0x22:Completed 1420000 out of 2000000 steps (71%)
13:07:09:WU01:FS01:0x22:Completed 1440000 out of 2000000 steps (72%)
13:19:28:WU01:FS01:0x22:Completed 1460000 out of 2000000 steps (73%)
13:31:47:WU01:FS01:0x22:Completed 1480000 out of 2000000 steps (74%)
13:45:08:WU01:FS01:0x22:Completed 1500000 out of 2000000 steps (75%)
13:45:47:WU01:FS01:0x22:Checkpoint completed at step 1500000
******************************* Date: 2020-10-02 *******************************
13:59:11:WU01:FS01:0x22:Completed 1520000 out of 2000000 steps (76%)
14:11:30:WU01:FS01:0x22:Completed 1540000 out of 2000000 steps (77%)
14:23:50:WU01:FS01:0x22:Completed 1560000 out of 2000000 steps (78%)
14:36:09:WU01:FS01:0x22:Completed 1580000 out of 2000000 steps (79%)
14:48:54:WU01:FS01:0x22:Completed 1600000 out of 2000000 steps (80%)
14:49:32:WU01:FS01:0x22:Checkpoint completed at step 1600000
15:01:52:WU01:FS01:0x22:Completed 1620000 out of 2000000 steps (81%)
15:14:28:WU01:FS01:0x22:Completed 1640000 out of 2000000 steps (82%)
15:26:48:WU01:FS01:0x22:Completed 1660000 out of 2000000 steps (83%)
15:40:05:WU01:FS01:0x22:Completed 1680000 out of 2000000 steps (84%)
15:52:24:WU01:FS01:0x22:Completed 1700000 out of 2000000 steps (85%)
15:53:03:WU01:FS01:0x22:Checkpoint completed at step 1700000
16:05:23:WU01:FS01:0x22:Completed 1720000 out of 2000000 steps (86%)
16:17:41:WU01:FS01:0x22:Completed 1740000 out of 2000000 steps (87%)
16:30:01:WU01:FS01:0x22:Completed 1760000 out of 2000000 steps (88%)
16:43:12:WU01:FS01:0x22:Completed 1780000 out of 2000000 steps (89%)
16:55:32:WU01:FS01:0x22:Completed 1800000 out of 2000000 steps (90%)
16:56:10:WU01:FS01:0x22:Checkpoint completed at step 1800000
17:08:29:WU01:FS01:0x22:Completed 1820000 out of 2000000 steps (91%)
17:20:49:WU01:FS01:0x22:Completed 1840000 out of 2000000 steps (92%)
17:33:08:WU01:FS01:0x22:Completed 1860000 out of 2000000 steps (93%)
17:45:54:WU01:FS01:0x22:Completed 1880000 out of 2000000 steps (94%)
17:58:13:WU01:FS01:0x22:Completed 1900000 out of 2000000 steps (95%)
17:58:52:WU01:FS01:0x22:Checkpoint completed at step 1900000
18:11:28:WU01:FS01:0x22:Completed 1920000 out of 2000000 steps (96%)
18:23:47:WU01:FS01:0x22:Completed 1940000 out of 2000000 steps (97%)
18:36:07:WU01:FS01:0x22:Completed 1960000 out of 2000000 steps (98%)
18:48:56:WU01:FS01:0x22:Completed 1980000 out of 2000000 steps (99%)
18:48:57:WU02:FS01:Connecting to assign1.foldingathome.org:80
18:48:57:WU02:FS01:Assigned to work server 18.188.125.154
18:48:57:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP108 [GeForce GT 1030] 1127 from 18.188.125.154
18:48:57:WU02:FS01:Connecting to 18.188.125.154:8080
18:48:58:WU02:FS01:Downloading 363.86KiB
18:48:58:WU02:FS01:Download complete
18:48:58:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13427 run:5472 clone:19 gen:2 core:0x22 unit:0x0000000212bc7d9a5f597d0a836d78ad
19:01:15:WU01:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
19:01:15:WU01:FS01:0x22:Average performance: 2.30831 ns/day
19:01:54:WU01:FS01:0x22:Checkpoint completed at step 2000000
19:02:01:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
19:02:01:WU01:FS01:0x22:Saving result file checkpointIntegrator.xml
19:02:01:WU01:FS01:0x22:Saving result file checkpointState.xml
19:02:06:WU01:FS01:0x22:Saving result file positions.xtc
19:02:06:WU01:FS01:0x22:Saving result file science.log
19:02:06:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
19:02:07:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:02:07:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14909 run:233 clone:1 gen:12 core:0x22 unit:0x0000001681d59d695f526022127800d3
19:02:07:WU01:FS01:Uploading 16.92MiB to 129.213.157.105
19:02:07:WU02:FS01:Starting
19:02:07:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Saam7882\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 2852 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
19:02:07:WU01:FS01:Connecting to 129.213.157.105:8080
19:02:07:WU02:FS01:Started FahCore on PID 4596
19:02:08:WU02:FS01:Core PID:3408
19:02:08:WU02:FS01:FahCore 0x22 started
19:02:09:WU02:FS01:0x22:*********************** Log Started 2020-10-02T19:02:09Z ***********************
19:02:09:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:02:09:WU02:FS01:0x22:       Core: Core22
19:02:09:WU02:FS01:0x22:       Type: 0x22
19:02:09:WU02:FS01:0x22:    Version: 0.0.13
19:02:09:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:02:09:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
19:02:09:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
19:02:09:WU02:FS01:0x22:       Date: Sep 19 2020
19:02:09:WU02:FS01:0x22:       Time: 02:35:58
19:02:09:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
19:02:09:WU02:FS01:0x22:     Branch: core22-0.0.13
19:02:09:WU02:FS01:0x22:   Compiler: Visual C++ 2015
19:02:09:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:02:09:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
19:02:09:WU02:FS01:0x22:   Platform: win32 10
19:02:09:WU02:FS01:0x22:       Bits: 64
19:02:09:WU02:FS01:0x22:       Mode: Release
19:02:09:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
19:02:09:WU02:FS01:0x22:             <peastman@stanford.edu>
19:02:09:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 4596 -checkpoint 30
19:02:09:WU02:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
19:02:09:WU02:FS01:0x22:             0 -gpu 0
19:02:09:WU02:FS01:0x22:************************************ libFAH ************************************
19:02:09:WU02:FS01:0x22:       Date: Sep 7 2020
19:02:09:WU02:FS01:0x22:       Time: 19:09:56
19:02:09:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
19:02:09:WU02:FS01:0x22:     Branch: HEAD
19:02:09:WU02:FS01:0x22:   Compiler: Visual C++ 2015
19:02:09:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:02:09:WU02:FS01:0x22:   Platform: win32 10
19:02:09:WU02:FS01:0x22:       Bits: 64
19:02:09:WU02:FS01:0x22:       Mode: Release
19:02:09:WU02:FS01:0x22:************************************ CBang *************************************
19:02:09:WU02:FS01:0x22:       Date: Sep 7 2020
19:02:09:WU02:FS01:0x22:       Time: 19:08:30
19:02:09:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
19:02:09:WU02:FS01:0x22:     Branch: HEAD
19:02:09:WU02:FS01:0x22:   Compiler: Visual C++ 2015
19:02:09:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:02:09:WU02:FS01:0x22:   Platform: win32 10
19:02:09:WU02:FS01:0x22:       Bits: 64
19:02:09:WU02:FS01:0x22:       Mode: Release
19:02:09:WU02:FS01:0x22:************************************ System ************************************
19:02:09:WU02:FS01:0x22:        CPU: Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
19:02:09:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 2
19:02:09:WU02:FS01:0x22:       CPUs: 2
19:02:09:WU02:FS01:0x22:     Memory: 8.00GiB
19:02:09:WU02:FS01:0x22:Free Memory: 6.15GiB
19:02:09:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
19:02:09:WU02:FS01:0x22: OS Version: 6.1
19:02:09:WU02:FS01:0x22:Has Battery: false
19:02:09:WU02:FS01:0x22: On Battery: false
19:02:09:WU02:FS01:0x22: UTC Offset: -4
19:02:09:WU02:FS01:0x22:        PID: 3408
19:02:09:WU02:FS01:0x22:        CWD: C:\Users\Saam7882\AppData\Roaming\FAHClient\work
19:02:09:WU02:FS01:0x22:************************************ OpenMM ************************************
19:02:09:WU02:FS01:0x22:   Revision: 189320d0
19:02:09:WU02:FS01:0x22:********************************************************************************
19:02:09:WU02:FS01:0x22:Project: 13427 (Run 5472, Clone 19, Gen 2)
19:02:09:WU02:FS01:0x22:Unit: 0x0000000212bc7d9a5f597d0a836d78ad
19:02:09:WU02:FS01:0x22:Reading tar file core.xml
19:02:09:WU02:FS01:0x22:Reading tar file integrator.xml
19:02:09:WU02:FS01:0x22:Reading tar file state.xml.bz2
19:02:09:WU02:FS01:0x22:Reading tar file system.xml.bz2
19:02:09:WU02:FS01:0x22:Digital signatures verified
19:02:09:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:02:09:WU02:FS01:0x22:Version 0.0.13
19:02:09:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
19:02:09:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
19:02:09:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
19:02:09:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
19:02:12:WU02:FS01:0x22:There are 3 platforms available.
19:02:12:WU02:FS01:0x22:Platform 0: Reference
19:02:12:WU02:FS01:0x22:Platform 1: OpenCL
19:02:12:WU02:FS01:0x22:  opencl-device 0 specified
19:02:12:WU02:FS01:0x22:Platform 2: CUDA
19:02:12:WU02:FS01:0x22:  cuda-device 0 specified
19:02:13:WU01:FS01:Upload 12.93%
19:02:13:WU02:FS01:0x22:Attempting to create CUDA context:
19:02:13:WU02:FS01:0x22:  Configuring platform CUDA
19:02:19:WU01:FS01:Upload 19.58%
19:02:25:WU01:FS01:Upload 32.14%
19:02:28:WU02:FS01:0x22:  Using CUDA and gpu 0
19:02:28:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
19:02:29:WU02:FS01:0x22:Checkpoint completed at step 0
19:02:31:WU01:FS01:Upload 57.27%
19:02:37:WU01:FS01:Upload 79.43%
19:02:43:WU01:FS01:Upload 92.36%
19:02:47:WU01:FS01:Upload complete
19:02:47:WU01:FS01:Server responded WORK_ACK (400)
19:02:47:WU01:FS01:Final credit estimate, 88669.00 points
19:02:47:WU01:FS01:Cleaning up
19:03:31:WU02:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
19:04:32:WU02:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
19:05:32:WU02:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
19:06:33:WU02:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
19:07:33:WU02:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
19:07:35:WU02:FS01:0x22:Checkpoint completed at step 50000
19:08:35:WU02:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
19:09:35:WU02:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
19:10:36:WU02:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
19:11:36:WU02:FS01:0x22:Completed 90000 out of 1000000 steps (9%)
19:12:36:WU02:FS01:0x22:Completed 100000 out of 1000000 steps (10%)
19:12:38:WU02:FS01:0x22:Checkpoint completed at step 100000
19:13:38:WU02:FS01:0x22:Completed 110000 out of 1000000 steps (11%)
19:14:39:WU02:FS01:0x22:Completed 120000 out of 1000000 steps (12%)
19:15:39:WU02:FS01:0x22:Completed 130000 out of 1000000 steps (13%)
19:16:40:WU02:FS01:0x22:Completed 140000 out of 1000000 steps (14%)
19:17:40:WU02:FS01:0x22:Completed 150000 out of 1000000 steps (15%)
19:17:42:WU02:FS01:0x22:Checkpoint completed at step 150000
19:18:42:WU02:FS01:0x22:Completed 160000 out of 1000000 steps (16%)
19:19:43:WU02:FS01:0x22:Completed 170000 out of 1000000 steps (17%)
19:20:43:WU02:FS01:0x22:Completed 180000 out of 1000000 steps (18%)
19:21:44:WU02:FS01:0x22:Completed 190000 out of 1000000 steps (19%)
19:22:51:WU02:FS01:0x22:Completed 200000 out of 1000000 steps (20%)
19:22:52:WU02:FS01:0x22:Checkpoint completed at step 200000
19:23:53:WU02:FS01:0x22:Completed 210000 out of 1000000 steps (21%)
19:24:53:WU02:FS01:0x22:Completed 220000 out of 1000000 steps (22%)
19:25:54:WU02:FS01:0x22:Completed 230000 out of 1000000 steps (23%)
19:26:54:WU02:FS01:0x22:Completed 240000 out of 1000000 steps (24%)
19:27:55:WU02:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
19:27:56:WU02:FS01:0x22:Checkpoint completed at step 250000
19:28:44:WU02:FS01:0x22:An exception occurred at step 257618: Error downloading array energySum: CUDA_ERROR_LAUNCH_FAILED (719)
19:28:44:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
19:28:44:WU02:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
******************************* Date: 2020-10-02 *******************************
21:48:49:WARNING:WU02:FS01:FahCore returned: FAILED_3 (255 = 0xff)
21:48:49:WU02:FS01:Starting
21:48:49:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Saam7882\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 2852 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
21:48:49:WU02:FS01:Started FahCore on PID 2728
21:48:50:WU02:FS01:Core PID:4192
21:48:50:WU02:FS01:FahCore 0x22 started
21:48:50:WU02:FS01:0x22:*********************** Log Started 2020-10-02T21:48:50Z ***********************
21:48:50:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
21:48:50:WU02:FS01:0x22:       Core: Core22
21:48:50:WU02:FS01:0x22:       Type: 0x22
21:48:50:WU02:FS01:0x22:    Version: 0.0.13
21:48:50:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:48:50:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
21:48:50:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
21:48:50:WU02:FS01:0x22:       Date: Sep 19 2020
21:48:50:WU02:FS01:0x22:       Time: 02:35:58
21:48:50:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
21:48:50:WU02:FS01:0x22:     Branch: core22-0.0.13
21:48:50:WU02:FS01:0x22:   Compiler: Visual C++ 2015
21:48:50:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:48:50:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
21:48:50:WU02:FS01:0x22:   Platform: win32 10
21:48:50:WU02:FS01:0x22:       Bits: 64
21:48:50:WU02:FS01:0x22:       Mode: Release
21:48:50:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
21:48:50:WU02:FS01:0x22:             <peastman@stanford.edu>
21:48:50:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 2728 -checkpoint 30
21:48:50:WU02:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
21:48:50:WU02:FS01:0x22:             0 -gpu 0
21:48:50:WU02:FS01:0x22:************************************ libFAH ************************************
21:48:50:WU02:FS01:0x22:       Date: Sep 7 2020
21:48:50:WU02:FS01:0x22:       Time: 19:09:56
21:48:50:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
21:48:50:WU02:FS01:0x22:     Branch: HEAD
21:48:50:WU02:FS01:0x22:   Compiler: Visual C++ 2015
21:48:50:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:48:50:WU02:FS01:0x22:   Platform: win32 10
21:48:50:WU02:FS01:0x22:       Bits: 64
21:48:50:WU02:FS01:0x22:       Mode: Release
21:48:50:WU02:FS01:0x22:************************************ CBang *************************************
21:48:50:WU02:FS01:0x22:       Date: Sep 7 2020
21:48:50:WU02:FS01:0x22:       Time: 19:08:30
21:48:50:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
21:48:50:WU02:FS01:0x22:     Branch: HEAD
21:48:50:WU02:FS01:0x22:   Compiler: Visual C++ 2015
21:48:50:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:48:50:WU02:FS01:0x22:   Platform: win32 10
21:48:50:WU02:FS01:0x22:       Bits: 64
21:48:50:WU02:FS01:0x22:       Mode: Release
21:48:50:WU02:FS01:0x22:************************************ System ************************************
21:48:50:WU02:FS01:0x22:        CPU: Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
21:48:50:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 2
21:48:50:WU02:FS01:0x22:       CPUs: 2
21:48:50:WU02:FS01:0x22:     Memory: 8.00GiB
21:48:50:WU02:FS01:0x22:Free Memory: 6.10GiB
21:48:50:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
21:48:50:WU02:FS01:0x22: OS Version: 6.1
21:48:50:WU02:FS01:0x22:Has Battery: false
21:48:50:WU02:FS01:0x22: On Battery: false
21:48:50:WU02:FS01:0x22: UTC Offset: -4
21:48:50:WU02:FS01:0x22:        PID: 4192
21:48:50:WU02:FS01:0x22:        CWD: C:\Users\Saam7882\AppData\Roaming\FAHClient\work
21:48:50:WU02:FS01:0x22:************************************ OpenMM ************************************
21:48:50:WU02:FS01:0x22:   Revision: 189320d0
21:48:50:WU02:FS01:0x22:********************************************************************************
21:48:50:WU02:FS01:0x22:Project: 13427 (Run 5472, Clone 19, Gen 2)
21:48:50:WU02:FS01:0x22:Unit: 0x0000000212bc7d9a5f597d0a836d78ad
21:48:50:WU02:FS01:0x22:Digital signatures verified
21:48:50:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:48:50:WU02:FS01:0x22:Version 0.0.13
21:48:51:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
21:48:51:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
21:48:51:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
21:48:51:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
21:48:51:WU02:FS01:0x22:There are 3 platforms available.
21:48:51:WU02:FS01:0x22:Platform 0: Reference
21:48:51:WU02:FS01:0x22:Platform 1: OpenCL
21:48:51:WU02:FS01:0x22:  opencl-device 0 specified
21:48:51:WU02:FS01:0x22:Platform 2: CUDA
21:48:51:WU02:FS01:0x22:  cuda-device 0 specified
21:48:52:WU02:FS01:0x22:Attempting to create CUDA context:
21:48:52:WU02:FS01:0x22:  Configuring platform CUDA
21:48:56:WU02:FS01:0x22:  Using CUDA and gpu 0
21:48:56:WU02:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
21:50:19:WU02:FS01:0x22:Completed 260000 out of 1000000 steps (26%)
21:50:59:WU02:FS01:0x22:An exception occurred at step 265920: Error downloading array energySum: CUDA_ERROR_LAUNCH_FAILED (719)
21:50:59:WU02:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
21:50:59:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:50:59:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
21:50:59:WU02:FS01:0x22:Saving result file globals.csv
21:50:59:WU02:FS01:0x22:Saving result file science.log
21:50:59:WU02:FS01:0x22:Saving result file state.xml.bz2
21:50:59:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
21:51:10:WARNING:WU02:FS01:FahCore returned: FAILED_3 (255 = 0xff)
21:51:11:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13427 run:5472 clone:19 gen:2 core:0x22 unit:0x0000000212bc7d9a5f597d0a836d78ad
21:51:12:WU02:FS01:Uploading 311.01KiB to 18.188.125.154
21:51:12:WU02:FS01:Connecting to 18.188.125.154:8080
21:51:12:WU01:FS01:Connecting to assign1.foldingathome.org:80
21:51:12:WU01:FS01:Assigned to work server 66.170.111.50
21:51:12:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP108 [GeForce GT 1030] 1127 from 66.170.111.50
21:51:12:WU01:FS01:Connecting to 66.170.111.50:8080
21:51:12:WU02:FS01:Upload complete
21:51:13:WU02:FS01:Server responded WORK_ACK (400)
21:51:14:WU02:FS01:Cleaning up
21:51:14:WU01:FS01:Downloading 10.37MiB
21:51:17:WU01:FS01:Download complete
21:51:17:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14486 run:0 clone:452 gen:65 core:0x22 unit:0x0000005942aa6f325f45deaac260a2eb
21:51:17:WU01:FS01:Starting
21:51:17:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Saam7882\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 2852 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
21:51:17:WU01:FS01:Started FahCore on PID 3560
21:51:17:WU01:FS01:Core PID:152
21:51:17:WU01:FS01:FahCore 0x22 started
21:51:18:WU01:FS01:0x22:*********************** Log Started 2020-10-02T21:51:17Z ***********************
21:51:18:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
21:51:18:WU01:FS01:0x22:       Core: Core22
21:51:18:WU01:FS01:0x22:       Type: 0x22
21:51:18:WU01:FS01:0x22:    Version: 0.0.13
21:51:18:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:51:18:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
21:51:18:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
21:51:18:WU01:FS01:0x22:       Date: Sep 19 2020
21:51:18:WU01:FS01:0x22:       Time: 02:35:58
21:51:18:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
21:51:18:WU01:FS01:0x22:     Branch: core22-0.0.13
21:51:18:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:51:18:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:51:18:WU01:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
21:51:18:WU01:FS01:0x22:   Platform: win32 10
21:51:18:WU01:FS01:0x22:       Bits: 64
21:51:18:WU01:FS01:0x22:       Mode: Release
21:51:18:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
21:51:18:WU01:FS01:0x22:             <peastman@stanford.edu>
21:51:18:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 3560 -checkpoint 30
21:51:18:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
21:51:18:WU01:FS01:0x22:             0 -gpu 0
21:51:18:WU01:FS01:0x22:************************************ libFAH ************************************
21:51:18:WU01:FS01:0x22:       Date: Sep 7 2020
21:51:18:WU01:FS01:0x22:       Time: 19:09:56
21:51:18:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
21:51:18:WU01:FS01:0x22:     Branch: HEAD
21:51:18:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:51:18:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:51:18:WU01:FS01:0x22:   Platform: win32 10
21:51:18:WU01:FS01:0x22:       Bits: 64
21:51:18:WU01:FS01:0x22:       Mode: Release
21:51:18:WU01:FS01:0x22:************************************ CBang *************************************
21:51:18:WU01:FS01:0x22:       Date: Sep 7 2020
21:51:18:WU01:FS01:0x22:       Time: 19:08:30
21:51:18:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
21:51:18:WU01:FS01:0x22:     Branch: HEAD
21:51:18:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:51:18:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:51:18:WU01:FS01:0x22:   Platform: win32 10
21:51:18:WU01:FS01:0x22:       Bits: 64
21:51:18:WU01:FS01:0x22:       Mode: Release
21:51:18:WU01:FS01:0x22:************************************ System ************************************
21:51:18:WU01:FS01:0x22:        CPU: Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
21:51:18:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 2
21:51:18:WU01:FS01:0x22:       CPUs: 2
21:51:18:WU01:FS01:0x22:     Memory: 8.00GiB
21:51:18:WU01:FS01:0x22:Free Memory: 5.81GiB
21:51:18:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
21:51:18:WU01:FS01:0x22: OS Version: 6.1
21:51:18:WU01:FS01:0x22:Has Battery: false
21:51:18:WU01:FS01:0x22: On Battery: false
21:51:18:WU01:FS01:0x22: UTC Offset: -4
21:51:18:WU01:FS01:0x22:        PID: 152
21:51:18:WU01:FS01:0x22:        CWD: C:\Users\Saam7882\AppData\Roaming\FAHClient\work
21:51:18:WU01:FS01:0x22:************************************ OpenMM ************************************
21:51:18:WU01:FS01:0x22:   Revision: 189320d0
21:51:18:WU01:FS01:0x22:********************************************************************************
21:51:18:WU01:FS01:0x22:Project: 14486 (Run 0, Clone 452, Gen 65)
21:51:18:WU01:FS01:0x22:Unit: 0x0000005942aa6f325f45deaac260a2eb
21:51:18:WU01:FS01:0x22:Reading tar file core.xml
21:51:18:WU01:FS01:0x22:Reading tar file integrator.xml.bz2
21:51:18:WU01:FS01:0x22:Reading tar file state.xml.bz2
21:51:18:WU01:FS01:0x22:Reading tar file system.xml.bz2
21:51:18:WU01:FS01:0x22:Digital signatures verified
21:51:18:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:51:18:WU01:FS01:0x22:Version 0.0.13
21:51:18:WU01:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
21:51:18:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
21:51:18:WU01:FS01:0x22:  XTC frame write interval: 10000 steps (0.8%) [125 total]
21:51:18:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
21:51:18:WU01:FS01:0x22:There are 3 platforms available.
21:51:18:WU01:FS01:0x22:Platform 0: Reference
21:51:18:WU01:FS01:0x22:Platform 1: OpenCL
21:51:18:WU01:FS01:0x22:  opencl-device 0 specified
21:51:18:WU01:FS01:0x22:Platform 2: CUDA
21:51:18:WU01:FS01:0x22:  cuda-device 0 specified
21:51:37:WU01:FS01:0x22:Attempting to create CUDA context:
21:51:37:WU01:FS01:0x22:  Configuring platform CUDA
21:52:37:WU01:FS01:0x22:  Using CUDA and gpu 0
21:52:37:WU01:FS01:0x22:Completed 0 out of 1250000 steps (0%)
21:53:01:WU01:FS01:0x22:Checkpoint completed at step 0
21:58:36:WU01:FS01:0x22:Completed 12500 out of 1250000 steps (1%)
22:04:31:WU01:FS01:0x22:Completed 25000 out of 1250000 steps (2%)
22:05:01:WU01:FS01:0x22:Checkpoint completed at step 25000
22:11:06:WU01:FS01:0x22:Completed 37500 out of 1250000 steps (3%)
22:17:02:WU01:FS01:0x22:Completed 50000 out of 1250000 steps (4%)
22:17:26:WU01:FS01:0x22:Checkpoint completed at step 50000
22:22:50:WU01:FS01:0x22:Completed 62500 out of 1250000 steps (5%)
22:28:15:WU01:FS01:0x22:Completed 75000 out of 1250000 steps (6%)
22:28:39:WU01:FS01:0x22:Checkpoint completed at step 75000
22:34:01:WU01:FS01:0x22:Completed 87500 out of 1250000 steps (7%)
22:40:27:WU01:FS01:0x22:Completed 100000 out of 1250000 steps (8%)
22:40:51:WU01:FS01:0x22:Checkpoint completed at step 100000
22:47:21:WU01:FS01:0x22:Completed 112500 out of 1250000 steps (9%)
22:53:41:WU01:FS01:0x22:Completed 125000 out of 1250000 steps (10%)
22:54:16:WU01:FS01:0x22:Checkpoint completed at step 125000
23:00:02:WU01:FS01:0x22:Completed 137500 out of 1250000 steps (11%)
23:05:44:WU01:FS01:0x22:Completed 150000 out of 1250000 steps (12%)
23:06:15:WU01:FS01:0x22:Checkpoint completed at step 150000
23:12:25:WU01:FS01:0x22:Completed 162500 out of 1250000 steps (13%)
23:18:04:WU01:FS01:0x22:Completed 175000 out of 1250000 steps (14%)
23:18:32:WU01:FS01:0x22:Checkpoint completed at step 175000
23:24:09:WU01:FS01:0x22:Completed 187500 out of 1250000 steps (15%)
23:29:48:WU01:FS01:0x22:Completed 200000 out of 1250000 steps (16%)
23:30:17:WU01:FS01:0x22:Checkpoint completed at step 200000
23:35:50:WU01:FS01:0x22:Completed 212500 out of 1250000 steps (17%)
23:42:00:WU01:FS01:0x22:Completed 225000 out of 1250000 steps (18%)
23:42:24:WU01:FS01:0x22:Checkpoint completed at step 225000
23:47:49:WU01:FS01:0x22:Completed 237500 out of 1250000 steps (19%)
23:53:14:WU01:FS01:0x22:Completed 250000 out of 1250000 steps (20%)
23:53:37:WU01:FS01:0x22:Checkpoint completed at step 250000
00:00:04:WU01:FS01:0x22:Completed 262500 out of 1250000 steps (21%)
00:07:26:WU01:FS01:0x22:Completed 275000 out of 1250000 steps (22%)
00:07:49:WU01:FS01:0x22:Checkpoint completed at step 275000
00:13:18:WU01:FS01:0x22:Completed 287500 out of 1250000 steps (23%)
00:19:00:WU01:FS01:0x22:Completed 300000 out of 1250000 steps (24%)
00:19:23:WU01:FS01:0x22:Checkpoint completed at step 300000
00:24:52:WU01:FS01:0x22:Completed 312500 out of 1250000 steps (25%)
00:31:01:WU01:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
00:31:31:WU01:FS01:0x22:Checkpoint completed at step 325000
00:37:16:WU01:FS01:0x22:Completed 337500 out of 1250000 steps (27%)
00:43:22:WU01:FS01:0x22:Completed 350000 out of 1250000 steps (28%)
00:43:46:WU01:FS01:0x22:Checkpoint completed at step 350000
00:49:37:WU01:FS01:0x22:Completed 362500 out of 1250000 steps (29%)
00:55:18:WU01:FS01:0x22:Completed 375000 out of 1250000 steps (30%)
00:55:44:WU01:FS01:0x22:Checkpoint completed at step 375000
01:01:20:WU01:FS01:0x22:Completed 387500 out of 1250000 steps (31%)
01:06:48:WU01:FS01:0x22:Completed 400000 out of 1250000 steps (32%)
01:07:13:WU01:FS01:0x22:Checkpoint completed at step 400000
01:12:51:WU01:FS01:0x22:Completed 412500 out of 1250000 steps (33%)
01:18:34:WU01:FS01:0x22:Completed 425000 out of 1250000 steps (34%)
01:18:56:WU01:FS01:0x22:Checkpoint completed at step 425000
01:24:16:WU01:FS01:0x22:Completed 437500 out of 1250000 steps (35%)
01:29:37:WU01:FS01:0x22:Completed 450000 out of 1250000 steps (36%)
01:29:59:WU01:FS01:0x22:Checkpoint completed at step 450000
01:35:18:WU01:FS01:0x22:Completed 462500 out of 1250000 steps (37%)
01:41:45:WU01:FS01:0x22:Completed 475000 out of 1250000 steps (38%)
01:42:07:WU01:FS01:0x22:Checkpoint completed at step 475000
01:47:27:WU01:FS01:0x22:Completed 487500 out of 1250000 steps (39%)
01:52:46:WU01:FS01:0x22:Completed 500000 out of 1250000 steps (40%)
01:53:08:WU01:FS01:0x22:Checkpoint completed at step 500000
01:58:27:WU01:FS01:0x22:Completed 512500 out of 1250000 steps (41%)
02:03:51:WU01:FS01:0x22:Completed 525000 out of 1250000 steps (42%)
02:04:13:WU01:FS01:0x22:Checkpoint completed at step 525000
02:09:33:WU01:FS01:0x22:Completed 537500 out of 1250000 steps (43%)
02:14:50:WU01:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
02:15:12:WU01:FS01:0x22:Checkpoint completed at step 550000
02:20:32:WU01:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
******************************* Date: 2020-10-03 *******************************
02:25:50:WU01:FS01:0x22:Completed 575000 out of 1250000 steps (46%)
02:26:12:WU01:FS01:0x22:Checkpoint completed at step 575000
02:32:14:WU01:FS01:0x22:Completed 587500 out of 1250000 steps (47%)
02:38:36:WU01:FS01:0x22:Completed 600000 out of 1250000 steps (48%)
02:39:32:WU01:FS01:0x22:Checkpoint completed at step 600000
02:45:30:WU01:FS01:0x22:Completed 612500 out of 1250000 steps (49%)
02:51:03:WU01:FS01:0x22:Completed 625000 out of 1250000 steps (50%)
02:51:26:WU01:FS01:0x22:Checkpoint completed at step 625000
02:53:20:FS01:Finishing
02:57:18:WU01:FS01:0x22:Completed 637500 out of 1250000 steps (51%)
03:03:11:WU01:FS01:0x22:Completed 650000 out of 1250000 steps (52%)
03:03:33:WU01:FS01:0x22:Checkpoint completed at step 650000
03:08:53:WU01:FS01:0x22:Completed 662500 out of 1250000 steps (53%)
03:14:11:WU01:FS01:0x22:Completed 675000 out of 1250000 steps (54%)
03:14:33:WU01:FS01:0x22:Checkpoint completed at step 675000
03:19:54:WU01:FS01:0x22:Completed 687500 out of 1250000 steps (55%)
03:25:11:WU01:FS01:0x22:Completed 700000 out of 1250000 steps (56%)
03:25:33:WU01:FS01:0x22:Checkpoint completed at step 700000
03:30:53:WU01:FS01:0x22:Completed 712500 out of 1250000 steps (57%)
03:36:10:WU01:FS01:0x22:Completed 725000 out of 1250000 steps (58%)
03:36:32:WU01:FS01:0x22:Checkpoint completed at step 725000
03:43:07:WU01:FS01:0x22:Completed 737500 out of 1250000 steps (59%)
03:48:32:WU01:FS01:0x22:Completed 750000 out of 1250000 steps (60%)
03:48:55:WU01:FS01:0x22:Checkpoint completed at step 750000
03:54:19:WU01:FS01:0x22:Completed 762500 out of 1250000 steps (61%)
03:59:45:WU01:FS01:0x22:Completed 775000 out of 1250000 steps (62%)
04:00:08:WU01:FS01:0x22:Checkpoint completed at step 775000
04:05:37:WU01:FS01:0x22:Completed 787500 out of 1250000 steps (63%)
04:11:01:WU01:FS01:0x22:Completed 800000 out of 1250000 steps (64%)
04:11:24:WU01:FS01:0x22:Checkpoint completed at step 800000
04:16:47:WU01:FS01:0x22:Completed 812500 out of 1250000 steps (65%)
04:22:12:WU01:FS01:0x22:Completed 825000 out of 1250000 steps (66%)
04:22:35:WU01:FS01:0x22:Checkpoint completed at step 825000
04:27:58:WU01:FS01:0x22:Completed 837500 out of 1250000 steps (67%)
04:33:21:WU01:FS01:0x22:Completed 850000 out of 1250000 steps (68%)
04:33:44:WU01:FS01:0x22:Checkpoint completed at step 850000
04:40:02:WU01:FS01:0x22:Completed 862500 out of 1250000 steps (69%)
04:45:24:WU01:FS01:0x22:Completed 875000 out of 1250000 steps (70%)
04:45:47:WU01:FS01:0x22:Checkpoint completed at step 875000
04:51:12:WU01:FS01:0x22:Completed 887500 out of 1250000 steps (71%)
04:56:35:WU01:FS01:0x22:Completed 900000 out of 1250000 steps (72%)
04:56:58:WU01:FS01:0x22:Checkpoint completed at step 900000
05:02:23:WU01:FS01:0x22:Completed 912500 out of 1250000 steps (73%)
05:07:47:WU01:FS01:0x22:Completed 925000 out of 1250000 steps (74%)
05:08:10:WU01:FS01:0x22:Checkpoint completed at step 925000
05:13:34:WU01:FS01:0x22:Completed 937500 out of 1250000 steps (75%)
05:18:59:WU01:FS01:0x22:Completed 950000 out of 1250000 steps (76%)
05:19:21:WU01:FS01:0x22:Checkpoint completed at step 950000
05:24:44:WU01:FS01:0x22:Completed 962500 out of 1250000 steps (77%)
05:30:08:WU01:FS01:0x22:Completed 975000 out of 1250000 steps (78%)
05:30:31:WU01:FS01:0x22:Checkpoint completed at step 975000
05:35:54:WU01:FS01:0x22:Completed 987500 out of 1250000 steps (79%)
05:41:47:WU01:FS01:0x22:Completed 1000000 out of 1250000 steps (80%)
05:42:10:WU01:FS01:0x22:Checkpoint completed at step 1000000
05:47:33:WU01:FS01:0x22:Completed 1012500 out of 1250000 steps (81%)
05:52:58:WU01:FS01:0x22:Completed 1025000 out of 1250000 steps (82%)
05:53:21:WU01:FS01:0x22:Checkpoint completed at step 1025000
05:58:44:WU01:FS01:0x22:Completed 1037500 out of 1250000 steps (83%)
06:04:09:WU01:FS01:0x22:Completed 1050000 out of 1250000 steps (84%)
06:04:33:WU01:FS01:0x22:Checkpoint completed at step 1050000
06:09:58:WU01:FS01:0x22:Completed 1062500 out of 1250000 steps (85%)
06:15:20:WU01:FS01:0x22:Completed 1075000 out of 1250000 steps (86%)
06:15:43:WU01:FS01:0x22:Checkpoint completed at step 1075000
06:21:06:WU01:FS01:0x22:Completed 1087500 out of 1250000 steps (87%)
06:26:29:WU01:FS01:0x22:Completed 1100000 out of 1250000 steps (88%)
06:26:52:WU01:FS01:0x22:Checkpoint completed at step 1100000
06:32:16:WU01:FS01:0x22:Completed 1112500 out of 1250000 steps (89%)
06:37:46:WU01:FS01:0x22:Completed 1125000 out of 1250000 steps (90%)
06:38:09:WU01:FS01:0x22:Checkpoint completed at step 1125000
06:44:00:WU01:FS01:0x22:Completed 1137500 out of 1250000 steps (91%)
06:49:25:WU01:FS01:0x22:Completed 1150000 out of 1250000 steps (92%)
06:49:47:WU01:FS01:0x22:Checkpoint completed at step 1150000
06:55:10:WU01:FS01:0x22:Completed 1162500 out of 1250000 steps (93%)
07:00:43:WU01:FS01:0x22:Completed 1175000 out of 1250000 steps (94%)
07:01:16:WU01:FS01:0x22:Checkpoint completed at step 1175000
07:07:46:WU01:FS01:0x22:Completed 1187500 out of 1250000 steps (95%)
07:14:23:WU01:FS01:0x22:Completed 1200000 out of 1250000 steps (96%)
07:14:47:WU01:FS01:0x22:Checkpoint completed at step 1200000
07:21:19:WU01:FS01:0x22:Completed 1212500 out of 1250000 steps (97%)
07:27:44:WU01:FS01:0x22:Completed 1225000 out of 1250000 steps (98%)
07:28:07:WU01:FS01:0x22:Checkpoint completed at step 1225000
07:33:33:WU01:FS01:0x22:Completed 1237500 out of 1250000 steps (99%)
07:33:34:WU02:FS01:Connecting to assign1.foldingathome.org:80
07:33:35:WU02:FS01:Assigned to work server 18.188.125.154
07:33:35:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP108 [GeForce GT 1030] 1127 from 18.188.125.154
07:33:35:WU02:FS01:Connecting to 18.188.125.154:8080
07:33:35:WU02:FS01:Downloading 363.41KiB
07:33:35:WU02:FS01:Download complete
07:33:35:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13427 run:5439 clone:23 gen:5 core:0x22 unit:0x0000000612bc7d9a5f597d0cc59bb1bc
07:39:55:WU01:FS01:0x22:Completed 1250000 out of 1250000 steps (100%)
07:39:55:WU01:FS01:0x22:Average performance: 4.88136 ns/day
07:40:18:WU01:FS01:0x22:Checkpoint completed at step 1250000
07:40:30:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
07:40:30:WU01:FS01:0x22:Saving result file checkpointIntegrator.xml.bz2
07:40:30:WU01:FS01:0x22:Saving result file checkpointState.xml.bz2
07:40:30:WU01:FS01:0x22:Saving result file positions.xtc
07:40:30:WU01:FS01:0x22:Saving result file science.log
07:40:30:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
07:40:31:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:40:31:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14486 run:0 clone:452 gen:65 core:0x22 unit:0x0000005942aa6f325f45deaac260a2eb
07:40:31:WU02:FS01:Starting
07:40:31:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Saam7882\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 2852 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:40:31:WU02:FS01:Started FahCore on PID 4376
07:40:31:WU01:FS01:Uploading 14.51MiB to 66.170.111.50
07:40:31:WU01:FS01:Connecting to 66.170.111.50:8080
07:40:32:WU02:FS01:Core PID:4256
07:40:32:WU02:FS01:FahCore 0x22 started
07:40:33:WU02:FS01:0x22:*********************** Log Started 2020-10-03T07:40:33Z ***********************
07:40:33:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
07:40:33:WU02:FS01:0x22:       Core: Core22
07:40:33:WU02:FS01:0x22:       Type: 0x22
07:40:33:WU02:FS01:0x22:    Version: 0.0.13
07:40:33:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
07:40:33:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
07:40:33:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
07:40:33:WU02:FS01:0x22:       Date: Sep 19 2020
07:40:33:WU02:FS01:0x22:       Time: 02:35:58
07:40:33:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:40:33:WU02:FS01:0x22:     Branch: core22-0.0.13
07:40:33:WU02:FS01:0x22:   Compiler: Visual C++ 2015
07:40:33:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:40:33:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:40:33:WU02:FS01:0x22:   Platform: win32 10
07:40:33:WU02:FS01:0x22:       Bits: 64
07:40:33:WU02:FS01:0x22:       Mode: Release
07:40:33:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
07:40:33:WU02:FS01:0x22:             <peastman@stanford.edu>
07:40:33:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 4376 -checkpoint 30
07:40:33:WU02:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:40:33:WU02:FS01:0x22:             0 -gpu 0
07:40:33:WU02:FS01:0x22:************************************ libFAH ************************************
07:40:33:WU02:FS01:0x22:       Date: Sep 7 2020
07:40:33:WU02:FS01:0x22:       Time: 19:09:56
07:40:33:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:40:33:WU02:FS01:0x22:     Branch: HEAD
07:40:33:WU02:FS01:0x22:   Compiler: Visual C++ 2015
07:40:33:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:40:33:WU02:FS01:0x22:   Platform: win32 10
07:40:33:WU02:FS01:0x22:       Bits: 64
07:40:33:WU02:FS01:0x22:       Mode: Release
07:40:33:WU02:FS01:0x22:************************************ CBang *************************************
07:40:33:WU02:FS01:0x22:       Date: Sep 7 2020
07:40:33:WU02:FS01:0x22:       Time: 19:08:30
07:40:33:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:40:33:WU02:FS01:0x22:     Branch: HEAD
07:40:33:WU02:FS01:0x22:   Compiler: Visual C++ 2015
07:40:33:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:40:33:WU02:FS01:0x22:   Platform: win32 10
07:40:33:WU02:FS01:0x22:       Bits: 64
07:40:33:WU02:FS01:0x22:       Mode: Release
07:40:33:WU02:FS01:0x22:************************************ System ************************************
07:40:33:WU02:FS01:0x22:        CPU: Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
07:40:33:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 2
07:40:33:WU02:FS01:0x22:       CPUs: 2
07:40:33:WU02:FS01:0x22:     Memory: 8.00GiB
07:40:33:WU02:FS01:0x22:Free Memory: 5.68GiB
07:40:33:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
07:40:33:WU02:FS01:0x22: OS Version: 6.1
07:40:33:WU02:FS01:0x22:Has Battery: false
07:40:33:WU02:FS01:0x22: On Battery: false
07:40:33:WU02:FS01:0x22: UTC Offset: -4
07:40:33:WU02:FS01:0x22:        PID: 4256
07:40:33:WU02:FS01:0x22:        CWD: C:\Users\Saam7882\AppData\Roaming\FAHClient\work
07:40:33:WU02:FS01:0x22:************************************ OpenMM ************************************
07:40:33:WU02:FS01:0x22:   Revision: 189320d0
07:40:33:WU02:FS01:0x22:********************************************************************************
07:40:33:WU02:FS01:0x22:Project: 13427 (Run 5439, Clone 23, Gen 5)
07:40:33:WU02:FS01:0x22:Unit: 0x0000000612bc7d9a5f597d0cc59bb1bc
07:40:33:WU02:FS01:0x22:Reading tar file core.xml
07:40:33:WU02:FS01:0x22:Reading tar file integrator.xml
07:40:33:WU02:FS01:0x22:Reading tar file state.xml.bz2
07:40:33:WU02:FS01:0x22:Reading tar file system.xml.bz2
07:40:33:WU02:FS01:0x22:Digital signatures verified
07:40:33:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
07:40:33:WU02:FS01:0x22:Version 0.0.13
07:40:34:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
07:40:34:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
07:40:34:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
07:40:34:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
07:40:36:WU02:FS01:0x22:There are 3 platforms available.
07:40:36:WU02:FS01:0x22:Platform 0: Reference
07:40:36:WU02:FS01:0x22:Platform 1: OpenCL
07:40:36:WU02:FS01:0x22:  opencl-device 0 specified
07:40:36:WU02:FS01:0x22:Platform 2: CUDA
07:40:36:WU02:FS01:0x22:  cuda-device 0 specified
07:40:37:WU02:FS01:0x22:Attempting to create CUDA context:
07:40:37:WU02:FS01:0x22:  Configuring platform CUDA
07:40:37:WU01:FS01:Upload 3.88%
07:40:43:WU01:FS01:Upload 8.62%
07:40:49:WU01:FS01:Upload 14.22%
07:40:53:WU02:FS01:0x22:  Using CUDA and gpu 0
07:40:53:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
07:40:55:WU01:FS01:Upload 19.81%
07:40:55:WU02:FS01:0x22:Checkpoint completed at step 0
07:41:01:WU01:FS01:Upload 25.85%
07:41:07:WU01:FS01:Upload 30.15%
07:41:13:WU01:FS01:Upload 34.03%
07:41:19:WU01:FS01:Upload 38.34%
07:41:25:WU01:FS01:Upload 44.37%
07:41:31:WU01:FS01:Upload 50.40%
07:41:37:WU01:FS01:Upload 56.00%
07:41:43:WU01:FS01:Upload 60.31%
07:41:49:WU01:FS01:Upload 64.61%
07:41:55:WU01:FS01:Upload 70.21%
07:42:01:WU01:FS01:Upload 76.24%
07:42:03:WU02:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
07:42:07:WU01:FS01:Upload 81.41%
07:42:13:WU01:FS01:Upload 85.29%
07:42:19:WU01:FS01:Upload 88.74%
07:42:25:WU01:FS01:Upload 93.91%
07:42:31:WU01:FS01:Upload 99.51%
07:42:31:WU01:FS01:Upload complete
07:42:31:WU01:FS01:Server responded WORK_ACK (400)
07:42:31:WU01:FS01:Final credit estimate, 38102.00 points
07:42:31:WU01:FS01:Cleaning up
07:43:04:WU02:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
07:44:05:WU02:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
07:45:07:WU02:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
07:46:10:WU02:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
07:46:12:WU02:FS01:0x22:Checkpoint completed at step 50000
07:47:23:WU02:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
07:48:28:WU02:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
07:49:34:WU02:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
07:50:41:WU02:FS01:0x22:Completed 90000 out of 1000000 steps (9%)
07:51:49:WU02:FS01:0x22:Completed 100000 out of 1000000 steps (10%)
07:51:50:WU02:FS01:0x22:Checkpoint completed at step 100000
07:52:57:WU02:FS01:0x22:Completed 110000 out of 1000000 steps (11%)
07:54:03:WU02:FS01:0x22:Completed 120000 out of 1000000 steps (12%)
07:55:08:WU02:FS01:0x22:Completed 130000 out of 1000000 steps (13%)
07:56:13:WU02:FS01:0x22:Completed 140000 out of 1000000 steps (14%)
07:57:17:WU02:FS01:0x22:Completed 150000 out of 1000000 steps (15%)
07:57:19:WU02:FS01:0x22:Checkpoint completed at step 150000
07:58:24:WU02:FS01:0x22:Completed 160000 out of 1000000 steps (16%)
07:59:29:WU02:FS01:0x22:Completed 170000 out of 1000000 steps (17%)
08:00:34:WU02:FS01:0x22:Completed 180000 out of 1000000 steps (18%)
08:01:39:WU02:FS01:0x22:Completed 190000 out of 1000000 steps (19%)
08:02:43:WU02:FS01:0x22:Completed 200000 out of 1000000 steps (20%)
08:02:45:WU02:FS01:0x22:Checkpoint completed at step 200000
08:03:50:WU02:FS01:0x22:Completed 210000 out of 1000000 steps (21%)
08:04:55:WU02:FS01:0x22:Completed 220000 out of 1000000 steps (22%)
08:06:00:WU02:FS01:0x22:Completed 230000 out of 1000000 steps (23%)
08:07:04:WU02:FS01:0x22:Completed 240000 out of 1000000 steps (24%)
08:08:11:WU02:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
08:08:12:WU02:FS01:0x22:Checkpoint completed at step 250000
08:09:20:WU02:FS01:0x22:Completed 260000 out of 1000000 steps (26%)
08:10:27:WU02:FS01:0x22:Completed 270000 out of 1000000 steps (27%)
08:10:51:WU02:FS01:0x22:An exception occurred at step 273635: Error downloading array energySum: CUDA_ERROR_LAUNCH_FAILED (719)
08:10:51:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
08:10:51:WU02:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
******************************* Date: 2020-10-03 *******************************
10:30:41:WARNING:WU02:FS01:FahCore returned: FAILED_3 (255 = 0xff)
10:30:42:WU02:FS01:Starting
10:30:42:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Saam7882\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 2852 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
10:30:42:WU02:FS01:Started FahCore on PID 3912
10:30:42:WU02:FS01:Core PID:3056
10:30:42:WU02:FS01:FahCore 0x22 started
10:30:43:WU02:FS01:0x22:*********************** Log Started 2020-10-03T10:30:43Z ***********************
10:30:43:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
10:30:43:WU02:FS01:0x22:       Core: Core22
10:30:43:WU02:FS01:0x22:       Type: 0x22
10:30:43:WU02:FS01:0x22:    Version: 0.0.13
10:30:43:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:30:43:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
10:30:43:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
10:30:43:WU02:FS01:0x22:       Date: Sep 19 2020
10:30:43:WU02:FS01:0x22:       Time: 02:35:58
10:30:43:WU02:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
10:30:43:WU02:FS01:0x22:     Branch: core22-0.0.13
10:30:43:WU02:FS01:0x22:   Compiler: Visual C++ 2015
10:30:43:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
10:30:43:WU02:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
10:30:43:WU02:FS01:0x22:   Platform: win32 10
10:30:43:WU02:FS01:0x22:       Bits: 64
10:30:43:WU02:FS01:0x22:       Mode: Release
10:30:43:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
10:30:43:WU02:FS01:0x22:             <peastman@stanford.edu>
10:30:43:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 3912 -checkpoint 30
10:30:43:WU02:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
10:30:43:WU02:FS01:0x22:             0 -gpu 0
10:30:43:WU02:FS01:0x22:************************************ libFAH ************************************
10:30:43:WU02:FS01:0x22:       Date: Sep 7 2020
10:30:43:WU02:FS01:0x22:       Time: 19:09:56
10:30:43:WU02:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
10:30:43:WU02:FS01:0x22:     Branch: HEAD
10:30:43:WU02:FS01:0x22:   Compiler: Visual C++ 2015
10:30:43:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
10:30:43:WU02:FS01:0x22:   Platform: win32 10
10:30:43:WU02:FS01:0x22:       Bits: 64
10:30:43:WU02:FS01:0x22:       Mode: Release
10:30:43:WU02:FS01:0x22:************************************ CBang *************************************
10:30:43:WU02:FS01:0x22:       Date: Sep 7 2020
10:30:43:WU02:FS01:0x22:       Time: 19:08:30
10:30:43:WU02:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
10:30:43:WU02:FS01:0x22:     Branch: HEAD
10:30:43:WU02:FS01:0x22:   Compiler: Visual C++ 2015
10:30:43:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
10:30:43:WU02:FS01:0x22:   Platform: win32 10
10:30:43:WU02:FS01:0x22:       Bits: 64
10:30:43:WU02:FS01:0x22:       Mode: Release
10:30:43:WU02:FS01:0x22:************************************ System ************************************
10:30:43:WU02:FS01:0x22:        CPU: Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
10:30:43:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 2
10:30:43:WU02:FS01:0x22:       CPUs: 2
10:30:43:WU02:FS01:0x22:     Memory: 8.00GiB
10:30:43:WU02:FS01:0x22:Free Memory: 5.69GiB
10:30:43:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
10:30:43:WU02:FS01:0x22: OS Version: 6.1
10:30:43:WU02:FS01:0x22:Has Battery: false
10:30:43:WU02:FS01:0x22: On Battery: false
10:30:43:WU02:FS01:0x22: UTC Offset: -4
10:30:43:WU02:FS01:0x22:        PID: 3056
10:30:43:WU02:FS01:0x22:        CWD: C:\Users\Saam7882\AppData\Roaming\FAHClient\work
10:30:43:WU02:FS01:0x22:************************************ OpenMM ************************************
10:30:43:WU02:FS01:0x22:   Revision: 189320d0
10:30:43:WU02:FS01:0x22:********************************************************************************
10:30:43:WU02:FS01:0x22:Project: 13427 (Run 5439, Clone 23, Gen 5)
10:30:43:WU02:FS01:0x22:Unit: 0x0000000612bc7d9a5f597d0cc59bb1bc
10:30:43:WU02:FS01:0x22:Digital signatures verified
10:30:43:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
10:30:43:WU02:FS01:0x22:Version 0.0.13
10:30:44:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
10:30:44:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
10:30:44:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
10:30:44:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
10:30:46:WU02:FS01:0x22:There are 3 platforms available.
10:30:46:WU02:FS01:0x22:Platform 0: Reference
10:30:46:WU02:FS01:0x22:Platform 1: OpenCL
10:30:46:WU02:FS01:0x22:  opencl-device 0 specified
10:30:46:WU02:FS01:0x22:Platform 2: CUDA
10:30:46:WU02:FS01:0x22:  cuda-device 0 specified
10:30:47:WU02:FS01:0x22:Attempting to create CUDA context:
10:30:47:WU02:FS01:0x22:  Configuring platform CUDA
10:30:52:WU02:FS01:0x22:  Using CUDA and gpu 0
10:30:52:WU02:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
10:31:15:WU02:FS01:0x22:An exception occurred at step 253385: Error downloading array energySum: CUDA_ERROR_LAUNCH_FAILED (719)
10:31:15:WU02:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
10:31:15:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
10:31:15:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
10:31:15:WU02:FS01:0x22:Saving result file globals.csv
10:31:15:WU02:FS01:0x22:Saving result file science.log
10:31:15:WU02:FS01:0x22:Saving result file state.xml.bz2
10:31:15:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
10:31:27:WARNING:WU02:FS01:FahCore returned: FAILED_3 (255 = 0xff)
10:31:27:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13427 run:5439 clone:23 gen:5 core:0x22 unit:0x0000000612bc7d9a5f597d0cc59bb1bc
10:31:27:WU02:FS01:Uploading 310.39KiB to 18.188.125.154
10:31:27:WU02:FS01:Connecting to 18.188.125.154:8080
10:31:27:WU01:FS01:Connecting to assign1.foldingathome.org:80
10:31:27:WU01:FS01:Assigned to work server 18.188.125.154
10:31:27:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP108 [GeForce GT 1030] 1127 from 18.188.125.154
10:31:27:WU01:FS01:Connecting to 18.188.125.154:8080
10:31:28:WU01:FS01:Downloading 371.16KiB
10:31:28:WU01:FS01:Download complete
10:31:28:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13427 run:5433 clone:4 gen:4 core:0x22 unit:0x0000000412bc7d9a5f597d0e0d76b238
10:31:28:WU02:FS01:Upload complete

Paul

[PantherX]

From the log file, it seems that you could initialize the FahCore_22 version 0.0.13 without issues. You even managed to successfully fold this WU:
Project: 14486 (Run 0, Clone 452, Gen 65)

However, your system failed to process WUs from Project: 13427 which is odd.

What driver version are you running on your system?

[foldy]

@psaam0001: GT 1030 only has 2GB VRAM. So maybe CUDA_ERROR_LAUNCH_FAILED means out of memory?