Project: 7644 (Run 313, Clone 0, Gen 13) - UNSTABLE_MACHINE

Moderators: Site Moderators, FAHC Science Team

Post Reply
DocJonz
Posts: 243
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 3070
Location: United Kingdom
Contact:

Project: 7644 (Run 313, Clone 0, Gen 13) - UNSTABLE_MACHINE

Post by DocJonz »

Similar issue to the thread on the other P7644 (viewtopic.php?f=19&t=21453#p214466).

Details - GTX 560Ti, no OC, been Folding 24/7 for over a year, seems to Fold other WU's, but not this one.

The code below shows it completing a P8008, then failing the P7644 five times. I cleared the directory and restarted - it did another P8008 and then failed the same P7644 five times;

Code: Select all


--- Opening Log file [May 2 07:23:49 UTC] 


# Windows GPU Systray Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.41r2

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\williams\AppData\Roaming\Folding@home-gpu2
Arguments: -gpu 1 

[07:23:49] - Ask before connecting: No
[07:23:49] - User name: DocJonz (Team 35947)
[07:23:49] - User ID: 64FC09F4051CE893
[07:23:49] - Machine ID: 6
[07:23:49] 
[07:23:49] Gpu type=3 species=21.
[07:23:49] Work directory not found. Creating...
[07:23:49] Could not open work queue, generating new queue...
[07:23:49] Initialization complete
[07:23:49] - Preparing to get new work unit...
[07:23:49] Cleaning up work directory
[07:23:49] + Attempting to get work packet
[07:23:49] Passkey found
[07:23:49] Gpu type=3 species=21.
[07:23:49] - Connecting to assignment server
[07:23:50] - Successful: assigned to (171.67.108.141).
[07:23:50] + News From Folding@Home: Welcome to Folding@Home
[07:23:50] Loaded queue successfully.
[07:23:50] Gpu type=3 species=21.
[07:23:51] + Closed connections
[07:23:51] 
[07:23:51] + Processing work unit
[07:23:51] Core required: FahCore_15.exe
[07:23:51] Core not found.
[07:23:51] - Core is not present or corrupted.
[07:23:51] - Attempting to download new core...
[07:23:51] + Downloading new core: FahCore_15.exe
[07:23:52] + 10240 bytes downloaded
...........................
[07:24:00] + 1559166 bytes downloaded
[07:24:00] Verifying core Core_15.fah...
[07:24:01] Signature is VALID
[07:24:01] 
[07:24:01] Trying to unzip core FahCore_15.exe
[07:24:01] Decompressed FahCore_15.exe (4685824 bytes) successfully
[07:24:06] + Core successfully engaged
[07:24:11] 
[07:24:11] + Processing work unit
[07:24:11] Core required: FahCore_15.exe
[07:24:11] Core found.
[07:24:11] Working on queue slot 01 [May 2 07:24:11 UTC]
[07:24:11] + Working ...
[07:24:23] 
[07:24:23] *------------------------------*
[07:24:23] Folding@Home GPU Core
[07:24:23] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[07:24:23] Build host             SimbiosNvdWin7
[07:24:23] Board Type             NVIDIA/CUDA
[07:24:23] Core                   15
[07:24:23] 
[07:24:23] Window's signal control handler registered.
[07:24:23] Preparing to commence simulation
[07:24:23] - Looking at optimizations...
[07:24:23] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[07:24:23] - Created dyn
[07:24:23] - Files status OK
[07:24:23] sizeof(CORE_PACKET_HDR) = 512 file=<>
[07:24:23] - Expanded 66278 -> 287126 (decompressed 433.2 percent)
[07:24:23] Called DecompressByteArray: compressed_data_size=66278 data_size=287126, decompressed_data_size=287126 diff=0
[07:24:23] - Digital signature verified
[07:24:23] 
[07:24:23] Project: 8008 (Run 6, Clone 47, Gen 17)
[07:24:23] 
[07:24:23] Assembly optimizations on if available.
[07:24:23] Entering M.D.
[07:24:25] Tpr hash work/wudata_01.tpr:  4273945901 3454392469 694568791 3440309264 1975964452
[07:24:25] GPU device info: vendor=0 device=0 name=<NA> match=0
[07:24:25] Working on Gromacs Runs On Most of All Computer Systems
[07:24:25] Client config found, loading data.
[07:24:26] Starting GUI Server
[07:25:29] Setting checkpoint frequency: 500000
[07:25:29] Completed         3 out of 50000000 steps (0%).
[07:27:40] Completed    500000 out of 50000000 steps (1%).
[07:29:53] Completed   1000000 out of 50000000 steps (2%).
[07:32:05] Completed   1500000 out of 50000000 steps (3%).
[07:34:17] Completed   2000000 out of 50000000 steps (4%).
[07:36:29] Completed   2500000 out of 50000000 steps (5%).
........................................................
[10:54:39] Completed  47500000 out of 50000000 steps (95%).
[10:56:51] Completed  48000000 out of 50000000 steps (96%).
[10:59:03] Completed  48500000 out of 50000000 steps (97%).
[11:01:15] Completed  49000000 out of 50000000 steps (98%).
[11:03:27] Completed  49500000 out of 50000000 steps (99%).
[11:05:40] Completed  50000000 out of 50000000 steps (100%).
[11:05:40] Finished fah_main status=0
[11:05:40] Successful run
[11:05:40] DynamicWrapper: Finished Work Unit: sleep=10000
[11:05:50] Reserved 358172 bytes for xtc file; Cosm status=0
[11:05:50] Allocated 358172 bytes for xtc file
[11:05:50] - Reading up to 358172 from "work/wudata_01.xtc": Read 358172
[11:05:50] Read 358172 bytes from xtc file; available packet space=786072292
[11:05:50] xtc file hash check passed.
[11:05:50] Reserved 22344 22344 786072292 bytes for arc file=<work/wudata_01.trr> Cosm status=0
[11:05:50] Allocated 22344 bytes for arc file
[11:05:50] - Reading up to 22344 from "work/wudata_01.trr": Read 22344
[11:05:50] Read 22344 bytes from arc file; available packet space=786049948
[11:05:50] trr file hash check passed.
[11:05:50] Allocated 544 bytes for edr file
[11:05:50] Read bedfile
[11:05:50] edr file hash check passed.
[11:05:50] Allocated 36868 bytes for logfile
[11:05:50] Read logfile
[11:05:50] GuardedRun: success in DynamicWrapper
[11:05:50] GuardedRun: done
[11:05:50] Run: GuardedRun completed.
[11:05:53] + Opened results file
[11:05:53] - Writing 418440 bytes of core data to disk...
[11:05:53] Done: 417928 -> 387155 (compressed to 92.6 percent)
[11:05:53]   ... Done.
[11:05:53] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[11:05:53] Shutting down core 
[11:05:53] 
[11:05:53] Folding@home Core Shutdown: FINISHED_UNIT
[11:05:57] CoreStatus = 64 (100)
[11:05:57] Sending work to server
[11:05:57] Project: 8008 (Run 6, Clone 47, Gen 17)
[11:05:57] - Read packet limit of 540015616... Set to 524286976.


[11:05:57] + Attempting to send results [May 2 11:05:57 UTC]
[11:05:57] Gpu type=3 species=21.
[11:06:03] + Results successfully sent
[11:06:03] Thank you for your contribution to Folding@Home.
[11:06:03] + Number of Units Completed: 794

[11:06:18] - Preparing to get new work unit...
[11:06:18] Cleaning up work directory
[11:06:18] + Attempting to get work packet
[11:06:18] Passkey found
[11:06:18] Gpu type=3 species=21.
[11:06:18] - Connecting to assignment server
[11:06:19] - Successful: assigned to (171.64.65.93).
[11:06:19] + News From Folding@Home: Welcome to Folding@Home
[11:06:19] Loaded queue successfully.
[11:06:19] Gpu type=3 species=21.
[11:06:23] + Closed connections
[11:06:23] 
[11:06:23] + Processing work unit
[11:06:23] Core required: FahCore_15.exe
[11:06:23] Core found.
[11:06:23] Working on queue slot 02 [May 2 11:06:23 UTC]
[11:06:23] + Working ...
[11:06:23] 
[11:06:23] *------------------------------*
[11:06:23] Folding@Home GPU Core
[11:06:23] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[11:06:23] Build host             SimbiosNvdWin7
[11:06:23] Board Type             NVIDIA/CUDA
[11:06:23] Core                   15
[11:06:23] 
[11:06:23] Window's signal control handler registered.
[11:06:23] Preparing to commence simulation
[11:06:23] - Looking at optimizations...
[11:06:23] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[11:06:23] - Created dyn
[11:06:23] - Files status OK
[11:06:23] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:06:23] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[11:06:23] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[11:06:23] - Digital signature verified
[11:06:23] 
[11:06:23] Project: 7644 (Run 313, Clone 0, Gen 13)
[11:06:23] 
[11:06:23] Assembly optimizations on if available.
[11:06:23] Entering M.D.
[11:06:25] Tpr hash work/wudata_02.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[11:06:25] GPU device info: vendor=0 device=0 name=<NA> match=0
[11:06:25] Working on Protein in water
[11:06:25] Client config found, loading data.
[11:06:25] Starting GUI Server
[11:07:58] Setting checkpoint frequency: 25000
[11:07:58] Completed         3 out of 2500000 steps (0%).
[11:32:35] Completed     25000 out of 2500000 steps (1%).
[11:32:35] mdrun_gpu returned 52
[11:32:35] NANs detected on GPU
[11:32:35] 
[11:32:35] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:32:39] CoreStatus = 7A (122)
[11:32:39] Sending work to server
[11:32:39] Project: 7644 (Run 313, Clone 0, Gen 13)
[11:32:39] - Read packet limit of 540015616... Set to 524286976.
[11:32:39] - Error: Could not get length of results file work/wuresults_02.dat
[11:32:39] - Error: Could not read unit 02 file. Removing from queue.
[11:32:39] - Preparing to get new work unit...
[11:32:39] Cleaning up work directory
[11:32:39] + Attempting to get work packet
[11:32:39] Passkey found
[11:32:39] Gpu type=3 species=21.
[11:32:39] - Connecting to assignment server
[11:32:40] - Successful: assigned to (171.64.65.93).
[11:32:40] + News From Folding@Home: Welcome to Folding@Home
[11:32:40] Loaded queue successfully.
[11:32:40] Gpu type=3 species=21.
[11:32:43] + Closed connections
[11:32:48] 
[11:32:48] + Processing work unit
[11:32:48] Core required: FahCore_15.exe
[11:32:48] Core found.
[11:32:48] Working on queue slot 03 [May 2 11:32:48 UTC]
[11:32:48] + Working ...
[11:32:48] 
[11:32:48] *------------------------------*
[11:32:48] Folding@Home GPU Core
[11:32:48] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[11:32:48] Build host             SimbiosNvdWin7
[11:32:48] Board Type             NVIDIA/CUDA
[11:32:48] Core                   15
[11:32:48] 
[11:32:48] Window's signal control handler registered.
[11:32:48] Preparing to commence simulation
[11:32:48] - Looking at optimizations...
[11:32:48] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[11:32:48] - Created dyn
[11:32:48] - Files status OK
[11:32:48] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:32:48] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[11:32:48] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[11:32:48] - Digital signature verified
[11:32:48] 
[11:32:48] Project: 7644 (Run 313, Clone 0, Gen 13)
[11:32:48] 
[11:32:48] Assembly optimizations on if available.
[11:32:48] Entering M.D.
[11:32:50] Tpr hash work/wudata_03.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[11:32:50] GPU device info: vendor=0 device=0 name=<NA> match=0
[11:32:51] Working on Protein in water
[11:32:51] Client config found, loading data.
[11:32:51] Starting GUI Server
[11:34:25] Setting checkpoint frequency: 25000
[11:34:25] Completed         3 out of 2500000 steps (0%).
[11:49:09] Completed     25000 out of 2500000 steps (1%).
[11:49:10] mdrun_gpu returned 52
[11:49:10] NANs detected on GPU
[11:49:10] 
[11:49:10] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:49:12] CoreStatus = 7A (122)
[11:49:12] Sending work to server
[11:49:12] Project: 7644 (Run 313, Clone 0, Gen 13)
[11:49:12] - Read packet limit of 540015616... Set to 524286976.
[11:49:12] - Error: Could not get length of results file work/wuresults_03.dat
[11:49:12] - Error: Could not read unit 03 file. Removing from queue.
[11:49:12] - Preparing to get new work unit...
[11:49:12] Cleaning up work directory
[11:49:12] + Attempting to get work packet
[11:49:12] Passkey found
[11:49:12] Gpu type=3 species=21.
[11:49:12] - Connecting to assignment server
[11:49:14] - Successful: assigned to (171.64.65.93).
[11:49:14] + News From Folding@Home: Welcome to Folding@Home
[11:49:14] Loaded queue successfully.
[11:49:14] Gpu type=3 species=21.
[11:49:18] + Closed connections
[11:49:23] 
[11:49:23] + Processing work unit
[11:49:23] Core required: FahCore_15.exe
[11:49:23] Core found.
[11:49:23] Working on queue slot 04 [May 2 11:49:23 UTC]
[11:49:23] + Working ...
[11:49:23] 
[11:49:23] *------------------------------*
[11:49:23] Folding@Home GPU Core
[11:49:23] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[11:49:23] Build host             SimbiosNvdWin7
[11:49:23] Board Type             NVIDIA/CUDA
[11:49:23] Core                   15
[11:49:23] 
[11:49:23] Window's signal control handler registered.
[11:49:23] Preparing to commence simulation
[11:49:23] - Looking at optimizations...
[11:49:23] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[11:49:23] - Created dyn
[11:49:23] - Files status OK
[11:49:23] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:49:23] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[11:49:23] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[11:49:23] - Digital signature verified
[11:49:23] 
[11:49:23] Project: 7644 (Run 313, Clone 0, Gen 13)
[11:49:23] 
[11:49:23] Assembly optimizations on if available.
[11:49:23] Entering M.D.
[11:49:25] Tpr hash work/wudata_04.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[11:49:25] GPU device info: vendor=0 device=0 name=<NA> match=0
[11:49:26] Working on Protein in water
[11:49:26] Client config found, loading data.
[11:49:26] Starting GUI Server
[11:50:58] Setting checkpoint frequency: 25000
[11:50:58] Completed         3 out of 2500000 steps (0%).
[12:00:48] Completed     25000 out of 2500000 steps (1%).
[12:10:39] Completed     50000 out of 2500000 steps (2%).
[12:33:48] Completed     75000 out of 2500000 steps (3%).
[12:33:48] mdrun_gpu returned 52
[12:33:48] NANs detected on GPU
[12:33:48] 
[12:33:48] Folding@home Core Shutdown: UNSTABLE_MACHINE
[12:33:52] CoreStatus = 7A (122)
[12:33:52] Sending work to server
[12:33:52] Project: 7644 (Run 313, Clone 0, Gen 13)
[12:33:52] - Read packet limit of 540015616... Set to 524286976.
[12:33:52] - Error: Could not get length of results file work/wuresults_04.dat
[12:33:52] - Error: Could not read unit 04 file. Removing from queue.
[12:33:52] - Preparing to get new work unit...
[12:33:52] Cleaning up work directory
[12:33:52] + Attempting to get work packet
[12:33:52] Passkey found
[12:33:52] Gpu type=3 species=21.
[12:33:52] - Connecting to assignment server
[12:33:53] - Successful: assigned to (171.64.65.93).
[12:33:53] + News From Folding@Home: Welcome to Folding@Home
[12:33:53] Loaded queue successfully.
[12:33:53] Gpu type=3 species=21.
[12:33:56] + Closed connections
[12:34:01] 
[12:34:01] + Processing work unit
[12:34:01] Core required: FahCore_15.exe
[12:34:01] Core found.
[12:34:01] Working on queue slot 05 [May 2 12:34:01 UTC]
[12:34:01] + Working ...
[12:34:02] 
[12:34:02] *------------------------------*
[12:34:02] Folding@Home GPU Core
[12:34:02] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[12:34:02] Build host             SimbiosNvdWin7
[12:34:02] Board Type             NVIDIA/CUDA
[12:34:02] Core                   15
[12:34:02] 
[12:34:02] Window's signal control handler registered.
[12:34:02] Preparing to commence simulation
[12:34:02] - Looking at optimizations...
[12:34:02] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[12:34:02] - Created dyn
[12:34:02] - Files status OK
[12:34:02] sizeof(CORE_PACKET_HDR) = 512 file=<>
[12:34:02] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[12:34:02] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[12:34:02] - Digital signature verified
[12:34:02] 
[12:34:02] Project: 7644 (Run 313, Clone 0, Gen 13)
[12:34:02] 
[12:34:02] Assembly optimizations on if available.
[12:34:02] Entering M.D.
[12:34:04] Tpr hash work/wudata_05.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[12:34:04] GPU device info: vendor=0 device=0 name=<NA> match=0
[12:34:04] Working on Protein in water
[12:34:04] Client config found, loading data.
[12:34:04] Starting GUI Server
[12:35:37] Setting checkpoint frequency: 25000
[12:35:37] Completed         3 out of 2500000 steps (0%).
[12:45:20] Completed     25000 out of 2500000 steps (1%).
[12:55:07] Completed     50000 out of 2500000 steps (2%).
[13:07:15] Completed     75000 out of 2500000 steps (3%).
[13:07:15] mdrun_gpu returned 52
[13:07:15] NANs detected on GPU
[13:07:15] 
[13:07:15] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:07:18] CoreStatus = 7A (122)
[13:07:18] Sending work to server
[13:07:18] Project: 7644 (Run 313, Clone 0, Gen 13)
[13:07:18] - Read packet limit of 540015616... Set to 524286976.
[13:07:18] - Error: Could not get length of results file work/wuresults_05.dat
[13:07:18] - Error: Could not read unit 05 file. Removing from queue.
[13:07:18] - Preparing to get new work unit...
[13:07:18] Cleaning up work directory
[13:07:18] + Attempting to get work packet
[13:07:18] Passkey found
[13:07:18] Gpu type=3 species=21.
[13:07:18] - Connecting to assignment server
[13:07:19] - Successful: assigned to (171.64.65.93).
[13:07:19] + News From Folding@Home: Welcome to Folding@Home
[13:07:19] Loaded queue successfully.
[13:07:19] Gpu type=3 species=21.
[13:07:23] + Closed connections
[13:07:28] 
[13:07:28] + Processing work unit
[13:07:28] Core required: FahCore_15.exe
[13:07:28] Core found.
[13:07:28] Working on queue slot 06 [May 2 13:07:28 UTC]
[13:07:28] + Working ...
[13:07:28] 
[13:07:28] *------------------------------*
[13:07:28] Folding@Home GPU Core
[13:07:28] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[13:07:28] Build host             SimbiosNvdWin7
[13:07:28] Board Type             NVIDIA/CUDA
[13:07:28] Core                   15
[13:07:28] 
[13:07:28] Window's signal control handler registered.
[13:07:28] Preparing to commence simulation
[13:07:28] - Looking at optimizations...
[13:07:28] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[13:07:28] - Created dyn
[13:07:28] - Files status OK
[13:07:28] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:07:28] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[13:07:28] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[13:07:28] - Digital signature verified
[13:07:28] 
[13:07:28] Project: 7644 (Run 313, Clone 0, Gen 13)
[13:07:28] 
[13:07:28] Assembly optimizations on if available.
[13:07:28] Entering M.D.
[13:07:30] Tpr hash work/wudata_06.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[13:07:30] GPU device info: vendor=0 device=0 name=<NA> match=0
[13:07:30] Working on Protein in water
[13:07:30] Client config found, loading data.
[13:07:30] Starting GUI Server
[13:09:02] Setting checkpoint frequency: 25000
[13:09:02] Completed         3 out of 2500000 steps (0%).
[13:18:48] Completed     25000 out of 2500000 steps (1%).
[13:23:49] + Working...
[13:49:41] Completed     50000 out of 2500000 steps (2%).
[13:49:41] mdrun_gpu returned 52
[13:49:41] NANs detected on GPU
[13:49:41] 
[13:49:41] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:49:44] CoreStatus = 7A (122)
[13:49:44] Sending work to server
[13:49:44] Project: 7644 (Run 313, Clone 0, Gen 13)
[13:49:44] - Read packet limit of 540015616... Set to 524286976.
[13:49:44] - Error: Could not get length of results file work/wuresults_06.dat
[13:49:44] - Error: Could not read unit 06 file. Removing from queue.
[13:49:44] EUE limit exceeded. Pausing 24 hours.

Folding@Home Client Shutdown.


--- Opening Log file [May 2 16:49:40 UTC] 


# Windows GPU Systray Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.41r2

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\williams\AppData\Roaming\Folding@home-gpu2
Arguments: -gpu 1 

[16:49:40] - Ask before connecting: No
[16:49:40] - User name: DocJonz (Team 35947)
[16:49:40] - User ID: 64FC09F4051CE893
[16:49:40] - Machine ID: 6
[16:49:40] 
[16:49:40] Gpu type=3 species=21.
[16:49:40] Work directory not found. Creating...
[16:49:40] Could not open work queue, generating new queue...
[16:49:41] Initialization complete
[16:49:41] - Preparing to get new work unit...
[16:49:41] Cleaning up work directory
[16:49:41] + Attempting to get work packet
[16:49:41] Passkey found
[16:49:41] Gpu type=3 species=21.
[16:49:41] - Connecting to assignment server
[16:49:42] - Successful: assigned to (171.67.108.141).
[16:49:42] + News From Folding@Home: Welcome to Folding@Home
[16:49:42] Loaded queue successfully.
[16:49:42] Gpu type=3 species=21.
[16:49:44] + Closed connections
[16:49:44] 
[16:49:44] + Processing work unit
[16:49:44] Core required: FahCore_15.exe
[16:49:44] Core not found.
[16:49:44] - Core is not present or corrupted.
[16:49:44] - Attempting to download new core...
[16:49:44] + Downloading new core: FahCore_15.exe
[16:49:45] + 10240 bytes downloaded
................................................
[16:49:56] + 1559166 bytes downloaded
[16:49:56] Verifying core Core_15.fah...
[16:49:56] Signature is VALID
[16:49:56] 
[16:49:56] Trying to unzip core FahCore_15.exe
[16:49:57] Decompressed FahCore_15.exe (4685824 bytes) successfully
[16:50:02] + Core successfully engaged
[16:50:07] 
[16:50:07] + Processing work unit
[16:50:07] Core required: FahCore_15.exe
[16:50:07] Core found.
[16:50:07] Working on queue slot 01 [May 2 16:50:07 UTC]
[16:50:07] + Working ...
[16:50:20] 
[16:50:20] *------------------------------*
[16:50:20] Folding@Home GPU Core
[16:50:20] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[16:50:20] Build host             SimbiosNvdWin7
[16:50:20] Board Type             NVIDIA/CUDA
[16:50:20] Core                   15
[16:50:20] 
[16:50:20] Window's signal control handler registered.
[16:50:20] Preparing to commence simulation
[16:50:21] - Looking at optimizations...
[16:50:21] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[16:50:21] - Created dyn
[16:50:21] - Files status OK
[16:50:21] sizeof(CORE_PACKET_HDR) = 512 file=<>
[16:50:21] - Expanded 66231 -> 287126 (decompressed 433.5 percent)
[16:50:21] Called DecompressByteArray: compressed_data_size=66231 data_size=287126, decompressed_data_size=287126 diff=0
[16:50:21] - Digital signature verified
[16:50:21] 
[16:50:21] Project: 8008 (Run 4, Clone 7, Gen 37)
[16:50:21] 
[16:50:21] Assembly optimizations on if available.
[16:50:21] Entering M.D.
[16:50:23] Tpr hash work/wudata_01.tpr:  2113150740 277953493 1451620970 2247053143 2583287459
[16:50:23] GPU device info: vendor=0 device=0 name=<NA> match=0
[16:50:23] Working on Gromacs Runs On Most of All Computer Systems
[16:50:23] Client config found, loading data.
[16:50:23] Starting GUI Server
[16:51:24] Setting checkpoint frequency: 500000
[16:51:24] Completed         3 out of 50000000 steps (0%).
[16:53:44] Completed    500000 out of 50000000 steps (1%).
[16:56:04] Completed   1000000 out of 50000000 steps (2%).
[16:58:25] Completed   1500000 out of 50000000 steps (3%).
[17:00:45] Completed   2000000 out of 50000000 steps (4%).
[17:03:05] Completed   2500000 out of 50000000 steps (5%).
..........................................
[20:33:31] Completed  47500000 out of 50000000 steps (95%).
[20:35:51] Completed  48000000 out of 50000000 steps (96%).
[20:38:12] Completed  48500000 out of 50000000 steps (97%).
[20:40:32] Completed  49000000 out of 50000000 steps (98%).
[20:42:52] Completed  49500000 out of 50000000 steps (99%).
[20:45:12] Completed  50000000 out of 50000000 steps (100%).
[20:45:13] Finished fah_main status=0
[20:45:13] Successful run
[20:45:13] DynamicWrapper: Finished Work Unit: sleep=10000
[20:45:23] Reserved 357408 bytes for xtc file; Cosm status=0
[20:45:23] Allocated 357408 bytes for xtc file
[20:45:23] - Reading up to 357408 from "work/wudata_01.xtc": Read 357408
[20:45:23] Read 357408 bytes from xtc file; available packet space=786073056
[20:45:23] xtc file hash check passed.
[20:45:23] Reserved 22344 22344 786073056 bytes for arc file=<work/wudata_01.trr> Cosm status=0
[20:45:23] Allocated 22344 bytes for arc file
[20:45:23] - Reading up to 22344 from "work/wudata_01.trr": Read 22344
[20:45:23] Read 22344 bytes from arc file; available packet space=786050712
[20:45:23] trr file hash check passed.
[20:45:23] Allocated 544 bytes for edr file
[20:45:23] Read bedfile
[20:45:23] edr file hash check passed.
[20:45:23] Allocated 36868 bytes for logfile
[20:45:23] Read logfile
[20:45:23] GuardedRun: success in DynamicWrapper
[20:45:23] GuardedRun: done
[20:45:23] Run: GuardedRun completed.
[20:45:26] + Opened results file
[20:45:26] - Writing 417676 bytes of core data to disk...
[20:45:26] Done: 417164 -> 386233 (compressed to 92.5 percent)
[20:45:26]   ... Done.
[20:45:26] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[20:45:26] Shutting down core 
[20:45:26] 
[20:45:26] Folding@home Core Shutdown: FINISHED_UNIT
[20:45:29] CoreStatus = 64 (100)
[20:45:29] Sending work to server
[20:45:29] Project: 8008 (Run 4, Clone 7, Gen 37)
[20:45:29] - Read packet limit of 540015616... Set to 524286976.


[20:45:29] + Attempting to send results [May 2 20:45:29 UTC]
[20:45:29] Gpu type=3 species=21.
[20:45:35] + Results successfully sent
[20:45:35] Thank you for your contribution to Folding@Home.
[20:45:35] + Number of Units Completed: 795

[20:45:43] - Preparing to get new work unit...
[20:45:43] Cleaning up work directory
[20:45:43] + Attempting to get work packet
[20:45:43] Passkey found
[20:45:43] Gpu type=3 species=21.
[20:45:43] - Connecting to assignment server
[20:45:44] - Successful: assigned to (171.64.65.93).
[20:45:44] + News From Folding@Home: Welcome to Folding@Home
[20:45:44] Loaded queue successfully.
[20:45:44] Gpu type=3 species=21.
[20:45:48] + Closed connections
[20:45:48] 
[20:45:48] + Processing work unit
[20:45:48] Core required: FahCore_15.exe
[20:45:48] Core found.
[20:45:48] Working on queue slot 02 [May 2 20:45:48 UTC]
[20:45:48] + Working ...
[20:45:52] 
[20:45:52] *------------------------------*
[20:45:52] Folding@Home GPU Core
[20:45:52] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[20:45:52] Build host             SimbiosNvdWin7
[20:45:52] Board Type             NVIDIA/CUDA
[20:45:52] Core                   15
[20:45:52] 
[20:45:52] Window's signal control handler registered.
[20:45:52] Preparing to commence simulation
[20:45:52] - Looking at optimizations...
[20:45:52] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[20:45:52] - Created dyn
[20:45:52] - Files status OK
[20:45:52] sizeof(CORE_PACKET_HDR) = 512 file=<>
[20:45:52] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[20:45:52] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[20:45:52] - Digital signature verified
[20:45:52] 
[20:45:52] Project: 7644 (Run 313, Clone 0, Gen 13)
[20:45:52] 
[20:45:52] Assembly optimizations on if available.
[20:45:52] Entering M.D.
[20:45:55] Tpr hash work/wudata_02.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[20:45:55] GPU device info: vendor=0 device=0 name=<NA> match=0
[20:45:55] Working on Protein in water
[20:45:55] Client config found, loading data.
[20:45:55] Starting GUI Server
[20:47:29] Setting checkpoint frequency: 25000
[20:47:29] Completed         3 out of 2500000 steps (0%).
[20:57:50] Completed     25000 out of 2500000 steps (1%).
[21:08:08] Completed     50000 out of 2500000 steps (2%).
[21:18:36] Completed     75000 out of 2500000 steps (3%).
[21:55:26] Completed    100000 out of 2500000 steps (4%).
[21:55:26] mdrun_gpu returned 52
[21:55:26] NANs detected on GPU
[21:55:26] 
[21:55:26] Folding@home Core Shutdown: UNSTABLE_MACHINE
[21:55:28] CoreStatus = 7A (122)
[21:55:28] Sending work to server
[21:55:28] Project: 7644 (Run 313, Clone 0, Gen 13)
[21:55:28] - Read packet limit of 540015616... Set to 524286976.
[21:55:28] - Error: Could not get length of results file work/wuresults_02.dat
[21:55:28] - Error: Could not read unit 02 file. Removing from queue.
[21:55:28] - Preparing to get new work unit...
[21:55:28] Cleaning up work directory
[21:55:28] + Attempting to get work packet
[21:55:28] Passkey found
[21:55:28] Gpu type=3 species=21.
[21:55:28] - Connecting to assignment server
[21:55:29] - Successful: assigned to (171.64.65.93).
[21:55:29] + News From Folding@Home: Welcome to Folding@Home
[21:55:29] Loaded queue successfully.
[21:55:29] Gpu type=3 species=21.
[21:55:33] + Closed connections
[21:55:38] 
[21:55:38] + Processing work unit
[21:55:38] Core required: FahCore_15.exe
[21:55:38] Core found.
[21:55:38] Working on queue slot 03 [May 2 21:55:38 UTC]
[21:55:38] + Working ...
[21:55:38] 
[21:55:38] *------------------------------*
[21:55:38] Folding@Home GPU Core
[21:55:38] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[21:55:38] Build host             SimbiosNvdWin7
[21:55:38] Board Type             NVIDIA/CUDA
[21:55:38] Core                   15
[21:55:38] 
[21:55:38] Window's signal control handler registered.
[21:55:38] Preparing to commence simulation
[21:55:38] - Looking at optimizations...
[21:55:38] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[21:55:38] - Created dyn
[21:55:38] - Files status OK
[21:55:38] sizeof(CORE_PACKET_HDR) = 512 file=<>
[21:55:38] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[21:55:38] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[21:55:38] - Digital signature verified
[21:55:38] 
[21:55:38] Project: 7644 (Run 313, Clone 0, Gen 13)
[21:55:38] 
[21:55:38] Assembly optimizations on if available.
[21:55:38] Entering M.D.
[21:55:40] Tpr hash work/wudata_03.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[21:55:40] GPU device info: vendor=0 device=0 name=<NA> match=0
[21:55:40] Working on Protein in water
[21:55:40] Client config found, loading data.
[21:55:40] Starting GUI Server
[21:57:14] Setting checkpoint frequency: 25000
[21:57:14] Completed         3 out of 2500000 steps (0%).
[22:07:24] Completed     25000 out of 2500000 steps (1%).
[22:27:04] Completed     50000 out of 2500000 steps (2%).
[22:27:04] mdrun_gpu returned 52
[22:27:04] NANs detected on GPU
[22:27:04] 
[22:27:04] Folding@home Core Shutdown: UNSTABLE_MACHINE
[22:27:08] CoreStatus = 7A (122)
[22:27:08] Sending work to server
[22:27:08] Project: 7644 (Run 313, Clone 0, Gen 13)
[22:27:08] - Read packet limit of 540015616... Set to 524286976.
[22:27:08] - Error: Could not get length of results file work/wuresults_03.dat
[22:27:08] - Error: Could not read unit 03 file. Removing from queue.
[22:27:08] - Preparing to get new work unit...
[22:27:08] Cleaning up work directory
[22:27:08] + Attempting to get work packet
[22:27:08] Passkey found
[22:27:08] Gpu type=3 species=21.
[22:27:08] - Connecting to assignment server
[22:27:09] - Successful: assigned to (171.64.65.93).
[22:27:09] + News From Folding@Home: Welcome to Folding@Home
[22:27:09] Loaded queue successfully.
[22:27:09] Gpu type=3 species=21.
[22:27:12] + Closed connections
[22:27:17] 
[22:27:17] + Processing work unit
[22:27:17] Core required: FahCore_15.exe
[22:27:17] Core found.
[22:27:17] Working on queue slot 04 [May 2 22:27:17 UTC]
[22:27:17] + Working ...
[22:27:17] 
[22:27:17] *------------------------------*
[22:27:17] Folding@Home GPU Core
[22:27:17] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[22:27:17] Build host             SimbiosNvdWin7
[22:27:17] Board Type             NVIDIA/CUDA
[22:27:17] Core                   15
[22:27:17] 
[22:27:17] Window's signal control handler registered.
[22:27:17] Preparing to commence simulation
[22:27:17] - Looking at optimizations...
[22:27:17] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[22:27:17] - Created dyn
[22:27:17] - Files status OK
[22:27:17] sizeof(CORE_PACKET_HDR) = 512 file=<>
[22:27:17] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[22:27:17] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[22:27:17] - Digital signature verified
[22:27:17] 
[22:27:17] Project: 7644 (Run 313, Clone 0, Gen 13)
[22:27:17] 
[22:27:17] Assembly optimizations on if available.
[22:27:17] Entering M.D.
[22:27:19] Tpr hash work/wudata_04.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[22:27:19] GPU device info: vendor=0 device=0 name=<NA> match=0
[22:27:20] Working on Protein in water
[22:27:20] Client config found, loading data.
[22:27:20] Starting GUI Server
[22:28:53] Setting checkpoint frequency: 25000
[22:28:53] Completed         3 out of 2500000 steps (0%).
[22:46:17] Completed     25000 out of 2500000 steps (1%).
[22:46:17] mdrun_gpu returned 52
[22:46:17] NANs detected on GPU
[22:46:17] 
[22:46:17] Folding@home Core Shutdown: UNSTABLE_MACHINE
[22:46:20] CoreStatus = 7A (122)
[22:46:20] Sending work to server
[22:46:20] Project: 7644 (Run 313, Clone 0, Gen 13)
[22:46:20] - Read packet limit of 540015616... Set to 524286976.
[22:46:20] - Error: Could not get length of results file work/wuresults_04.dat
[22:46:20] - Error: Could not read unit 04 file. Removing from queue.
[22:46:20] - Preparing to get new work unit...
[22:46:20] Cleaning up work directory
[22:46:20] + Attempting to get work packet
[22:46:20] Passkey found
[22:46:20] Gpu type=3 species=21.
[22:46:20] - Connecting to assignment server
[22:46:21] - Successful: assigned to (171.64.65.93).
[22:46:21] + News From Folding@Home: Welcome to Folding@Home
[22:46:21] Loaded queue successfully.
[22:46:21] Gpu type=3 species=21.
[22:46:24] + Closed connections
[22:46:29] 
[22:46:29] + Processing work unit
[22:46:29] Core required: FahCore_15.exe
[22:46:29] Core found.
[22:46:29] Working on queue slot 05 [May 2 22:46:29 UTC]
[22:46:29] + Working ...
[22:46:30] 
[22:46:30] *------------------------------*
[22:46:30] Folding@Home GPU Core
[22:46:30] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[22:46:30] Build host             SimbiosNvdWin7
[22:46:30] Board Type             NVIDIA/CUDA
[22:46:30] Core                   15
[22:46:30] 
[22:46:30] Window's signal control handler registered.
[22:46:30] Preparing to commence simulation
[22:46:30] - Looking at optimizations...
[22:46:30] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[22:46:30] - Created dyn
[22:46:30] - Files status OK
[22:46:30] sizeof(CORE_PACKET_HDR) = 512 file=<>
[22:46:30] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[22:46:30] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[22:46:30] - Digital signature verified
[22:46:30] 
[22:46:30] Project: 7644 (Run 313, Clone 0, Gen 13)
[22:46:30] 
[22:46:30] Assembly optimizations on if available.
[22:46:30] Entering M.D.
[22:46:32] Tpr hash work/wudata_05.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[22:46:32] GPU device info: vendor=0 device=0 name=<NA> match=0
[22:46:32] Working on Protein in water
[22:46:32] Client config found, loading data.
[22:46:32] Starting GUI Server
[22:48:06] Setting checkpoint frequency: 25000
[22:48:06] Completed         3 out of 2500000 steps (0%).
[22:49:41] + Working...
[22:58:31] Completed     25000 out of 2500000 steps (1%).
[23:09:03] Completed     50000 out of 2500000 steps (2%).
[23:40:30] Completed     75000 out of 2500000 steps (3%).
[23:40:31] mdrun_gpu returned 52
[23:40:31] NANs detected on GPU
[23:40:31] 
[23:40:31] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:40:34] CoreStatus = 7A (122)
[23:40:34] Sending work to server
[23:40:34] Project: 7644 (Run 313, Clone 0, Gen 13)
[23:40:34] - Read packet limit of 540015616... Set to 524286976.
[23:40:34] - Error: Could not get length of results file work/wuresults_05.dat
[23:40:34] - Error: Could not read unit 05 file. Removing from queue.
[23:40:34] - Preparing to get new work unit...
[23:40:34] Cleaning up work directory
[23:40:34] + Attempting to get work packet
[23:40:34] Passkey found
[23:40:34] Gpu type=3 species=21.
[23:40:34] - Connecting to assignment server
[23:40:35] - Successful: assigned to (171.64.65.93).
[23:40:35] + News From Folding@Home: Welcome to Folding@Home
[23:40:35] Loaded queue successfully.
[23:40:35] Gpu type=3 species=21.
[23:40:38] + Closed connections
[23:40:43] 
[23:40:43] + Processing work unit
[23:40:43] Core required: FahCore_15.exe
[23:40:43] Core found.
[23:40:43] Working on queue slot 06 [May 2 23:40:43 UTC]
[23:40:43] + Working ...
[23:40:43] 
[23:40:43] *------------------------------*
[23:40:43] Folding@Home GPU Core
[23:40:43] Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
[23:40:43] Build host             SimbiosNvdWin7
[23:40:43] Board Type             NVIDIA/CUDA
[23:40:43] Core                   15
[23:40:43] 
[23:40:43] Window's signal control handler registered.
[23:40:43] Preparing to commence simulation
[23:40:43] - Looking at optimizations...
[23:40:43] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[23:40:43] - Created dyn
[23:40:43] - Files status OK
[23:40:43] sizeof(CORE_PACKET_HDR) = 512 file=<>
[23:40:43] - Expanded 551247 -> 985104 (decompressed 178.7 percent)
[23:40:43] Called DecompressByteArray: compressed_data_size=551247 data_size=985104, decompressed_data_size=985104 diff=0
[23:40:43] - Digital signature verified
[23:40:43] 
[23:40:43] Project: 7644 (Run 313, Clone 0, Gen 13)
[23:40:43] 
[23:40:44] Assembly optimizations on if available.
[23:40:44] Entering M.D.
[23:40:46] Tpr hash work/wudata_06.tpr:  3679987123 2050792548 3094056820 1261786474 4233343982
[23:40:46] GPU device info: vendor=0 device=0 name=<NA> match=0
[23:40:46] Working on Protein in water
[23:40:46] Client config found, loading data.
[23:40:46] Starting GUI Server
[23:42:18] Setting checkpoint frequency: 25000
[23:42:18] Completed         3 out of 2500000 steps (0%).
[00:09:17] Completed     25000 out of 2500000 steps (1%).
[00:09:17] mdrun_gpu returned 52
[00:09:17] NANs detected on GPU
[00:09:17] 
[00:09:17] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:09:19] CoreStatus = 7A (122)
[00:09:19] Sending work to server
[00:09:19] Project: 7644 (Run 313, Clone 0, Gen 13)
[00:09:19] - Read packet limit of 540015616... Set to 524286976.
[00:09:19] - Error: Could not get length of results file work/wuresults_06.dat
[00:09:19] - Error: Could not read unit 06 file. Removing from queue.
[00:09:19] EUE limit exceeded. Pausing 24 hours.
[04:49:41] + Working...
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Post Reply