[Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Moderators: slegrand, Site Moderators, PandeGroup

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby spyrus » Sun Sep 27, 2009 2:30 pm

* Failing projects (please add a list of exact project numbers if you have them)
o Project: 5791 (Run 14, Clone 434, Gen 7), 5768 (Run 6, Clone 118, Gen 1117)
* Failing hardware
o Sparkle GTS250 1GB
* Failing OS
o Windows 7 x64
* Failing drivers
o 19x.xx
spyrus
 
Posts: 8
Joined: Sun Sep 27, 2009 2:26 pm

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby Chris_Cherry » Mon Oct 05, 2009 2:41 am

Hey everyone, I'm new to the forums although I have folded on and off for quite some time.Recently I have come back to folding after a hiatus and I have been getting NaNs / EUE with some projects. From a competitive / technical interest it's kind of disconcerting to wake up and find out my pc was powered on for 7 hours with an EUE screen. I would like to continue to help the cause and I hope any issues will be resolved

Also I have noticed many other post with similar work units:


# Failing projects (please add a list of exact project numbers if you have them)

5768 (R3, C39, G264)
5768(R0, C196, G224)
5766 (r11, c190, g873)
5766 (other specifics)
5765
5768 (R14, c61 Gen 335)

and most likely many variations of these projects, I only started counting NANs projects this morning

# Failing hardware (please add the exact GPU designation if you know it. ie 9800GTX+)

Folding on dual card rig:
evga 9800 GTX (non plus)
xfx 9800 GTX (non plus)


# Failing OS

* Windows Vista Ultimate 64 bits


# Failing drivers (enter here the version number of the driver you use)
nvidia forceware 190.62

# Comments (add below any detail you might find useful to the report)

sli disabled
-nvidia forcegpu flag enabled/disabled does not help, still EUEs

Also still crashes on sub clocking both cards, below standard clocks
memtest gave clean reports
Image
Chris_Cherry
 
Posts: 1
Joined: Thu Oct 01, 2009 8:51 pm

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby Prettz » Sat Oct 17, 2009 7:06 pm

Failing projects
I haven't been keeping track, but all of them use Core 11. I don't recall ever seeing any mention of "Core 11" before WUs started failing; all I ever saw before then was Core 14. Is Core 11 relatively new?

Failing hardware
Geforce 8800 GTS 512MB (G92 core, A2 revision, 128 shaders, never been overclocked)
It's running in PCIe 2.0 mode, in case that matters.

Failing OS
Vista Home Premium 64-bit

Failing drivers
190.38
I've had this same driver since well before any EUEs started appearing. That's probably important to note.

Comments
It's definitely not an overclocking or temperature problem. My card is running cooler than ever, as is the motherboard Northbridge.

Here's my most recent log file. There's not much because I regularly close the client when playing games. As you can see, it's hit-and-miss with getting WUs that don't immediately fail.
Note that I've never seen any GPU WUs fail mid-way on my machine. The only ones that fail do so instantly.

Code: Select all
...
[23:37:18] - Ask before connecting: No
[23:37:18] - User name: Prettz (Team 150)
[23:37:18] - User ID:
[23:37:18] - Machine ID: 2
[23:37:18]
[23:37:18] Loaded queue successfully.
[23:37:18] Initialization complete
[23:37:18] - Preparing to get new work unit...
[23:37:18] + Attempting to get work packet
[23:37:18] - Connecting to assignment server
[23:37:18] - Successful: assigned to (171.67.108.11).
[23:37:18] + News From Folding@Home: Welcome to Folding@Home
[23:37:18] Loaded queue successfully.
[23:37:19] + Closed connections
[23:37:19]
[23:37:19] + Processing work unit
[23:37:19] Core required: FahCore_11.exe
[23:37:19] Core found.
[23:37:19] Working on queue slot 01 [October 15 23:37:19 UTC]
[23:37:19] + Working ...
[23:37:19]
[23:37:19] *------------------------------*
[23:37:19] Folding@Home GPU Core - Beta
[23:37:19] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[23:37:19]
[23:37:19] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[23:37:19] Build host: amoeba
[23:37:19] Board Type: Nvidia
[23:37:19] Core      :
[23:37:19] Preparing to commence simulation
[23:37:19] - Looking at optimizations...
[23:37:20] - Created dyn
[23:37:20] - Files status OK
[23:37:20] - Expanded 46721 -> 252912 (decompressed 541.3 percent)
[23:37:20] Called DecompressByteArray: compressed_data_size=46721 data_size=252912, decompressed_data_size=252912 diff=0
[23:37:20] - Digital signature verified
[23:37:20]
[23:37:20] Project: 5766 (Run 5, Clone 393, Gen 396)
[23:37:20]
[23:37:20] Assembly optimizations on if available.
[23:37:20] Entering M.D.
[23:37:26] Working on Protein
[23:37:27] Client config found, loading data.
[23:37:27] Starting GUI Server
[23:37:27] mdrun_gpu returned
[23:37:27] NANs detected on GPU
[23:37:27]
[23:37:27] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:37:29] CoreStatus = 7A (122)
[23:37:29] Sending work to server
[23:37:29] Project: 5766 (Run 5, Clone 393, Gen 396)
[23:37:29] - Read packet limit of 540015616... Set to 524286976.
[23:37:29] - Error: Could not get length of results file work/wuresults_01.dat
[23:37:29] - Error: Could not read unit 01 file. Removing from queue.
[23:37:29] - Preparing to get new work unit...
[23:37:29] + Attempting to get work packet
[23:37:29] - Connecting to assignment server
[23:37:30] - Successful: assigned to (171.67.108.11).
[23:37:30] + News From Folding@Home: Welcome to Folding@Home
[23:37:30] Loaded queue successfully.
[23:37:31] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[23:37:46] + Attempting to get work packet
[23:37:46] - Connecting to assignment server
[23:37:48] - Successful: assigned to (171.67.108.11).
[23:37:48] + News From Folding@Home: Welcome to Folding@Home
[23:37:48] Loaded queue successfully.
[23:37:50] + Closed connections
[23:37:55]
[23:37:55] + Processing work unit
[23:37:55] Core required: FahCore_11.exe
[23:37:55] Core found.
[23:37:55] Working on queue slot 02 [October 15 23:37:55 UTC]
[23:37:55] + Working ...
[23:37:55]
[23:37:55] *------------------------------*
[23:37:55] Folding@Home GPU Core - Beta
[23:37:55] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[23:37:55]
[23:37:55] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[23:37:55] Build host: amoeba
[23:37:55] Board Type: Nvidia
[23:37:55] Core      :
[23:37:55] Preparing to commence simulation
[23:37:55] - Looking at optimizations...
[23:37:55] - Created dyn
[23:37:55] - Files status OK
[23:37:55] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[23:37:55] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[23:37:55] - Digital signature verified
[23:37:55]
[23:37:55] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:37:55]
[23:37:55] Assembly optimizations on if available.
[23:37:55] Entering M.D.
[23:38:01] Working on Protein
[23:38:02] Client config found, loading data.
[23:38:02] mdrun_gpu returned
[23:38:02] NANs detected on GPU
[23:38:02]
[23:38:02] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:38:05] CoreStatus = 7A (122)
[23:38:05] Sending work to server
[23:38:05] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:38:05] - Read packet limit of 540015616... Set to 524286976.
[23:38:05] - Error: Could not get length of results file work/wuresults_02.dat
[23:38:05] - Error: Could not read unit 02 file. Removing from queue.
[23:38:05] - Preparing to get new work unit...
[23:38:05] + Attempting to get work packet
[23:38:05] - Connecting to assignment server
[23:38:06] - Successful: assigned to (171.67.108.11).
[23:38:06] + News From Folding@Home: Welcome to Folding@Home
[23:38:06] Loaded queue successfully.
[23:38:07] + Closed connections
[23:38:12]
[23:38:12] + Processing work unit
[23:38:12] Core required: FahCore_11.exe
[23:38:12] Core found.
[23:38:12] Working on queue slot 03 [October 15 23:38:12 UTC]
[23:38:12] + Working ...
[23:38:12]
[23:38:12] *------------------------------*
[23:38:12] Folding@Home GPU Core - Beta
[23:38:12] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[23:38:12]
[23:38:12] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[23:38:12] Build host: amoeba
[23:38:12] Board Type: Nvidia
[23:38:12] Core      :
[23:38:12] Preparing to commence simulation
[23:38:12] - Looking at optimizations...
[23:38:13] - Created dyn
[23:38:13] - Files status OK
[23:38:13] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[23:38:13] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[23:38:13] - Digital signature verified
[23:38:13]
[23:38:13] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:38:13]
[23:38:13] Assembly optimizations on if available.
[23:38:13] Entering M.D.
[23:38:19] Working on Protein
[23:38:20] Client config found, loading data.
[23:38:20] mdrun_gpu returned
[23:38:20] NANs detected on GPU
[23:38:20]
[23:38:20] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:38:22] CoreStatus = 7A (122)
[23:38:22] Sending work to server
[23:38:22] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:38:22] - Read packet limit of 540015616... Set to 524286976.
[23:38:22] - Error: Could not get length of results file work/wuresults_03.dat
[23:38:22] - Error: Could not read unit 03 file. Removing from queue.
[23:38:22] - Preparing to get new work unit...
[23:38:22] + Attempting to get work packet
[23:38:22] - Connecting to assignment server
[23:38:23] - Successful: assigned to (171.67.108.11).
[23:38:23] + News From Folding@Home: Welcome to Folding@Home
[23:38:24] Loaded queue successfully.
[23:38:29] + Closed connections
[23:38:34]
[23:38:34] + Processing work unit
[23:38:34] Core required: FahCore_11.exe
[23:38:34] Core found.
[23:38:34] Working on queue slot 04 [October 15 23:38:34 UTC]
[23:38:34] + Working ...
[23:38:34]
[23:38:34] *------------------------------*
[23:38:34] Folding@Home GPU Core - Beta
[23:38:34] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[23:38:34]
[23:38:34] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[23:38:34] Build host: amoeba
[23:38:34] Board Type: Nvidia
[23:38:34] Core      :
[23:38:34] Preparing to commence simulation
[23:38:34] - Looking at optimizations...
[23:38:35] - Created dyn
[23:38:35] - Files status OK
[23:38:35] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[23:38:35] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[23:38:35] - Digital signature verified
[23:38:35]
[23:38:35] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:38:35]
[23:38:35] Assembly optimizations on if available.
[23:38:35] Entering M.D.
[23:38:41] Working on Protein
[23:38:41] Client config found, loading data.
[23:38:42] mdrun_gpu returned
[23:38:42] NANs detected on GPU
[23:38:42]
[23:38:42] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:38:44] CoreStatus = 7A (122)
[23:38:44] Sending work to server
[23:38:44] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:38:44] - Read packet limit of 540015616... Set to 524286976.
[23:38:44] - Error: Could not get length of results file work/wuresults_04.dat
[23:38:44] - Error: Could not read unit 04 file. Removing from queue.
[23:38:44] - Preparing to get new work unit...
[23:38:44] + Attempting to get work packet
[23:38:44] - Connecting to assignment server
[23:38:47] - Successful: assigned to (171.67.108.11).
[23:38:47] + News From Folding@Home: Welcome to Folding@Home
[23:38:47] Loaded queue successfully.
[23:38:54] + Closed connections
[23:38:59]
[23:38:59] + Processing work unit
[23:38:59] Core required: FahCore_11.exe
[23:38:59] Core found.
[23:38:59] Working on queue slot 05 [October 15 23:38:59 UTC]
[23:38:59] + Working ...
[23:39:00]
[23:39:00] *------------------------------*
[23:39:00] Folding@Home GPU Core - Beta
[23:39:00] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[23:39:00]
[23:39:00] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[23:39:00] Build host: amoeba
[23:39:00] Board Type: Nvidia
[23:39:00] Core      :
[23:39:00] Preparing to commence simulation
[23:39:00] - Looking at optimizations...
[23:39:00] - Created dyn
[23:39:00] - Files status OK
[23:39:00] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[23:39:00] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[23:39:00] - Digital signature verified
[23:39:00]
[23:39:00] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:39:00]
[23:39:00] Assembly optimizations on if available.
[23:39:00] Entering M.D.
[23:39:06] Working on Protein
[23:39:07] Client config found, loading data.
[23:39:07] mdrun_gpu returned
[23:39:07] NANs detected on GPU
[23:39:07]
[23:39:07] Folding@home Core Shutdown: UNSTABLE_MACHINE
[23:39:10] CoreStatus = 7A (122)
[23:39:10] Sending work to server
[23:39:10] Project: 5766 (Run 11, Clone 52, Gen 1119)
[23:39:10] - Read packet limit of 540015616... Set to 524286976.
[23:39:10] - Error: Could not get length of results file work/wuresults_05.dat
[23:39:10] - Error: Could not read unit 05 file. Removing from queue.
[23:39:10] EUE limit exceeded. Pausing 24 hours.

Folding@Home Client Shutdown.


--- Opening Log file [October 16 01:07:50 UTC]

...

[01:07:50] - Ask before connecting: No
[01:07:50] - User name: Prettz (Team 150)
[01:07:50] - User ID:
[01:07:50] - Machine ID: 2
[01:07:50]
[01:07:50] Loaded queue successfully.
[01:07:50] Initialization complete
[01:07:50] - Preparing to get new work unit...
[01:07:50] + Attempting to get work packet
[01:07:50] - Connecting to assignment server
[01:07:51] - Successful: assigned to (171.67.108.11).
[01:07:51] + News From Folding@Home: Welcome to Folding@Home
[01:07:51] Loaded queue successfully.
[01:07:52] + Closed connections
[01:07:52]
[01:07:52] + Processing work unit
[01:07:52] Core required: FahCore_11.exe
[01:07:52] Core found.
[01:07:52] Working on queue slot 06 [October 16 01:07:52 UTC]
[01:07:52] + Working ...
[01:07:52]
[01:07:52] *------------------------------*
[01:07:52] Folding@Home GPU Core - Beta
[01:07:52] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[01:07:52]
[01:07:52] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[01:07:52] Build host: amoeba
[01:07:52] Board Type: Nvidia
[01:07:52] Core      :
[01:07:52] Preparing to commence simulation
[01:07:52] - Looking at optimizations...
[01:07:53] - Created dyn
[01:07:53] - Files status OK
[01:07:53] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[01:07:53] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[01:07:53] - Digital signature verified
[01:07:53]
[01:07:53] Project: 5766 (Run 11, Clone 52, Gen 1119)
[01:07:53]
[01:07:53] Assembly optimizations on if available.
[01:07:53] Entering M.D.
[01:07:59] Working on Protein
[01:07:59] Client config found, loading data.
[01:07:59] mdrun_gpu returned
[01:07:59] NANs detected on GPU
[01:07:59]
[01:07:59] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:08:02] CoreStatus = 7A (122)
[01:08:02] Sending work to server
[01:08:02] Project: 5766 (Run 11, Clone 52, Gen 1119)
[01:08:02] - Read packet limit of 540015616... Set to 524286976.
[01:08:02] - Error: Could not get length of results file work/wuresults_06.dat
[01:08:02] - Error: Could not read unit 06 file. Removing from queue.
[01:08:02] - Preparing to get new work unit...
[01:08:02] + Attempting to get work packet
[01:08:02] - Connecting to assignment server
[01:08:03] - Successful: assigned to (171.67.108.11).
[01:08:03] + News From Folding@Home: Welcome to Folding@Home
[01:08:03] Loaded queue successfully.
[01:08:04] + Closed connections
[01:08:09]
[01:08:09] + Processing work unit
[01:08:09] Core required: FahCore_11.exe
[01:08:09] Core found.
[01:08:09] Working on queue slot 07 [October 16 01:08:09 UTC]
[01:08:09] + Working ...
[01:08:09]
[01:08:09] *------------------------------*
[01:08:09] Folding@Home GPU Core - Beta
[01:08:09] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[01:08:09]
[01:08:09] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[01:08:09] Build host: amoeba
[01:08:09] Board Type: Nvidia
[01:08:09] Core      :
[01:08:09] Preparing to commence simulation
[01:08:09] - Looking at optimizations...
[01:08:09] - Created dyn
[01:08:09] - Files status OK
[01:08:09] - Expanded 46791 -> 252912 (decompressed 540.5 percent)
[01:08:09] Called DecompressByteArray: compressed_data_size=46791 data_size=252912, decompressed_data_size=252912 diff=0
[01:08:09] - Digital signature verified
[01:08:09]
[01:08:09] Project: 5766 (Run 11, Clone 52, Gen 1119)
[01:08:09]
[01:08:09] Assembly optimizations on if available.
[01:08:09] Entering M.D.
[01:08:16] Working on Protein
[01:08:16] Client config found, loading data.
[01:08:16] Starting GUI Server
[01:08:16] mdrun_gpu returned
[01:08:16] NANs detected on GPU
[01:08:16]
[01:08:16] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:08:19] CoreStatus = 7A (122)
[01:08:19] Sending work to server
[01:08:19] Project: 5766 (Run 11, Clone 52, Gen 1119)
[01:08:19] - Read packet limit of 540015616... Set to 524286976.
[01:08:19] - Error: Could not get length of results file work/wuresults_07.dat
[01:08:19] - Error: Could not read unit 07 file. Removing from queue.
[01:08:19] - Preparing to get new work unit...
[01:08:19] + Attempting to get work packet
[01:08:19] - Connecting to assignment server
[01:08:19] - Successful: assigned to (171.67.108.11).
[01:08:19] + News From Folding@Home: Welcome to Folding@Home
[01:08:20] Loaded queue successfully.
[01:08:20] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[01:08:27] + Attempting to get work packet
[01:08:27] - Connecting to assignment server
[01:08:28] - Successful: assigned to (171.67.108.11).
[01:08:28] + News From Folding@Home: Welcome to Folding@Home
[01:08:28] Loaded queue successfully.
[01:08:29] + Closed connections
[01:08:34]
[01:08:34] + Processing work unit
[01:08:34] Core required: FahCore_11.exe
[01:08:34] Core found.
[01:08:34] Working on queue slot 08 [October 16 01:08:34 UTC]
[01:08:34] + Working ...
[01:08:34]
[01:08:34] *------------------------------*
[01:08:34] Folding@Home GPU Core - Beta
[01:08:34] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[01:08:34]
[01:08:34] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[01:08:34] Build host: amoeba
[01:08:34] Board Type: Nvidia
[01:08:34] Core      :
[01:08:34] Preparing to commence simulation
[01:08:34] - Looking at optimizations...
[01:08:34] - Created dyn
[01:08:34] - Files status OK
[01:08:34] - Expanded 45373 -> 251112 (decompressed 553.4 percent)
[01:08:34] Called DecompressByteArray: compressed_data_size=45373 data_size=251112, decompressed_data_size=251112 diff=0
[01:08:34] - Digital signature verified
[01:08:34]
[01:08:34] Project: 5769 (Run 10, Clone 381, Gen 1178)
[01:08:34]
[01:08:34] Assembly optimizations on if available.
[01:08:34] Entering M.D.
[01:08:40] Working on Protein
[01:08:41] Client config found, loading data.
[01:08:41] Starting GUI Server
[01:09:39] Completed 1%
[01:10:38] Completed 2%
[01:11:38] Completed 3%
[01:12:38] Completed 4%
[01:13:34] Completed 5%
[01:14:26] Completed 6%
[01:15:18] Completed 7%
[01:16:11] Completed 8%
[01:17:06] Completed 9%
[01:18:01] Completed 10%
[01:18:54] Completed 11%
[01:19:48] Completed 12%
[01:20:41] Completed 13%
[01:21:34] Completed 14%
[01:22:27] Completed 15%
[01:23:20] Completed 16%
[01:24:14] Completed 17%
[01:25:07] Completed 18%
[01:26:00] Completed 19%
[01:26:53] Completed 20%
[01:27:46] Completed 21%
[01:28:40] Completed 22%
[01:29:33] Completed 23%
[01:30:26] Completed 24%
[01:31:19] Completed 25%
[01:32:14] Completed 26%
[01:33:09] Completed 27%
[01:34:05] Completed 28%
[01:35:00] Completed 29%
[01:35:55] Completed 30%
[01:36:51] Completed 31%
[01:37:49] Completed 32%
[01:38:47] Completed 33%
[01:39:45] Completed 34%
[01:40:43] Completed 35%
[01:41:37] Completed 36%
[01:42:30] Completed 37%
[01:43:22] Completed 38%
[01:44:15] Completed 39%
[01:45:09] Completed 40%
[01:46:02] Completed 41%
[01:46:55] Completed 42%
[01:47:49] Completed 43%
[01:48:43] Completed 44%
[01:49:35] Completed 45%
[01:50:29] Completed 46%
[01:51:26] Completed 47%
[01:52:23] Completed 48%
[01:53:17] Completed 49%
[01:54:11] Completed 50%
[01:55:04] Completed 51%
[01:55:58] Completed 52%
[01:56:52] Completed 53%
[01:57:44] Completed 54%
[01:58:36] Completed 55%
[01:59:28] Completed 56%
[02:00:21] Completed 57%
[02:01:16] Completed 58%
[02:02:11] Completed 59%
[02:03:05] Completed 60%
[02:03:58] Completed 61%
[02:04:53] Completed 62%
[02:05:47] Completed 63%
[02:06:42] Completed 64%
[02:07:35] Completed 65%
[02:08:27] Completed 66%
[02:09:18] Completed 67%
[02:10:11] Completed 68%
[02:11:03] Completed 69%
[02:12:03] Completed 70%
[02:13:03] Completed 71%
[02:14:03] Completed 72%
[02:15:03] Completed 73%
[02:16:03] Completed 74%
[02:17:03] Completed 75%
[02:18:03] Completed 76%
[02:19:03] Completed 77%
[02:20:01] Completed 78%
[02:20:59] Completed 79%
[02:21:58] Completed 80%
[02:22:57] Completed 81%
[02:23:57] Completed 82%
[02:24:53] Completed 83%
[02:25:47] Completed 84%
[02:26:44] Completed 85%
[02:27:44] Completed 86%
[02:28:43] Completed 87%
[02:29:43] Completed 88%
[02:30:38] Completed 89%
[02:31:36] Completed 90%
[02:32:33] Completed 91%
[02:33:31] Completed 92%
[02:34:29] Completed 93%
[02:35:26] Completed 94%
[02:36:24] Completed 95%
[02:37:21] Completed 96%
[02:38:19] Completed 97%
[02:39:16] Completed 98%
[02:40:09] Completed 99%
[02:41:02] Completed 100%
[02:41:03] Successful run
[02:41:03] DynamicWrapper: Finished Work Unit: sleep=10000
[02:41:13] Reserved 75840 bytes for xtc file; Cosm status=0
[02:41:13] Allocated 75840 bytes for xtc file
[02:41:13] - Reading up to 75840 from "work/wudata_08.xtc": Read 75840
[02:41:13] Read 75840 bytes from xtc file; available packet space=786354624
[02:41:13] xtc file hash check passed.
[02:41:13] Reserved 15168 15168 786354624 bytes for arc file=<work/wudata_08.trr> Cosm status=0
[02:41:13] Allocated 15168 bytes for arc file
[02:41:13] - Reading up to 15168 from "work/wudata_08.trr": Read 15168
[02:41:13] Read 15168 bytes from arc file; available packet space=786339456
[02:41:13] trr file hash check passed.
[02:41:13] Allocated 560 bytes for edr file
[02:41:13] Read bedfile
[02:41:13] edr file hash check passed.
[02:41:13] Allocated 18368 bytes for logfile
[02:41:13] Read logfile
[02:41:13] GuardedRun: success in DynamicWrapper
[02:41:13] GuardedRun: done
[02:41:13] Run: GuardedRun completed.
[02:41:13] - Writing 110448 bytes of core data to disk...
[02:41:13] Done: 109936 -> 96790 (compressed to 88.0 percent)
[02:41:13]   ... Done.
[02:41:13] - Shutting down core
[02:41:13]
[02:41:13] Folding@home Core Shutdown: FINISHED_UNIT
[02:41:16] CoreStatus = 64 (100)
[02:41:16] Sending work to server
[02:41:16] Project: 5769 (Run 10, Clone 381, Gen 1178)
[02:41:16] - Read packet limit of 540015616... Set to 524286976.


[02:41:16] + Attempting to send results [October 16 02:41:16 UTC]
[02:41:17] + Results successfully sent
[02:41:17] Thank you for your contribution to Folding@Home.
[02:41:17] + Number of Units Completed: 444

[02:41:21] - Preparing to get new work unit...
[02:41:21] + Attempting to get work packet
[02:41:21] - Connecting to assignment server
[02:41:21] - Successful: assigned to (171.67.108.11).
[02:41:21] + News From Folding@Home: Welcome to Folding@Home
[02:41:21] Loaded queue successfully.
[02:41:22] + Closed connections
[02:41:22]
[02:41:22] + Processing work unit
[02:41:22] Core required: FahCore_11.exe
[02:41:22] Core found.
[02:41:22] Working on queue slot 09 [October 16 02:41:22 UTC]
[02:41:22] + Working ...
[02:41:22]
[02:41:22] *------------------------------*
[02:41:22] Folding@Home GPU Core - Beta
[02:41:22] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[02:41:22]
[02:41:22] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[02:41:22] Build host: amoeba
[02:41:22] Board Type: Nvidia
[02:41:22] Core      :
[02:41:22] Preparing to commence simulation
[02:41:22] - Looking at optimizations...
[02:41:23] - Created dyn
[02:41:23] - Files status OK
[02:41:23] - Expanded 45434 -> 251112 (decompressed 552.6 percent)
[02:41:23] Called DecompressByteArray: compressed_data_size=45434 data_size=251112, decompressed_data_size=251112 diff=0
[02:41:23] - Digital signature verified
[02:41:23]
[02:41:23] Project: 5771 (Run 12, Clone 286, Gen 301)
[02:41:23]
[02:41:23] Assembly optimizations on if available.
[02:41:23] Entering M.D.
[02:41:29] Working on Protein
[02:41:29] Client config found, loading data.
[02:41:29] Starting GUI Server
[02:42:22] Completed 1%
[02:43:15] Completed 2%
[02:44:09] Completed 3%
[02:45:02] Completed 4%
[02:45:55] Completed 5%
[02:46:49] Completed 6%
[02:47:42] Completed 7%
[02:48:35] Completed 8%
[02:49:28] Completed 9%
[02:50:22] Completed 10%
[02:51:15] Completed 11%
[02:52:08] Completed 12%
[02:53:01] Completed 13%
[02:53:55] Completed 14%
[02:54:48] Completed 15%
[02:55:41] Completed 16%
[02:56:35] Completed 17%
[02:57:28] Completed 18%
[02:58:22] Completed 19%
[02:59:15] Completed 20%
[03:00:08] Completed 21%
[03:01:01] Completed 22%
[03:01:55] Completed 23%
[03:02:49] Completed 24%
[03:03:46] Completed 25%
[03:04:44] Completed 26%
[03:05:42] Completed 27%
[03:06:39] Completed 28%
[03:07:37] Completed 29%
[03:08:35] Completed 30%
[03:09:32] Completed 31%
[03:10:30] Completed 32%
[03:11:28] Completed 33%
[03:12:25] Completed 34%
[03:13:21] Completed 35%
[03:14:18] Completed 36%
[03:15:14] Completed 37%
[03:16:11] Completed 38%
[03:17:06] Completed 39%
[03:18:04] Completed 40%
[03:19:02] Completed 41%
[03:20:00] Completed 42%
[03:20:58] Completed 43%
[03:21:53] Completed 44%
[03:22:46] Completed 45%
[03:23:39] Completed 46%
[03:24:32] Completed 47%
[03:25:26] Completed 48%
[03:26:19] Completed 49%
[03:27:12] Completed 50%
[03:28:06] Completed 51%
[03:28:59] Completed 52%
[03:29:52] Completed 53%
[03:30:44] Completed 54%
[03:31:36] Completed 55%
[03:32:28] Completed 56%
[03:33:20] Completed 57%
[03:34:15] Completed 58%
[03:35:11] Completed 59%
[03:36:06] Completed 60%
[03:36:59] Completed 61%
[03:37:52] Completed 62%
[03:38:44] Completed 63%
[03:39:38] Completed 64%
[03:40:33] Completed 65%
[03:41:29] Completed 66%
[03:42:21] Completed 67%
[03:43:13] Completed 68%
[03:44:05] Completed 69%
[03:44:57] Completed 70%
[03:45:50] Completed 71%
[03:46:43] Completed 72%
[03:47:36] Completed 73%
[03:48:29] Completed 74%
[03:49:23] Completed 75%
[03:50:16] Completed 76%
[03:51:09] Completed 77%
[03:52:02] Completed 78%
[03:52:56] Completed 79%
[03:53:49] Completed 80%
[03:54:43] Completed 81%
[03:55:39] Completed 82%
[03:56:34] Completed 83%
[03:57:29] Completed 84%
[03:58:24] Completed 85%
[03:59:20] Completed 86%
[04:00:15] Completed 87%
[04:01:10] Completed 88%
[04:02:05] Completed 89%
[04:03:01] Completed 90%
[04:03:56] Completed 91%
[04:04:54] Completed 92%
[04:05:54] Completed 93%
[04:06:54] Completed 94%
[04:07:55] Completed 95%
[04:08:55] Completed 96%
[04:09:55] Completed 97%
[04:10:55] Completed 98%
[04:11:55] Completed 99%
[04:12:54] Completed 100%
[04:12:55] Successful run
[04:12:55] DynamicWrapper: Finished Work Unit: sleep=10000
[04:13:05] Reserved 75996 bytes for xtc file; Cosm status=0
[04:13:05] Allocated 75996 bytes for xtc file
[04:13:05] - Reading up to 75996 from "work/wudata_09.xtc": Read 75996
[04:13:05] Read 75996 bytes from xtc file; available packet space=786354468
[04:13:05] xtc file hash check passed.
[04:13:05] Reserved 15168 15168 786354468 bytes for arc file=<work/wudata_09.trr> Cosm status=0
[04:13:05] Allocated 15168 bytes for arc file
[04:13:05] - Reading up to 15168 from "work/wudata_09.trr": Read 15168
[04:13:05] Read 15168 bytes from arc file; available packet space=786339300
[04:13:05] trr file hash check passed.
[04:13:05] Allocated 560 bytes for edr file
[04:13:05] Read bedfile
[04:13:05] edr file hash check passed.
[04:13:05] Allocated 17036 bytes for logfile
[04:13:05] Read logfile
[04:13:05] GuardedRun: success in DynamicWrapper
[04:13:05] GuardedRun: done
[04:13:05] Run: GuardedRun completed.
[04:13:05] - Writing 109272 bytes of core data to disk...
[04:13:05] Done: 108760 -> 96720 (compressed to 88.9 percent)
[04:13:05]   ... Done.
[04:13:06] - Shutting down core
[04:13:06]
[04:13:06] Folding@home Core Shutdown: FINISHED_UNIT
[04:13:09] CoreStatus = 64 (100)
[04:13:09] Sending work to server
[04:13:09] Project: 5771 (Run 12, Clone 286, Gen 301)
[04:13:09] - Read packet limit of 540015616... Set to 524286976.


[04:13:09] + Attempting to send results [October 16 04:13:09 UTC]
[04:13:10] + Results successfully sent
[04:13:10] Thank you for your contribution to Folding@Home.
[04:13:10] + Number of Units Completed: 445

[04:13:14] - Preparing to get new work unit...
[04:13:14] + Attempting to get work packet
[04:13:14] - Connecting to assignment server
[04:13:14] - Successful: assigned to (171.64.65.20).
[04:13:14] + News From Folding@Home: Welcome to Folding@Home
[04:13:14] Loaded queue successfully.
[04:13:15] + Closed connections
[04:13:15]
[04:13:15] + Processing work unit
[04:13:15] Core required: FahCore_14.exe
[04:13:15] Core found.
[04:13:15] Working on queue slot 00 [October 16 04:13:15 UTC]
[04:13:15] + Working ...
[04:13:15]
[04:13:15] *------------------------------*
[04:13:15] Folding@Home GPU Core - Beta
[04:13:15] Version 1.25 (Mon Mar 2 19:49:32 PST 2009)
[04:13:15]
[04:13:15] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[04:13:15] Build host: vspm46
[04:13:15] Board Type: Nvidia
[04:13:15] Core      :
[04:13:15] Preparing to commence simulation
[04:13:15] - Looking at optimizations...
[04:13:16] - Created dyn
[04:13:16] - Files status OK
[04:13:16] - Expanded 68512 -> 357580 (decompressed 521.9 percent)
[04:13:16] Called DecompressByteArray: compressed_data_size=68512 data_size=357580, decompressed_data_size=357580 diff=0
[04:13:16] - Digital signature verified
[04:13:16]
[04:13:16] Project: 5915 (Run 2, Clone 388, Gen 12)
[04:13:16]
[04:13:16] Assembly optimizations on if available.
[04:13:16] Entering M.D.
[04:13:22] Tpr hash work/wudata_00.tpr:  3948971587 2253933699 4134817532 412995723 3973164934
[04:13:22] Working on Protein
[04:13:23] Client config found, loading data.
[04:13:23] Starting GUI Server
[04:18:42] Completed 1%
[04:24:53] Completed 2%
[04:30:30] Completed 3%
[04:36:14] Completed 4%
[04:41:58] Completed 5%
[04:47:36] Completed 6%
[04:53:10] Completed 7%
[04:58:49] Completed 8%
[05:04:40] Completed 9%
[05:10:26] Completed 10%
[05:16:05] Completed 11%
[05:21:47] Completed 12%
[05:27:30] Completed 13%
[05:33:13] Completed 14%
[05:38:58] Completed 15%
[05:44:35] Completed 16%
[05:50:16] Completed 17%
[05:56:31] Completed 18%
[06:02:59] Completed 19%
[06:09:38] Completed 20%
[06:16:19] Completed 21%
[06:23:27] Completed 22%
[06:29:57] Completed 23%
[06:36:35] Completed 24%
[06:43:22] Completed 25%
[06:49:58] Completed 26%
[06:56:37] Completed 27%
[07:03:11] Completed 28%
[07:07:49] + Working...
[07:09:38] Completed 29%
[07:16:17] Completed 30%
[07:22:49] Completed 31%
[07:28:39] Completed 32%
[07:34:19] Completed 33%
[07:40:08] Completed 34%
[07:46:03] Completed 35%
[07:51:53] Completed 36%
[07:57:45] Completed 37%
[08:03:36] Completed 38%
[08:09:26] Completed 39%
[08:15:22] Completed 40%
[08:21:14] Completed 41%
[08:27:00] Completed 42%
[08:32:53] Completed 43%
[08:38:44] Completed 44%
[08:44:39] Completed 45%
[08:50:27] Completed 46%
[08:56:08] Completed 47%
[09:01:54] Completed 48%
[09:07:35] Completed 49%
[09:13:29] Completed 50%
[09:19:08] Completed 51%
[09:24:52] Completed 52%
[09:30:34] Completed 53%
[09:36:09] Completed 54%
[09:41:54] Completed 55%
[09:47:36] Completed 56%
[09:53:20] Completed 57%
[09:59:04] Completed 58%
[10:04:43] Completed 59%
[10:10:31] Completed 60%
[10:16:19] Completed 61%
[10:22:03] Completed 62%
[10:27:55] Completed 63%
[10:33:43] Completed 64%
[10:39:33] Completed 65%
[10:45:23] Completed 66%
[10:51:10] Completed 67%
[10:56:57] Completed 68%
[11:02:41] Completed 69%
[11:08:37] Completed 70%
[11:14:19] Completed 71%
[11:20:11] Completed 72%
[11:26:04] Completed 73%
[11:31:51] Completed 74%
[11:37:43] Completed 75%
[11:43:33] Completed 76%
[11:49:17] Completed 77%
[11:55:08] Completed 78%
[12:00:57] Completed 79%
[12:06:50] Completed 80%
[12:12:37] Completed 81%
[12:18:28] Completed 82%
[12:24:20] Completed 83%
[12:30:13] Completed 84%
[12:36:08] Completed 85%
[12:41:51] Completed 86%
[12:47:35] Completed 87%
[12:53:23] Completed 88%
[12:59:15] Completed 89%
[13:05:12] Completed 90%
[13:07:48] + Working...
[13:10:59] Completed 91%
[13:16:46] Completed 92%
[13:22:36] Completed 93%
[13:28:25] Completed 94%
[13:34:28] Completed 95%
[13:40:21] Completed 96%
[13:46:08] Completed 97%
[13:51:58] Completed 98%
[13:57:52] Completed 99%
[14:03:53] Completed 100%
[14:03:53] Successful run
[14:03:53] DynamicWrapper: Finished Work Unit: sleep=10000
[14:04:03] Reserved 33748 bytes for xtc file; Cosm status=0
[14:04:03] Allocated 33748 bytes for xtc file
[14:04:03] - Reading up to 33748 from "work/wudata_00.xtc": Read 33748
[14:04:03] Read 33748 bytes from xtc file; available packet space=786396716
[14:04:03] xtc file hash check passed.
[14:04:03] Reserved 23472 23472 786396716 bytes for arc file=<work/wudata_00.trr> Cosm status=0
[14:04:03] Allocated 23472 bytes for arc file
[14:04:03] - Reading up to 23472 from "work/wudata_00.trr": Read 23472
[14:04:03] Read 23472 bytes from arc file; available packet space=786373244
[14:04:03] trr file hash check passed.
[14:04:03] Allocated 560 bytes for edr file
[14:04:03] Read bedfile
[14:04:03] edr file hash check passed.
[14:04:03] Allocated 22598 bytes for logfile
[14:04:03] Read logfile
[14:04:03] GuardedRun: success in DynamicWrapper
[14:04:03] GuardedRun: done
[14:04:03] Run: GuardedRun completed.
[14:04:04] - Writing 80890 bytes of core data to disk...
[14:04:04] Done: 80378 -> 62949 (compressed to 78.3 percent)
[14:04:04]   ... Done.
[14:04:04] - Shutting down core
[14:04:04]
[14:04:04] Folding@home Core Shutdown: FINISHED_UNIT
[14:04:07] CoreStatus = 64 (100)
[14:04:07] Sending work to server
[14:04:07] Project: 5915 (Run 2, Clone 388, Gen 12)
[14:04:07] - Read packet limit of 540015616... Set to 524286976.


[14:04:07] + Attempting to send results [October 16 14:04:07 UTC]
[14:04:08] + Results successfully sent
[14:04:08] Thank you for your contribution to Folding@Home.
[14:04:08] + Number of Units Completed: 446

[14:04:12] - Preparing to get new work unit...
[14:04:12] + Attempting to get work packet
[14:04:12] - Connecting to assignment server
[14:04:12] - Successful: assigned to (171.67.108.11).
[14:04:12] + News From Folding@Home: Welcome to Folding@Home
[14:04:13] Loaded queue successfully.
[14:04:13] + Closed connections
[14:04:13]
[14:04:13] + Processing work unit
[14:04:13] Core required: FahCore_11.exe
[14:04:13] Core found.
[14:04:13] Working on queue slot 01 [October 16 14:04:13 UTC]
[14:04:13] + Working ...
[14:04:13]
[14:04:13] *------------------------------*
[14:04:13] Folding@Home GPU Core - Beta
[14:04:13] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[14:04:13]
[14:04:13] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[14:04:13] Build host: amoeba
[14:04:13] Board Type: Nvidia
[14:04:13] Core      :
[14:04:13] Preparing to commence simulation
[14:04:13] - Looking at optimizations...
[14:04:14] - Created dyn
[14:04:14] - Files status OK
[14:04:14] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[14:04:14] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[14:04:14] - Digital signature verified
[14:04:14]
[14:04:14] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:14]
[14:04:14] Assembly optimizations on if available.
[14:04:14] Entering M.D.
[14:04:20] Working on Protein
[14:04:20] Client config found, loading data.
[14:04:20] mdrun_gpu returned
[14:04:20] NANs detected on GPU
[14:04:20]
[14:04:20] Folding@home Core Shutdown: UNSTABLE_MACHINE
[14:04:24] CoreStatus = 7A (122)
[14:04:24] Sending work to server
[14:04:24] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:24] - Read packet limit of 540015616... Set to 524286976.
[14:04:24] - Error: Could not get length of results file work/wuresults_01.dat
[14:04:24] - Error: Could not read unit 01 file. Removing from queue.
[14:04:24] - Preparing to get new work unit...
[14:04:24] + Attempting to get work packet
[14:04:24] - Connecting to assignment server
[14:04:24] - Successful: assigned to (171.67.108.11).
[14:04:24] + News From Folding@Home: Welcome to Folding@Home
[14:04:24] Loaded queue successfully.
[14:04:25] + Closed connections
[14:04:30]
[14:04:30] + Processing work unit
[14:04:30] Core required: FahCore_11.exe
[14:04:30] Core found.
[14:04:30] Working on queue slot 02 [October 16 14:04:30 UTC]
[14:04:30] + Working ...
[14:04:30]
[14:04:30] *------------------------------*
[14:04:30] Folding@Home GPU Core - Beta
[14:04:30] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[14:04:30]
[14:04:30] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[14:04:30] Build host: amoeba
[14:04:30] Board Type: Nvidia
[14:04:30] Core      :
[14:04:30] Preparing to commence simulation
[14:04:30] - Looking at optimizations...
[14:04:30] - Created dyn
[14:04:30] - Files status OK
[14:04:30] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[14:04:30] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[14:04:30] - Digital signature verified
[14:04:30]
[14:04:30] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:30]
[14:04:31] Assembly optimizations on if available.
[14:04:31] Entering M.D.
[14:04:37] Working on Protein
[14:04:37] Client config found, loading data.
[14:04:37] mdrun_gpu returned
[14:04:37] NANs detected on GPU
[14:04:37]
[14:04:37] Folding@home Core Shutdown: UNSTABLE_MACHINE
[14:04:40] CoreStatus = 7A (122)
[14:04:40] Sending work to server
[14:04:40] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:40] - Read packet limit of 540015616... Set to 524286976.
[14:04:40] - Error: Could not get length of results file work/wuresults_02.dat
[14:04:40] - Error: Could not read unit 02 file. Removing from queue.
[14:04:40] - Preparing to get new work unit...
[14:04:40] + Attempting to get work packet
[14:04:40] - Connecting to assignment server
[14:04:41] - Successful: assigned to (171.67.108.11).
[14:04:41] + News From Folding@Home: Welcome to Folding@Home
[14:04:41] Loaded queue successfully.
[14:04:41] + Closed connections
[14:04:46]
[14:04:46] + Processing work unit
[14:04:46] Core required: FahCore_11.exe
[14:04:46] Core found.
[14:04:46] Working on queue slot 03 [October 16 14:04:46 UTC]
[14:04:46] + Working ...
[14:04:47]
[14:04:47] *------------------------------*
[14:04:47] Folding@Home GPU Core - Beta
[14:04:47] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[14:04:47]
[14:04:47] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[14:04:47] Build host: amoeba
[14:04:47] Board Type: Nvidia
[14:04:47] Core      :
[14:04:47] Preparing to commence simulation
[14:04:47] - Looking at optimizations...
[14:04:47] - Created dyn
[14:04:47] - Files status OK
[14:04:47] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[14:04:47] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[14:04:47] - Digital signature verified
[14:04:47]
[14:04:47] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:47]
[14:04:47] Assembly optimizations on if available.
[14:04:47] Entering M.D.
[14:04:53] Working on Protein
[14:04:54] Client config found, loading data.
[14:04:54] mdrun_gpu returned
[14:04:54] NANs detected on GPU
[14:04:54]
[14:04:54] Folding@home Core Shutdown: UNSTABLE_MACHINE
[14:04:57] CoreStatus = 7A (122)
[14:04:57] Sending work to server
[14:04:57] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:04:57] - Read packet limit of 540015616... Set to 524286976.
[14:04:57] - Error: Could not get length of results file work/wuresults_03.dat
[14:04:57] - Error: Could not read unit 03 file. Removing from queue.
[14:04:57] - Preparing to get new work unit...
[14:04:57] + Attempting to get work packet
[14:04:57] - Connecting to assignment server
[14:04:57] - Successful: assigned to (171.67.108.11).
[14:04:57] + News From Folding@Home: Welcome to Folding@Home
[14:04:57] Loaded queue successfully.
[14:04:58] + Closed connections
[14:05:03]
[14:05:03] + Processing work unit
[14:05:03] Core required: FahCore_11.exe
[14:05:03] Core found.
[14:05:03] Working on queue slot 04 [October 16 14:05:03 UTC]
[14:05:03] + Working ...
[14:05:03]
[14:05:03] *------------------------------*
[14:05:03] Folding@Home GPU Core - Beta
[14:05:03] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[14:05:03]
[14:05:03] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[14:05:03] Build host: amoeba
[14:05:03] Board Type: Nvidia
[14:05:03] Core      :
[14:05:03] Preparing to commence simulation
[14:05:03] - Looking at optimizations...
[14:05:04] - Created dyn
[14:05:04] - Files status OK
[14:05:04] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[14:05:04] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[14:05:04] - Digital signature verified
[14:05:04]
[14:05:04] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:05:04]
[14:05:04] Assembly optimizations on if available.
[14:05:04] Entering M.D.
[14:05:10] Working on Protein
[14:05:10] Client config found, loading data.
[14:05:11] Starting GUI Server
[14:05:11] mdrun_gpu returned
[14:05:11] NANs detected on GPU
[14:05:11]
[14:05:11] Folding@home Core Shutdown: UNSTABLE_MACHINE
[14:05:13] CoreStatus = 7A (122)
[14:05:13] Sending work to server
[14:05:13] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:05:13] - Read packet limit of 540015616... Set to 524286976.
[14:05:13] - Error: Could not get length of results file work/wuresults_04.dat
[14:05:13] - Error: Could not read unit 04 file. Removing from queue.
[14:05:13] - Preparing to get new work unit...
[14:05:13] + Attempting to get work packet
[14:05:13] - Connecting to assignment server
[14:05:14] - Successful: assigned to (171.67.108.11).
[14:05:14] + News From Folding@Home: Welcome to Folding@Home
[14:05:14] Loaded queue successfully.
[14:05:15] + Closed connections
[14:05:20]
[14:05:20] + Processing work unit
[14:05:20] Core required: FahCore_11.exe
[14:05:20] Core found.
[14:05:20] Working on queue slot 05 [October 16 14:05:20 UTC]
[14:05:20] + Working ...
[14:05:20]
[14:05:20] *------------------------------*
[14:05:20] Folding@Home GPU Core - Beta
[14:05:20] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[14:05:20]
[14:05:20] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[14:05:20] Build host: amoeba
[14:05:20] Board Type: Nvidia
[14:05:20] Core      :
[14:05:20] Preparing to commence simulation
[14:05:20] - Looking at optimizations...
[14:05:20] - Created dyn
[14:05:20] - Files status OK
[14:05:20] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[14:05:20] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[14:05:20] - Digital signature verified
[14:05:20]
[14:05:20] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:05:20]
[14:05:20] Assembly optimizations on if available.
[14:05:20] Entering M.D.
[14:05:26] Working on Protein
[14:05:27] Client config found, loading data.
[14:05:27] Starting GUI Server
[14:05:27] mdrun_gpu returned
[14:05:27] NANs detected on GPU
[14:05:27]
[14:05:27] Folding@home Core Shutdown: UNSTABLE_MACHINE
[14:05:30] CoreStatus = 7A (122)
[14:05:30] Sending work to server
[14:05:30] Project: 5765 (Run 8, Clone 125, Gen 931)
[14:05:30] - Read packet limit of 540015616... Set to 524286976.
[14:05:30] - Error: Could not get length of results file work/wuresults_05.dat
[14:05:30] - Error: Could not read unit 05 file. Removing from queue.
[14:05:30] EUE limit exceeded. Pausing 24 hours.
[19:07:47] + Working...
[01:07:45] + Working...

Folding@Home Client Shutdown.


--- Opening Log file [October 17 06:52:27 UTC]

...

[06:52:27] - Ask before connecting: No
[06:52:27] - User name: Prettz (Team 150)
[06:52:27] - User ID:
[06:52:27] - Machine ID: 2
[06:52:27]
[06:52:27] Loaded queue successfully.
[06:52:27] Initialization complete
[06:52:27] - Preparing to get new work unit...
[06:52:27] + Attempting to get work packet
[06:52:27] - Connecting to assignment server
[06:52:28] - Successful: assigned to (171.67.108.11).
[06:52:28] + News From Folding@Home: Welcome to Folding@Home
[06:52:28] Loaded queue successfully.
[06:52:29] - Couldn't send HTTP request to server
[06:52:29] + Could not connect to Work Server
[06:52:29] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[06:52:44] + Attempting to get work packet
[06:52:45] - Connecting to assignment server
[06:52:45] - Successful: assigned to (171.67.108.11).
[06:52:45] + News From Folding@Home: Welcome to Folding@Home
[06:52:45] Loaded queue successfully.
[06:52:46] - Couldn't send HTTP request to server
[06:52:46] + Could not connect to Work Server
[06:52:46] - Attempt #2  to get work failed, and no other work to do.
Waiting before retry.
[06:52:57] + Attempting to get work packet
[06:52:57] - Connecting to assignment server
[06:52:58] - Successful: assigned to (171.64.65.106).
[06:52:58] + News From Folding@Home: Welcome to Folding@Home
[06:52:58] Loaded queue successfully.
[06:52:59] + Closed connections
[06:52:59]
[06:52:59] + Processing work unit
[06:52:59] Core required: FahCore_11.exe
[06:52:59] Core found.
[06:52:59] Working on queue slot 06 [October 17 06:52:59 UTC]
[06:52:59] + Working ...
[06:52:59]
[06:52:59] *------------------------------*
[06:52:59] Folding@Home GPU Core - Beta
[06:52:59] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[06:52:59]
[06:52:59] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[06:52:59] Build host: amoeba
[06:52:59] Board Type: Nvidia
[06:52:59] Core      :
[06:52:59] Preparing to commence simulation
[06:52:59] - Looking at optimizations...
[06:53:00] - Created dyn
[06:53:00] - Files status OK
[06:53:00] - Expanded 67342 -> 350744 (decompressed 520.8 percent)
[06:53:00] Called DecompressByteArray: compressed_data_size=67342 data_size=350744, decompressed_data_size=350744 diff=0
[06:53:00] - Digital signature verified
[06:53:00]
[06:53:00] Project: 5790 (Run 23, Clone 556, Gen 1)
[06:53:00]
[06:53:00] Assembly optimizations on if available.
[06:53:00] Entering M.D.
[06:53:07] Working on Protein
[06:53:08] Client config found, loading data.
[06:53:08] Starting GUI Server
[06:55:41] Completed 1%
[06:58:15] Completed 2%
[07:00:49] Completed 3%
[07:03:23] Completed 4%
[07:05:49] Completed 5%
[07:08:21] Completed 6%
[07:10:52] Completed 7%
[07:13:23] Completed 8%
[07:15:54] Completed 9%
[07:18:25] Completed 10%
[07:20:54] Completed 11%
[07:23:24] Completed 12%
[07:25:55] Completed 13%
[07:28:26] Completed 14%
[07:30:57] Completed 15%
[07:33:29] Completed 16%
[07:35:48] Completed 17%
[07:37:58] Completed 18%
[07:40:09] Completed 19%
[07:42:23] Completed 20%
[07:44:36] Completed 21%
[07:46:50] Completed 22%
[07:49:03] Completed 23%
[07:51:17] Completed 24%
[07:53:30] Completed 25%
[07:55:44] Completed 26%
[07:57:58] Completed 27%
[08:00:11] Completed 28%
[08:02:25] Completed 29%
[08:04:39] Completed 30%
[08:06:52] Completed 31%
[08:09:06] Completed 32%
[08:11:19] Completed 33%
[08:13:33] Completed 34%
[08:15:47] Completed 35%
[08:18:00] Completed 36%
[08:20:14] Completed 37%
[08:22:27] Completed 38%
[08:24:41] Completed 39%
[08:26:55] Completed 40%
[08:29:08] Completed 41%
[08:31:22] Completed 42%
[08:33:36] Completed 43%
[08:35:49] Completed 44%
[08:38:03] Completed 45%
[08:40:17] Completed 46%
[08:42:30] Completed 47%
[08:44:44] Completed 48%
[08:46:57] Completed 49%
[08:49:11] Completed 50%
[08:51:25] Completed 51%
[08:53:38] Completed 52%
[08:55:52] Completed 53%
[08:58:05] Completed 54%
[09:00:19] Completed 55%
[09:02:33] Completed 56%
[09:04:46] Completed 57%
[09:06:57] Completed 58%
[09:09:05] Completed 59%
[09:11:13] Completed 60%
[09:13:21] Completed 61%
[09:15:30] Completed 62%
[09:17:39] Completed 63%
[09:19:47] Completed 64%
[09:21:55] Completed 65%
[09:24:03] Completed 66%
[09:26:12] Completed 67%
[09:28:20] Completed 68%
[09:30:28] Completed 69%
[09:32:36] Completed 70%
[09:34:45] Completed 71%
[09:36:53] Completed 72%
[09:39:01] Completed 73%
[09:41:09] Completed 74%
[09:43:18] Completed 75%
[09:45:26] Completed 76%
[09:47:34] Completed 77%
[09:49:43] Completed 78%
[09:51:51] Completed 79%
[09:54:00] Completed 80%
[09:56:08] Completed 81%
[09:58:16] Completed 82%
[10:00:25] Completed 83%
[10:02:33] Completed 84%
[10:04:41] Completed 85%
[10:06:49] Completed 86%
[10:08:58] Completed 87%
[10:11:06] Completed 88%
[10:13:14] Completed 89%
[10:15:23] Completed 90%
[10:17:31] Completed 91%
[10:19:39] Completed 92%
[10:21:47] Completed 93%
[10:23:56] Completed 94%
[10:26:04] Completed 95%
[10:28:12] Completed 96%
[10:30:21] Completed 97%
[10:32:29] Completed 98%
[10:34:37] Completed 99%
[10:36:46] Completed 100%
[10:36:46] Successful run
[10:36:46] DynamicWrapper: Finished Work Unit: sleep=10000
[10:36:56] Reserved 149196 bytes for xtc file; Cosm status=0
[10:36:56] Allocated 149196 bytes for xtc file
[10:36:56] - Reading up to 149196 from "work/wudata_06.xtc": Read 149196
[10:36:56] Read 149196 bytes from xtc file; available packet space=786281268
[10:36:56] xtc file hash check passed.
[10:36:56] Reserved 22704 22704 786281268 bytes for arc file=<work/wudata_06.trr> Cosm status=0
[10:36:56] Allocated 22704 bytes for arc file
[10:36:56] - Reading up to 22704 from "work/wudata_06.trr": Read 22704
[10:36:56] Read 22704 bytes from arc file; available packet space=786258564
[10:36:56] trr file hash check passed.
[10:36:56] Allocated 560 bytes for edr file
[10:36:56] Read bedfile
[10:36:56] edr file hash check passed.
[10:36:56] Allocated 10413 bytes for logfile
[10:36:56] Read logfile
[10:36:56] GuardedRun: success in DynamicWrapper
[10:36:56] GuardedRun: done
[10:36:56] Run: GuardedRun completed.
[10:36:57] - Writing 183385 bytes of core data to disk...
[10:36:57] Done: 182873 -> 176176 (compressed to 96.3 percent)
[10:36:57]   ... Done.
[10:36:57] - Shutting down core
[10:36:57]
[10:36:57] Folding@home Core Shutdown: FINISHED_UNIT
[10:36:59] CoreStatus = 64 (100)
[10:36:59] Sending work to server
[10:36:59] Project: 5790 (Run 23, Clone 556, Gen 1)
[10:36:59] - Read packet limit of 540015616... Set to 524286976.


[10:36:59] + Attempting to send results [October 17 10:36:59 UTC]
[10:37:01] + Results successfully sent
[10:37:01] Thank you for your contribution to Folding@Home.
[10:37:01] + Number of Units Completed: 447

[10:37:05] - Preparing to get new work unit...
[10:37:05] + Attempting to get work packet
[10:37:05] - Connecting to assignment server
[10:37:05] - Successful: assigned to (171.67.108.11).
[10:37:05] + News From Folding@Home: Welcome to Folding@Home
[10:37:05] Loaded queue successfully.
[10:37:06] + Closed connections
[10:37:06]
[10:37:06] + Processing work unit
[10:37:06] Core required: FahCore_11.exe
[10:37:06] Core found.
[10:37:06] Working on queue slot 07 [October 17 10:37:06 UTC]
[10:37:06] + Working ...
[10:37:07]
[10:37:07] *------------------------------*
[10:37:07] Folding@Home GPU Core - Beta
[10:37:07] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[10:37:07]
[10:37:07] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:37:07] Build host: amoeba
[10:37:07] Board Type: Nvidia
[10:37:07] Core      :
[10:37:07] Preparing to commence simulation
[10:37:07] - Looking at optimizations...
[10:37:07] - Created dyn
[10:37:07] - Files status OK
[10:37:07] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[10:37:07] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[10:37:07] - Digital signature verified
[10:37:07]
[10:37:07] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:07]
[10:37:07] Assembly optimizations on if available.
[10:37:07] Entering M.D.
[10:37:13] Working on Protein
[10:37:14] Client config found, loading data.
[10:37:14] mdrun_gpu returned
[10:37:14] NANs detected on GPU
[10:37:14]
[10:37:14] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:37:17] CoreStatus = 7A (122)
[10:37:17] Sending work to server
[10:37:17] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:17] - Read packet limit of 540015616... Set to 524286976.
[10:37:17] - Error: Could not get length of results file work/wuresults_07.dat
[10:37:17] - Error: Could not read unit 07 file. Removing from queue.
[10:37:17] - Preparing to get new work unit...
[10:37:17] + Attempting to get work packet
[10:37:17] - Connecting to assignment server
[10:37:17] - Successful: assigned to (171.67.108.11).
[10:37:17] + News From Folding@Home: Welcome to Folding@Home
[10:37:17] Loaded queue successfully.
[10:37:18] + Closed connections
[10:37:23]
[10:37:23] + Processing work unit
[10:37:23] Core required: FahCore_11.exe
[10:37:23] Core found.
[10:37:23] Working on queue slot 08 [October 17 10:37:23 UTC]
[10:37:23] + Working ...
[10:37:23]
[10:37:23] *------------------------------*
[10:37:23] Folding@Home GPU Core - Beta
[10:37:23] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[10:37:23]
[10:37:23] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:37:23] Build host: amoeba
[10:37:23] Board Type: Nvidia
[10:37:23] Core      :
[10:37:23] Preparing to commence simulation
[10:37:23] - Looking at optimizations...
[10:37:23] - Created dyn
[10:37:23] - Files status OK
[10:37:23] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[10:37:23] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[10:37:23] - Digital signature verified
[10:37:23]
[10:37:23] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:23]
[10:37:23] Assembly optimizations on if available.
[10:37:23] Entering M.D.
[10:37:30] Working on Protein
[10:37:30] Client config found, loading data.
[10:37:30] Starting GUI Server
[10:37:30] mdrun_gpu returned
[10:37:30] NANs detected on GPU
[10:37:30]
[10:37:30] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:37:33] CoreStatus = 7A (122)
[10:37:33] Sending work to server
[10:37:33] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:33] - Read packet limit of 540015616... Set to 524286976.
[10:37:33] - Error: Could not get length of results file work/wuresults_08.dat
[10:37:33] - Error: Could not read unit 08 file. Removing from queue.
[10:37:33] - Preparing to get new work unit...
[10:37:33] + Attempting to get work packet
[10:37:33] - Connecting to assignment server
[10:37:34] - Successful: assigned to (171.67.108.11).
[10:37:34] + News From Folding@Home: Welcome to Folding@Home
[10:37:34] Loaded queue successfully.
[10:37:35] + Closed connections
[10:37:40]
[10:37:40] + Processing work unit
[10:37:40] Core required: FahCore_11.exe
[10:37:40] Core found.
[10:37:40] Working on queue slot 09 [October 17 10:37:40 UTC]
[10:37:40] + Working ...
[10:37:40]
[10:37:40] *------------------------------*
[10:37:40] Folding@Home GPU Core - Beta
[10:37:40] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[10:37:40]
[10:37:40] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:37:40] Build host: amoeba
[10:37:40] Board Type: Nvidia
[10:37:40] Core      :
[10:37:40] Preparing to commence simulation
[10:37:40] - Looking at optimizations...
[10:37:40] - Created dyn
[10:37:40] - Files status OK
[10:37:40] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[10:37:40] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[10:37:40] - Digital signature verified
[10:37:40]
[10:37:40] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:40]
[10:37:40] Assembly optimizations on if available.
[10:37:40] Entering M.D.
[10:37:46] Working on Protein
[10:37:47] Client config found, loading data.
[10:37:47] mdrun_gpu returned
[10:37:47] NANs detected on GPU
[10:37:47]
[10:37:47] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:37:50] CoreStatus = 7A (122)
[10:37:50] Sending work to server
[10:37:50] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:50] - Read packet limit of 540015616... Set to 524286976.
[10:37:50] - Error: Could not get length of results file work/wuresults_09.dat
[10:37:50] - Error: Could not read unit 09 file. Removing from queue.
[10:37:50] - Preparing to get new work unit...
[10:37:50] + Attempting to get work packet
[10:37:50] - Connecting to assignment server
[10:37:50] - Successful: assigned to (171.67.108.11).
[10:37:50] + News From Folding@Home: Welcome to Folding@Home
[10:37:50] Loaded queue successfully.
[10:37:51] + Closed connections
[10:37:56]
[10:37:56] + Processing work unit
[10:37:56] Core required: FahCore_11.exe
[10:37:56] Core found.
[10:37:56] Working on queue slot 00 [October 17 10:37:56 UTC]
[10:37:56] + Working ...
[10:37:56]
[10:37:56] *------------------------------*
[10:37:56] Folding@Home GPU Core - Beta
[10:37:56] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[10:37:56]
[10:37:56] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:37:56] Build host: amoeba
[10:37:56] Board Type: Nvidia
[10:37:56] Core      :
[10:37:56] Preparing to commence simulation
[10:37:56] - Looking at optimizations...
[10:37:56] - Created dyn
[10:37:56] - Files status OK
[10:37:56] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[10:37:56] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[10:37:56] - Digital signature verified
[10:37:56]
[10:37:56] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:37:56]
[10:37:56] Assembly optimizations on if available.
[10:37:56] Entering M.D.
[10:38:03] Working on Protein
[10:38:03] Client config found, loading data.
[10:38:03] Starting GUI Server
[10:38:03] mdrun_gpu returned
[10:38:03] NANs detected on GPU
[10:38:03]
[10:38:03] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:38:06] CoreStatus = 7A (122)
[10:38:06] Sending work to server
[10:38:06] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:38:06] - Read packet limit of 540015616... Set to 524286976.
[10:38:06] - Error: Could not get length of results file work/wuresults_00.dat
[10:38:06] - Error: Could not read unit 00 file. Removing from queue.
[10:38:06] - Preparing to get new work unit...
[10:38:06] + Attempting to get work packet
[10:38:06] - Connecting to assignment server
[10:38:07] - Successful: assigned to (171.67.108.11).
[10:38:07] + News From Folding@Home: Welcome to Folding@Home
[10:38:07] Loaded queue successfully.
[10:38:08] + Closed connections
[10:38:13]
[10:38:13] + Processing work unit
[10:38:13] Core required: FahCore_11.exe
[10:38:13] Core found.
[10:38:13] Working on queue slot 01 [October 17 10:38:13 UTC]
[10:38:13] + Working ...
[10:38:13]
[10:38:13] *------------------------------*
[10:38:13] Folding@Home GPU Core - Beta
[10:38:13] Version 1.19 (Mon Nov 3 09:34:13 PST 2008)
[10:38:13]
[10:38:13] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:38:13] Build host: amoeba
[10:38:13] Board Type: Nvidia
[10:38:13] Core      :
[10:38:13] Preparing to commence simulation
[10:38:13] - Looking at optimizations...
[10:38:13] - Created dyn
[10:38:13] - Files status OK
[10:38:13] - Expanded 46655 -> 252912 (decompressed 542.0 percent)
[10:38:13] Called DecompressByteArray: compressed_data_size=46655 data_size=252912, decompressed_data_size=252912 diff=0
[10:38:13] - Digital signature verified
[10:38:13]
[10:38:13] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:38:13]
[10:38:13] Assembly optimizations on if available.
[10:38:13] Entering M.D.
[10:38:20] Working on Protein
[10:38:20] Client config found, loading data.
[10:38:20] mdrun_gpu returned
[10:38:20] NANs detected on GPU
[10:38:20]
[10:38:20] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:38:23] CoreStatus = 7A (122)
[10:38:23] Sending work to server
[10:38:23] Project: 5765 (Run 8, Clone 125, Gen 931)
[10:38:23] - Read packet limit of 540015616... Set to 524286976.
[10:38:23] - Error: Could not get length of results file work/wuresults_01.dat
[10:38:23] - Error: Could not read unit 01 file. Removing from queue.
[10:38:23] EUE limit exceeded. Pausing 24 hours.
[12:52:26] + Working...

Folding@Home Client Shutdown.

Fortunately my SMP client is soldiering on like a champ. :)
Prettz
 
Posts: 30
Joined: Sat Oct 17, 2009 6:47 pm

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby bruce » Sun Oct 18, 2009 12:21 am

Prettz wrote:I haven't been keeping track, but all of them use Core 11. I don't recall ever seeing any mention of "Core 11" before WUs started failing; all I ever saw before then was Core 14. Is Core 11 relatively new?


No, core 11 is the standard GPU core and it has been around since the start of GPU2 folding and has gone through a number of updates. By comparison, core 14 is really rather new.
bruce
 
Posts: 22701
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby heikosch » Sun Oct 18, 2009 9:24 pm

@Prettz
It might be that you ran into the same problem like me.
Projects 5765-5768 fail immediately but other projects run without any problems.

Vista 64 SP2, 8800 GTS 512, driver version doesn´t matter

Heiko
Image Image
Image
heikosch
 
Posts: 139
Joined: Thu Apr 30, 2009 7:31 pm
Location: Essen, Germany

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby Prettz » Mon Oct 19, 2009 1:54 am

bruce wrote:
Prettz wrote:I haven't been keeping track, but all of them use Core 11. I don't recall ever seeing any mention of "Core 11" before WUs started failing; all I ever saw before then was Core 14. Is Core 11 relatively new?


No, core 11 is the standard GPU core and it has been around since the start of GPU2 folding and has gone through a number of updates. By comparison, core 14 is really rather new.

That's really weird, because I'm still sure I always saw Core_14 every time I looked in the log file or Task Manager, and I swear I never saw Core_11 before the 24-hour shutdowns started happening. I guess I was always looking at the wrong time.

heikosch wrote:@Prettz
It might be that you ran into the same problem like me.
Projects 5765-5768 fail immediately but other projects run without any problems.

Vista 64 SP2, 8800 GTS 512, driver version doesn´t matter

Heiko

Those are the usual ones I see failing in the log file, but several other project numbers not in that range have failed immediately on start up as well. I never saved which ones they were, though. What I'm not sure of is if any of the other projects I've seen failed used Core_14 or not.
Prettz
 
Posts: 30
Joined: Sat Oct 17, 2009 6:47 pm

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby Kingcarcas » Sun Oct 25, 2009 4:38 am

This is getting a little ridiculous, my log is filled with EUEs. Old drivers, new drivers, XP, 7 it doesn't really matter.

5767 (Run 3, Clone 58, Gen 1029)
5770 (Run 4, Clone 180, Gen 146)
5793 (Run 9, Clone 541, Gen 2)
5765 (Run 2, Clone 340, Gen 406)
5765 (Run 10, Clone 293, Gen 622)
5789 (Run 4, Clone 492, Gen 14)
5772 (Run 14, Clone 114, Gen 486)

My 9800GTX+ has been at stock for a long while now. I'm going to give GPUGrid a try.
Image
Kingcarcas
 
Posts: 36
Joined: Thu Dec 06, 2007 9:20 am

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby efok » Wed Nov 18, 2009 11:45 pm

Failing projects:

Mostly 57xx series

Failing Hardware: 8600GT

Failing OS:

Windows 7 Ultimate 64 bits

Failing driver:

191.07

Below are the error messages I've gotten:

Code: Select all

[18:06:02] Project: 5765 (Run 7, Clone 118, Gen 149)
[18:06:02]
[18:50:31] Completed 24%
[18:53:33] Run: exception thrown during GuardedRun
[18:53:33] Run: exception thrown in GuardedRun -- Gromacs cannot continue further.
[18:53:33] Going to send back what have done -- stepsTotalG=15000000
[18:53:33] Work fraction=0.2483 steps=15000000.
[18:53:37] logfile size=12629 infoLength=12629 edr=0 trr=23
[18:53:37] - Writing 13165 bytes of core data to disk...
[18:53:37] Done: 12653 -> 4253 (compressed to 33.6 percent)
[18:53:37]   ... Done.
[18:53:40]
[18:53:40] Folding@home Core Shutdown: UNSTABLE_MACHINE
[18:53:42] CoreStatus = 7A (122)
[18:53:42] Sending work to server


[18:29:38] Project: 5765 (Run 1, Clone 278, Gen 168)
[18:29:38]
[20:17:07] Completed 30%
[20:17:38] Run: exception thrown during GuardedRun
[20:17:38] Run: exception thrown in GuardedRun -- Gromacs cannot continue further.
[20:17:38] Going to send back what have done -- stepsTotalG=15000000
[20:17:38] Work fraction=0.3009 steps=15000000.


[10:10:39] Project: 5771 (Run 10, Clone 162, Gen 1315)
[10:10:39]
[10:10:39] Assembly optimizations on if available.
[10:10:39] Entering M.D.
[10:10:46] Working on Protein
[10:10:48] Client config found, loading data.
[10:10:48] Starting GUI Server
[10:10:48] mdrun_gpu returned
[10:10:48] NANs detected on GPU
[10:10:48]
[10:10:48] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:10:51] CoreStatus = 7A (122)
[10:10:51] Sending work to server

[10:10:58] Project: 5771 (Run 10, Clone 162, Gen 1315)
[10:10:58]
[10:10:58] Assembly optimizations on if available.
[10:10:58] Entering M.D.
[10:11:04] Working on Protein
[10:11:06] Client config found, loading data.
[10:11:06] Starting GUI Server
[10:11:07] mdrun_gpu returned
[10:11:07] NANs detected on GPU
[10:11:07]
[10:11:07] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:11:10] CoreStatus = 7A (122)
[10:11:10] Sending work to server


[10:11:17] Project: 5771 (Run 10, Clone 162, Gen 1315)
[10:11:17]
[10:11:17] Assembly optimizations on if available.
[10:11:17] Entering M.D.
[10:11:23] Working on Protein
[10:11:25] Client config found, loading data.
[10:11:25] mdrun_gpu returned
[10:11:25] NANs detected on GPU
[10:11:25]
[10:11:25] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:11:25] Starting GUI Server
[10:11:29] CoreStatus = 7A (122)
[10:11:29] Sending work to server



[10:11:36] Project: 5771 (Run 10, Clone 162, Gen 1315)
[10:11:36]
[10:11:36] Assembly optimizations on if available.
[10:11:36] Entering M.D.
[10:11:43] Working on Protein
[10:11:45] Client config found, loading data.
[10:11:45] Starting GUI Server
[10:11:45] mdrun_gpu returned
[10:11:45] NANs detected on GPU
[10:11:45]
[10:11:45] Folding@home Core Shutdown: UNSTABLE_MACHINE
[10:11:48] CoreStatus = 7A (122)
[10:11:48] Sending work to server
[10:11:48] Project: 5771 (Run 10, Clone 162, Gen 1315)
[10:11:48] - Error: Could not get length of results file work/wuresults_05.dat
[10:11:48] - Error: Could not read unit 05 file. Removing from queue.
[10:11:48] Trying to send all finished work units


[16:58:20] Project: 5771 (Run 10, Clone 162, Gen 1315)
[16:58:20]
[16:58:20] Assembly optimizations on if available.
[16:58:20] Entering M.D.
[16:58:28] Working on Protein
[16:58:30] Client config found, loading data.
[16:58:30] mdrun_gpu returned
[16:58:30] NANs detected on GPU
[16:58:30]
[16:58:30] Folding@home Core Shutdown: UNSTABLE_MACHINE
[16:58:34] CoreStatus = 7A (122)
[16:58:34] Sending work to server
[16:58:34] Project: 5771 (Run 10, Clone 162, Gen 1315)
[16:58:34] - Error: Could not get length of results file work/wuresults_07.dat
[16:58:34] - Error: Could not read unit 07 file. Removing from queue.



[16:58:53]
[16:58:53] Project: 5768 (Run 6, Clone 207, Gen 417)
[16:58:53]
[16:58:53] Assembly optimizations on if available.
[16:58:53] Entering M.D.
[16:59:00] Working on Protein
[16:59:02] Client config found, loading data.
[16:59:02] Starting GUI Server
[17:03:40] Completed 1%
[19:42:38] Completed 36%
[19:42:39] mdrun_gpu returned
[19:42:39] NANs detected on GPU
[19:42:39]
[19:42:39] Folding@home Core Shutdown: UNSTABLE_MACHINE
[19:42:44] CoreStatus = 7A (122)
[19:42:44] Sending work to server


[00:09:34] Project: 5771 (Run 8, Clone 140, Gen 768)
[00:09:34]
[00:09:34] Assembly optimizations on if available.
[00:09:34] Entering M.D.
[00:09:41] Working on Protein
[00:09:43] Client config found, loading data.
[00:09:43] Starting GUI Server
[04:41:28] Completed 74%
[04:45:04] Run: exception thrown during GuardedRun
[04:45:04] Run: exception thrown in GuardedRun -- Gromacs cannot continue further.
[04:45:04] Going to send back what have done -- stepsTotalG=15000000
[04:45:04] Work fraction=0.7492 steps=15000000.

[06:22:31] Project: 5914 (Run 10, Clone 614, Gen 1)
[06:22:31]
[06:22:31] Assembly optimizations on if available.
[06:22:31] Entering M.D.
[06:22:37] Tpr hash work/wudata_02.tpr:  2140297399 1674546578 1818721312 3839498596 1145642235
[06:22:38] Working on Protein
[06:22:40] Client config found, loading data.
[06:22:40] Starting GUI Server
[18:27:54] Completed 29%
[18:27:56] mdrun_gpu returned
[18:27:56] NANs detected on GPU
[18:27:56]
[18:27:56] Folding@home Core Shutdown: UNSTABLE_MACHINE
[18:28:00] CoreStatus = 7A (122)
[18:28:00] Sending work to server
[18:28:00] Project: 5914 (Run 10, Clone 614, Gen 1)
[18:28:00] - Error: Could not get length of results file work/wuresults_02.dat
[18:28:00] - Error: Could not read unit 02 file. Removing from queue.

[18:28:08] Project: 5791 (Run 0, Clone 318, Gen 9)
[18:28:08]
[18:28:08] Assembly optimizations on if available.
[18:28:08] Entering M.D.
[18:28:14] Working on Protein
[18:28:18] Client config found, loading data.
[18:28:18] Starting GUI Server
[18:28:18] mdrun_gpu returned
[18:28:18] SHAKE violations on GPU
[18:28:18]
[18:28:18] Folding@home Core Shutdown: UNSTABLE_MACHINE

[18:28:29] Project: 5791 (Run 0, Clone 318, Gen 9)
[18:28:29]
[18:28:29] Assembly optimizations on if available.
[18:28:29] Entering M.D.
[18:28:35] Working on Protein
[18:28:38] Client config found, loading data.
[18:28:38] Starting GUI Server
[18:28:39] mdrun_gpu returned
[18:28:39] SHAKE violations on GPU
[18:28:39]
[18:28:39] Folding@home Core Shutdown: UNSTABLE_MACHINE
[18:28:42] CoreStatus = 7A (122)
[18:28:42] Sending work to server
[18:28:42] Project: 5791 (Run 0, Clone 318, Gen 9)
[18:28:42] - Error: Could not get length of results file work/wuresults_04.dat
[18:28:42] - Error: Could not read unit 04 file. Removing from queue.
[18:28:42] Trying to send all finished work units

[18:28:50] Project: 5791 (Run 0, Clone 318, Gen 9)
[18:28:50]
[18:28:50] Assembly optimizations on if available.
[18:28:50] Entering M.D.
[18:28:56] Working on Protein
[18:28:59] Client config found, loading data.
[18:29:00] Starting GUI Server
[18:29:00] mdrun_gpu returned
[18:29:00] SHAKE violations on GPU
[18:29:00]
[18:29:00] Folding@home Core Shutdown: UNSTABLE_MACHINE
[18:29:04] CoreStatus = 7A (122)
[18:29:04] Sending work to server
[18:29:04] Project: 5791 (Run 0, Clone 318, Gen 9)

efok
 
Posts: 2
Joined: Wed Nov 18, 2009 8:04 pm

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby ultrason » Fri Nov 20, 2009 11:04 am

Failing projects: 5789,5771,5767......

Failing Hardware: 9800GTX

Failing OS: Windows 7 Ultimate 64 bits

Failing driver: 186.18
ultrason
 
Posts: 1
Joined: Fri Nov 20, 2009 10:57 am

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby ScienceKid » Sun Nov 22, 2009 4:22 pm

Hi all. :)
Since updating ForceWare 191.xx to 195.55 beta i dont seem to se any failing projects!
I just changed from GPU-Z 3.6 to 3.7 and with this new tool GPUmemory tells something new to me. The senser did not register any memory load with failing projects, but, now with 195.55 everything for now seems to be perfect... ??

191.xx:
Opening Log file [November 21 18:49:58 UTC]
Project: 5768 (Run 14, Clone 227, Gen 448) NANs detected on GPU

Project: 5772 (Run 11, Clone 75, Gen 804) OK
Project: 5913 (Run 3, Clone 631, Gen 3) OK

195.55:
Opening Log file [November 22 08:39:17 UTC] (New driver: Forcewave 195.55)
Project: 5913 (Run 3, Clone 631, Gen 3) OK
Project: 5767 (Run 9, Clone 51, Gen 982) OK
Project: 5766 (Run 4, Clone 321, Gen 1375) OK
Project: 5769 (Run 1, Clone 60, Gen 653) OK
Project: 5771 (Run 6, Clone 5, Gen 1452) OK
Project: 5768 (Run 14, Clone 172, Gen 555) OK

Older data: (still 191.xx)
Project: 5768 (Run 3, Clone 37, Gen 867) NANs detected on GPU
Project: 5766 (Run 0, Clone 49, Gen 1425) NANs detected on GPU
Project: 5772 (Run 3, Clone 207, Gen 1417) OK
ScienceKid
 
Posts: 8
Joined: Sat Sep 06, 2008 1:30 pm
Location: Aarhus, Denmark

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby HaloJones » Mon Nov 23, 2009 9:54 pm

This set me thinking and I've seen very different behaviour with the same hardware but differing Forceware drivers. Don't have conclusions yet but I think there are real problems with some units and some driver versions.
1x Titan X, 1x 1070ti, 4x 1070
HaloJones
 
Posts: 349
Joined: Thu Jul 24, 2008 10:16 am

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby HaloJones » Tue Nov 24, 2009 8:19 am

So having reverted to 191.07, Project: 5914 (Run 0, Clone 633, Gen 7) is up to 87% completed on a board that wouldn't run anything past 5% on any other version of the drivers.

I really don't get this. I am starting to believe that there is nothing wrong with a card I have already paid to replace.
HaloJones
 
Posts: 349
Joined: Thu Jul 24, 2008 10:16 am

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby HaloJones » Tue Nov 24, 2009 8:18 pm

Not sure what I'm "proving" here. FahCore_14 unit completed successfully with 191.07 but subsequent FahCore_11 units all EUE.

Replaced card with an identical 256MB 8800GT model, same drivers and it's currently running a FahCore_11 unit.

More later...

(I hope you're all riveted by this exciting analysis?)
HaloJones
 
Posts: 349
Joined: Thu Jul 24, 2008 10:16 am

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby ScienceKid » Tue Nov 24, 2009 8:39 pm

Hmm new situation again :(
Vista 32bit, 195.55 ForceWare, 260 GTX

Project: 5769 (Run 10, Clone 206, Gen 571) OK
Project: 5769 (Run 0, Clone 13, Gen 1542) OK
Project: 5772 (Run 6, Clone 134, Gen 877) OK
Project: 5766 (Run 12, Clone 416, Gen 1239) NANs detected on GPU
Project: 5772 (Run 5, Clone 49, Gen 1088) OK
Project: 5768 (Run 9, Clone 207, Gen 407) NANs detected on GPU
Project: 5770 (Run 8, Clone 63, Gen 556) OK
Project: 5766 (Run 0, Clone 123, Gen 597) NANs detected on GPU
Project: 5766 (Run 11, Clone 294, Gen 546) NANs detected on GPU
Project: 5770 (Run 2, Clone 146, Gen 714) OK
ScienceKid
 
Posts: 8
Joined: Sat Sep 06, 2008 1:30 pm
Location: Aarhus, Denmark

Re: [Please read] NaNs detected on GPU - UNSTABLE_MACHINE error

Postby MarkAGr » Thu Nov 26, 2009 8:34 am

Phenom II x4, 8GB RAM
Vista 64 Ultimate
2x9600GT underclocked -50% on shaders, gpu and memory
p5763, p5765, p5767, p5768, p5771 & p5772

:(
MarkAGr
 
Posts: 2
Joined: Mon Nov 16, 2009 6:03 am

PreviousNext

Return to NVIDIA specific issues

Who is online

Users browsing this forum: No registered users and 8 guests

cron