GTX 660 gpu_memory_error

It seems that a lot of GPU problems revolve around specific versions of drivers. Though NVidia has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
agwahlfridsson
Posts: 3
Joined: Mon Dec 03, 2012 9:09 pm

GTX 660 gpu_memory_error

Post by agwahlfridsson »

Hi all.
New to the forum but not to folding.
Recently built a newer rig (not stand alone folding) but have gotten problem with my GPU folding.
Installed the latest folding client 7.2.9, under windows 8 pro.
It worked very well for about 1 - 1.5 days, then the gpu failed to fold 2 tasks.
After trying again it does not even start, just states:
----------------------------------
21:14:08:WU00:FS00:0x15:Client config unavailable.
21:14:08:WU00:FS00:0x15:Finished fah_main status=59
21:14:08:WU00:FS00:0x15:mdrun_gpu returned 59
21:14:08:WU00:FS00:0x15:GPU memtest failure
21:14:08:WU00:FS00:0x15:
21:14:08:WU00:FS00:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
21:14:08:WARNING:WU00:FS00:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
----------------------------------
Asus Maximum Gene V MB with i7 3770k running @ stock.
Asus GTX660 TI-DC2-2GD5 running stock for this card.

I have tried:
- installing asus own driver nVIDIA Display Driver V306.23 WHQL
- installing NVIDIA ref driver 306.97 WHQL.
- installing the drivers with minimum addon as in only disply driver part.
no difference, still the same error.
- downloaded the latest GPUs.txt as advices in some forums, no difference.
- tried defining the gpu core id, no difference (just a long shot I read somewhere)
- tried running the memtestg80 software, but it just states "Error: No CUDA hardware detected. CUDA device emulator is not supported."
- tried lowering clock and gpu frequencies but no difference. temperatures where not high when it was working, stable at 68 degree celcius @ longtime load.

Running out of ideas.
Does anyone have any ideas or have the Asus GTX660 TI-DC2-2GD5 broken from 1 day of folding in 68 degree celcius?

Just as note. I'm very familiar with ESD and very certain I have not introduced any ESD damage or other damage to any components during the build.
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: GTX 660 gpu_memory_error

Post by P5-133XL »

May I suggest that you start out just testing the memory of the video card using http://folding.stanford.edu/English/DownloadUtils

P.S. Sometimes it is useful to see more of the log than just the error message if you want a reason.
Image
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: GTX 660 gpu_memory_error

Post by P5-133XL »

I just noticed that you have already tried memtestg80.

No CUDA HW detected -- implies driver issue. The CUDA SW is installed with the driver. No, just a minimum of a driver install is not enough since you need CUDA as well.

Since it was working, for 1-1.5 days, what changed? If you did nothing then did a Microsoft update install new drivers? Note, WDDM 1.2 contains new video drivers! see: viewtopic.php?f=80&t=23059&hilit=Windows+update#p230027
Image
agwahlfridsson
Posts: 3
Joined: Mon Dec 03, 2012 9:09 pm

Re: GTX 660 gpu_memory_error

Post by agwahlfridsson »

Thanks for really fast reply!

I did no changes to the system, nor got any information that the system had updated itself during that time.
Driver installation was always complete with everything selected, minimal driver installation was only a part of a long shot trouble shooting. (Read somewhere that some people were having issues with PhysX)

It started by the GPU folding failed. As in it was started (= memtest ok I guesss?) but failed during the operation.
After first restart it started to fold on the GPU again but again it failed.

After these to events it has always stated GPU_MEMORY_ERROR and never started folding again. So as far as I know, no changes were introduced to the system between successfully GPU folding and units starting to fail. Sorry am on business trip, but will be home tonight. I will swap my GPUs, (ATI HD6850 in the old system still running) with this and see if this new GPU start to work in the old computer (Win7 based if that has any influens.)

Thanks
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: GTX 660 gpu_memory_error

Post by P5-133XL »

Well something changed...

I'd still like to see the entire log as opposed to just the error. Stuff, like the specific project it was running on when it happend can matter.
Image
agwahlfridsson
Posts: 3
Joined: Mon Dec 03, 2012 9:09 pm

Re: GTX 660 gpu_memory_error

Post by agwahlfridsson »

Have returned home to fetch the logs you wanted but first time restart from home and it started gpu folding again.
I have no explaination for this :-(

Can controlling folding client software, through windows remote desktop, make it fail? That is my only theory. Will look more into this if it happenes again. I need 4 hours of sleep before returning to work :/

First try, avoid remote desktop and see if the gpu folding continues to work.

Anyhow thanks again for fast response to my issue, appriciated!
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: GTX 660 gpu_memory_error

Post by P5-133XL »

Absolutely. Remote desktop will cause GPU folding to fail. It resets the video subsystem of the destination machine. We recommend VNC as a replacement that does not cause folding to crash.

See viewtopic.php?f=43&t=3337
Image
JimF
Posts: 652
Joined: Thu Jan 21, 2010 2:03 pm

Re: GTX 660 gpu_memory_error

Post by JimF »

I now prefer LiteManager (free). It works well with Win7 64-bit.
http://www.litemanager.com/
rhavern
Posts: 425
Joined: Mon Dec 03, 2007 8:45 am
Location: UK

Re: GTX 660 gpu_memory_error

Post by rhavern »

And I like logmein, pick one you like and go with it. :)
Folding since 1 WU=1 point
ImageImage
mmonnin
Posts: 324
Joined: Wed Dec 05, 2007 1:27 am

Re: GTX 660 gpu_memory_error

Post by mmonnin »

Teamviewer for me.
uncle fuzzy
Posts: 460
Joined: Sun Dec 02, 2007 10:15 pm
Location: Michigan

Re: GTX 660 gpu_memory_error

Post by uncle fuzzy »

mmonnin wrote:Teamviewer for me.
Seconded.
rhavern
Posts: 425
Joined: Mon Dec 03, 2007 8:45 am
Location: UK

Re: GTX 660 gpu_memory_error

Post by rhavern »

Some of your decision comes down to how many machines you need to remotely access. All of the solutions offered will work with a single machine where you have control of the internet access security policy. Others work better with multiple machines and again maybe others where you do not control access policy. See which meets your requirements and go from there.
Folding since 1 WU=1 point
ImageImage
Arrgone
Posts: 6
Joined: Sat Dec 08, 2012 9:53 pm

Re: GTX 660 gpu_memory_error

Post by Arrgone »

I have Just had the same problem with my GTX 610 (2GB DDR3) and having read this subject through it helped me to understand what I had done wrong.

I installed WHS 2011 0n Friday 14th Dec. 2012 on a new PC, which activates remote access on PC's with windows 7 Ultimate or Professional editions only, My PC with the GTX 610 is running the Ultimate edition. I of course tried a remote access to it yesterday and it was at that time it broke the GTX 610 giving lots of MEMORY_ERROR messages. All five of my other PC's are running W7 Home Premium edition.

Last night after rebooting the GTX 610 PC and getting MEMORY test fail again I tried purging the gpu slot and set a new gpu slot. This also gave the memory test error so I set the gpu slot to paused. This morning (UK) after reading this subject I have un-paused the GPU slot and it is now folding again. I will NOT try a remote access to or from this PC again.

This is the log from after the reboot, I have trimmed it to get it to fit under word limit.

Code: Select all

*********************** Log Started 2012-12-15T22:09:00Z ***********************
22:09:00:WU02:FS01:Starting
22:09:00:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 02 -suffix 01 -version 702 -lifeline 4788 -checkpoint 15 -gpu 0
22:09:00:WU02:FS01:Started FahCore on PID 2408
22:09:00:WU02:FS01:Core PID:3144
22:09:00:WU02:FS01:FahCore 0x15 started
22:09:01:WU02:FS01:0x15:
22:09:01:WU02:FS01:0x15:*------------------------------*
22:09:01:WU02:FS01:0x15:Folding@Home GPU Core
22:09:01:WU02:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
22:09:01:WU02:FS01:0x15:Build host             AmoebaRemote
22:09:01:WU02:FS01:0x15:Board Type             NVIDIA/CUDA
22:09:01:WU02:FS01:0x15:Core                   15
22:09:01:WU02:FS01:0x15:
22:09:01:WU02:FS01:0x15:Window's signal control handler registered.
22:09:01:WU02:FS01:0x15:Preparing to commence simulation
22:09:01:WU02:FS01:0x15:- Looking at optimizations...
22:09:01:WU02:FS01:0x15:- Files status OK
22:09:01:WU02:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
22:09:01:WU02:FS01:0x15:- Expanded 56953 -> 257342 (decompressed 451.8 percent)
22:09:01:WU02:FS01:0x15:Called DecompressByteArray: compressed_data_size=56953 data_size=257342, decompressed_data_size=257342 diff=0
22:09:01:WU02:FS01:0x15:- Digital signature verified
22:09:01:WU02:FS01:0x15:
22:09:01:WU02:FS01:0x15:Project: 8072 (Run 0, Clone 418, Gen 26)
22:09:01:WU02:FS01:0x15:
22:09:01:WU02:FS01:0x15:Assembly optimizations on if available.
22:09:01:WU02:FS01:0x15:Entering M.D.
22:09:03:WU02:FS01:0x15:Will resume from checkpoint file 02/wudata_01.ckp
22:09:03:WU02:FS01:0x15:Tpr hash 02/wudata_01.tpr:  1342670174 1383150549 1028803388 978962291 3585974849
22:09:03:WU02:FS01:0x15:GPU device id=0
22:09:03:WARNING:WU02:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
22:09:03:WU02:FS01:Starting
22:09:03:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 02 -suffix 01 -version 702 -lifeline 4788 -checkpoint 15 -gpu 0
22:09:03:WU02:FS01:Started FahCore on PID 4440
22:09:03:WU02:FS01:Core PID:5668
22:09:03:WU02:FS01:FahCore 0x15 started
22:09:03:WU02:FS01:0x15:
22:09:03:WU02:FS01:0x15:*------------------------------*
22:09:03:WU02:FS01:0x15:Folding@Home GPU Core
22:09:03:WU02:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
22:09:03:WU02:FS01:0x15:Build host             AmoebaRemote
22:09:03:WU02:FS01:0x15:Board Type             NVIDIA/CUDA
22:09:03:WU02:FS01:0x15:Core                   15
22:09:03:WU02:FS01:0x15:
22:09:04:WU02:FS01:0x15:Window's signal control handler registered.
22:09:04:WU02:FS01:0x15:Preparing to commence simulation
22:09:04:WU02:FS01:0x15:- Looking at optimizations...
22:09:04:WU02:FS01:0x15:DeleteFrameFiles: successfully deleted file=02/wudata_01.ckp
22:09:04:WU02:FS01:0x15:- Created dyn
22:09:04:WU02:FS01:0x15:- Files status OK
22:09:04:WU02:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
22:09:04:WU02:FS01:0x15:- Expanded 56953 -> 257342 (decompressed 451.8 percent)
22:09:04:WU02:FS01:0x15:Called DecompressByteArray: compressed_data_size=56953 data_size=257342, decompressed_data_size=257342 diff=0
22:09:04:WU02:FS01:0x15:- Digital signature verified
22:09:04:WU02:FS01:0x15:
22:09:04:WU02:FS01:0x15:Project: 8072 (Run 0, Clone 418, Gen 26)
22:09:04:WU02:FS01:0x15:
22:09:04:WU02:FS01:0x15:Assembly optimizations on if available.
22:09:04:WU02:FS01:0x15:Entering M.D.
22:09:05:WU02:FS01:0x15:Tpr hash 02/wudata_01.tpr:  1342670174 1383150549 1028803388 978962291 3585974849
22:09:05:WU02:FS01:0x15:GPU device id=0
22:09:05:WU02:FS01:0x15:Working on Giving Russians Opium May Alter Current Situation
22:09:05:WU02:FS01:0x15:Client config unavailable.
22:09:05:WU02:FS01:0x15:Finished fah_main status=59
22:09:05:WU02:FS01:0x15:mdrun_gpu returned 59
22:09:05:WU02:FS01:0x15:GPU memtest failure
22:09:06:WU02:FS01:0x15:
22:09:06:WU02:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
22:09:06:WARNING:WU02:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
*********************** Log Started 2012-12-15T23:26:35Z ***********************
23:26:35:WU00:FS01:Connecting to assign-GPU.stanford.edu:80
23:26:36:WU00:FS01:News: Welcome to Folding@Home
23:26:36:WU00:FS01:Assigned to work server 171.67.108.36
23:26:36:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:"GF116 [GeForce GT 610]" from 171.67.108.36
23:26:36:WU00:FS01:Connecting to 171.67.108.36:8080
23:26:37:WU00:FS01:Downloading 59.56KiB
23:26:38:WU00:FS01:Download complete
23:26:38:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8074 run:57 clone:19 gen:11 core:0x15 unit:0x0000000f6652edb450b4312e9d1c15b4
23:26:38:WU00:FS01:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah
23:26:38:WU00:FS01:Connecting to www.stanford.edu:80
23:26:38:WU00:FS01:FahCore 15: Downloading 1.88MiB
23:26:44:WU00:FS01:FahCore 15: 43.32%
23:26:50:WU00:FS01:FahCore 15: 93.30%
23:26:50:WU00:FS01:FahCore 15: Download complete
23:26:50:WU00:FS01:Valid core signature
23:26:50:WARNING:WU00:FS01:FahCore has not changed since last download, aborting core update
23:26:50:WU00:FS01:Starting
23:26:50:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -gpu 0
23:26:51:WU00:FS01:Started FahCore on PID 5992
23:26:51:WU00:FS01:Core PID:2684
23:26:51:WU00:FS01:FahCore 0x15 started
23:26:51:WU00:FS01:Downloading project 8074 description
23:26:51:WU00:FS01:Connecting to fah-web.stanford.edu:80
23:26:51:WU00:FS01:0x15:
23:26:51:WU00:FS01:0x15:*------------------------------*
23:26:51:WU00:FS01:0x15:Folding@Home GPU Core
23:26:51:WU00:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
23:26:51:WU00:FS01:0x15:Build host             AmoebaRemote
23:26:51:WU00:FS01:0x15:Board Type             NVIDIA/CUDA
23:26:51:WU00:FS01:0x15:Core                   15
23:26:51:WU00:FS01:0x15:
23:26:51:WU00:FS01:0x15:Window's signal control handler registered.
23:26:51:WU00:FS01:0x15:Preparing to commence simulation
23:26:51:WU00:FS01:0x15:- Looking at optimizations...
23:26:51:WU00:FS01:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
23:26:51:WU00:FS01:0x15:- Created dyn
23:26:51:WU00:FS01:0x15:- Files status OK
23:26:51:WU00:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:26:51:WU00:FS01:0x15:- Expanded 60473 -> 264610 (decompressed 437.5 percent)
23:26:51:WU00:FS01:0x15:Called DecompressByteArray: compressed_data_size=60473 data_size=264610, decompressed_data_size=264610 diff=0
23:26:51:WU00:FS01:0x15:- Digital signature verified
23:26:51:WU00:FS01:0x15:
23:26:51:WU00:FS01:0x15:Project: 8074 (Run 57, Clone 19, Gen 11)
23:26:51:WU00:FS01:0x15:
23:26:51:WU00:FS01:0x15:Assembly optimizations on if available.
23:26:51:WU00:FS01:0x15:Entering M.D.
23:26:51:WU00:FS01:Project 8074 description downloaded successfully
23:26:53:WU00:FS01:0x15:Tpr hash 00/wudata_01.tpr:  503660661 208272441 2628625799 887819571 207319722
23:26:53:WU00:FS01:0x15:GPU device id=0
23:26:53:WU00:FS01:0x15:Working on Gromacs Runs One Microsecond At Cannonball Speeds
23:26:53:WU00:FS01:0x15:Client config unavailable.
23:26:53:WU00:FS01:0x15:Finished fah_main status=59
23:26:53:WU00:FS01:0x15:mdrun_gpu returned 59
23:26:53:WU00:FS01:0x15:GPU memtest failure
23:26:53:WU00:FS01:0x15:
23:26:53:WU00:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:26:53:WARNING:WU00:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:26:53:WU00:FS01:Starting
23:26:53:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -gpu 0
23:26:53:WU00:FS01:Started FahCore on PID 2576
23:26:53:WU00:FS01:Core PID:4084
23:26:53:WU00:FS01:FahCore 0x15 started
23:26:54:WU00:FS01:0x15:
23:26:54:WU00:FS01:0x15:*------------------------------*
<---
There was a number repeats of above I removed
--->
23:36:31:WU00:FS01:0xa4:*------------------------------*
23:36:31:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
23:36:31:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
23:36:31:WU00:FS01:0xa4:
23:36:31:WU00:FS01:0xa4:Preparing to commence simulation
23:36:31:WU00:FS01:0xa4:- Looking at optimizations...
23:36:31:WU00:FS01:0xa4:- Created dyn
23:36:31:WU00:FS01:0xa4:- Files status OK
23:36:31:WU00:FS01:Project 7809 description downloaded successfully
23:36:32:WU00:FS01:0xa4:- Expanded 2079252 -> 5386224 (decompressed 259.0 percent)
23:36:32:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=2079252 data_size=5386224, decompressed_data_size=5386224 diff=0
23:36:32:WU00:FS01:0xa4:- Digital signature verified
23:36:32:WU00:FS01:0xa4:
23:36:32:WU00:FS01:0xa4:Project: 7809 (Run 4, Clone 251, Gen 19)
23:36:32:WU00:FS01:0xa4:
23:36:32:WU00:FS01:0xa4:Assembly optimizations on if available.
23:36:32:WU00:FS01:0xa4:Entering M.D.
23:36:38:WU00:FS01:0xa4:Mapping NT from 2 to 2 
23:36:42:WU00:FS01:0xa4:Completed 0 out of 1500000 steps  (0%)
23:39:33:FS01:Shutting core down
23:39:39:WU00:FS01:0xa4:Client no longer detected. Shutting down core 
23:39:39:WU00:FS01:0xa4:
23:39:39:WU00:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
23:39:39:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
23:40:46:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
23:40:47:WU01:FS01:News: Welcome to Folding@Home
23:40:47:WU01:FS01:Assigned to work server 171.67.108.36
23:40:47:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:"GF116 [GeForce GT 610]" from 171.67.108.36
23:40:47:WU01:FS01:Connecting to 171.67.108.36:8080
23:40:48:WU01:FS01:Downloading 59.33KiB
23:40:48:WU01:FS01:Download complete
23:40:48:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8074 run:14 clone:11 gen:11 core:0x15 unit:0x0000000b6652edb450b43038445fce90
23:40:48:WU01:FS01:Starting
23:40:48:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -cpu 94 -gpu 0
23:40:48:WU01:FS01:Started FahCore on PID 5084
23:40:48:WU01:FS01:Core PID:5956
23:40:48:WU01:FS01:FahCore 0x15 started
23:40:49:WU01:FS01:0x15:
23:40:49:WU01:FS01:0x15:*------------------------------*
23:40:49:WU01:FS01:0x15:Folding@Home GPU Core
23:40:49:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
23:40:49:WU01:FS01:0x15:Build host             AmoebaRemote
23:40:49:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
23:40:49:WU01:FS01:0x15:Core                   15
23:40:49:WU01:FS01:0x15:
23:40:49:WU01:FS01:0x15:Window's signal control handler registered.
23:40:49:WU01:FS01:0x15:Preparing to commence simulation
23:40:49:WU01:FS01:0x15:- Looking at optimizations...
23:40:49:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
23:40:49:WU01:FS01:0x15:- Created dyn
23:40:49:WU01:FS01:0x15:- Files status OK
23:40:49:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:40:49:WU01:FS01:0x15:- Expanded 60244 -> 264602 (decompressed 439.2 percent)
23:40:49:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=60244 data_size=264602, decompressed_data_size=264602 diff=0
23:40:49:WU01:FS01:0x15:- Digital signature verified
23:40:49:WU01:FS01:0x15:
23:40:49:WU01:FS01:0x15:Project: 8074 (Run 14, Clone 11, Gen 11)
23:40:49:WU01:FS01:0x15:
23:40:49:WU01:FS01:0x15:Assembly optimizations on if available.
23:40:49:WU01:FS01:0x15:Entering M.D.
23:40:51:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  682874204 1901493450 1679110643 2817504050 2097985344
23:40:51:WU01:FS01:0x15:GPU device id=0
23:40:51:WU01:FS01:0x15:Working on GROningen MAchine for Chemical Simulation
23:40:51:WU01:FS01:0x15:Client config unavailable.
23:40:51:WU01:FS01:0x15:Finished fah_main status=59
23:40:51:WU01:FS01:0x15:mdrun_gpu returned 59
23:40:51:WU01:FS01:0x15:GPU memtest failure
23:40:51:WU01:FS01:0x15:
23:40:51:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:51:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:40:51:WU01:FS01:Starting
23:40:51:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -cpu 94 -gpu 0
23:40:51:WU01:FS01:Started FahCore on PID 2388
23:40:52:WU01:FS01:Core PID:1088
23:40:52:WU01:FS01:FahCore 0x15 started
23:40:52:WU01:FS01:0x15:
23:40:52:WU01:FS01:0x15:*------------------------------*
23:40:52:WU01:FS01:0x15:Folding@Home GPU Core
23:40:52:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
23:40:52:WU01:FS01:0x15:Build host             AmoebaRemote
23:40:52:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
23:40:52:WU01:FS01:0x15:Core                   15
23:40:52:WU01:FS01:0x15:
23:40:52:WU01:FS01:0x15:Window's signal control handler registered.
23:40:52:WU01:FS01:0x15:Preparing to commence simulation
23:40:52:WU01:FS01:0x15:- Looking at optimizations...
23:40:52:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
23:40:52:WU01:FS01:0x15:- Created dyn
23:40:52:WU01:FS01:0x15:- Files status OK
23:40:52:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:40:52:WU01:FS01:0x15:- Expanded 60244 -> 264602 (decompressed 439.2 percent)
23:40:52:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=60244 data_size=264602, decompressed_data_size=264602 diff=0
23:40:52:WU01:FS01:0x15:- Digital signature verified
23:40:52:WU01:FS01:0x15:
23:40:52:WU01:FS01:0x15:Project: 8074 (Run 14, Clone 11, Gen 11)
23:40:52:WU01:FS01:0x15:
23:40:52:WU01:FS01:0x15:Assembly optimizations on if available.
23:40:52:WU01:FS01:0x15:Entering M.D.
23:40:54:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  682874204 1901493450 1679110643 2817504050 2097985344
23:40:54:WU01:FS01:0x15:GPU device id=0
23:40:54:WU01:FS01:0x15:Working on GROningen MAchine for Chemical Simulation
23:40:54:WU01:FS01:0x15:Client config unavailable.
23:40:54:WU01:FS01:0x15:Finished fah_main status=59
23:40:54:WU01:FS01:0x15:mdrun_gpu returned 59
23:40:54:WU01:FS01:0x15:GPU memtest failure
23:40:54:WU01:FS01:0x15:
23:40:54:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:54:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:41:52:WU01:FS01:Starting
23:41:52:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -cpu 94 -gpu 0
23:41:52:WU01:FS01:Started FahCore on PID 6024
23:41:52:WU01:FS01:Core PID:2744
23:41:52:WU01:FS01:FahCore 0x15 started
23:41:52:WU01:FS01:0x15:
<---
More repeats deleted
--->
23:43:29:WU01:FS01:Started FahCore on PID 6008
23:43:29:WU01:FS01:Core PID:1920
23:43:29:WU01:FS01:FahCore 0x15 started
23:43:29:WU01:FS01:0x15:
23:43:29:WU01:FS01:0x15:*------------------------------*
23:43:29:WU01:FS01:0x15:Folding@Home GPU Core
23:43:29:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
23:43:29:WU01:FS01:0x15:Build host             AmoebaRemote
23:43:29:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
23:43:29:WU01:FS01:0x15:Core                   15
23:43:29:WU01:FS01:0x15:
23:43:29:WU01:FS01:0x15:Window's signal control handler registered.
23:43:29:WU01:FS01:0x15:Preparing to commence simulation
23:43:29:WU01:FS01:0x15:- Looking at optimizations...
23:43:29:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
23:43:30:WU01:FS01:0x15:- Created dyn
23:43:30:WU01:FS01:0x15:- Files status OK
23:43:30:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:43:30:WU01:FS01:0x15:- Expanded 60244 -> 264602 (decompressed 439.2 percent)
23:43:30:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=60244 data_size=264602, decompressed_data_size=264602 diff=0
23:43:30:WU01:FS01:0x15:- Digital signature verified
23:43:30:WU01:FS01:0x15:
23:43:30:WU01:FS01:0x15:Project: 8074 (Run 14, Clone 11, Gen 11)
23:43:30:WU01:FS01:0x15:
23:43:30:WU01:FS01:0x15:Assembly optimizations on if available.
23:43:30:WU01:FS01:0x15:Entering M.D.
23:43:32:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  682874204 1901493450 1679110643 2817504050 2097985344
23:43:32:WU01:FS01:0x15:GPU device id=0
23:43:32:WU01:FS01:0x15:Working on GROningen MAchine for Chemical Simulation
23:43:32:WU01:FS01:0x15:Client config unavailable.
23:43:32:WU01:FS01:0x15:Finished fah_main status=59
23:43:32:WU01:FS01:0x15:mdrun_gpu returned 59
23:43:32:WU01:FS01:0x15:GPU memtest failure
23:43:32:WU01:FS01:0x15:
23:43:32:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:43:32:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:44:10:FS01:Paused
******************************** Date: 16/12/12 ********************************
******************************** Date: 16/12/12 ********************************
12:23:04:FS01:Unpaused
12:23:04:WU01:FS01:Starting
12:23:04:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/xxxx/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 3712 -checkpoint 15 -cpu 94 -gpu 0
12:23:04:WU01:FS01:Started FahCore on PID 3196
12:23:04:WU01:FS01:Core PID:5148
12:23:04:WU01:FS01:FahCore 0x15 started
12:23:05:WU01:FS01:0x15:
12:23:05:WU01:FS01:0x15:*------------------------------*
12:23:05:WU01:FS01:0x15:Folding@Home GPU Core
12:23:05:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
12:23:05:WU01:FS01:0x15:Build host             AmoebaRemote
12:23:05:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
12:23:05:WU01:FS01:0x15:Core                   15
12:23:05:WU01:FS01:0x15:
12:23:05:WU01:FS01:0x15:Window's signal control handler registered.
12:23:05:WU01:FS01:0x15:Preparing to commence simulation
12:23:05:WU01:FS01:0x15:- Looking at optimizations...
12:23:05:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
12:23:05:WU01:FS01:0x15:- Created dyn
12:23:05:WU01:FS01:0x15:- Files status OK
12:23:05:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
12:23:05:WU01:FS01:0x15:- Expanded 60244 -> 264602 (decompressed 439.2 percent)
12:23:05:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=60244 data_size=264602, decompressed_data_size=264602 diff=0
12:23:05:WU01:FS01:0x15:- Digital signature verified
12:23:05:WU01:FS01:0x15:
12:23:05:WU01:FS01:0x15:Project: 8074 (Run 14, Clone 11, Gen 11)
12:23:05:WU01:FS01:0x15:
12:23:05:WU01:FS01:0x15:Assembly optimizations on if available.
12:23:05:WU01:FS01:0x15:Entering M.D.
12:23:07:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  682874204 1901493450 1679110643 2817504050 2097985344
12:23:07:WU01:FS01:0x15:GPU device id=0
12:23:07:WU01:FS01:0x15:Working on GROningen MAchine for Chemical Simulation
12:23:07:WU01:FS01:0x15:Client config unavailable.
12:23:07:WU01:FS01:0x15:Starting GUI Server
12:24:13:WU01:FS01:0x15:Setting checkpoint frequency: 500000
12:24:13:WU01:FS01:0x15:Completed         3 out of 50000000 steps (0%).
12:41:17:WU01:FS01:0x15:Completed    500000 out of 50000000 steps (1%).
12:58:22:WU01:FS01:0x15:Completed   1000000 out of 50000000 steps (2%).
13:15:27:WU01:FS01:0x15:Completed   1500000 out of 50000000 steps (3%).
I Hope this helps someone else.
Arrgone
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: GTX 660 gpu_memory_error

Post by P5-133XL »

You can remote in, just don't use Microsoft's Remote Desktop. Use a free version of VNC or Team Viewer...
Image
Post Reply