75XX Project issues (crashes, too many steps etc.)

Moderators: Site Moderators, FAHC Science Team

jimerickson
Posts: 533
Joined: Tue May 27, 2008 11:56 pm
Hardware configuration: Parts:
Asus H370 Mining Master motherboard (X2)
Patriot Viper DDR4 memory 16gb stick (X4)
Nvidia GeForce GTX 1080 gpu (X16)
Intel Core i7 8700 cpu (X2)
Silverstone 1000 watt psu (X4)
Veddha 8 gpu miner case (X2)
Thermaltake hsf (X2)
Ubit riser card (X16)
Location: ames, iowa

Project: 7516 (Run 0, Clone 114, Gen 9) endless loop

Post by jimerickson »

Code: Select all

21:26:39:WU01:FS00:0xa3:
21:26:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:26:39:WU01:FS00:0xa3:
21:26:39:WU01:FS00:0xa3:Entering M.D.
21:26:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:26:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:26:48:WU02:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
21:27:02:WU03:FS04:0x17:Completed 1700000 out of 5000000 steps (34%)
21:27:03:WU06:FS01:0x17:Completed 500000 out of 5000000 steps (10%)
21:27:29:WU01:FS00:Starting
21:27:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:27:29:WU01:FS00:Started FahCore on PID 9479
21:27:29:WU01:FS00:Core PID:9483
21:27:29:WU01:FS00:FahCore 0xa3 started
21:27:30:WU01:FS00:0xa3:
21:27:30:WU01:FS00:0xa3:*------------------------------*
21:27:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:27:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:27:30:WU01:FS00:0xa3:
21:27:30:WU01:FS00:0xa3:Preparing to commence simulation
21:27:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:27:39:WU01:FS00:0xa3:- Looking at optimizations...
21:27:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:27:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:27:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:27:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:27:39:WU01:FS00:0xa3:- Digital signature verified
21:27:39:WU01:FS00:0xa3:
21:27:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:27:39:WU01:FS00:0xa3:
21:27:39:WU01:FS00:0xa3:Entering M.D.
21:27:45:WU00:FS02:0x17:Completed 1750000 out of 5000000 steps (35%)
21:27:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:27:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:28:29:WU01:FS00:Starting
21:28:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:28:29:WU01:FS00:Started FahCore on PID 9509
21:28:29:WU01:FS00:Core PID:9513
21:28:29:WU01:FS00:FahCore 0xa3 started
21:28:30:WU01:FS00:0xa3:
21:28:30:WU01:FS00:0xa3:*------------------------------*
21:28:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:28:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:28:30:WU01:FS00:0xa3:
21:28:30:WU01:FS00:0xa3:Preparing to commence simulation
21:28:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:28:32:WU02:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
21:28:38:WU06:FS01:0x17:Completed 550000 out of 5000000 steps (11%)
21:28:39:WU01:FS00:0xa3:- Looking at optimizations...
21:28:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:28:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:28:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:28:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:28:39:WU01:FS00:0xa3:- Digital signature verified
21:28:39:WU01:FS00:0xa3:
21:28:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:28:39:WU01:FS00:0xa3:
21:28:39:WU01:FS00:0xa3:Entering M.D.
21:28:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:28:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:28:47:WU03:FS04:0x17:Completed 1750000 out of 5000000 steps (35%)
21:29:29:WU01:FS00:Starting
21:29:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:29:29:WU01:FS00:Started FahCore on PID 9521
21:29:29:WU01:FS00:Core PID:9525
21:29:29:WU01:FS00:FahCore 0xa3 started
21:29:29:WU00:FS02:0x17:Completed 1800000 out of 5000000 steps (36%)
21:29:30:WU01:FS00:0xa3:
21:29:30:WU01:FS00:0xa3:*------------------------------*
21:29:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:29:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:29:30:WU01:FS00:0xa3:
21:29:30:WU01:FS00:0xa3:Preparing to commence simulation
21:29:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:29:39:WU01:FS00:0xa3:- Looking at optimizations...
21:29:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:29:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:29:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:29:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:29:39:WU01:FS00:0xa3:- Digital signature verified
21:29:39:WU01:FS00:0xa3:
21:29:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:29:39:WU01:FS00:0xa3:
21:29:39:WU01:FS00:0xa3:Entering M.D.
21:29:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:29:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:30:13:WU06:FS01:0x17:Completed 600000 out of 5000000 steps (12%)
21:30:17:WU02:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
21:30:29:WU01:FS00:Starting
21:30:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:30:29:WU01:FS00:Started FahCore on PID 9533
21:30:29:WU01:FS00:Core PID:9537
21:30:29:WU01:FS00:FahCore 0xa3 started
21:30:30:WU01:FS00:0xa3:
21:30:30:WU01:FS00:0xa3:*------------------------------*
21:30:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:30:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:30:30:WU01:FS00:0xa3:
21:30:30:WU01:FS00:0xa3:Preparing to commence simulation
21:30:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:30:32:WU03:FS04:0x17:Completed 1800000 out of 5000000 steps (36%)
21:30:39:WU01:FS00:0xa3:- Looking at optimizations...
21:30:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:30:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:30:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:30:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:30:39:WU01:FS00:0xa3:- Digital signature verified
21:30:39:WU01:FS00:0xa3:
21:30:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:30:39:WU01:FS00:0xa3:
21:30:39:WU01:FS00:0xa3:Entering M.D.
21:30:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:30:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:31:14:WU00:FS02:0x17:Completed 1850000 out of 5000000 steps (37%)
21:31:29:WU01:FS00:Starting
21:31:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:31:29:WU01:FS00:Started FahCore on PID 9545
21:31:29:WU01:FS00:Core PID:9549
21:31:29:WU01:FS00:FahCore 0xa3 started
21:31:30:WU01:FS00:0xa3:
21:31:30:WU01:FS00:0xa3:*------------------------------*
21:31:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:31:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:31:30:WU01:FS00:0xa3:
21:31:30:WU01:FS00:0xa3:Preparing to commence simulation
21:31:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:31:39:WU01:FS00:0xa3:- Looking at optimizations...
21:31:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:31:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:31:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:31:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:31:39:WU01:FS00:0xa3:- Digital signature verified
21:31:39:WU01:FS00:0xa3:
21:31:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:31:39:WU01:FS00:0xa3:
21:31:39:WU01:FS00:0xa3:Entering M.D.
21:31:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:31:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:31:48:WU06:FS01:0x17:Completed 650000 out of 5000000 steps (13%)
21:32:02:WU02:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
21:32:16:WU03:FS04:0x17:Completed 1850000 out of 5000000 steps (37%)
21:32:29:WU01:FS00:Starting
21:32:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:32:29:WU01:FS00:Started FahCore on PID 9557
21:32:29:WU01:FS00:Core PID:9561
21:32:29:WU01:FS00:FahCore 0xa3 started
21:32:30:WU01:FS00:0xa3:
21:32:30:WU01:FS00:0xa3:*------------------------------*
21:32:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:32:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:32:30:WU01:FS00:0xa3:
21:32:30:WU01:FS00:0xa3:Preparing to commence simulation
21:32:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:32:39:WU01:FS00:0xa3:- Looking at optimizations...
21:32:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:32:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:32:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:32:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:32:39:WU01:FS00:0xa3:- Digital signature verified
21:32:39:WU01:FS00:0xa3:
21:32:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:32:39:WU01:FS00:0xa3:
21:32:39:WU01:FS00:0xa3:Entering M.D.
21:32:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:32:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:32:58:WU00:FS02:0x17:Completed 1900000 out of 5000000 steps (38%)
21:33:23:WU06:FS01:0x17:Completed 700000 out of 5000000 steps (14%)
21:33:29:WU01:FS00:Starting
21:33:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:33:29:WU01:FS00:Started FahCore on PID 9571
21:33:29:WU01:FS00:Core PID:9575
21:33:29:WU01:FS00:FahCore 0xa3 started
21:33:30:WU01:FS00:0xa3:
21:33:30:WU01:FS00:0xa3:*------------------------------*
21:33:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:33:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:33:30:WU01:FS00:0xa3:
21:33:30:WU01:FS00:0xa3:Preparing to commence simulation
21:33:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:33:39:WU01:FS00:0xa3:- Looking at optimizations...
21:33:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:33:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:33:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:33:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:33:39:WU01:FS00:0xa3:- Digital signature verified
21:33:39:WU01:FS00:0xa3:
21:33:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:33:39:WU01:FS00:0xa3:
21:33:39:WU01:FS00:0xa3:Entering M.D.
21:33:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:33:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:33:47:WU02:FS03:0x17:Completed 1900000 out of 5000000 steps (38%)
21:34:01:WU03:FS04:0x17:Completed 1900000 out of 5000000 steps (38%)
21:34:29:WU01:FS00:Starting
21:34:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:34:29:WU01:FS00:Started FahCore on PID 9583
21:34:29:WU01:FS00:Core PID:9587
21:34:29:WU01:FS00:FahCore 0xa3 started
21:34:30:WU01:FS00:0xa3:
21:34:30:WU01:FS00:0xa3:*------------------------------*
21:34:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:34:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:34:30:WU01:FS00:0xa3:
21:34:30:WU01:FS00:0xa3:Preparing to commence simulation
21:34:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:34:39:WU01:FS00:0xa3:- Looking at optimizations...
21:34:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:34:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:34:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:34:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:34:39:WU01:FS00:0xa3:- Digital signature verified
21:34:39:WU01:FS00:0xa3:
21:34:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:34:39:WU01:FS00:0xa3:
21:34:39:WU01:FS00:0xa3:Entering M.D.
21:34:43:WU00:FS02:0x17:Completed 1950000 out of 5000000 steps (39%)
21:34:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:34:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:34:58:WU06:FS01:0x17:Completed 750000 out of 5000000 steps (15%)
21:35:29:WU01:FS00:Starting
21:35:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:35:29:WU01:FS00:Started FahCore on PID 9595
21:35:29:WU01:FS00:Core PID:9599
21:35:29:WU01:FS00:FahCore 0xa3 started
21:35:30:WU01:FS00:0xa3:
21:35:30:WU01:FS00:0xa3:*------------------------------*
21:35:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:35:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:35:30:WU01:FS00:0xa3:
21:35:30:WU01:FS00:0xa3:Preparing to commence simulation
21:35:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:35:31:WU02:FS03:0x17:Completed 1950000 out of 5000000 steps (39%)
21:35:39:WU01:FS00:0xa3:- Looking at optimizations...
21:35:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:35:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:35:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:35:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:35:39:WU01:FS00:0xa3:- Digital signature verified
21:35:39:WU01:FS00:0xa3:
21:35:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:35:39:WU01:FS00:0xa3:
21:35:39:WU01:FS00:0xa3:Entering M.D.
21:35:45:WU03:FS04:0x17:Completed 1950000 out of 5000000 steps (39%)
21:35:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:35:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:36:28:WU00:FS02:0x17:Completed 2000000 out of 5000000 steps (40%)
21:36:29:WU01:FS00:Starting
21:36:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:36:29:WU01:FS00:Started FahCore on PID 9607
21:36:29:WU01:FS00:Core PID:9611
21:36:29:WU01:FS00:FahCore 0xa3 started
21:36:30:WU01:FS00:0xa3:
21:36:30:WU01:FS00:0xa3:*------------------------------*
21:36:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:36:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:36:30:WU01:FS00:0xa3:
21:36:30:WU01:FS00:0xa3:Preparing to commence simulation
21:36:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:36:34:WU06:FS01:0x17:Completed 800000 out of 5000000 steps (16%)
21:36:39:WU01:FS00:0xa3:- Looking at optimizations...
21:36:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:36:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:36:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:36:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:36:39:WU01:FS00:0xa3:- Digital signature verified
21:36:39:WU01:FS00:0xa3:
21:36:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:36:39:WU01:FS00:0xa3:
21:36:39:WU01:FS00:0xa3:Entering M.D.
21:36:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:36:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:37:16:WU02:FS03:0x17:Completed 2000000 out of 5000000 steps (40%)
21:37:29:WU01:FS00:Starting
21:37:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:37:29:WU01:FS00:Started FahCore on PID 9619
21:37:29:WU01:FS00:Core PID:9623
21:37:29:WU01:FS00:FahCore 0xa3 started
21:37:30:WU01:FS00:0xa3:
21:37:30:WU01:FS00:0xa3:*------------------------------*
21:37:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:37:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:37:30:WU01:FS00:0xa3:
21:37:30:WU01:FS00:0xa3:Preparing to commence simulation
21:37:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:37:30:WU03:FS04:0x17:Completed 2000000 out of 5000000 steps (40%)
21:37:39:WU01:FS00:0xa3:- Looking at optimizations...
21:37:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:37:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:37:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:37:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:37:39:WU01:FS00:0xa3:- Digital signature verified
21:37:39:WU01:FS00:0xa3:
21:37:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:37:39:WU01:FS00:0xa3:
21:37:39:WU01:FS00:0xa3:Entering M.D.
21:37:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:37:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:38:09:WU06:FS01:0x17:Completed 850000 out of 5000000 steps (17%)
21:38:12:WU00:FS02:0x17:Completed 2050000 out of 5000000 steps (41%)
21:38:29:WU01:FS00:Starting
21:38:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:38:29:WU01:FS00:Started FahCore on PID 9632
21:38:29:WU01:FS00:Core PID:9636
21:38:29:WU01:FS00:FahCore 0xa3 started
21:38:30:WU01:FS00:0xa3:
21:38:30:WU01:FS00:0xa3:*------------------------------*
21:38:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:38:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:38:30:WU01:FS00:0xa3:
21:38:30:WU01:FS00:0xa3:Preparing to commence simulation
21:38:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:38:39:WU01:FS00:0xa3:- Looking at optimizations...
21:38:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:38:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:38:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:38:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:38:39:WU01:FS00:0xa3:- Digital signature verified
21:38:39:WU01:FS00:0xa3:
21:38:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:38:39:WU01:FS00:0xa3:
21:38:39:WU01:FS00:0xa3:Entering M.D.
21:38:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:38:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:39:01:WU02:FS03:0x17:Completed 2050000 out of 5000000 steps (41%)
21:39:15:WU03:FS04:0x17:Completed 2050000 out of 5000000 steps (41%)
21:39:29:WU01:FS00:Starting
21:39:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:39:29:WU01:FS00:Started FahCore on PID 9651
21:39:29:WU01:FS00:Core PID:9655
21:39:29:WU01:FS00:FahCore 0xa3 started
21:39:30:WU01:FS00:0xa3:
21:39:30:WU01:FS00:0xa3:*------------------------------*
21:39:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:39:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:39:30:WU01:FS00:0xa3:
21:39:30:WU01:FS00:0xa3:Preparing to commence simulation
21:39:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:39:39:WU01:FS00:0xa3:- Looking at optimizations...
21:39:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:39:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:39:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:39:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:39:39:WU01:FS00:0xa3:- Digital signature verified
21:39:39:WU01:FS00:0xa3:
21:39:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:39:39:WU01:FS00:0xa3:
21:39:39:WU01:FS00:0xa3:Entering M.D.
21:39:44:WU06:FS01:0x17:Completed 900000 out of 5000000 steps (18%)
21:39:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:39:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:39:57:WU00:FS02:0x17:Completed 2100000 out of 5000000 steps (42%)
21:40:29:WU01:FS00:Starting
21:40:29:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:40:29:WU01:FS00:Started FahCore on PID 9663
21:40:29:WU01:FS00:Core PID:9667
21:40:29:WU01:FS00:FahCore 0xa3 started
21:40:30:WU01:FS00:0xa3:
21:40:30:WU01:FS00:0xa3:*------------------------------*
21:40:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:40:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:40:30:WU01:FS00:0xa3:
21:40:30:WU01:FS00:0xa3:Preparing to commence simulation
21:40:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:40:39:WU01:FS00:0xa3:- Looking at optimizations...
21:40:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:40:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:40:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:40:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:40:39:WU01:FS00:0xa3:- Digital signature verified
21:40:39:WU01:FS00:0xa3:
21:40:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:40:39:WU01:FS00:0xa3:
21:40:39:WU01:FS00:0xa3:Entering M.D.
21:40:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:40:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:40:46:WU02:FS03:0x17:Completed 2100000 out of 5000000 steps (42%)
21:40:59:WU03:FS04:0x17:Completed 2100000 out of 5000000 steps (42%)
21:41:19:WU06:FS01:0x17:Completed 950000 out of 5000000 steps (19%)
21:41:30:WU01:FS00:Starting
21:41:30:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:41:30:WU01:FS00:Started FahCore on PID 9675
21:41:30:WU01:FS00:Core PID:9679
21:41:30:WU01:FS00:FahCore 0xa3 started
21:41:30:WU01:FS00:0xa3:
21:41:30:WU01:FS00:0xa3:*------------------------------*
21:41:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:41:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:41:30:WU01:FS00:0xa3:
21:41:30:WU01:FS00:0xa3:Preparing to commence simulation
21:41:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:41:39:WU01:FS00:0xa3:- Looking at optimizations...
21:41:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:41:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:41:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:41:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:41:39:WU01:FS00:0xa3:- Digital signature verified
21:41:39:WU01:FS00:0xa3:
21:41:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:41:39:WU01:FS00:0xa3:
21:41:39:WU01:FS00:0xa3:Entering M.D.
21:41:41:WU00:FS02:0x17:Completed 2150000 out of 5000000 steps (43%)
21:41:46:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:41:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:42:30:WU01:FS00:Starting
21:42:30:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:42:30:WU01:FS00:Started FahCore on PID 9687
21:42:30:WU01:FS00:Core PID:9691
21:42:30:WU01:FS00:FahCore 0xa3 started
21:42:30:WU01:FS00:0xa3:
21:42:30:WU01:FS00:0xa3:*------------------------------*
21:42:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:42:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:42:30:WU01:FS00:0xa3:
21:42:30:WU01:FS00:0xa3:Preparing to commence simulation
21:42:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:42:31:WU02:FS03:0x17:Completed 2150000 out of 5000000 steps (43%)
21:42:39:WU01:FS00:0xa3:- Looking at optimizations...
21:42:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:42:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:42:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:42:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:42:39:WU01:FS00:0xa3:- Digital signature verified
21:42:39:WU01:FS00:0xa3:
21:42:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:42:39:WU01:FS00:0xa3:
21:42:39:WU01:FS00:0xa3:Entering M.D.
21:42:44:WU03:FS04:0x17:Completed 2150000 out of 5000000 steps (43%)
21:42:46:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:42:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:42:54:WU06:FS01:0x17:Completed 1000000 out of 5000000 steps (20%)
21:43:26:WU00:FS02:0x17:Completed 2200000 out of 5000000 steps (44%)
21:43:30:WU01:FS00:Starting
21:43:30:WU01:FS00:Removing old file './work/01/logfile_01-20150303-211129.txt'
21:43:30:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:43:30:WU01:FS00:Started FahCore on PID 9701
21:43:30:WU01:FS00:Core PID:9705
21:43:30:WU01:FS00:FahCore 0xa3 started
21:43:30:WU01:FS00:0xa3:
21:43:30:WU01:FS00:0xa3:*------------------------------*
21:43:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:43:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:43:30:WU01:FS00:0xa3:
21:43:30:WU01:FS00:0xa3:Preparing to commence simulation
21:43:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:43:39:WU01:FS00:0xa3:- Looking at optimizations...
21:43:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:43:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:43:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:43:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:43:39:WU01:FS00:0xa3:- Digital signature verified
21:43:39:WU01:FS00:0xa3:
21:43:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:43:39:WU01:FS00:0xa3:
21:43:39:WU01:FS00:0xa3:Entering M.D.
21:43:46:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:43:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:44:15:WU02:FS03:0x17:Completed 2200000 out of 5000000 steps (44%)
21:44:28:WU03:FS04:0x17:Completed 2200000 out of 5000000 steps (44%)
21:44:29:WU06:FS01:0x17:Completed 1050000 out of 5000000 steps (21%)
21:44:30:WU01:FS00:Starting
21:44:30:WU01:FS00:Removing old file './work/01/logfile_01-20150303-211229.txt'
21:44:30:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:44:30:WU01:FS00:Started FahCore on PID 9713
21:44:30:WU01:FS00:Core PID:9717
21:44:30:WU01:FS00:FahCore 0xa3 started
21:44:30:WU01:FS00:0xa3:
21:44:30:WU01:FS00:0xa3:*------------------------------*
21:44:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:44:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:44:30:WU01:FS00:0xa3:
21:44:30:WU01:FS00:0xa3:Preparing to commence simulation
21:44:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:44:39:WU01:FS00:0xa3:- Looking at optimizations...
21:44:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:44:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:44:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:44:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:44:39:WU01:FS00:0xa3:- Digital signature verified
21:44:39:WU01:FS00:0xa3:
21:44:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:44:39:WU01:FS00:0xa3:
21:44:39:WU01:FS00:0xa3:Entering M.D.
21:44:45:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:44:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:45:11:WU00:FS02:0x17:Completed 2250000 out of 5000000 steps (45%)
21:45:30:WU01:FS00:Starting
21:45:30:WU01:FS00:Removing old file './work/01/logfile_01-20150303-211329.txt'
21:45:30:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/jim/fah/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 01 -suffix 01 -version 704 -lifeline 3487 -checkpoint 15 -np 8
21:45:30:WU01:FS00:Started FahCore on PID 9725
21:45:30:WU01:FS00:Core PID:9729
21:45:30:WU01:FS00:FahCore 0xa3 started
21:45:30:WU01:FS00:0xa3:
21:45:30:WU01:FS00:0xa3:*------------------------------*
21:45:30:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
21:45:30:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
21:45:30:WU01:FS00:0xa3:
21:45:30:WU01:FS00:0xa3:Preparing to commence simulation
21:45:30:WU01:FS00:0xa3:- Ensuring status. Please wait.
21:45:39:WU01:FS00:0xa3:- Looking at optimizations...
21:45:39:WU01:FS00:0xa3:- Working with standard loops on this execution.
21:45:39:WU01:FS00:0xa3:Examination of work files indicates 8 consecutive improper terminations of core.
21:45:39:WU01:FS00:0xa3:- Expanded 2356424 -> 2944444 (decompressed 124.9 percent)
21:45:39:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=2356424 data_size=2944444, decompressed_data_size=2944444 diff=0
21:45:39:WU01:FS00:0xa3:- Digital signature verified
21:45:39:WU01:FS00:0xa3:
21:45:39:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 114, Gen 9)
21:45:39:WU01:FS00:0xa3:
21:45:39:WU01:FS00:0xa3:Entering M.D.
21:45:46:WU01:FS00:0xa3:Mapping NT from 8 to 8 
21:45:46:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:46:00:WU02:FS03:0x17:Completed 2250000 out of 5000000 steps (45%)
21:46:04:WU06:FS01:0x17:Completed 1100000 out of 5000000 steps (22%)
21:46:13:WU03:FS04:0x17:Completed 2250000 out of 5000000 steps (45%)
EXT64
Posts: 323
Joined: Mon Apr 09, 2012 11:54 pm

Re: Various a3 projects cause client to crash

Post by EXT64 »

Looks like I've got one too (not sure if it has already been reported):

Code: Select all

23:01:38:WU01:FS00:0xa3:Project: 7516 (Run 0, Clone 113, Gen 10)
23:01:38:WU01:FS00:0xa3:
23:01:38:WU01:FS00:0xa3:Entering M.D.
23:01:44:WU01:FS00:0xa3:Mapping NT from 4 to 4 
23:01:44:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
ChristianVirtual
Posts: 1596
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: Various a3 projects cause client to crash

Post by ChristianVirtual »

EXT64 wrote:Looks like I've got one too (not sure if it has already been reported):
I dumped that one before ... Thanks for trying too :wink:
ImageImage
Please contribute your logs to http://ppd.fahmm.net
uncle_fungus
Site Admin
Posts: 1288
Joined: Fri Nov 30, 2007 9:37 am
Location: Oxfordshire, UK

Re: Various a3 projects cause client to crash

Post by uncle_fungus »

P7523 R0 C92 G233 in an endless UNKNOWN_ENUM loop this morning.
uncle_fungus
Site Admin
Posts: 1288
Joined: Fri Nov 30, 2007 9:37 am
Location: Oxfordshire, UK

Re: Various a3 projects cause client to crash

Post by uncle_fungus »

Project: 7516 (Run 0, Clone 102, Gen 395) seems to have way too many steps. As far as I can tell these WUs should normally contain 500,000 steps, whereas the one I've got at the moment is 198,000,000 steps. I'm going to stop this unit as it's clearly broken.

Might not be relevant but:

Code: Select all

Input Parameters:
   integrator           = md
   nsteps               = 198000000
   init_step            = 0
   ns_type              = Grid
   nstlist              = 10
   ndelta               = 2
   nstcomm              = 10
   comm_mode            = Linear
   nstlog               = 1000
   nstxout              = 250000
   nstvout              = 250000
   nstfout              = 0
   nstcalcenergy        = 10
   nstenergy            = 10000
   nstxtcout            = 25000
   init_t               = 0
   delta_t              = 0.002
   xtcprec              = 1000
   nkx                  = 72
   nky                  = 72
   nkz                  = 72
   pme_order            = 4
   ewald_rtol           = 1e-005
   ewald_geometry       = 0
   epsilon_surface      = 0
   optimize_fft         = FALSE
   ePBC                 = xyz
   bPeriodicMols        = FALSE
   bContinuation        = TRUE
   bShakeSOR            = FALSE
   etc                  = V-rescale
   nsttcouple           = 10
   epc                  = Berendsen
   epctype              = Isotropic
   nstpcouple           = 10
   tau_p                = 10
   ref_p (3x3):
      ref_p[    0]={1.00000e+000, 0.00000e+000, 0.00000e+000}
      ref_p[    1]={0.00000e+000, 1.00000e+000, 0.00000e+000}
      ref_p[    2]={0.00000e+000, 0.00000e+000, 1.00000e+000}
   compress (3x3):
      compress[    0]={1.00000e-004, 0.00000e+000, 0.00000e+000}
      compress[    1]={0.00000e+000, 1.00000e-004, 0.00000e+000}
      compress[    2]={0.00000e+000, 0.00000e+000, 1.00000e-004}
   refcoord_scaling     = No
   posres_com (3):
      posres_com[0]=0.00000e+000
      posres_com[1]=0.00000e+000
      posres_com[2]=0.00000e+000
   posres_comB (3):
      posres_comB[0]=0.00000e+000
      posres_comB[1]=0.00000e+000
      posres_comB[2]=0.00000e+000
   andersen_seed        = 815131
   rlist                = 1.2
   rlistlong            = 1.2
   rtpi                 = 0.05
   coulombtype          = PME
   rcoulomb_switch      = 0
   rcoulomb             = 1.2
   vdwtype              = Cut-off
   rvdw_switch          = 0
   rvdw                 = 1.2
   epsilon_r            = 1
   epsilon_rf           = 1
   tabext               = 1
   implicit_solvent     = No
   gb_algorithm         = Still
   gb_epsilon_solvent   = 80
   nstgbradii           = 1
   rgbradii             = 2
   gb_saltconc          = 0
   gb_obc_alpha         = 1
   gb_obc_beta          = 0.8
   gb_obc_gamma         = 4.85
   gb_dielectric_offset = 0.009
   sa_algorithm         = Ace-approximation
   sa_surface_tension   = 2.092
   DispCorr             = No
   free_energy          = no
   init_lambda          = 0
   delta_lambda         = 0
   n_foreign_lambda     = 0
   sc_alpha             = 0
   sc_power             = 0
   sc_sigma             = 0.3
   sc_sigma_min         = 0.3
   nstdhdl              = 10
   separate_dhdl_file   = yes
   dhdl_derivatives     = yes
   dh_hist_size         = 0
   dh_hist_spacing      = 0.1
   nwall                = 0
   wall_type            = 9-3
   wall_atomtype[0]     = -1
   wall_atomtype[1]     = -1
   wall_density[0]      = 0
   wall_density[1]      = 0
   wall_ewald_zfac      = 3
   pull                 = no
   disre                = No
   disre_weighting      = Equal
   disre_mixed          = FALSE
   dr_fc                = 1000
   dr_tau               = 1.25
   nstdisreout          = 100
   orires_fc            = 0
   orires_tau           = 0
   nstorireout          = 100
   dihre-fc             = 1000
   em_stepsize          = 0.1
   em_tol               = 10
   niter                = 20
   fc_stepsize          = 1
   nstcgsteep           = 1000
   nbfgscorr            = 10
   ConstAlg             = Lincs
   shake_tol            = 0.0001
   lincs_order          = 4
   lincs_warnangle      = 90
   lincs_iter           = 2
   bd_fric              = 0
   ld_seed              = 1993
   cos_accel            = 0
   deform (3x3):
      deform[    0]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      deform[    1]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      deform[    2]={0.00000e+000, 0.00000e+000, 0.00000e+000}
   userint1             = 0
   userint2             = 0
   userint3             = 0
   userint4             = 0
   userreal1            = 0
   userreal2            = 0
   userreal3            = 0
   userreal4            = 0
grpopts:
   nrdf:      160364
   ref_t:         310
   tau_t:          10
anneal:          No
ann_npoints:           0
   acc:	           0           0           0
   nfreeze:           N           N           N
   energygrp_flags[  0]: 0
   efield-x:
      n = 0
   efield-xt:
      n = 0
   efield-y:
      n = 0
   efield-yt:
      n = 0
   efield-z:
      n = 0
   efield-zt:
      n = 0
   bQMMM                = FALSE
   QMconstraints        = 0
   QMMMscheme           = 0
   scalefactor          = 1
qm_opts:
   ngQM                 = 0
Edit: It has also already been completed successfully by someone else. (On 2015-02-13 13:08:28)
uncle_fungus
Site Admin
Posts: 1288
Joined: Fri Nov 30, 2007 9:37 am
Location: Oxfordshire, UK

Re: Various a3 projects cause client to crash

Post by uncle_fungus »

@jimerickson That WU is definitely broken. It's been returned twice already but with a WU_FAULTY status code.
7im
Posts: 10189
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Various a3 projects cause client to crash

Post by 7im »

Kasson, please update us on the status of correcting this problem with 75xx projects.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
folding_hoomer
Posts: 349
Joined: Sun Feb 10, 2013 6:06 pm
Hardware configuration: Sys 1: I7 2700K@4,4GHz with NH-C14
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Sys 2: I7 3930K@4,4GHz with Corsair H110
16GB G.Skill Ripjaws X DDR3 1866MHz CL 9-10-9-28
ASUS Ranpage IV Formula, Ubuntu 10.10

Sys 3 i7 875K@3,826 GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI P55-GD80, Win7 64Bit Pro
Sapphire Radeon HD5870@1,163V 900/1250MHz
Sapphire Radeon HD7870@1,218V 1200/1300MHz

Sys 4 i7 2600K@4,4GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Optional:
ASUS P5Q Pro with Q9550
ASUS P5Q Pro with Q6300
Location: Bavaria, Germany

Re: Various a3 projects cause client to crash

Post by folding_hoomer »

A member of my Team got another CoreA4 Project on his 32-Cores-Server.
Project: 7520 (Run 84, Clone 8, Gen 1) - infinite loop:

Code: Select all

*********************** Log Started 2015-03-04T17:13:58Z ***********************
17:13:58:************************* Folding@home Client *************************
17:13:58: Website: Folding@home
17:13:58: Copyright: (c) 2009-2013 Stanford University
17:13:58: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:13:58: Args: --child --lifeline 1506 /etc/fahclient/config.xml --run-as
17:13:58: fahclient --pid-file=/var/run/fahclient.pid --daemon
17:13:58: Config: /etc/fahclient/config.xml
17:13:58:******************************** Build ********************************
17:13:58: Version: 7.3.6
17:13:58: Date: Feb 18 2013
17:13:58: Time: 07:24:08
17:13:58: SVN Rev: 3923
17:13:58: Branch: fah/trunk/client
17:13:58: Compiler: GNU 4.4.7
17:13:58: Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
17:13:58: -fno-unsafe-math-optimizations -msse2
17:13:58: Platform: linux2 3.2.0-1-amd64
17:13:58: Bits: 64
17:13:58: Mode: Release
17:13:58:******************************* System ********************************
17:13:58: CPU: Genuine Intel(R) CPU @ 3.00GHz
17:13:58: CPU ID: GenuineIntel Family 6 Model 45 Stepping 2
17:13:58: CPUs: 32
17:13:58: Memory: 15.66GiB
17:13:58:Free Memory: 14.75GiB
17:13:58: Threads: POSIX_THREADS
17:13:58:Has Battery: false
17:13:58: On Battery: false
17:13:58: UTC offset: 1
17:13:58: PID: 1520
17:13:58: CWD: /var/lib/fahclient
17:13:58: OS: Linux 3.2.0-67-generic x86_64
17:13:58: OS Arch: AMD64
17:13:58: GPUs: 0
17:13:58: CUDA: Not detected
17:13:58:***************************************** ******************************
17:13:58:<config>
17:13:58: <!-- Folding Core -->
17:13:58: <checkpoint v='3'/>
17:13:58:
17:13:58: <!-- Folding Slot Configuration -->
17:13:58: <power v='full'/>
17:13:58:
17:13:58: <!-- HTTP Server -->
17:13:58: <allow v='127.0.0.1 192.168.0.0/24'/>
17:13:58:
17:13:58: <!-- Network -->
17:13:58: <proxy v=':8080'/>
17:13:58:
17:13:58: <!-- Remote Command Server -->
17:13:58: <password v='***********'/>
17:13:58:
17:13:58: <!-- User Information -->
17:13:58: <passkey v='********************************'/>
17:13:58: <team v='70335'/>
17:13:58: <user v='A.Meier-PS3'/>
17:13:58:
17:13:58: <!-- Folding Slots -->
17:13:58: <slot id='0' type='CPU'>
17:13:58: <client-type v='advanced'/>
17:13:58: <cpus v='-1'/>
17:13:58: <max-packet-size v='big'/>
17:13:58: <next-unit-percentage v='100'/>
17:13:58: </slot>
17:13:58:</config>
17:13:58:Switching to user fahclient
17:13:58:Trying to access database...
17:13:58:Successfully acquired database lock
17:13:58:Enabled folding slot 00: READY cpu:32
17:13:58:WU00:FS00:Starting
17:13:58:WU00:FS00:Removing old file './work/00/logfile_01-20150304-160507.txt'
17:13:58:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 703 -lifeline 1520 -checkpoint 3 -np 32
17:13:58:WU00:FS00:Started FahCore on PID 1530
17:13:58:WU00:FS00:Core PID:1536
17:13:58:WU00:FS00:FahCore 0xa4 started
17:13:59:WU00:FS00:0xa4:
17:13:59:WU00:FS00:0xa4:*------------------------------*
17:13:59:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
17:13:59:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:13:59:WU00:FS00:0xa4:
17:13:59:WU00:FS00:0xa4reparing to commence simulation
17:13:59:WU00:FS00:0xa4:- Ensuring status. Please wait.
17:14:08:WU00:FS00:0xa4:- Looking at optimizations...
17:14:08:WU00:FS00:0xa4:- Working with standard loops on this execution.
17:14:08:WU00:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
17:14:08:WU00:FS00:0xa4:- Expanded 2426255 -> 3199980 (decompressed 131.8 percent)
17:14:08:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2426255 data_size=3199980, decompressed_data_size=3199980 diff=0
17:14:08:WU00:FS00:0xa4:- Digital signature verified
17:14:08:WU00:FS00:0xa4:
17:14:08:WU00:FS00:0xa4roject: 7520 (Run 84, Clone 8, Gen 1)
17:14:08:WU00:FS00:0xa4:
17:14:08:WU00:FS00:0xa4:Entering M.D.
17:14:14:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
17:14:15:WU00:FS00:Starting
17:14:15:WU00:FS00:Removing old file './work/00/logfile_01-20150304-160607.txt'
17:14:15:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 703 -lifeline 1520 -checkpoint 3 -np 32
17:14:15:WU00:FS00:Started FahCore on PID 1942
17:14:15:WU00:FS00:Core PID:1946
17:14:15:WU00:FS00:FahCore 0xa4 started
17:14:15:WU00:FS00:0xa4:
17:14:15:WU00:FS00:0xa4:*------------------------------*
17:14:15:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
17:14:15:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:14:15:WU00:FS00:0xa4:
17:14:15:WU00:FS00:0xa4reparing to commence simulation
17:14:15:WU00:FS00:0xa4:- Ensuring status. Please wait.
17:14:24:WU00:FS00:0xa4:- Looking at optimizations...
17:14:24:WU00:FS00:0xa4:- Working with standard loops on this execution.
17:14:24:WU00:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
17:14:24:WU00:FS00:0xa4:- Expanded 2426255 -> 3199980 (decompressed 131.8 percent)
17:14:24:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2426255 data_size=3199980, decompressed_data_size=3199980 diff=0
17:14:24:WU00:FS00:0xa4:- Digital signature verified
17:14:24:WU00:FS00:0xa4:
17:14:24:WU00:FS00:0xa4roject: 7520 (Run 84, Clone 8, Gen 1)
17:14:24:WU00:FS00:0xa4:
17:14:24:WU00:FS00:0xa4:Entering M.D.
17:14:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
17:15:15:WU00:FS00:Starting
17:15:15:WU00:FS00:Removing old file './work/00/logfile_01-20150304-160707.txt'
17:15:15:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 703 -lifeline 1520 -checkpoint 3 -np 32
17:15:15:WU00:FS00:Started FahCore on PID 1999
17:15:15:WU00:FS00:Core PID:2003
17:15:15:WU00:FS00:FahCore 0xa4 started
17:15:15:WU00:FS00:0xa4:
17:15:15:WU00:FS00:0xa4:*------------------------------*
17:15:15:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
17:15:15:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:15:15:WU00:FS00:0xa4:
17:15:15:WU00:FS00:0xa4reparing to commence simulation
17:15:15:WU00:FS00:0xa4:- Ensuring status. Please wait.
17:15:24:WU00:FS00:0xa4:- Looking at optimizations...
17:15:24:WU00:FS00:0xa4:- Working with standard loops on this execution.
17:15:24:WU00:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
17:15:24:WU00:FS00:0xa4:- Expanded 2426255 -> 3199980 (decompressed 131.8 percent)
17:15:24:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2426255 data_size=3199980, decompressed_data_size=3199980 diff=0
17:15:24:WU00:FS00:0xa4:- Digital signature verified
17:15:24:WU00:FS00:0xa4:
17:15:24:WU00:FS00:0xa4roject: 7520 (Run 84, Clone 8, Gen 1)
17:15:24:WU00:FS00:0xa4:
17:15:24:WU00:FS00:0xa4:Entering M.D.
17:15:31:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
17:15:36:FS00aused
Image
orion456
Posts: 27
Joined: Wed Jun 25, 2008 6:25 am

Project: 7520 (Run 39, Clone 5, Gen 186)

Post by orion456 »

I have two machines that pick up 7520 WUs, try them a few times with "Client-core communications error: ERROR 0xc0000417" then they pick up another type of WU and all goes well.

Code: Select all

23:30:15] Folding@Home Gromacs GB Core
[23:30:15] Version 2.27 (Dec. 15, 2010)
[23:30:15] 
[23:30:15] Preparing to commence simulation
[23:30:15] - Looking at optimizations...
[23:30:15] - Created dyn
[23:30:15] - Files status OK
[23:30:16] - Expanded 2590265 -> 3347756 (decompressed 129.2 percent)
[23:30:16] Called DecompressByteArray: compressed_data_size=2590265 data_size=3347756, decompressed_data_size=3347756 diff=0
[23:30:16] - Digital signature verified
[23:30:16] 
[23:30:16] Project: 7520 (Run 39, Clone 5, Gen 186)
[23:30:16] 
[23:30:16] Assembly optimizations on if available.
[23:30:16] Entering M.D.
[23:30:22] Mapping NT from 4 to 4 
[23:44:13] CoreStatus = C0000417 (-1073740777)
[23:44:13] Client-core communications error: ERROR 0xc0000417
[23:44:13] Deleting current work unit & continuing...
[23:44:25] Trying to send all finished work units
[23:44:25] + No unsent completed units remaining.
[23:44:25] - Preparing to get new work unit...
[23:44:25] Cleaning up work directory
[23:44:25] + Attempting to get work packet
[23:44:25] Passkey found
[23:44:25] - Will indicate memory of 3326 MB
[23:44:25] - Connecting to assignment server
[23:44:25] Connecting to http://assign.stanford.edu:8080/
[23:44:26] Posted data.
[23:44:26] Initial: 8F80; - Successful: assigned to (128.143.199.97).
[23:44:26] + News From Folding@Home: 
[23:44:26] Loaded queue successfully.
[23:44:26] Sent data
[23:44:26] Connecting to http://128.143.199.97:8080/
[23:44:27] Posted data.
[23:44:27] Initial: 0000; - Receiving payload (expected size: 2590777)
[23:44:29] - Downloaded at ~1265 kB/s
[23:44:29] - Averaged speed for that direction ~1163 kB/s
[23:44:29] + Received work.
[23:44:29] + Closed connections
[23:44:34] 
[23:44:34] + Processing work unit
[23:44:34] A4 will attempt to use 4 threads.
[23:44:34] Core required: FahCore_a4.exe
[23:44:34] Core found.
[23:44:34] Working on queue slot 03 [March 4 23:44:34 UTC]
[23:44:34] + Working ...
[23:44:34] - Calling '.\FahCore_a4.exe -dir work/ -nice 19 -suffix 03 -np 4 -checkpoint 30 -verbose -lifeline 276 -version 634'

[23:44:34] 
[23:44:34] *------------------------------*
[23:44:34] Folding@Home Gromacs GB Core
[23:44:34] Version 2.27 (Dec. 15, 2010)
[23:44:34] 
[23:44:34] Preparing to commence simulation
[23:44:34] - Looking at optimizations...
[23:44:34] - Created dyn
[23:44:34] - Files status OK
[23:44:35] - Expanded 2590265 -> 3347756 (decompressed 129.2 percent)
[23:44:35] Called DecompressByteArray: compressed_data_size=2590265 data_size=3347756, decompressed_data_size=3347756 diff=0
[23:44:35] - Digital signature verified
[23:44:35] 
[23:44:35] Project: 7520 (Run 39, Clone 5, Gen 186)
[23:44:35] 
[23:44:35] Assembly optimizations on if available.
[23:44:35] Entering M.D.
[23:44:41] Mapping NT from 4 to 4 
[23:44:44] CoreStatus = C0000417 (-1073740777)
[23:44:44] Client-core communications error: ERROR 0xc0000417
[23:44:44] Deleting current work unit & continuing...
[23:44:56] Trying to send all finished work units
[23:44:56] + No unsent completed units remaining.
[23:44:56] - Preparing to get new work unit...
[23:44:56] Cleaning up work directory
[23:44:56] + Attempting to get work packet
[23:44:56] Passkey found
[23:44:56] - Will indicate memory of 3326 MB
[23:44:56] - Connecting to assignment server
[23:44:56] Connecting to http://assign.stanford.edu:8080/
[23:44:58] Posted data.
[23:44:58] Initial: 8F80; - Successful: assigned to (128.143.199.97).
[23:44:58] + News From Folding@Home: 
[23:44:58] Loaded queue successfully.
[23:44:58] Sent data
[23:44:58] Connecting to http://128.143.199.97:8080/
[23:44:59] Posted data.
[23:44:59] Initial: 0000; - Receiving payload (expected size: 2590777)
[23:45:01] - Downloaded at ~1265 kB/s
[23:45:01] - Averaged speed for that direction ~1183 kB/s
[23:45:01] + Received work.
[23:45:01] + Closed connections

and then:

[23:46:00] Folding@Home Gromacs SMP Core
[23:46:00] Version 2.27 (Dec. 15, 2010)
[23:46:00] 
[23:46:00] Preparing to commence simulation
[23:46:00] - Looking at optimizations...
[23:46:00] - Created dyn
[23:46:00] - Files status OK
[23:46:00] - Expanded 3802836 -> 4167964 (decompressed 109.6 percent)
[23:46:01] Called DecompressByteArray: compressed_data_size=3802836 data_size=4167964, decompressed_data_size=4167964 diff=0
[23:46:01] - Digital signature verified
[23:46:01] 
[23:46:01] Project: 8838 (Run 0, Clone 19, Gen 404)
[23:46:01] 
[23:46:01] Assembly optimizations on if available.
[23:46:01] Entering M.D.
[23:46:07] Mapping NT from 4 to 4 
[23:46:08] Completed 0 out of 500000 steps  (0%)
folding_hoomer
Posts: 349
Joined: Sun Feb 10, 2013 6:06 pm
Hardware configuration: Sys 1: I7 2700K@4,4GHz with NH-C14
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Sys 2: I7 3930K@4,4GHz with Corsair H110
16GB G.Skill Ripjaws X DDR3 1866MHz CL 9-10-9-28
ASUS Ranpage IV Formula, Ubuntu 10.10

Sys 3 i7 875K@3,826 GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI P55-GD80, Win7 64Bit Pro
Sapphire Radeon HD5870@1,163V 900/1250MHz
Sapphire Radeon HD7870@1,218V 1200/1300MHz

Sys 4 i7 2600K@4,4GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Optional:
ASUS P5Q Pro with Q9550
ASUS P5Q Pro with Q6300
Location: Bavaria, Germany

Re: Various a3 projects cause client to crash

Post by folding_hoomer »

Got two Projects ending in an infinite loop:
Project: 7521 (Run 0, Clone 45, Gen 138) and Project: 7521 (Run 0, Clone 47, Gen 57)

Code: Select all

*********************** Log Started 2015-03-06T02:58:28Z ***********************
02:58:28:************************* Folding@home Client *************************
02:58:28:    Website: http://folding.stanford.edu/
02:58:28:  Copyright: (c) 2009-2014 Stanford University
02:58:28:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:58:28:       Args: --child --lifeline 1038 /etc/fahclient/config.xml --run-as
02:58:28:             fahclient --pid-file=/var/run/fahclient.pid --daemon
02:58:28:     Config: /etc/fahclient/config.xml
02:58:28:******************************** Build ********************************
02:58:28:    Version: 7.4.4
02:58:28:       Date: Mar 4 2014
02:58:28:       Time: 12:02:38
02:58:28:    SVN Rev: 4130
02:58:28:     Branch: fah/trunk/client
02:58:28:   Compiler: GNU 4.4.7
02:58:28:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
02:58:28:             -fno-unsafe-math-optimizations -msse2
02:58:28:   Platform: linux2 3.2.0-1-amd64
02:58:28:       Bits: 64
02:58:28:       Mode: Release
02:58:28:******************************* System ********************************
02:58:28:        CPU: Intel(R) Core(TM) i7-2700K CPU @ 3.50GHz
02:58:28:     CPU ID: GenuineIntel Family 6 Model 42 Stepping 7
02:58:28:       CPUs: 8
02:58:28:     Memory: 3.56GiB
02:58:28:Free Memory: 3.23GiB
02:58:28:    Threads: POSIX_THREADS
02:58:28: OS Version: 3.13
02:58:28:Has Battery: false
02:58:28: On Battery: false
02:58:28: UTC Offset: 1
02:58:28:        PID: 1040
02:58:28:        CWD: /var/lib/fahclient
02:58:28:         OS: Linux 3.13.0-46-generic x86_64
02:58:28:    OS Arch: AMD64
02:58:28:       GPUs: 0
02:58:28:       CUDA: Not detected
02:58:28:***********************************************************************
02:58:28:<config>
02:58:28:  <!-- Client Control -->
02:58:28:  <fold-anon v='true'/>
02:58:28:
02:58:28:  <!-- Folding Slot Configuration -->
02:58:28:  <gpu v='false'/>
02:58:28:
02:58:28:  <!-- HTTP Server -->
02:58:28:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
02:58:28:
02:58:28:  <!-- Network -->
02:58:28:  <proxy v=':8080'/>
02:58:28:
02:58:28:  <!-- Remote Command Server -->
02:58:28:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
02:58:28:
02:58:28:  <!-- Slot Control -->
02:58:28:  <power v='full'/>
02:58:28:
02:58:28:  <!-- User Information -->
02:58:28:  <passkey v='********************************'/>
02:58:28:  <team v='70335'/>
02:58:28:  <user v='folding_hoomer'/>
02:58:28:
02:58:28:  <!-- Folding Slots -->
02:58:28:  <slot id='0' type='CPU'>
02:58:28:    <client-type v='beta'/>
02:58:28:    <next-unit-percentage v='100'/>
02:58:28:    <pause-on-start v='true'/>
02:58:28:    <paused v='true'/>
02:58:28:  </slot>
02:58:28:</config>
02:58:28:Switching to user fahclient
02:58:28:Trying to access database...
02:58:28:Successfully acquired database lock
02:58:28:Enabled folding slot 00: PAUSED cpu:8 (by user)
02:58:28:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9009 run:250 clone:3 gen:106 core:0xa4 unit:0x0000007f664f2de45386879a210f862d
02:58:28:WU01:FS00:Uploading 1.57MiB to 171.64.65.124
02:58:28:WU01:FS00:Connecting to 171.64.65.124:8080
02:58:28:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
02:58:28:WU01:FS00:Connecting to 171.64.65.124:80
02:58:29:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.124:80: Network is unreachable
02:58:29:WU01:FS00:Trying to send results to collection server
02:58:29:WU01:FS00:Uploading 1.57MiB to 171.65.103.160
02:58:29:WU01:FS00:Connecting to 171.65.103.160:8080
02:58:29:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
02:58:29:WU01:FS00:Connecting to 171.65.103.160:80
02:58:30:ERROR:WU01:FS00:Exception: Failed to connect to 171.65.103.160:80: Network is unreachable
02:58:30:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9009 run:250 clone:3 gen:106 core:0xa4 unit:0x0000007f664f2de45386879a210f862d
02:58:30:WU01:FS00:Uploading 1.57MiB to 171.64.65.124
02:58:30:WU01:FS00:Connecting to 171.64.65.124:8080
02:58:30:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
02:58:30:WU01:FS00:Connecting to 171.64.65.124:80
02:58:30:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.124:80: Network is unreachable
02:58:30:WU01:FS00:Trying to send results to collection server
02:58:30:WU01:FS00:Uploading 1.57MiB to 171.65.103.160
02:58:30:WU01:FS00:Connecting to 171.65.103.160:8080
02:58:37:WU01:FS00:Upload 3.98%
02:58:43:WU01:FS00:Upload 31.81%
02:58:44:FS00:Unpaused
02:58:44:WU00:FS00:Starting
02:58:44:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
02:58:44:WU00:FS00:Started FahCore on PID 2035
02:58:44:WU00:FS00:Core PID:2039
02:58:44:WU00:FS00:FahCore 0xa4 started
02:58:44:WU00:FS00:0xa4:
02:58:44:WU00:FS00:0xa4:*------------------------------*
02:58:44:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
02:58:44:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
02:58:44:WU00:FS00:0xa4:
02:58:44:WU00:FS00:0xa4:Preparing to commence simulation
02:58:44:WU00:FS00:0xa4:- Ensuring status. Please wait.
02:58:49:WU01:FS00:Upload 63.63%
02:58:54:WU00:FS00:0xa4:- Looking at optimizations...
02:58:54:WU00:FS00:0xa4:- Working with standard loops on this execution.
02:58:54:WU00:FS00:0xa4:- Previous termination of core was improper.
02:58:54:WU00:FS00:0xa4:- Going to use standard loops.
02:58:54:WU00:FS00:0xa4:- Files status OK
02:58:54:WU00:FS00:0xa4:- Expanded 2509230 -> 3157328 (decompressed 125.8 percent)
02:58:54:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2509230 data_size=3157328, decompressed_data_size=3157328 diff=0
02:58:54:WU00:FS00:0xa4:- Digital signature verified
02:58:54:WU00:FS00:0xa4:
02:58:54:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 45, Gen 138)
02:58:54:WU00:FS00:0xa4:
02:58:54:WU00:FS00:0xa4:Entering M.D.
02:58:58:WU01:FS00:Upload complete
02:58:58:WU01:FS00:Server responded WORK_ACK (400)
02:58:58:WU01:FS00:Final credit estimate, 2032.00 points
02:58:58:WU01:FS00:Cleaning up
02:59:00:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
02:59:00:WU00:FS00:Starting
02:59:00:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
02:59:00:WU00:FS00:Started FahCore on PID 2142
02:59:00:WU00:FS00:Core PID:2146
02:59:00:WU00:FS00:FahCore 0xa4 started
02:59:01:WU00:FS00:0xa4:
02:59:01:WU00:FS00:0xa4:*------------------------------*
02:59:01:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
02:59:01:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
02:59:01:WU00:FS00:0xa4:
02:59:01:WU00:FS00:0xa4:Preparing to commence simulation
02:59:01:WU00:FS00:0xa4:- Ensuring status. Please wait.
02:59:10:WU00:FS00:0xa4:- Looking at optimizations...
02:59:10:WU00:FS00:0xa4:- Working with standard loops on this execution.
02:59:10:WU00:FS00:0xa4:- Previous termination of core was improper.
02:59:10:WU00:FS00:0xa4:- Going to use standard loops.
02:59:10:WU00:FS00:0xa4:- Files status OK
02:59:10:WU00:FS00:0xa4:- Expanded 2509230 -> 3157328 (decompressed 125.8 percent)
02:59:10:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2509230 data_size=3157328, decompressed_data_size=3157328 diff=0
02:59:10:WU00:FS00:0xa4:- Digital signature verified
02:59:10:WU00:FS00:0xa4:
02:59:10:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 45, Gen 138)
02:59:10:WU00:FS00:0xa4:
02:59:10:WU00:FS00:0xa4:Entering M.D.
02:59:17:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
02:59:25:FS00:Paused
03:00:00:Removing old file 'configs/config-20150215-112440.xml'
03:00:00:Saving configuration to /etc/fahclient/config.xml
03:00:00:<config>
03:00:00:  <!-- Client Control -->
03:00:00:  <fold-anon v='true'/>
03:00:00:
03:00:00:  <!-- Folding Slot Configuration -->
03:00:00:  <gpu v='false'/>
03:00:00:
03:00:00:  <!-- HTTP Server -->
03:00:00:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:00:
03:00:00:  <!-- Network -->
03:00:00:  <proxy v=':8080'/>
03:00:00:
03:00:00:  <!-- Remote Command Server -->
03:00:00:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:00:
03:00:00:  <!-- Slot Control -->
03:00:00:  <power v='full'/>
03:00:00:
03:00:00:  <!-- User Information -->
03:00:00:  <passkey v='********************************'/>
03:00:00:  <team v='70335'/>
03:00:00:  <user v='folding_hoomer'/>
03:00:00:
03:00:00:  <!-- Folding Slots -->
03:00:00:</config>
03:00:00:WARNING:WU00:Slot ID 0 no longer exists and there are no other matching slots, dumping
03:00:00:WU00:Sending unit results: id:00 state:SEND error:DUMPED project:7521 run:0 clone:45 gen:138 core:0xa4 unit:0x00000006fbcb017d54ebbafef6d2e4b5
03:00:00:WU00:Connecting to 128.143.199.97:8080
03:00:02:WU00:Server responded WORK_ACK (400)
03:00:02:WU00:Cleaning up
03:00:30:Removing old file 'configs/config-20150225-082403.xml'
03:00:30:Saving configuration to /etc/fahclient/config.xml
03:00:30:<config>
03:00:30:  <!-- Client Control -->
03:00:30:  <fold-anon v='true'/>
03:00:30:
03:00:30:  <!-- Folding Slot Configuration -->
03:00:30:  <gpu v='false'/>
03:00:30:
03:00:30:  <!-- HTTP Server -->
03:00:30:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:30:
03:00:30:  <!-- Network -->
03:00:30:  <proxy v=':8080'/>
03:00:30:
03:00:30:  <!-- Remote Command Server -->
03:00:30:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:30:
03:00:30:  <!-- Slot Control -->
03:00:30:  <power v='full'/>
03:00:30:
03:00:30:  <!-- User Information -->
03:00:30:  <passkey v='********************************'/>
03:00:30:  <team v='70335'/>
03:00:30:  <user v='folding_hoomer'/>
03:00:30:
03:00:30:  <!-- Folding Slots -->
03:00:30:</config>
03:00:55:Adding folding slot 00: READY cpu:8
03:00:55:Removing old file 'configs/config-20150225-083136.xml'
03:00:55:Saving configuration to /etc/fahclient/config.xml
03:00:55:<config>
03:00:55:  <!-- Client Control -->
03:00:55:  <fold-anon v='true'/>
03:00:55:
03:00:55:  <!-- Folding Slot Configuration -->
03:00:55:  <gpu v='false'/>
03:00:55:
03:00:55:  <!-- HTTP Server -->
03:00:55:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:55:
03:00:55:  <!-- Network -->
03:00:55:  <proxy v=':8080'/>
03:00:55:
03:00:55:  <!-- Remote Command Server -->
03:00:55:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:00:55:
03:00:55:  <!-- Slot Control -->
03:00:55:  <power v='full'/>
03:00:55:
03:00:55:  <!-- User Information -->
03:00:55:  <passkey v='********************************'/>
03:00:55:  <team v='70335'/>
03:00:55:  <user v='folding_hoomer'/>
03:00:55:
03:00:55:  <!-- Folding Slots -->
03:00:55:  <slot id='0' type='CPU'>
03:00:55:    <client-type v='beta'/>
03:00:55:    <next-unit-percentage v='100'/>
03:00:55:  </slot>
03:00:55:</config>
03:00:56:WU00:FS00:Connecting to 171.67.108.200:8080
03:00:58:WU00:FS00:Assigned to work server 128.143.199.97
03:00:58:WU00:FS00:Requesting new work unit for slot 00: READY cpu:8 from 128.143.199.97
03:00:58:WU00:FS00:Connecting to 128.143.199.97:8080
03:01:00:WU00:FS00:Downloading 2.31MiB
03:01:05:WU00:FS00:Download complete
03:01:05:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7521 run:0 clone:47 gen:57 core:0xa4 unit:0x00000007fbcb017d54ebbafe6620fdb8
03:01:05:WU00:FS00:Starting
03:01:05:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
03:01:05:WU00:FS00:Started FahCore on PID 2205
03:01:05:WU00:FS00:Core PID:2209
03:01:05:WU00:FS00:FahCore 0xa4 started
03:01:06:WU00:FS00:0xa4:
03:01:06:WU00:FS00:0xa4:*------------------------------*
03:01:06:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
03:01:06:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
03:01:06:WU00:FS00:0xa4:
03:01:06:WU00:FS00:0xa4:Preparing to commence simulation
03:01:06:WU00:FS00:0xa4:- Looking at optimizations...
03:01:06:WU00:FS00:0xa4:- Created dyn
03:01:06:WU00:FS00:0xa4:- Files status OK
03:01:06:WU00:FS00:0xa4:- Expanded 2425816 -> 3157328 (decompressed 130.1 percent)
03:01:06:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2425816 data_size=3157328, decompressed_data_size=3157328 diff=0
03:01:06:WU00:FS00:0xa4:- Digital signature verified
03:01:06:WU00:FS00:0xa4:
03:01:06:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 47, Gen 57)
03:01:06:WU00:FS00:0xa4:
03:01:06:WU00:FS00:0xa4:Assembly optimizations on if available.
03:01:06:WU00:FS00:0xa4:Entering M.D.
03:01:12:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
03:01:12:WU00:FS00:Starting
03:01:12:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
03:01:12:WU00:FS00:Started FahCore on PID 2214
03:01:12:WU00:FS00:Core PID:2218
03:01:12:WU00:FS00:FahCore 0xa4 started
03:01:13:WU00:FS00:0xa4:
03:01:13:WU00:FS00:0xa4:*------------------------------*
03:01:13:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
03:01:13:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
03:01:13:WU00:FS00:0xa4:
03:01:13:WU00:FS00:0xa4:Preparing to commence simulation
03:01:13:WU00:FS00:0xa4:- Ensuring status. Please wait.
03:01:22:WU00:FS00:0xa4:- Looking at optimizations...
03:01:22:WU00:FS00:0xa4:- Working with standard loops on this execution.
03:01:22:WU00:FS00:0xa4:- Previous termination of core was improper.
03:01:22:WU00:FS00:0xa4:- Files status OK
03:01:22:WU00:FS00:0xa4:- Expanded 2425816 -> 3157328 (decompressed 130.1 percent)
03:01:22:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2425816 data_size=3157328, decompressed_data_size=3157328 diff=0
03:01:22:WU00:FS00:0xa4:- Digital signature verified
03:01:22:WU00:FS00:0xa4:
03:01:22:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 47, Gen 57)
03:01:22:WU00:FS00:0xa4:
03:01:22:WU00:FS00:0xa4:Entering M.D.
03:01:29:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
03:01:31:Removing old file 'configs/config-20150225-083237.xml'
03:01:31:Saving configuration to /etc/fahclient/config.xml
03:01:31:<config>
03:01:31:  <!-- Client Control -->
03:01:31:  <fold-anon v='true'/>
03:01:31:
03:01:31:  <!-- Folding Slot Configuration -->
03:01:31:  <gpu v='false'/>
03:01:31:
03:01:31:  <!-- HTTP Server -->
03:01:31:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:01:31:
03:01:31:  <!-- Network -->
03:01:31:  <proxy v=':8080'/>
03:01:31:
03:01:31:  <!-- Remote Command Server -->
03:01:31:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:01:31:
03:01:31:  <!-- Slot Control -->
03:01:31:  <power v='full'/>
03:01:31:
03:01:31:  <!-- User Information -->
03:01:31:  <passkey v='********************************'/>
03:01:31:  <team v='70335'/>
03:01:31:  <user v='folding_hoomer'/>
03:01:31:
03:01:31:  <!-- Folding Slots -->
03:01:31:  <slot id='0' type='CPU'>
03:01:31:    <client-type v='beta'/>
03:01:31:    <next-unit-percentage v='100'/>
03:01:31:  </slot>
03:01:31:</config>
03:02:11:Removing old file 'configs/config-20150225-084045.xml'
03:02:11:Saving configuration to /etc/fahclient/config.xml
03:02:11:<config>
03:02:11:  <!-- Client Control -->
03:02:11:  <fold-anon v='true'/>
03:02:11:
03:02:11:  <!-- Folding Slot Configuration -->
03:02:11:  <gpu v='false'/>
03:02:11:
03:02:11:  <!-- HTTP Server -->
03:02:11:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:02:11:
03:02:11:  <!-- Network -->
03:02:11:  <proxy v=':8080'/>
03:02:11:
03:02:11:  <!-- Remote Command Server -->
03:02:11:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:02:11:
03:02:11:  <!-- Slot Control -->
03:02:11:  <power v='full'/>
03:02:11:
03:02:11:  <!-- User Information -->
03:02:11:  <passkey v='********************************'/>
03:02:11:  <team v='70335'/>
03:02:11:  <user v='folding_hoomer'/>
03:02:11:
03:02:11:  <!-- Folding Slots -->
03:02:11:  <slot id='0' type='CPU'>
03:02:11:    <client-type v='beta'/>
03:02:11:    <next-unit-percentage v='100'/>
03:02:11:    <pause-on-start v='true'/>
03:02:11:  </slot>
03:02:11:</config>
03:02:13:WU00:FS00:Starting
03:02:13:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
03:02:13:WU00:FS00:Started FahCore on PID 2224
03:02:13:WU00:FS00:Core PID:2228
03:02:13:WU00:FS00:FahCore 0xa4 started
03:02:13:WU00:FS00:0xa4:
03:02:13:WU00:FS00:0xa4:*------------------------------*
03:02:13:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
03:02:13:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
03:02:13:WU00:FS00:0xa4:
03:02:13:WU00:FS00:0xa4:Preparing to commence simulation
03:02:13:WU00:FS00:0xa4:- Ensuring status. Please wait.
03:02:22:WU00:FS00:0xa4:- Looking at optimizations...
03:02:22:WU00:FS00:0xa4:- Working with standard loops on this execution.
03:02:22:WU00:FS00:0xa4:- Previous termination of core was improper.
03:02:22:WU00:FS00:0xa4:- Going to use standard loops.
03:02:22:WU00:FS00:0xa4:- Files status OK
03:02:22:WU00:FS00:0xa4:- Expanded 2425816 -> 3157328 (decompressed 130.1 percent)
03:02:22:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2425816 data_size=3157328, decompressed_data_size=3157328 diff=0
03:02:22:WU00:FS00:0xa4:- Digital signature verified
03:02:22:WU00:FS00:0xa4:
03:02:22:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 47, Gen 57)
03:02:22:WU00:FS00:0xa4:
03:02:22:WU00:FS00:0xa4:Entering M.D.
03:02:29:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
03:02:32:Removing old file 'configs/config-20150225-172015.xml'
03:02:32:Saving configuration to /etc/fahclient/config.xml
03:02:32:<config>
03:02:32:  <!-- Client Control -->
03:02:32:  <fold-anon v='true'/>
03:02:32:
03:02:32:  <!-- Folding Slot Configuration -->
03:02:32:  <gpu v='false'/>
03:02:32:
03:02:32:  <!-- HTTP Server -->
03:02:32:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:02:32:
03:02:32:  <!-- Network -->
03:02:32:  <proxy v=':8080'/>
03:02:32:
03:02:32:  <!-- Remote Command Server -->
03:02:32:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:02:32:
03:02:32:  <!-- Slot Control -->
03:02:32:  <power v='full'/>
03:02:32:
03:02:32:  <!-- User Information -->
03:02:32:  <passkey v='********************************'/>
03:02:32:  <team v='70335'/>
03:02:32:  <user v='folding_hoomer'/>
03:02:32:
03:02:32:  <!-- Folding Slots -->
03:02:32:  <slot id='0' type='CPU'>
03:02:32:    <client-type v='beta'/>
03:02:32:    <next-unit-percentage v='100'/>
03:02:32:    <pause-on-start v='true'/>
03:02:32:  </slot>
03:02:32:</config>
03:03:13:WU00:FS00:Starting
03:03:13:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
03:03:13:WU00:FS00:Started FahCore on PID 2233
03:03:13:WU00:FS00:Core PID:2237
03:03:13:WU00:FS00:FahCore 0xa4 started
03:03:13:WU00:FS00:0xa4:
03:03:13:WU00:FS00:0xa4:*------------------------------*
03:03:13:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
03:03:13:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
03:03:13:WU00:FS00:0xa4:
03:03:13:WU00:FS00:0xa4:Preparing to commence simulation
03:03:13:WU00:FS00:0xa4:- Ensuring status. Please wait.
03:03:22:WU00:FS00:0xa4:- Looking at optimizations...
03:03:22:WU00:FS00:0xa4:- Working with standard loops on this execution.
03:03:22:WU00:FS00:0xa4:- Previous termination of core was improper.
03:03:22:WU00:FS00:0xa4:- Going to use standard loops.
03:03:22:WU00:FS00:0xa4:- Files status OK
03:03:22:WU00:FS00:0xa4:- Expanded 2425816 -> 3157328 (decompressed 130.1 percent)
03:03:22:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2425816 data_size=3157328, decompressed_data_size=3157328 diff=0
03:03:22:WU00:FS00:0xa4:- Digital signature verified
03:03:22:WU00:FS00:0xa4:
03:03:22:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 47, Gen 57)
03:03:22:WU00:FS00:0xa4:
03:03:22:WU00:FS00:0xa4:Entering M.D.
03:03:29:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
03:04:13:WU00:FS00:Starting
03:04:13:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 1040 -checkpoint 15 -np 8
03:04:13:WU00:FS00:Started FahCore on PID 2242
03:04:13:WU00:FS00:Core PID:2246
03:04:13:WU00:FS00:FahCore 0xa4 started
03:04:13:WU00:FS00:0xa4:
03:04:13:WU00:FS00:0xa4:*------------------------------*
03:04:13:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
03:04:13:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
03:04:13:WU00:FS00:0xa4:
03:04:13:WU00:FS00:0xa4:Preparing to commence simulation
03:04:13:WU00:FS00:0xa4:- Ensuring status. Please wait.
03:04:22:WU00:FS00:0xa4:- Looking at optimizations...
03:04:22:WU00:FS00:0xa4:- Working with standard loops on this execution.
03:04:22:WU00:FS00:0xa4:- Previous termination of core was improper.
03:04:22:WU00:FS00:0xa4:- Going to use standard loops.
03:04:22:WU00:FS00:0xa4:- Files status OK
03:04:22:WU00:FS00:0xa4:- Expanded 2425816 -> 3157328 (decompressed 130.1 percent)
03:04:22:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2425816 data_size=3157328, decompressed_data_size=3157328 diff=0
03:04:22:WU00:FS00:0xa4:- Digital signature verified
03:04:22:WU00:FS00:0xa4:
03:04:22:WU00:FS00:0xa4:Project: 7521 (Run 0, Clone 47, Gen 57)
03:04:22:WU00:FS00:0xa4:
03:04:22:WU00:FS00:0xa4:Entering M.D.
03:04:29:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
03:04:34:FS00:Paused
03:05:35:Removing old file 'configs/config-20150225-172016.xml'
03:05:35:Saving configuration to /etc/fahclient/config.xml
03:05:35:<config>
03:05:35:  <!-- Client Control -->
03:05:35:  <fold-anon v='true'/>
03:05:35:
03:05:35:  <!-- Folding Slot Configuration -->
03:05:35:  <gpu v='false'/>
03:05:35:
03:05:35:  <!-- HTTP Server -->
03:05:35:  <allow v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:05:35:
03:05:35:  <!-- Network -->
03:05:35:  <proxy v=':8080'/>
03:05:35:
03:05:35:  <!-- Remote Command Server -->
03:05:35:  <command-allow-no-pass v='127.0.0.1 192.168.2.100-192.168.2.110'/>
03:05:35:
03:05:35:  <!-- Slot Control -->
03:05:35:  <power v='full'/>
03:05:35:
03:05:35:  <!-- User Information -->
03:05:35:  <passkey v='********************************'/>
03:05:35:  <team v='70335'/>
03:05:35:  <user v='folding_hoomer'/>
03:05:35:
03:05:35:  <!-- Folding Slots -->
03:05:35:  <slot id='0' type='CPU'>
03:05:35:    <client-type v='beta'/>
03:05:35:    <next-unit-percentage v='100'/>
03:05:35:    <pause-on-start v='true'/>
03:05:35:    <paused v='true'/>
03:05:35:  </slot>
03:05:35:</config>
In both cases the CPU-Slot was deleted to dump the data of the BadWorkUnits.
Image
ChristianVirtual
Posts: 1596
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: Various a3 projects cause client to crash

Post by ChristianVirtual »

7522 (0, 96, 62)
endless retry, Ubuntu 12.04 (I think) and client 7.3.6


Code: Select all

2015-03-06:15:27:49:WU00:FS00:0xa3:- Digital signature verified
2015-03-06:15:27:49:WU00:FS00:0xa3:
2015-03-06:15:27:49:WU00:FS00:0xa3:Project: 7522 (Run 0, Clone 96, Gen 62)
2015-03-06:15:27:49:WU00:FS00:0xa3:
2015-03-06:15:27:49:WU00:FS00:0xa3:Entering M.D.
2015-03-06:15:27:55:WU00:FS00:0xa3:Mapping NT from 3 to 3
2015-03-06:15:27:56:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
2015-03-06:15:28:40:WU00:FS00:Starting
2015-03-06:15:28:40:WU00:FS00:Removing old file './work/00/logfile_01-20150306-145639.txt'
2015-03-06:15:28:40:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/beta/Core_a3.fah/FahCore_a3 -dir 00 -suffix 01 -version 703 -lifeline 3431 -checkpoint 15 -np 3
2015-03-06:15:28:40:WU00:FS00:Started FahCore on PID 3111

ImageImage
Please contribute your logs to http://ppd.fahmm.net
folding_hoomer
Posts: 349
Joined: Sun Feb 10, 2013 6:06 pm
Hardware configuration: Sys 1: I7 2700K@4,4GHz with NH-C14
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Sys 2: I7 3930K@4,4GHz with Corsair H110
16GB G.Skill Ripjaws X DDR3 1866MHz CL 9-10-9-28
ASUS Ranpage IV Formula, Ubuntu 10.10

Sys 3 i7 875K@3,826 GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI P55-GD80, Win7 64Bit Pro
Sapphire Radeon HD5870@1,163V 900/1250MHz
Sapphire Radeon HD7870@1,218V 1200/1300MHz

Sys 4 i7 2600K@4,4GHz with Scythe Mine2
8GB G.Skill Sniper DDR3 1866MHz CL 9-10-9-28
MSI Z68A-GD65 (G3), various operating systems (WinXP, Ubuntu: 10.4.3 LTS, 12.04.2 LTS)
Optional: GTX560TI 448@stock/OC´d

Optional:
ASUS P5Q Pro with Q9550
ASUS P5Q Pro with Q6300
Location: Bavaria, Germany

CoreA4-Project: infinite loop

Post by folding_hoomer »

A Teammember got a Project on his 32-Cores-Server without being able to fold:
Project: 7520 (Run 32, Clone 3, Gen 465) - infinite loop:

Code: Select all

*********************** Log Started 2015-03-06T13:33:23Z ***********************
13:33:23:************************* Folding@home Client *************************
13:33:23: Website: Folding@home
13:33:23: Copyright: (c) 2009-2013 Stanford University
13:33:23: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:33:23: Args: --child --lifeline 1536 /etc/fahclient/config.xml --run-as
13:33:23: fahclient --pid-file=/var/run/fahclient.pid --daemon
13:33:23: Config: /etc/fahclient/config.xml
13:33:23:******************************** Build ********************************
13:33:23: Version: 7.3.6
13:33:23: Date: Feb 18 2013
13:33:23: Time: 07:24:08
13:33:23: SVN Rev: 3923
13:33:23: Branch: fah/trunk/client
13:33:23: Compiler: GNU 4.4.7
13:33:23: Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
13:33:23: -fno-unsafe-math-optimizations -msse2
13:33:23: Platform: linux2 3.2.0-1-amd64
13:33:23: Bits: 64
13:33:23: Mode: Release
13:33:23:******************************* System ********************************
13:33:23: CPU: Genuine Intel(R) CPU @ 3.00GHz
13:33:23: CPU ID: GenuineIntel Family 6 Model 45 Stepping 2
13:33:23: CPUs: 32
13:33:23: Memory: 15.66GiB
13:33:23:Free Memory: 14.77GiB
13:33:23: Threads: POSIX_THREADS
13:33:23:Has Battery: false
13:33:23: On Battery: false
13:33:23: UTC offset: 1
13:33:23: PID: 1544
13:33:23: CWD: /var/lib/fahclient
13:33:23: OS: Linux 3.2.0-67-generic x86_64
13:33:23: OS Arch: AMD64
13:33:23: GPUs: 0
13:33:23: CUDA: Not detected
13:33:23:***************************************** ******************************
13:33:23:<config>
13:33:23: <!-- Folding Core -->
13:33:23: <checkpoint v='3'/>
13:33:23:
13:33:23: <!-- Folding Slot Configuration -->
13:33:23: <power v='full'/>
13:33:23:
13:33:23: <!-- HTTP Server -->
13:33:23: <allow v='127.0.0.1 192.168.0.0/24'/>
13:33:23:
13:33:23: <!-- Network -->
13:33:23: <proxy v=':8080'/>
13:33:23:
13:33:23: <!-- Remote Command Server -->
13:33:23: <password v='***********'/>
13:33:23:
13:33:23: <!-- User Information -->
13:33:23: <passkey v='********************************'/>
13:33:23: <team v='70335'/>
13:33:23: <user v='A.Meier-PS3'/>
13:33:23:
13:33:23: <!-- Folding Slots -->
13:33:23: <slot id='0' type='CPU'>
13:33:23: <cpus v='-1'/>
13:33:23: <next-unit-percentage v='100'/>
13:33:23: </slot>
13:33:23:</config>
13:33:23:Switching to user fahclient
13:33:23:Trying to access database...
13:33:23:Successfully acquired database lock
13:33:23:Enabled folding slot 00: READY cpu:32
13:33:23:WU00:FS00:Starting
13:33:23:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a3.fah/FahCore_a3 -dir 00 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
13:33:23:WU00:FS00:Started FahCore on PID 1551
13:33:23:WU00:FS00:Core PID:1555
13:33:23:WU00:FS00:FahCore 0xa3 started
13:33:24:WU00:FS00:0xa3:
13:33:24:WU00:FS00:0xa3:*------------------------------*
13:33:24:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
13:33:24:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
13:33:24:WU00:FS00:0xa3:
13:33:24:WU00:FS00:0xa3reparing to commence simulation
13:33:24:WU00:FS00:0xa3:- Looking at optimizations...
13:33:24:WU00:FS00:0xa3:- Files status OK
13:33:24:WU00:FS00:0xa3:- Expanded 3802916 -> 4173672 (decompressed 109.7 percent)
13:33:24:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3802916 data_size=4173672, decompressed_data_size=4173672 diff=0
13:33:24:WU00:FS00:0xa3:- Digital signature verified
13:33:24:WU00:FS00:0xa3:
13:33:24:WU00:FS00:0xa3roject: 8805 (Run 0, Clone 6, Gen 418)
13:33:24:WU00:FS00:0xa3:
13:33:24:WU00:FS00:0xa3:Assembly optimizations on if available.
13:33:24:WU00:FS00:0xa3:Entering M.D.
13:33:30:WU00:FS00:0xa3:Using Gromacs checkpoints
13:33:30:WU00:FS00:0xa3:Mapping NT from 32 to 32
13:33:33:WU00:FS00:0xa3:Resuming from checkpoint
13:33:33:WU00:FS00:0xa3:Verified 00/wudata_01.log
13:33:33:WU00:FS00:0xa3:Verified 00/wudata_01.trr
13:33:33:WU00:FS00:0xa3:Verified 00/wudata_01.edr
13:33:33:WU00:FS00:0xa3:Completed 151135 out of 500000 steps (30%)

...


21:06:44:WU01:FS00:0xa4:- Digital signature verified
21:06:44:WU01:FS00:0xa4:
21:06:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:06:44:WU01:FS00:0xa4:
21:06:44:WU01:FS00:0xa4:Entering M.D.
21:06:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:07:34:WU01:FS00:Starting
21:07:34:WU01:FS00:Removing old file './work/01/logfile_01-20150306-203533.txt'
21:07:34:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
21:07:34:WU01:FS00:Started FahCore on PID 4669
21:07:34:WU01:FS00:Core PID:4673
21:07:34:WU01:FS00:FahCore 0xa4 started
21:07:35:WU01:FS00:0xa4:
21:07:35:WU01:FS00:0xa4:*------------------------------*
21:07:35:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
21:07:35:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:07:35:WU01:FS00:0xa4:
21:07:35:WU01:FS00:0xa4reparing to commence simulation
21:07:35:WU01:FS00:0xa4:- Ensuring status. Please wait.
21:07:44:WU01:FS00:0xa4:- Looking at optimizations...
21:07:44:WU01:FS00:0xa4:- Working with standard loops on this execution.
21:07:44:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
21:07:44:WU01:FS00:0xa4:- Expanded 2715804 -> 3307052 (decompressed 121.7 percent)
21:07:44:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2715804 data_size=3307052, decompressed_data_size=3307052 diff=0
21:07:44:WU01:FS00:0xa4:- Digital signature verified
21:07:44:WU01:FS00:0xa4:
21:07:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:07:44:WU01:FS00:0xa4:
21:07:44:WU01:FS00:0xa4:Entering M.D.
21:07:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:08:34:WU01:FS00:Starting
21:08:34:WU01:FS00:Removing old file './work/01/logfile_01-20150306-203633.txt'
21:08:34:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
21:08:34:WU01:FS00:Started FahCore on PID 4682
21:08:34:WU01:FS00:Core PID:4686
21:08:34:WU01:FS00:FahCore 0xa4 started
21:08:35:WU01:FS00:0xa4:
21:08:35:WU01:FS00:0xa4:*------------------------------*
21:08:35:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
21:08:35:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:08:35:WU01:FS00:0xa4:
21:08:35:WU01:FS00:0xa4reparing to commence simulation
21:08:35:WU01:FS00:0xa4:- Ensuring status. Please wait.
21:08:44:WU01:FS00:0xa4:- Looking at optimizations...
21:08:44:WU01:FS00:0xa4:- Working with standard loops on this execution.
21:08:44:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
21:08:44:WU01:FS00:0xa4:- Expanded 2715804 -> 3307052 (decompressed 121.7 percent)
21:08:44:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2715804 data_size=3307052, decompressed_data_size=3307052 diff=0
21:08:44:WU01:FS00:0xa4:- Digital signature verified
21:08:44:WU01:FS00:0xa4:
21:08:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:08:44:WU01:FS00:0xa4:
21:08:44:WU01:FS00:0xa4:Entering M.D.
21:08:50:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:09:34:WU01:FS00:Starting
21:09:34:WU01:FS00:Removing old file './work/01/logfile_01-20150306-203733.txt'
21:09:34:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
21:09:34:WU01:FS00:Started FahCore on PID 4696
21:09:34:WU01:FS00:Core PID:4700
21:09:34:WU01:FS00:FahCore 0xa4 started
21:09:35:WU01:FS00:0xa4:
21:09:35:WU01:FS00:0xa4:*------------------------------*
21:09:35:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
21:09:35:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:09:35:WU01:FS00:0xa4:
21:09:35:WU01:FS00:0xa4reparing to commence simulation
21:09:35:WU01:FS00:0xa4:- Ensuring status. Please wait.
21:09:44:WU01:FS00:0xa4:- Looking at optimizations...
21:09:44:WU01:FS00:0xa4:- Working with standard loops on this execution.
21:09:44:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
21:09:44:WU01:FS00:0xa4:- Expanded 2715804 -> 3307052 (decompressed 121.7 percent)
21:09:44:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2715804 data_size=3307052, decompressed_data_size=3307052 diff=0
21:09:44:WU01:FS00:0xa4:- Digital signature verified
21:09:44:WU01:FS00:0xa4:
21:09:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:09:44:WU01:FS00:0xa4:
21:09:44:WU01:FS00:0xa4:Entering M.D.
21:09:51:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:10:34:WU01:FS00:Starting
21:10:34:WU01:FS00:Removing old file './work/01/logfile_01-20150306-203833.txt'
21:10:34:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
21:10:34:WU01:FS00:Started FahCore on PID 4709
21:10:34:WU01:FS00:Core PID:4713
21:10:34:WU01:FS00:FahCore 0xa4 started
21:10:35:WU01:FS00:0xa4:
21:10:35:WU01:FS00:0xa4:*------------------------------*
21:10:35:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
21:10:35:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:10:35:WU01:FS00:0xa4:
21:10:35:WU01:FS00:0xa4reparing to commence simulation
21:10:35:WU01:FS00:0xa4:- Ensuring status. Please wait.
21:10:44:WU01:FS00:0xa4:- Looking at optimizations...
21:10:44:WU01:FS00:0xa4:- Working with standard loops on this execution.
21:10:44:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
21:10:44:WU01:FS00:0xa4:- Expanded 2715804 -> 3307052 (decompressed 121.7 percent)
21:10:44:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2715804 data_size=3307052, decompressed_data_size=3307052 diff=0
21:10:44:WU01:FS00:0xa4:- Digital signature verified
21:10:44:WU01:FS00:0xa4:
21:10:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:10:44:WU01:FS00:0xa4:
21:10:44:WU01:FS00:0xa4:Entering M.D.
21:10:51:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:11:34:WU01:FS00:Starting
21:11:34:WU01:FS00:Removing old file './work/01/logfile_01-20150306-203934.txt'
21:11:34:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 1544 -checkpoint 3 -np 32
21:11:34:WU01:FS00:Started FahCore on PID 4722
21:11:34:WU01:FS00:Core PID:4726
21:11:34:WU01:FS00:FahCore 0xa4 started
21:11:35:WU01:FS00:0xa4:
21:11:35:WU01:FS00:0xa4:*------------------------------*
21:11:35:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
21:11:35:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:11:35:WU01:FS00:0xa4:
21:11:35:WU01:FS00:0xa4reparing to commence simulation
21:11:35:WU01:FS00:0xa4:- Ensuring status. Please wait.
21:11:44:WU01:FS00:0xa4:- Looking at optimizations...
21:11:44:WU01:FS00:0xa4:- Working with standard loops on this execution.
21:11:44:WU01:FS00:0xa4:Examination of work files indicates 8 consecutive improper terminations of core.
21:11:44:WU01:FS00:0xa4:- Expanded 2715804 -> 3307052 (decompressed 121.7 percent)
21:11:44:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2715804 data_size=3307052, decompressed_data_size=3307052 diff=0
21:11:44:WU01:FS00:0xa4:- Digital signature verified
21:11:44:WU01:FS00:0xa4:
21:11:44:WU01:FS00:0xa4roject: 7520 (Run 32, Clone 3, Gen 465)
21:11:44:WU01:FS00:0xa4:
21:11:44:WU01:FS00:0xa4:Entering M.D.
21:11:51:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
21:12:05:FS00aused
CPU-Slot was deleted, data were dumped.
Image
kasson
Pande Group Member
Posts: 1459
Joined: Thu Nov 29, 2007 9:37 pm

Re: Various CPU projects cause client to crash

Post by kasson »

It looks like the post-RAID corruption was fairly widespread. I just rehabilitated about 50 WU's from PROJ7522 (Clones ~ 82-140). Will keep working.
ThunderRd
Posts: 78
Joined: Sun Dec 02, 2007 5:30 am
Location: Nong Khai, Thailand

7520 (R119 C4 G264) [RESOLVED-BAD WU]

Post by ThunderRd »

For two days now, my machine attempts to run this WU. I have deleted the work directory and the queue file, and have re-booted the machine, but the result is the same. This is on a QX9650/Gentoo box that is fully up-to date and has been folding continuously for many years. As you see, there is an immediate error, and the client downloads the same file again and again.

Code: Select all

thunderrd@Q6600:~/FAH6$ fah

Note: Please read the license agreement (fah6 -license). Further 
use of this software requires that you have read and accepted this agreement.

4 cores detected


--- Opening Log file [March 10 04:54:26 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/thunderrd/FAH6
Executable: ./fah6
Arguments: -smp -verbosity 9 -advmethods 

[04:54:26] - Ask before connecting: No
[04:54:26] - User name: ThunderRd (Team 45)
[04:54:26] - User ID: 5C88288854EAB7D4
[04:54:26] - Machine ID: 1
[04:54:26] 
[04:54:26] Work directory not found. Creating...
[04:54:26] Could not open work queue, generating new queue...
[04:54:26] - Preparing to get new work unit...
[04:54:26] - Autosending finished units... [04:54:26]
[04:54:26] Cleaning up work directory
[04:54:26] Trying to send all finished work units
[04:54:26] + Attempting to get work packet
[04:54:26] + No unsent completed units remaining.
[04:54:26] Passkey found
[04:54:26] - Autosend completed
[04:54:26] - Will indicate memory of 3952 MB
[04:54:26] - Connecting to assignment server
[04:54:26] Connecting to http://assign.stanford.edu:8080/
[04:54:27] Posted data.
[04:54:27] Initial: 8F80; - Successful: assigned to (128.143.199.97).
[04:54:27] + News From Folding@Home: 
[04:54:27] Loaded queue successfully.
[04:54:27] Sent data
[04:54:27] Connecting to http://128.143.199.97:8080/
[04:54:29] Posted data.
[04:54:29] Initial: 0000; - Receiving payload (expected size: 2370234)
[04:54:38] - Downloaded at ~257 kB/s
[04:54:38] - Averaged speed for that direction ~257 kB/s
[04:54:38] + Received work.
[04:54:38] + Closed connections
[04:54:38] 
[04:54:38] + Processing work unit
[04:54:38] A4 will attempt to use 4 threads.
[04:54:38] Core required: FahCore_a4.exe
[04:54:38] Core found.
[04:54:38] Working on queue slot 01 [March 10 04:54:38 UTC]
[04:54:38] + Working ...
[04:54:38] - Calling './FahCore_a4.exe -dir work/ -nice 19 -suffix 01 -np 4 -checkpoint 5 -verbose -lifeline 29794 -version 634'

[04:54:38] 
[04:54:38] *------------------------------*
[04:54:38] Folding@Home Gromacs GB Core
[04:54:38] Version 2.27 (Dec. 15, 2010)
[04:54:38] 
[04:54:38] Preparing to commence simulation
[04:54:38] - Looking at optimizations...
[04:54:38] - Created dyn
[04:54:38] - Files status OK
[04:54:39] - Expanded 2369722 -> 3305616 (decompressed 139.4 percent)
[04:54:39] Called DecompressByteArray: compressed_data_size=2369722 data_size=3305616, decompressed_data_size=3305616 diff=0
[04:54:39] - Digital signature verified
[04:54:39] 
[04:54:39] Project: 7520 (Run 119, Clone 4, Gen 264)
[04:54:39] 
[04:54:39] Assembly optimizations on if available.
[04:54:39] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_01.tpr, VERSION 4.5.5-dev-20120703-fc032f9-dirty (single precision)
[04:54:45] CoreStatus = 0 (0)
[04:54:45] Sending work to server
[04:54:45] Project: 7520 (Run 119, Clone 4, Gen 264)
[04:54:45] - Error: Could not get length of results file work/wuresults_01.dat
[04:54:45] - Error: Could not read unit 01 file. Removing from queue.
[04:54:45] Trying to send all finished work units
[04:54:45] + No unsent completed units remaining.
[04:54:45] - Preparing to get new work unit...
[04:54:45] Cleaning up work directory
[04:54:45] + Attempting to get work packet
[04:54:45] Passkey found
[04:54:45] - Will indicate memory of 3952 MB
[04:54:45] - Connecting to assignment server
[04:54:45] Connecting to http://assign.stanford.edu:8080/
[04:54:46] Posted data.
[04:54:46] Initial: 8F80; - Successful: assigned to (128.143.199.97).
[04:54:46] + News From Folding@Home: 
[04:54:46] Loaded queue successfully.
[04:54:46] Sent data
[04:54:46] Connecting to http://128.143.199.97:8080/
[04:54:48] Posted data.
[04:54:48] Initial: 0000; - Receiving payload (expected size: 2370234)
[04:54:57] - Downloaded at ~257 kB/s
[04:54:57] - Averaged speed for that direction ~257 kB/s
[04:54:57] + Received work.
[04:54:57] Trying to send all finished work units
[04:54:57] + No unsent completed units remaining.
[04:54:57] + Closed connections
[04:55:02] 
[04:55:02] + Processing work unit
[04:55:02] A4 will attempt to use 4 threads.
[04:55:02] Core required: FahCore_a4.exe
[04:55:02] Core found.
[04:55:02] Working on queue slot 02 [March 10 04:55:02 UTC]
[04:55:02] + Working ...
[04:55:02] - Calling './FahCore_a4.exe -dir work/ -nice 19 -suffix 02 -np 4 -checkpoint 5 -verbose -lifeline 29794 -version 634'

[04:55:02] 
[04:55:02] *------------------------------*
[04:55:02] Folding@Home Gromacs GB Core
[04:55:02] Version 2.27 (Dec. 15, 2010)
[04:55:02] 
[04:55:02] Preparing to commence simulation
[04:55:02] - Ensuring status. Please wait.
[04:55:11] - Looking at optimizations...
[04:55:11] - Working with standard loops on this execution.
[04:55:11] - Created dyn
[04:55:11] - Files status OK
[04:55:12] - Expanded 2369722 -> 3305616 (decompressed 139.4 percent)
[04:55:12] Called DecompressByteArray: compressed_data_size=2369722 data_size=3305616, decompressed_data_size=3305616 diff=0
[04:55:12] - Digital signature verified
[04:55:12] 
[04:55:12] Project: 7520 (Run 119, Clone 4, Gen 264)
[04:55:12] 
[04:55:12] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_02.tpr, VERSION 4.5.5-dev-20120703-fc032f9-dirty (single precision)
[04:55:18] CoreStatus = 0 (0)
[04:55:18] Sending work to server
[04:55:18] Project: 7520 (Run 119, Clone 4, Gen 264)
[04:55:18] - Error: Could not get length of results file work/wuresults_02.dat
[04:55:18] - Error: Could not read unit 02 file. Removing from queue.
[04:55:18] Trying to send all finished work units
[04:55:18] + No unsent completed units remaining.
[04:55:18] - Preparing to get new work unit...
[04:55:18] Cleaning up work directory
[04:55:18] + Attempting to get work packet
[04:55:18] Passkey found
[04:55:18] - Will indicate memory of 3952 MB
[04:55:18] - Connecting to assignment server
[04:55:18] Connecting to http://assign.stanford.edu:8080/
[04:55:19] Posted data.
[04:55:19] Initial: 8F80; - Successful: assigned to (128.143.199.97).
[04:55:19] + News From Folding@Home: 
[04:55:19] Loaded queue successfully.
[04:55:19] Sent data
[04:55:19] Connecting to http://128.143.199.97:8080/
[04:55:21] Posted data.
[04:55:21] Initial: 0000; - Receiving payload (expected size: 2370234)
^C[04:55:24] ***** Got an Activate signal (2)
[04:55:24] Killing all core threads

Folding@Home Client Shutdown.
Last edited by ThunderRd on Tue Mar 10, 2015 2:49 pm, edited 2 times in total.
uncle_fungus
Site Admin
Posts: 1288
Joined: Fri Nov 30, 2007 9:37 am
Location: Oxfordshire, UK

Re: 7520 (R119 C4 G264) Could not get length of results file

Post by uncle_fungus »

Looks like a faulty WU. Someone else has returned a very small partial result and received 0 credit, and the stats system suggests that the WU is faulty. I'm going to mark it as bad, so it shouldn't be re-assigned until someone looks at it.
Post Reply