Page 1 of 1

Project: 3059 (Run 3, Clone 90, Gen 91) crashing @ 24 %

Posted: Tue Dec 18, 2007 12:37 pm
by dschief
Consecutive Wu's crashed at 24 %

Code: Select all

[12:35:57] Working on Unit 07 [December 18 12:35:57]
[12:35:57] + Working ...
[12:35:57] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 07 -priority 96 -checkpoint 15 -verbose -lifeline 18106 -version 600'

[12:35:57] 
[12:35:57] *------------------------------*
[12:35:57] Folding@Home Gromacs SMP Core
[12:35:57] Version 1.74 (November 27, 2006)
[12:35:57] 
[12:35:57] Preparing to commence simulation
[12:35:57] - Ensuring status. Please wait.
[12:35:57] Created dyn
[12:35:57] - Files status OK
[12:35:57] - Expanded 538502 -> 2920917 (decompressed 542.4 percent)
[12:35:57] - Starting from initial work packet
[12:35:57] 
[12:35:57] Project: 3059 (Run 3, Clone 90, Gen 91)
[12:35:57] 
[12:35:57] Assembly optimizations on if available.
[12:35:57] Entering M.D.
[12:36:14] ial work pa- Sta
[12:36:14] Project: 3059 (Run 3, Clone 90, Gen 91)
[12:36:14] 
[12:36:14] Entering M.D.
[12:36:14] one 90, Gen 91)
[12:36:14] 
[12:36:14] Entering M.D.
NNODES=4, MYRANK=1, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=0, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=2, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=3, HOSTNAME=localhost.localdomain
NODEID=0 argc=15
NODEID=1 argc=15
NODEID=3 argc=15
NODEID=2 argc=15
      Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
             Copyright (c) 2001-2004, The GROMACS development team,
            check out http://www.gromacs.org for more information.

        This inclusion of Gromacs code in the Folding@Home Core is under
        a special license (see http://folding.stanford.edu/gromacs.html)
         specially granted to Stanford by the copyright holders. If you
          are interested in using Gromacs, visit http://www.gromacs.org where
                you can download a free version of Gromacs under
         the terms of the GNU General Public License (GPL) as published
       by the Free Software Foundation; either version 2 of the License,
                     or (at your option) any later version.

starting mdrun '19872 p3059_supervillin_newbox'
5000000 steps,  10000.0 ps.

[12:36:20] iting local files
[12:36:20] Completed 0 out of 5000000 steps  (0 percent)
[12:36:20] a SSE boost OK.
[12:43:36] les
[12:43:36] Completed 50000 out of 5000000 steps  (1 percent)
[12:50:52] Writing local files
[12:50:52] Completed 100000 out of 5000000 steps  (2 percent)
[12:58:10] Writing local files
[12:58:10] Completed 150000 out of 5000000 steps  (3 percent)
[13:05:27] Writing local files
[13:05:27] Completed 200000 out of 5000000 steps  (4 percent)
[13:12:42] Writing local files
[13:12:42] Completed 250000 out of 5000000 steps  (5 percent)
[13:19:57] Writing local files
[13:19:57] Completed 300000 out of 5000000 steps  (6 percent)
[13:27:12] Writing local files
[13:27:12] Completed 350000 out of 5000000 steps  (7 percent)
[13:34:25] Writing local files
[13:34:25] Completed 400000 out of 5000000 steps  (8 percent)
[13:41:40] Writing local files
[13:41:40] Completed 450000 out of 5000000 steps  (9 percent)
[13:48:57] Writing local files
[13:48:57] Completed 500000 out of 5000000 steps  (10 percent)
[13:56:14] Writing local files
[13:56:14] Completed 550000 out of 5000000 steps  (11 percent)
[14:03:29] Writing local files
[14:03:29] Completed 600000 out of 5000000 steps  (12 percent)
[14:10:43] Writing local files
[14:10:43] Completed 650000 out of 5000000 steps  (13 percent)
[14:17:57] Writing local files
[14:17:57] Completed 700000 out of 5000000 steps  (14 percent)
[14:25:12] Writing local files
[14:25:12] Completed 750000 out of 5000000 steps  (15 percent)
[14:32:27] Writing local files
[14:32:27] Completed 800000 out of 5000000 steps  (16 percent)
[14:39:43] Writing local files
[14:39:43] Completed 850000 out of 5000000 steps  (17 percent)
[14:46:58] Writing local files
[14:46:58] Completed 900000 out of 5000000 steps  (18 percent)
[14:54:14] Writing local files
[14:54:14] Completed 950000 out of 5000000 steps  (19 percent)
[15:01:30] Writing local files
[15:01:30] Completed 1000000 out of 5000000 steps  (20 percent)
[15:08:45] Writing local files
[15:08:45] Completed 1050000 out of 5000000 steps  (21 percent)
[15:15:59] Writing local files
[15:15:59] Completed 1100000 out of 5000000 steps  (22 percent)
[15:23:15] Writing local files
[15:23:16] Completed 1150000 out of 5000000 steps  (23 percent)
[15:30:30] Writing local files
[15:30:30] Completed 1200000 out of 5000000 steps  (24 percent)
[15:32:11] Warning:  long 1-4 interactions
[0]0:Return code = 0, signaled with Segmentation fault
[0]1:Return code = 0, signaled with Quit
[0]2:Return code = 0, signaled with Segmentation fault
[0]3:Return code = 0, signaled with Segmentation fault
[15:32:15] CoreStatus = 0 (0)
[15:32:15] Client-core communications error: ERROR 0x0
[15:32:15] Deleting current work unit & continuing...
[0]0:Return code = 18
[0]1:Return code = 0, signaled with Quit
[0]2:Return code = 0, signaled with Quit
[0]3:Return code = 0, signaled with Quit
[15:36:36] - Warning: Could not delete all work unit files (7): Core returned invalid code
[15:36:36] Trying to send all finished work units
[15:36:36] + No unsent completed units remaining.
[15:36:36] - Preparing to get new work unit...
[15:36:36] + Attempting to get work packet
[15:36:36] - Will indicate memory of 2013 MB
[15:36:36] - Connecting to assignment server
[15:36:36] Connecting to http://assign.stanford.edu:8080/
[15:36:36] Posted data.
[15:36:36] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[15:36:36] + News From Folding@Home: Welcome to Folding@Home
[15:36:36] Loaded queue successfully.
[15:36:36] Connecting to http://171.64.65.63:8080/
[15:36:37] Posted data.
[15:36:37] Initial: 0000; - Receiving payload (expected size: 539014)
[15:36:41] - Downloaded at ~131 kB/s
[15:36:41] - Averaged speed for that direction ~159 kB/s
[15:36:41] + Received work.
[15:36:41] + Closed connections
[15:36:46] 
[15:36:46] + Processing work unit
[15:36:46] Core required: FahCore_a1.exe
[15:36:46] Core found.
[15:36:46] Working on Unit 08 [December 18 15:36:46]
[15:36:46] + Working ...
[15:36:46] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 08 -priority 96 -checkpoint 15 -verbose -lifeline 18106 -version 600'

[15:36:46] 
[15:36:46] *------------------------------*
[15:36:46] Folding@Home Gromacs SMP Core
[15:36:46] Version 1.74 (November 27, 2006)
[15:36:46] 
[15:36:46] Preparing to commence simulation
[15:36:46] - Ensuring status. Please wait.
[15:37:03] - Looking at optimizations...
[15:37:03] - Working with standard loops on this execution.
[15:37:03] - Previous termination of core w- Expanded 538502 -> 2920917 (d- Expanded 538502 -> 292091- Starting from initial work packet
[15:37:03] 
[15:37:03] Project: 3059 (Run 3, Clone 90, Gen 91)
[15:37:03] 
[15:37:03] Entering M.D.
[15:37:03] one 90, Gen 91)
[15:37:03] 
[15:37:03] Entering M.D.
[15:37:03] one 90, Gen 91)
[15:37:03] 
[15:37:03] Entering M.D.
NNODES=4, MYRANK=0, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=1, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=2, HOSTNAME=localhost.localdomain
NNODES=4, MYRANK=3, HOSTNAME=localhost.localdomain
NODEID=0 argc=15
NODEID=1 argc=15
NODEID=2 argc=15
NODEID=3 argc=15
      Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
             Copyright (c) 2001-2004, The GROMACS development team,
            check out http://www.gromacs.org for more information.

        This inclusion of Gromacs code in the Folding@Home Core is under
        a special license (see http://folding.stanford.edu/gromacs.html)
         specially granted to Stanford by the copyright holders. If you
          are interested in using Gromacs, visit http://www.gromacs.org where
                you can download a free version of Gromacs under
         the terms of the GNU General Public License (GPL) as published
       by the Free Software Foundation; either version 2 of the License,
                     or (at your option) any later version.

starting mdrun '19872 p3059_supervillin_newbox'
5000000 steps,  10000.0 ps.

[15:37:09] tra SSE boost OK.
[15:37:09] 
[15:37:09] Extra SSE boost OK.
[15:37:09] Writing local files
[15:37:09] Completed 0 out of 5000000 steps  (0 percent)
[15:42:07] - Autosending finished units...
[15:42:07] Trying to send all finished work units
[15:42:07] + No unsent completed units remaining.
[15:42:07] - Autosend completed
[15:44:28] Writing local files
[15:44:28] Completed 50000 out of 5000000 steps  (1 percent)
[15:51:45] Writing local files
[15:51:45] Completed 100000 out of 5000000 steps  (2 percent)
[15:59:06] Writing local files
[15:59:06] Completed 150000 out of 5000000 steps  (3 percent)
[16:06:24] Writing local files
[16:06:24] Completed 200000 out of 5000000 steps  (4 percent)
[16:13:41] Writing local files
[16:13:41] Completed 250000 out of 5000000 steps  (5 percent)
[16:21:00] Writing local files
[16:21:00] Completed 300000 out of 5000000 steps  (6 percent)
[16:28:17] Writing local files
[16:28:17] Completed 350000 out of 5000000 steps  (7 percent)
[16:35:33] Writing local files
[16:35:34] Completed 400000 out of 5000000 steps  (8 percent)
[16:42:50] Writing local files
[16:42:50] Completed 450000 out of 5000000 steps  (9 percent)
[16:50:08] Writing local files
[16:50:08] Completed 500000 out of 5000000 steps  (10 percent)
[16:57:29] Writing local files
[16:57:29] Completed 550000 out of 5000000 steps  (11 percent)
[17:04:45] Writing local files
[17:04:45] Completed 600000 out of 5000000 steps  (12 percent)
[17:12:01] Writing local files
[17:12:01] Completed 650000 out of 5000000 steps  (13 percent)
[17:19:17] Writing local files
[17:19:17] Completed 700000 out of 5000000 steps  (14 percent)
[17:26:35] Writing local files
[17:26:35] Completed 750000 out of 5000000 steps  (15 percent)
[17:33:51] Writing local files
[17:33:51] Completed 800000 out of 5000000 steps  (16 percent)
[17:41:09] Writing local files
[17:41:09] Completed 850000 out of 5000000 steps  (17 percent)
[17:48:26] Writing local files
[17:48:26] Completed 900000 out of 5000000 steps  (18 percent)
[17:55:43] Writing local files
[17:55:43] Completed 950000 out of 5000000 steps  (19 percent)
[18:03:00] Writing local files
[18:03:00] Completed 1000000 out of 5000000 steps  (20 percent)
[18:10:16] Writing local files
[18:10:16] Completed 1050000 out of 5000000 steps  (21 percent)
[18:17:33] Writing local files
[18:17:33] Completed 1100000 out of 5000000 steps  (22 percent)
[18:24:51] Writing local files
[18:24:51] Completed 1150000 out of 5000000 steps  (23 percent)
[18:32:07] Writing local files
[18:32:07] Completed 1200000 out of 5000000 steps  (24 percent)
[18:33:48] Warning:  long 1-4 interactions
[0]0:Return code = 0, signaled with Segmentation fault
[0]1:Return code = 0, signaled with Quit
[0]2:Return code = 0, signaled with Segmentation fault
[0]3:Return code = 0, signaled with Segmentation fault
[18:33:52] CoreStatus = 0 (0)
[18:33:52] Client-core communications error: ERROR 0x0
[18:33:52] Deleting current work unit & continuing...
[0]0:Return code = 0, signaled with Quit
[0]1:Return code = 0, signaled with Quit
[0]2:Return code = 18
[0]3:Return code = 0, signaled with Quit
[18:38:19] - Warning: Could not delete all work unit files (8): Core returned invalid code
[18:38:19] Trying to send all finished work units
[18:38:19] + No unsent completed units remaining.
[18:38:19] - Preparing to get new work unit...
[18:38:19] + Attempting to get work packet
[18:38:19] - Will indicate memory of 2013 MB
System:
Q6600
ASUS P5K-E M/B
2 G ram
Stock Clock ing
FC8 2.6.23.8-63 X86_64

Re: Project: 3059 (Run 3, Clone 90, Gen 91) crashing @ 24 %

Posted: Sat Dec 22, 2007 2:14 am
by uncle_fungus
This WU has now been completed by someone else.