Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Moderators: Site Moderators, FAHC Science Team

Post Reply
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by GreyWhiskers »

Symptoms:

a. Unable to connect to Work Server 171.64.65.104 - to upload results of a completed project:7610 run:490 clone:0 gen:38 core:0xa4
b. failed over to CS171.67.108.49
c. CS returned Final credit estimate, 788.00 points (base points)
d. Given download/upload times, and computed TPF, Folding@home Bonus Point Calculator computes Total Points of 4499.23
e. Server Status of Work Server at Sat Dec 10 19:30:01 PST 2011 (Dec 11 at 0530 GMT): 171.64.65.104 vspg14b tjlane SMP full DOWN
f. The Stanford main stats page was offline for a time this evening - and when it came up, at about 19:30 PDT, it hadn't shown any recent updats since 15:00 PDT


Was the collection server giving wrong points?
Is the Stats system off?

Note- my system has been up and stable for a long time. The header of the log as shown in the v7 GUI shows it started almost 7 days ago. The Windows 7 Task Monitor shows 6 days 22 hours uptime.
I've manually put the date in at the point in the log where the interesting things start. Kind of reinforces my suggestion from a few days ago that v7 might use a full DATE/TIME ISO format for each log entry.
02:25:40:WARNING: WorkServer connection failed on port 8080 trying 80
02:25:40:Connecting to 171.64.65.104:80
02:26:01:WARNING: Exception: Failed to send results to work server: Failed to connect to 171.64.65.104:80: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond .
02:26:01:Trying to send results to collection server
02:26:01:Unit 00: Uploading 533.06KiB to 171.67.108.49
02:26:01:Connecting to 171.67.108.49:8080
02:26:04:Unit 00: Upload complete
02:26:04:Server responded WORK_ACK (400)
02:26:04:Final credit estimate, 788.00 points
Stats from MtMs FAHWatch7
Downloaded: 12/10/2011 15:31
Completed: 12/11/2011 2:25
TPF: 00:06:28
Upload time: 00:00:45

Code: Select all

*********************** Log Started 2011-12-04T05:24:58 ************************
05:24:58:************************* Folding@home Client *************************
05:24:58:      Website: http://folding.stanford.edu/
05:24:58:    Copyright: (c) 2009-2011 Stanford University
05:24:58:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:24:58:         Args: --lifeline 4268 --command-port=36330
05:24:58:       Config: C:/Users/USER/AppData/Roaming/FAHClient/config.xml
05:24:58:******************************** Build ********************************
05:24:58:      Version: 7.1.38
05:24:58:         Date: Oct 6 2011
05:24:58:         Time: 19:57:04
05:24:58:      SVN Rev: 3080
05:24:58:       Branch: fah/trunk/client
05:24:58:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
05:24:58:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
05:24:58:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT
05:24:58:     Platform: win32 XP
05:24:58:         Bits: 32
05:24:58:         Mode: Release
05:24:58:******************************* System ********************************
05:24:58:          CPU: Intel(R) Core(TM) i7-2860QM CPU @ 2.50GHz
05:24:58:       CPU ID: GenuineIntel Family 6 Model 42 Stepping 7
05:24:58:         CPUs: 8
05:24:58:       Memory: 15.98GiB
05:24:58:  Free Memory: 13.82GiB
05:24:58:      Threads: WINDOWS_THREADS
05:24:58:   On Battery: false
05:24:58:   UTC offset: -8
05:24:58:          PID: 5840
05:24:58:          CWD: C:/Users/USER/AppData/Roaming/FAHClient
05:24:58:           OS: Windows 7 Home Premium
05:24:58:      OS Arch: AMD64
05:24:58:         GPUs: 0
05:24:58:         CUDA: 2.1
05:24:58:  CUDA Driver: 4010
05:24:58:Win32 Service: false
05:24:58:***********************************************************************
05:24:58:<config>
05:24:58:  <service-description v='Folding@home Client'/>
05:24:58:  <service-restart v='true'/>
05:24:58:  <service-restart-delay v='5000'/>
05:24:58:
05:24:58:  <!-- Client Control -->
05:24:58:  <cycle-rate v='4'/>
05:24:58:  <cycles v='-1'/>
05:24:58:  <data-directory v='.'/>
05:24:58:  <disable-project-lookup v='false'/>
05:24:58:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
05:24:58:  <exit-when-done v='false'/>
05:24:58:  <threads v='4'/>
05:24:58:
05:24:58:  <!-- Configuration -->
05:24:58:  <config-rotate v='true'/>
05:24:58:  <config-rotate-dir v='configs'/>
05:24:58:  <config-rotate-max v='16'/>
05:24:58:
05:24:58:  <!-- Debugging -->
05:24:58:  <assignment-servers>
05:24:58:    assign3.stanford.edu:8080 assign4.stanford.edu:80
05:24:58:  </assignment-servers>
05:24:58:  <capture-directory v='capture'/>
05:24:58:  <capture-sockets v='false'/>
05:24:58:  <debug-sockets v='false'/>
05:24:58:  <exception-locations v='true'/>
05:24:58:  <gpu-assignment-servers>
05:24:58:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
05:24:58:  </gpu-assignment-servers>
05:24:58:  <stack-traces v='false'/>
05:24:58:
05:24:58:  <!-- Error Handling -->
05:24:58:  <max-slot-errors v='5'/>
05:24:58:  <max-unit-errors v='5'/>
05:24:58:
05:24:58:  <!-- FahCore Control -->
05:24:58:  <checkpoint v='15'/>
05:24:58:  <core-dir v='cores'/>
05:24:58:  <core-priority v='idle'/>
05:24:58:  <cpu-affinity v='false'/>
05:24:58:  <cpu-usage v='100'/>
05:24:58:  <no-assembly v='false'/>
05:24:58:
05:24:58:  <!-- Folding Slot Configuration -->
05:24:58:  <client-subtype v='STDCLI'/>
05:24:58:  <client-type v='normal'/>
05:24:58:  <cpu-species v='X86_PENTIUM_II'/>
05:24:58:  <cpu-type v='AMD64'/>
05:24:58:  <cpus v='-1'/>
05:24:58:  <cuda-index v='0'/>
05:24:58:  <gpu v='false'/>
05:24:58:  <gpu-usage v='100'/>
05:24:58:  <max-packet-size v='normal'/>
05:24:58:  <opencl-index v='0'/>
05:24:58:  <os-species v='UNKNOWN'/>
05:24:58:  <os-type v='WIN32'/>
05:24:58:  <project-key v='0'/>
05:24:58:  <smp v='true'/>
05:24:58:
05:24:58:  <!-- Logging -->
05:24:58:  <log v='log.txt'/>
05:24:58:  <log-color v='false'/>
05:24:58:  <log-crlf v='true'/>
05:24:58:  <log-date v='false'/>
05:24:58:  <log-debug v='true'/>
05:24:58:  <log-domain v='false'/>
05:24:58:  <log-header v='true'/>
05:24:58:  <log-level v='true'/>
05:24:58:  <log-no-info-header v='true'/>
05:24:58:  <log-redirect v='false'/>
05:24:58:  <log-rotate v='true'/>
05:24:58:  <log-rotate-dir v='logs'/>
05:24:58:  <log-rotate-max v='60'/>
05:24:58:  <log-short-level v='false'/>
05:24:58:  <log-simple-domains v='true'/>
05:24:58:  <log-thread-id v='false'/>
05:24:58:  <log-time v='true'/>
05:24:58:  <log-to-screen v='true'/>
05:24:58:  <log-truncate v='false'/>
05:24:58:  <verbosity v='4'/>
05:24:58:
05:24:58:  <!-- Network -->
05:24:58:  <proxy v=':8080'/>
05:24:58:  <proxy-enable v='false'/>
05:24:58:  <proxy-pass v=''/>
05:24:58:  <proxy-user v=''/>
05:24:58:
05:24:58:  <!-- Process Control -->
05:24:58:  <child v='false'/>
05:24:58:  <daemon v='false'/>
05:24:58:  <pid v='false'/>
05:24:58:  <pid-file v='Folding@home Client.pid'/>
05:24:58:  <respawn v='false'/>
05:24:58:  <service v='false'/>
05:24:58:
05:24:58:  <!-- Remote Command Server -->
05:24:58:  <command-address v='0.0.0.0'/>
05:24:58:  <command-allow v='127.0.0.1'/>
05:24:58:  <command-allow-no-pass v='127.0.0.1'/>
05:24:58:  <command-deny v='0.0.0.0/0'/>
05:24:58:  <command-deny-no-pass v='0.0.0.0/0'/>
05:24:58:  <command-port v='36330'/>
05:24:58:  <password v='********************************'/>
05:24:58:
05:24:58:  <!-- Slot Control -->
05:24:58:  <max-shutdown-wait v='60'/>
05:24:58:  <pause-on-battery v='true'/>
05:24:58:  <pause-on-start v='false'/>
05:24:58:
05:24:58:  <!-- User Information -->
05:24:58:  <machine-id v='0'/>
05:24:58:  <passkey v='********************************'/>
05:24:58:  <team v='0'/>
05:24:58:  <user v='GreyWhiskers'/>
05:24:58:
05:24:58:  <!-- Work Unit Control -->
05:24:58:  <dump-after-deadline v='true'/>
05:24:58:  <max-queue v='16'/>
05:24:58:  <max-units v='0'/>
05:24:58:  <next-unit-percentage v='100'/>
05:24:58:
05:24:58:  <!-- Folding Slots -->
05:24:58:  <slot id='0' type='SMP'/>
05:24:58:</config>

SNIP



15:31:37:Starting Unit 00
15:31:37:Running core: "C:/Users/OWNER/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 00 -suffix 01 -lifeline 5840 -version 701 -checkpoint 15 -np 8
15:31:37:Started core on PID 16904
15:31:37:FahCore 0xa4 started
15:31:38:Unit 00:
15:31:38:Unit 00:*------------------------------*
15:31:38:Unit 00:Folding@Home Gromacs GB Core
15:31:38:Unit 00:Version 2.27 (Dec. 15, 2010)
15:31:38:Unit 00:
15:31:38:Unit 00:Preparing to commence simulation
15:31:38:Unit 00:- Looking at optimizations...
15:31:38:Unit 00:- Created dyn
15:31:38:Unit 00:- Files status OK
15:31:38:Unit 00:- Expanded 337868 -> 644556 (decompressed 190.7 percent)
15:31:38:Unit 00:Called DecompressByteArray: compressed_data_size=337868 data_size=644556, decompressed_data_size=644556 diff=0
15:31:38:Unit 00:- Digital signature verified
15:31:38:Unit 00:
15:31:38:Unit 00:Project: 7610 (Run 490, Clone 0, Gen 38)
15:31:38:Unit 00:
15:31:38:Unit 00:Assembly optimizations on if available.
15:31:38:Unit 00:Entering M.D.
15:31:43:Unit 01: 39.20%
15:31:43:Unit 00:Mapping NT from 8 to 8 
15:31:43:Unit 00:Completed 0 out of 2000000 steps  (0%)
15:31:49:Unit 01: 77.83%
15:31:52:Unit 01: Upload complete
15:31:52:Server responded WORK_ACK (400)
15:31:52:Final credit estimate, 10718.00 points
15:31:52:Cleaning up Unit 01
15:37:52:Unit 00:Completed 20000 out of 2000000 steps  (1%)

SNIP

02:18:34:Unit 00:Completed 1980000 out of 2000000 steps  (99%)
02:25:07:Unit 00:Completed 2000000 out of 2000000 steps  (100%)
02:25:07:Unit 00:DynamicWrapper: Finished Work Unit: sleep=10000
02:25:08:Connecting to assign3.stanford.edu:8080
02:25:08:News: Welcome to Folding@Home
02:25:08:Assigned to work server 128.113.12.163
02:25:08:Requesting new work unit for slot 00: RUNNING smp:8 from 128.113.12.163
02:25:08:Connecting to 128.113.12.163:8080
02:25:09:Slot 00: Downloading 1.29MiB
02:25:12:Slot 00: Download complete
02:25:12:Received Unit: id:01 state:DOWNLOAD error:OK project:7905 run:60 clone:41 gen:0 core:0xa4 unit:0x0000000000ac9c234ecffacee184a4e0
02:25:17:Unit 00:
02:25:17:Unit 00:Finished Work Unit:
02:25:17:Unit 00:- Reading up to 488544 from "00/wudata_01.trr": Read 488544
02:25:17:Unit 00:trr file hash check passed.
02:25:17:Unit 00:- Reading up to 58104 from "00/wudata_01.xtc": Read 58104
02:25:17:Unit 00:xtc file hash check passed.
02:25:17:Unit 00:edr file hash check passed.
02:25:17:Unit 00:logfile size: 39686
02:25:17:Unit 00:Leaving Run
02:25:18:Unit 00:- Writing 610250 bytes of core data to disk...
02:25:18:Unit 00:Done: 609738 -> 545338 (compressed to 89.4 percent)
02:25:18:Unit 00:  ... Done.
02:25:19:Unit 00:- Shutting down core
02:25:19:Unit 00:
02:25:19:Unit 00:Folding@home Core Shutdown: FINISHED_UNIT
02:25:19:FahCore, running Unit 00, returned: FINISHED_UNIT (100 = 0x64)
02:25:19:Sending unit results: id:00 state:SEND error:OK project:7610 run:490 clone:0 gen:38 core:0xa4 unit:0x00000030664f2dd04de6d473f66a360a
02:25:19:Unit 00: Uploading 533.06KiB to 171.64.65.104
02:25:19:Connecting to 171.64.65.104:8080

*********************************************************************
02:25:19:Starting Unit 01
SNIP
02:25:26:Unit 01:Mapping NT from 8 to 8 
02:25:26:Unit 01:Completed 0 out of 500000 steps  (0%)

******************************************************************
[Added by GreyWhiskers:  DATE/Time: 2011-12-11T02:25:40Z]

02:25:40:WARNING: WorkServer connection failed on port 8080 trying 80
02:25:40:Connecting to 171.64.65.104:80
02:26:01:WARNING: Exception: Failed to send results to work server: Failed to connect to 171.64.65.104:80: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
02:26:01:Trying to send results to collection server
02:26:01:Unit 00: Uploading 533.06KiB to 171.67.108.49
02:26:01:Connecting to 171.67.108.49:8080
02:26:04:Unit 00: Upload complete
02:26:04:Server responded WORK_ACK (400)
02:26:04:Final credit estimate, 788.00 points
02:26:04:Cleaning up Unit 00
*******************************************************************

02:30:09:Unit 01:Completed 5000 out of 500000 steps  (1%)

bollix47
Posts: 2946
Joined: Sun Dec 02, 2007 5:04 am
Location: Canada

Re: Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by bollix47 »

Currently there appear to be some major problems at Stanford:

http://fah-web.stanford.edu/pybeta/serverstat.html

https://gadgets.stanford.edu/prod/mmr/c ... lerts.cgi#
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by bruce »

GreyWhiskers wrote:Symptoms:

c. CS returned Final credit estimate, 788.00 points (base points)

Was the collection server giving wrong points?
Is the Stats system off?
The Final Credit estimate is given by the V7 client, not by the CS. At this time it does not include a factor for the QRB.
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Re: Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by GreyWhiskers »

Well, I just pulled the following out of the v7 log from new i7 laptop system that is running SMP-8's. The log shows accurate "final credit estimates" for all the other completed work units in the log (as I said before, it's just shy of one week), except for this last one.

06:07:18:Final credit estimate, 10202.00 points
03:00:23:Final credit estimate, 10469.00 points
17:39:09:Final credit estimate, 10634.00 points
04:04:49:Final credit estimate, 4572.00 points
23:17:38:Final credit estimate, 10684.00 points
04:46:52:Final credit estimate, 3601.00 points
17:15:21:Final credit estimate, 4429.00 points
03:18:43:Final credit estimate, 4630.00 points
19:35:58:Final credit estimate, 2091.00 points
15:31:52:Final credit estimate, 10718.00 points
02:26:04:Final credit estimate, 788.00 points
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by PantherX »

Please read this -> viewtopic.php?f=18&t=20214
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Re: Issues with WS 171.64.65.104 and CS 171.67.108.49:8080

Post by GreyWhiskers »

Thanks.

BTW, I've been watching Stanford IT Service Alerts, and just noticed that the issue of chilled water was reported resolved about an hour ago (see blivit below). I also just checked the server stats, and see that many are still either DOWN or REJECT states.

Let's see what the morrow brings...

Resolved
Facilities: Computing Chilled water supply to Forsythe Hall interrupted 2011-12-10 23:45:00
Post Reply