What, exactly, gets uploaded as a completed WU?

Moderators: Site Moderators, FAHC Science Team

What, exactly, gets uploaded as a completed WU?

Postby kencl » Thu Apr 09, 2020 7:10 pm

I had a WU which would not upload for days (now successfully uploaded) so I made a copy of the entire FAHClient dir and was reading through some of the data files. That's just what coders do when they are told to stay home. :)

Is the data which is actually uploaded compressed either before upload or on the fly? I'm not finding any files which match the smaller upload size reported in the log.

I'd like to know exactly which file(s) is/are uploaded and what processing is done before they are transmitted because I see over 10% redundancy in the viewerFrame#.json files.

Thanks.
kencl
 
Posts: 3
Joined: Thu Apr 09, 2020 6:15 am

Re: What, exactly, gets uploaded as a completed WU?

Postby Joe_H » Thu Apr 09, 2020 11:41 pm

If you read the section of the log just after a WU reaches 100%, the client echoes that it is reading a series of files, those are packed up wit the wu data file. As I understand it, they are compressed before sending.

The downloaded WU is also compressed. Part of the logged messages in the client's log used to show the decompressed size, and the same for compressing the results. But that was removed form logging several versions ago.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 6521
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: What, exactly, gets uploaded as a completed WU?

Postby PantherX » Fri Apr 10, 2020 12:16 am

At the completion of the WU, everything is packed into a single file that's created called wuresult_XX.dat which is uploaded to the server. Here's the log snippet showing that:
Code: Select all
19:35:20:WU01:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
19:35:22:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
19:35:22:WU01:FS01:0x22:Saving result file checkpointState.xml
19:35:22:WU01:FS01:0x22:Saving result file checkpt.crc
19:35:22:WU01:FS01:0x22:Saving result file positions.xtc
19:35:22:WU01:FS01:0x22:Saving result file science.log
19:35:22:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
19:35:23:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:35:23:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11778 run:0 clone:8750 gen:19 core:0x22 unit:0x00000023287234c95e7432494a58a618
19:35:23:WU01:FS01:Uploading 23.04MiB to 40.114.52.201
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
User avatar
PantherX
Site Moderator
 
Posts: 6539
Joined: Wed Dec 23, 2009 10:33 am
Location: Land Of The Long White Cloud


Return to V7.5.1 Public Release Windows/Linux/MacOS X

Who is online

Users browsing this forum: No registered users and 2 guests

cron