Folding@Home RAM usage grows until exceeded, then PC crashes

[Dark_Vera]

Greetings everyone,

I am running the latest FAH client on Manjaro LXDE (Archlinux) on a rig utilizing a Celeron dual core and 8X AMD RX460 gpus, with 12GB of RAM.

Everything has been working swimmingly except the RAM usage, when folding, keeps growing and growing until it uses all 12GB of my available RAM - then my PC hard freezes and requires a reboot.

I've also noticed that if I voluntarily reboot the PC before running out of RAM, RAM usage drops to 5GB, then slowly by steadily grows again until hitting my 12GB limit.

According to system monitor, no other applications or processes are using this significant amount of RAM - it's only FAH which uses any meaningful RAM, and specifically, FAHcore_21.

Could I get some help here? Perhaps FAH has a memory leak? I cannot continue to fold this way because the PC now cannot be left unattended for long periods of time.

Thanks in advance!

[bruce]

That's called a "memory leak" and it's a bug. Which FAHCore(s) are you running? Just FAHCore_21?

What happens to the memory footprint if you PAUSE / FOLD instead of reboot? What project(s) have you been getting?

[Dark_Vera]

hi bruce, thanks for the quick reply.

All 8 of my GPUs are working on FahCore_21 / 0x21.

Also I'm attaching a screenshot of my desktop which shows memory and GPU usage via Conky, as well as attaching my FAH logfile.

Let me know if you see anything out of the ordinary.

https://imgur.com/a/4ouDdno

Code: Select all

*********************** Log Started 2019-10-28T08:11:45Z ***********************
08:11:45:************************* Folding@home Client *************************
08:11:45:    Website: https://foldingathome.org/
08:11:45:  Copyright: (c) 2009-2018 foldingathome.org
08:11:45:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:11:45:       Args: --config /opt/fah/config.xml --exec-directory=/opt/fah
08:11:45:             --data-directory=/opt/fah
08:11:45:     Config: /opt/fah/config.xml
08:11:45:******************************** Build ********************************
08:11:45:    Version: 7.5.1
08:11:45:       Date: May 11 2018
08:11:45:       Time: 19:59:04
08:11:45: Repository: Git
08:11:45:   Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
08:11:45:     Branch: master
08:11:45:   Compiler: GNU 6.3.0 20170516
08:11:45:    Options: -std=gnu++98 -O3 -funroll-loops
08:11:45:   Platform: linux2 4.14.0-3-amd64
08:11:45:       Bits: 64
08:11:45:       Mode: Release
08:11:45:******************************* System ********************************
08:11:45:        CPU: Intel(R) Celeron(R) CPU G3930 @ 2.90GHz
08:11:45:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
08:11:45:       CPUs: 2
08:11:45:     Memory: 11.63GiB
08:11:45:Free Memory: 11.25GiB
08:11:45:    Threads: POSIX_THREADS
08:11:45: OS Version: 5.3
08:11:45:Has Battery: false
08:11:45: On Battery: false
08:11:45: UTC Offset: 4
08:11:45:        PID: 401
08:11:45:        CWD: /opt/fah
08:11:45:         OS: Linux 5.3.6-1-MANJARO x86_64
08:11:45:    OS Arch: AMD64
08:11:45:       GPUs: 8
08:11:45:      GPU 0: Bus:1 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 1: Bus:2 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 2: Bus:3 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 3: Bus:4 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 4: Bus:5 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 5: Bus:6 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 6: Bus:7 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:      GPU 7: Bus:8 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
08:11:45:       CUDA: Not detected: Failed to open dynamic library 'libcuda.so':
08:11:45:             libcuda.so: cannot open shared object file: No such file or
08:11:45:             directory
08:11:45:     OpenCL: Not detected: clGetDeviceIDs() returned -1
08:11:45:***********************************************************************
08:11:45:<config>
08:11:45:  <!-- Network -->
08:11:45:  <proxy v=':8080'/>
08:11:45:
08:11:45:  <!-- Slot Control -->
08:11:45:  <power v='full'/>
08:11:45:
08:11:45:  <!-- User Information -->
08:11:45:  <passkey v='********************************'/>
08:11:45:  <team v='111065'/>
08:11:45:  <user v='TheFountainhead'/>
08:11:45:
08:11:45:  <!-- Folding Slots -->
08:11:45:  <slot id='1' type='GPU'>
08:11:45:    <opencl-index v='1'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='0' type='GPU'>
08:11:45:    <opencl-index v='2'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='2' type='GPU'>
08:11:45:    <opencl-index v='3'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='3' type='GPU'>
08:11:45:    <opencl-index v='4'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='4' type='GPU'>
08:11:45:    <opencl-index v='5'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='5' type='GPU'>
08:11:45:    <opencl-index v='6'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='6' type='GPU'>
08:11:45:    <opencl-index v='7'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:  <slot id='7' type='GPU'>
08:11:45:    <opencl-index v='8'/>
08:11:45:    <paused v='true'/>
08:11:45:  </slot>
08:11:45:</config>
08:11:45:Trying to access database...
08:11:45:Successfully acquired database lock
08:11:45:Enabled folding slot 01: PAUSED gpu:0:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 00: PAUSED gpu:1:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 02: PAUSED gpu:2:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 03: PAUSED gpu:3:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 04: PAUSED gpu:4:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 05: PAUSED gpu:5:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 06: PAUSED gpu:6:Baffin XT [Radeon RX 460] (by user)
08:11:45:Enabled folding slot 07: PAUSED gpu:7:Baffin XT [Radeon RX 460] (by user)
08:11:45:ERROR:No compute devices matched GPU #0 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #1 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #2 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #3 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #4 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #5 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #6 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:11:45:ERROR:No compute devices matched GPU #7 AMD:5 Baffin XT [Radeon RX 460].  You may need to update your graphics drivers.
08:19:44:FS01:Unpaused
08:19:44:FS00:Unpaused
08:19:44:FS02:Unpaused
08:19:44:FS03:Unpaused
08:19:44:FS04:Unpaused
08:19:44:FS05:Unpaused
08:19:44:FS06:Unpaused
08:19:44:FS07:Unpaused
08:19:44:WU07:FS06:Downloading core from http://cores.foldingathome.org/v7/lin/64bit/Core_21.fah
08:19:44:WU07:FS06:Connecting to cores.foldingathome.org:80
08:19:44:WU07:FS06:FahCore 21: Downloading 3.23MiB
08:19:49:WU07:FS06:FahCore 21: Download complete
08:19:49:WU07:FS06:Valid core signature
08:19:49:WARNING:WU07:FS06:FahCore has not changed since last download, aborting core update
08:19:49:WU07:FS06:Starting
08:19:49:WU07:FS06:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 07 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 7 -gpu 7
08:19:49:WU07:FS06:Started FahCore on PID 1672
08:19:49:WU07:FS06:Core PID:1676
08:19:49:WU07:FS06:FahCore 0x21 started
08:19:49:WU04:FS01:Starting
08:19:49:WU04:FS01:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 04 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 1 -gpu 1
08:19:49:WU04:FS01:Started FahCore on PID 1677
08:19:49:WU04:FS01:Core PID:1681
08:19:49:WU04:FS01:FahCore 0x21 started
08:19:49:WU05:FS07:Starting
08:19:49:WU05:FS07:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 05 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 8 -gpu 8
08:19:49:WU05:FS07:Started FahCore on PID 1682
08:19:49:WU05:FS07:Core PID:1686
08:19:49:WU05:FS07:FahCore 0x21 started
08:19:49:WU06:FS04:Starting
08:19:49:WU06:FS04:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 06 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 5 -gpu 5
08:19:49:WU06:FS04:Started FahCore on PID 1687
08:19:49:WU06:FS04:Core PID:1691
08:19:49:WU06:FS04:FahCore 0x21 started
08:19:49:WU09:FS00:Starting
08:19:49:WU09:FS00:Removing old file '/opt/fah/work/09/logfile_01-20191028-021223.txt'
08:19:49:WU09:FS00:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 09 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 2 -gpu 2
08:19:49:WU09:FS00:Started FahCore on PID 1696
08:19:49:WU09:FS00:Core PID:1700
08:19:49:WU09:FS00:FahCore 0x21 started
08:19:49:WU02:FS05:Starting
08:19:49:WU02:FS05:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 6 -gpu 6
08:19:49:WU02:FS05:Started FahCore on PID 1707
08:19:49:WU02:FS05:Core PID:1711
08:19:49:WU02:FS05:FahCore 0x21 started
08:19:49:WU03:FS02:Starting
08:19:49:WU03:FS02:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 03 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 3 -gpu 3
08:19:49:WU03:FS02:Started FahCore on PID 1713
08:19:49:WU03:FS02:Core PID:1718
08:19:49:WU03:FS02:FahCore 0x21 started
08:19:49:WU00:FS03:Starting
08:19:49:WU00:FS03:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 4 -gpu 4
08:19:49:WU00:FS03:Started FahCore on PID 1720
08:19:49:WU00:FS03:Core PID:1725
08:19:49:WU00:FS03:FahCore 0x21 started
08:19:50:WU07:FS06:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU07:FS06:0x21:Project: 14196 (Run 5, Clone 295, Gen 14)
08:19:50:WU07:FS06:0x21:Unit: 0x000000170002894b5d92465af5ee46b3
08:19:50:WU07:FS06:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU07:FS06:0x21:Machine: 6
08:19:50:WU07:FS06:0x21:Digital signatures verified
08:19:50:WU07:FS06:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU07:FS06:0x21:Version 0.0.20
08:19:50:WU04:FS01:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU04:FS01:0x21:Project: 14196 (Run 10, Clone 10, Gen 56)
08:19:50:WU04:FS01:0x21:Unit: 0x0000003f0002894b5d9246731f078749
08:19:50:WU04:FS01:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU04:FS01:0x21:Machine: 1
08:19:50:WU04:FS01:0x21:Digital signatures verified
08:19:50:WU04:FS01:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU04:FS01:0x21:Version 0.0.20
08:19:50:WU05:FS07:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU05:FS07:0x21:Project: 14191 (Run 0, Clone 0, Gen 78)
08:19:50:WU05:FS07:0x21:Unit: 0x000000710002894c5d5d740ddd24b5ef
08:19:50:WU05:FS07:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU05:FS07:0x21:Machine: 7
08:19:50:WU05:FS07:0x21:Digital signatures verified
08:19:50:WU05:FS07:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU05:FS07:0x21:Version 0.0.20
08:19:50:WU06:FS04:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU06:FS04:0x21:Project: 14196 (Run 17, Clone 429, Gen 6)
08:19:50:WU06:FS04:0x21:Unit: 0x000000080002894b5d9246a5799c451d
08:19:50:WU06:FS04:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU06:FS04:0x21:Machine: 4
08:19:50:WU06:FS04:0x21:Reading tar file core.xml
08:19:50:WU06:FS04:0x21:Reading tar file integrator.xml
08:19:50:WU06:FS04:0x21:Reading tar file state.xml
08:19:50:WU06:FS04:0x21:Reading tar file system.xml
08:19:50:WU09:FS00:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU09:FS00:0x21:Project: 14276 (Run 0, Clone 94, Gen 54)
08:19:50:WU09:FS00:0x21:Unit: 0x0000003f80fccb0a5d98ab6022b81c2a
08:19:50:WU09:FS00:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU09:FS00:0x21:Machine: 0
08:19:50:WU09:FS00:0x21:Digital signatures verified
08:19:50:WU09:FS00:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU09:FS00:0x21:Version 0.0.20
08:19:50:WU02:FS05:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU02:FS05:0x21:Project: 14180 (Run 1, Clone 406, Gen 116)
08:19:50:WU02:FS05:0x21:Unit: 0x000000a60002894c5d3b5453c9566777
08:19:50:WU02:FS05:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU02:FS05:0x21:Machine: 5
08:19:50:WU02:FS05:0x21:Digital signatures verified
08:19:50:WU02:FS05:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU02:FS05:0x21:Version 0.0.20
08:19:50:WU03:FS02:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU03:FS02:0x21:Project: 14180 (Run 6, Clone 72, Gen 229)
08:19:50:WU03:FS02:0x21:Unit: 0x0000014d0002894c5cbf4a124ce991c2
08:19:50:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU03:FS02:0x21:Machine: 2
08:19:50:WU03:FS02:0x21:Digital signatures verified
08:19:50:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU03:FS02:0x21:Version 0.0.20
08:19:50:WU03:FS02:0x21:  Found a checkpoint file
08:19:50:WU00:FS03:0x21:*********************** Log Started 2019-10-28T08:19:49Z ***********************
08:19:50:WU00:FS03:0x21:Project: 14272 (Run 0, Clone 84, Gen 26)
08:19:50:WU00:FS03:0x21:Unit: 0x0000002080fccb0a5d9cfc71e741876f
08:19:50:WU00:FS03:0x21:CPU: 0x00000000000000000000000000000000
08:19:50:WU00:FS03:0x21:Machine: 3
08:19:50:WU00:FS03:0x21:Digital signatures verified
08:19:50:WU00:FS03:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU00:FS03:0x21:Version 0.0.20
08:19:50:WU00:FS03:0x21:  Found a checkpoint file
08:19:50:WU05:FS07:0x21:  Found a checkpoint file
08:19:50:WU09:FS00:0x21:  Found a checkpoint file
08:19:50:WU02:FS05:0x21:  Found a checkpoint file
08:19:50:WU07:FS06:0x21:  Found a checkpoint file
08:19:50:WU06:FS04:0x21:Digital signatures verified
08:19:50:WU06:FS04:0x21:Folding@home GPU Core21 Folding@home Core
08:19:50:WU06:FS04:0x21:Version 0.0.20
08:19:53:Removing old file 'configs/config-20191025-225004.xml'
08:19:53:Saving configuration to /opt/fah/config.xml
08:19:53:<config>
08:19:53:  <!-- Network -->
08:19:53:  <proxy v=':8080'/>
08:19:53:
08:19:53:  <!-- Slot Control -->
08:19:53:  <power v='full'/>
08:19:53:
08:19:53:  <!-- User Information -->
08:19:53:  <passkey v='********************************'/>
08:19:53:  <team v='111065'/>
08:19:53:  <user v='TheFountainhead'/>
08:19:53:
08:19:53:  <!-- Folding Slots -->
08:19:53:  <slot id='1' type='GPU'>
08:19:53:    <opencl-index v='1'/>
08:19:53:  </slot>
08:19:53:  <slot id='0' type='GPU'>
08:19:53:    <opencl-index v='2'/>
08:19:53:  </slot>
08:19:53:  <slot id='2' type='GPU'>
08:19:53:    <opencl-index v='3'/>
08:19:53:  </slot>
08:19:53:  <slot id='3' type='GPU'>
08:19:53:    <opencl-index v='4'/>
08:19:53:  </slot>
08:19:53:  <slot id='4' type='GPU'>
08:19:53:    <opencl-index v='5'/>
08:19:53:  </slot>
08:19:53:  <slot id='5' type='GPU'>
08:19:53:    <opencl-index v='6'/>
08:19:53:  </slot>
08:19:53:  <slot id='6' type='GPU'>
08:19:53:    <opencl-index v='7'/>
08:19:53:  </slot>
08:19:53:  <slot id='7' type='GPU'>
08:19:53:    <opencl-index v='8'/>
08:19:53:  </slot>
08:19:53:</config>
08:20:06:WU05:FS07:0x21:Completed 250000 out of 25000000 steps (1%)
08:20:06:WU05:FS07:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:13:WU03:FS02:0x21:Completed 2500000 out of 12500000 steps (20%)
08:20:13:WU03:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:14:WU02:FS05:0x21:Completed 3250000 out of 12500000 steps (26%)
08:20:14:WU02:FS05:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:20:WU07:FS06:0x21:Completed 250000 out of 5000000 steps (5%)
08:20:20:WU07:FS06:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:20:WU04:FS01:0x21:Completed 0 out of 5000000 steps (0%)
08:20:20:WU04:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:20:WU06:FS04:0x21:Completed 0 out of 5000000 steps (0%)
08:20:20:WU06:FS04:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:31:WU00:FS03:0x21:Completed 380000 out of 1000000 steps (38%)
08:20:31:WU00:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:20:34:WU09:FS00:0x21:Completed 780000 out of 1000000 steps (78%)
08:20:34:WU09:FS00:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:26:18:WU00:FS03:0x21:Completed 390000 out of 1000000 steps (39%)
08:27:01:WU09:FS00:0x21:Completed 790000 out of 1000000 steps (79%)
08:30:39:WU04:FS01:0x21:Completed 50000 out of 5000000 steps (1%)
08:30:50:WU06:FS04:0x21:Completed 50000 out of 5000000 steps (1%)
08:31:59:WU02:FS05:0x21:Completed 3375000 out of 12500000 steps (27%)
08:32:00:WU03:FS02:0x21:Completed 2625000 out of 12500000 steps (21%)
08:32:00:WU00:FS03:0x21:Completed 400000 out of 1000000 steps (40%)
08:32:49:WU05:FS07:0x21:Completed 500000 out of 25000000 steps (2%)
08:33:24:WU09:FS00:0x21:Completed 800000 out of 1000000 steps (80%)
08:37:46:WU00:FS03:0x21:Completed 410000 out of 1000000 steps (41%)
08:39:54:WU09:FS00:0x21:Completed 810000 out of 1000000 steps (81%)
08:40:58:WU04:FS01:0x21:Completed 100000 out of 5000000 steps (2%)
08:41:09:WU06:FS04:0x21:Completed 100000 out of 5000000 steps (2%)
08:43:29:WU00:FS03:0x21:Completed 420000 out of 1000000 steps (42%)
08:43:44:WU02:FS05:0x21:Completed 3500000 out of 12500000 steps (28%)
08:43:47:WU03:FS02:0x21:Completed 2750000 out of 12500000 steps (22%)
08:45:29:WU05:FS07:0x21:Completed 750000 out of 25000000 steps (3%)
08:46:17:WU09:FS00:0x21:Completed 820000 out of 1000000 steps (82%)
08:49:17:WU00:FS03:0x21:Completed 430000 out of 1000000 steps (43%)
08:51:15:WU04:FS01:0x21:Completed 150000 out of 5000000 steps (3%)
08:51:28:WU06:FS04:0x21:Completed 150000 out of 5000000 steps (3%)
08:52:47:WU09:FS00:0x21:Completed 830000 out of 1000000 steps (83%)
08:55:03:WU00:FS03:0x21:Completed 440000 out of 1000000 steps (44%)
08:55:29:WU02:FS05:0x21:Completed 3625000 out of 12500000 steps (29%)
08:55:32:WU03:FS02:0x21:Completed 2875000 out of 12500000 steps (23%)
08:58:07:WU05:FS07:0x21:Completed 1000000 out of 25000000 steps (4%)
08:59:11:WU09:FS00:0x21:Completed 840000 out of 1000000 steps (84%)
09:00:49:WU00:FS03:0x21:Completed 450000 out of 1000000 steps (45%)
09:01:33:WU04:FS01:0x21:Completed 200000 out of 5000000 steps (4%)
09:01:48:WU06:FS04:0x21:Completed 200000 out of 5000000 steps (4%)
09:05:41:WU09:FS00:0x21:Completed 850000 out of 1000000 steps (85%)
09:06:33:WU00:FS03:0x21:Completed 460000 out of 1000000 steps (46%)
09:07:14:WU02:FS05:0x21:Completed 3750000 out of 12500000 steps (30%)
09:07:16:WU03:FS02:0x21:Completed 3000000 out of 12500000 steps (24%)
09:10:46:WU05:FS07:0x21:Completed 1250000 out of 25000000 steps (5%)
09:11:50:WU04:FS01:0x21:Completed 250000 out of 5000000 steps (5%)
09:12:04:WU09:FS00:0x21:Completed 860000 out of 1000000 steps (86%)
09:12:07:WU06:FS04:0x21:Completed 250000 out of 5000000 steps (5%)
09:12:18:WU00:FS03:0x21:Completed 470000 out of 1000000 steps (47%)
09:13:55:WU07:FS06:0x21:Completed 300000 out of 5000000 steps (6%)
09:17:58:WU00:FS03:0x21:Completed 480000 out of 1000000 steps (48%)
09:18:34:WU09:FS00:0x21:Completed 870000 out of 1000000 steps (87%)
09:18:59:WU02:FS05:0x21:Completed 3875000 out of 12500000 steps (31%)
09:19:02:WU03:FS02:0x21:Completed 3125000 out of 12500000 steps (25%)
09:22:10:WU04:FS01:0x21:Completed 300000 out of 5000000 steps (6%)
09:22:28:WU06:FS04:0x21:Completed 300000 out of 5000000 steps (6%)
09:23:24:WU05:FS07:0x21:Completed 1500000 out of 25000000 steps (6%)
09:23:48:WU00:FS03:0x21:Completed 490000 out of 1000000 steps (49%)
09:24:57:WU09:FS00:0x21:Completed 880000 out of 1000000 steps (88%)
09:29:28:WU00:FS03:0x21:Completed 500000 out of 1000000 steps (50%)
09:30:43:WU02:FS05:0x21:Completed 4000000 out of 12500000 steps (32%)
09:30:46:WU03:FS02:0x21:Completed 3250000 out of 12500000 steps (26%)
09:31:26:WU09:FS00:0x21:Completed 890000 out of 1000000 steps (89%)
09:32:29:WU04:FS01:0x21:Completed 350000 out of 5000000 steps (7%)
09:32:48:WU06:FS04:0x21:Completed 350000 out of 5000000 steps (7%)
09:35:14:WU00:FS03:0x21:Completed 510000 out of 1000000 steps (51%)
09:36:01:WU05:FS07:0x21:Completed 1750000 out of 25000000 steps (7%)
09:37:52:WU09:FS00:0x21:Completed 900000 out of 1000000 steps (90%)
09:40:58:WU00:FS03:0x21:Completed 520000 out of 1000000 steps (52%)
09:42:30:WU02:FS05:0x21:Completed 4125000 out of 12500000 steps (33%)
09:42:33:WU03:FS02:0x21:Completed 3375000 out of 12500000 steps (27%)
09:42:48:WU04:FS01:0x21:Completed 400000 out of 5000000 steps (8%)
09:43:08:WU06:FS04:0x21:Completed 400000 out of 5000000 steps (8%)
09:44:21:WU09:FS00:0x21:Completed 910000 out of 1000000 steps (91%)
09:46:57:WU00:FS03:0x21:Completed 530000 out of 1000000 steps (53%)
09:48:36:WU05:FS07:0x21:Completed 2000000 out of 25000000 steps (8%)
09:50:44:WU09:FS00:0x21:Completed 920000 out of 1000000 steps (92%)
09:52:54:WU00:FS03:0x21:Completed 540000 out of 1000000 steps (54%)
09:53:06:WU04:FS01:0x21:Completed 450000 out of 5000000 steps (9%)
09:53:27:WU06:FS04:0x21:Completed 450000 out of 5000000 steps (9%)
09:54:14:WU02:FS05:0x21:Completed 4250000 out of 12500000 steps (34%)
09:54:17:WU03:FS02:0x21:Completed 3500000 out of 12500000 steps (28%)
09:57:14:WU09:FS00:0x21:Completed 930000 out of 1000000 steps (93%)
09:58:45:WU00:FS03:0x21:Completed 550000 out of 1000000 steps (55%)
10:01:12:WU05:FS07:0x21:Completed 2250000 out of 25000000 steps (9%)
10:03:25:WU04:FS01:0x21:Completed 500000 out of 5000000 steps (10%)
10:03:37:WU09:FS00:0x21:Completed 940000 out of 1000000 steps (94%)
10:03:47:WU06:FS04:0x21:Completed 500000 out of 5000000 steps (10%)
10:04:24:WU00:FS03:0x21:Completed 560000 out of 1000000 steps (56%)
10:05:59:WU02:FS05:0x21:Completed 4375000 out of 12500000 steps (35%)
10:06:04:WU03:FS02:0x21:Completed 3625000 out of 12500000 steps (29%)
10:07:25:WU07:FS06:0x21:Completed 350000 out of 5000000 steps (7%)
10:10:07:WU09:FS00:0x21:Completed 950000 out of 1000000 steps (95%)
10:10:10:WU00:FS03:0x21:Completed 570000 out of 1000000 steps (57%)
10:13:45:WU04:FS01:0x21:Completed 550000 out of 5000000 steps (11%)
10:13:49:WU05:FS07:0x21:Completed 2500000 out of 25000000 steps (10%)
10:14:09:WU06:FS04:0x21:Completed 550000 out of 5000000 steps (11%)
10:15:50:WU00:FS03:0x21:Completed 580000 out of 1000000 steps (58%)
10:16:30:WU09:FS00:0x21:Completed 960000 out of 1000000 steps (96%)
10:17:44:WU02:FS05:0x21:Completed 4500000 out of 12500000 steps (36%)
10:17:48:WU03:FS02:0x21:Completed 3750000 out of 12500000 steps (30%)
10:21:36:WU00:FS03:0x21:Completed 590000 out of 1000000 steps (59%)
10:23:00:WU09:FS00:0x21:Completed 970000 out of 1000000 steps (97%)
10:24:04:WU04:FS01:0x21:Completed 600000 out of 5000000 steps (12%)
10:24:28:WU06:FS04:0x21:Completed 600000 out of 5000000 steps (12%)
10:26:25:WU05:FS07:0x21:Completed 2750000 out of 25000000 steps (11%)
10:27:15:WU00:FS03:0x21:Completed 600000 out of 1000000 steps (60%)
10:29:23:WU09:FS00:0x21:Completed 980000 out of 1000000 steps (98%)
10:29:29:WU02:FS05:0x21:Completed 4625000 out of 12500000 steps (37%)
10:29:34:WU03:FS02:0x21:Completed 3875000 out of 12500000 steps (31%)
10:33:01:WU00:FS03:0x21:Completed 610000 out of 1000000 steps (61%)
10:34:22:WU04:FS01:0x21:Completed 650000 out of 5000000 steps (13%)
10:34:48:WU06:FS04:0x21:Completed 650000 out of 5000000 steps (13%)
10:35:52:WU09:FS00:0x21:Completed 990000 out of 1000000 steps (99%)
10:35:53:WU01:FS00:Connecting to 65.254.110.245:8080
10:35:54:WU01:FS00:Assigned to work server 155.247.166.219
10:35:54:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:1:Baffin XT [Radeon RX 460] from 155.247.166.219
10:35:54:WU01:FS00:Connecting to 155.247.166.219:8080
10:35:54:WU01:FS00:Downloading 27.47MiB
10:36:00:WU01:FS00:Download 18.88%
10:36:06:WU01:FS00:Download 35.49%
10:36:12:WU01:FS00:Download 43.00%
10:36:18:WU01:FS00:Download 50.51%
10:36:24:WU01:FS00:Download 58.02%
10:36:30:WU01:FS00:Download 66.89%
10:36:36:WU01:FS00:Download 75.08%
10:36:42:WU01:FS00:Download 81.68%
10:36:48:WU01:FS00:Download 90.10%
10:36:54:WU01:FS00:Download 98.06%
10:36:55:WU01:FS00:Download complete
10:36:55:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14196 run:15 clone:223 gen:16 core:0x21 unit:0x000000200002894b5d924693f1ddf546
10:38:40:WU00:FS03:0x21:Completed 620000 out of 1000000 steps (62%)
10:39:03:WU05:FS07:0x21:Completed 3000000 out of 25000000 steps (12%)
10:41:14:WU02:FS05:0x21:Completed 4750000 out of 12500000 steps (38%)
10:41:19:WU03:FS02:0x21:Completed 4000000 out of 12500000 steps (32%)
10:42:15:WU09:FS00:0x21:Completed 1000000 out of 1000000 steps (100%)
10:42:22:WU09:FS00:0x21:Saving result file logfile_01.txt
10:42:22:WU09:FS00:0x21:Saving result file checkpointState.xml
10:42:23:WU09:FS00:0x21:Saving result file checkpt.crc
10:42:23:WU09:FS00:0x21:Saving result file log.txt
10:42:23:WU09:FS00:0x21:Saving result file positions.xtc
10:42:23:WU09:FS00:0x21:Folding@home Core Shutdown: FINISHED_UNIT
10:42:23:WU09:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:42:23:WU09:FS00:Sending unit results: id:09 state:SEND error:NO_ERROR project:14276 run:0 clone:94 gen:54 core:0x21 unit:0x0000003f80fccb0a5d98ab6022b81c2a
10:42:23:WU09:FS00:Uploading 81.61MiB to 128.252.203.10
10:42:23:WU09:FS00:Connecting to 128.252.203.10:8080
10:42:23:WU01:FS00:Starting
10:42:23:WU01:FS00:Running FahCore: /opt/fah/FAHCoreWrapper /opt/fah/cores/cores.foldingathome.org/v7/lin/64bit/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 705 -lifeline 401 -checkpoint 15 -gpu-vendor amd -opencl-device 2 -gpu 2
10:42:23:WU01:FS00:Started FahCore on PID 2783
10:42:23:WU01:FS00:Core PID:2787
10:42:23:WU01:FS00:FahCore 0x21 started
10:42:24:WU01:FS00:0x21:*********************** Log Started 2019-10-28T10:42:23Z ***********************
10:42:24:WU01:FS00:0x21:Project: 14196 (Run 15, Clone 223, Gen 16)
10:42:24:WU01:FS00:0x21:Unit: 0x000000200002894b5d924693f1ddf546
10:42:24:WU01:FS00:0x21:CPU: 0x00000000000000000000000000000000
10:42:24:WU01:FS00:0x21:Machine: 0
10:42:24:WU01:FS00:0x21:Reading tar file core.xml
10:42:24:WU01:FS00:0x21:Reading tar file integrator.xml
10:42:24:WU01:FS00:0x21:Reading tar file state.xml
10:42:24:WU01:FS00:0x21:Reading tar file system.xml
10:42:24:WU01:FS00:0x21:Digital signatures verified
10:42:24:WU01:FS00:0x21:Folding@home GPU Core21 Folding@home Core
10:42:24:WU01:FS00:0x21:Version 0.0.20
10:42:29:WU09:FS00:Upload 35.69%
10:42:31:WU01:FS00:0x21:Completed 0 out of 5000000 steps (0%)
10:42:31:WU01:FS00:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:42:35:WU09:FS00:Upload 74.44%
10:42:39:WU09:FS00:Upload complete
10:42:39:WU09:FS00:Server responded WORK_ACK (400)
10:42:39:WU09:FS00:Final credit estimate, 43593.00 points
10:42:39:WU09:FS00:Cleaning up
10:44:25:WU00:FS03:0x21:Completed 630000 out of 1000000 steps (63%)
10:44:41:WU04:FS01:0x21:Completed 700000 out of 5000000 steps (14%)
10:45:07:WU06:FS04:0x21:Completed 700000 out of 5000000 steps (14%)
10:50:05:WU00:FS03:0x21:Completed 640000 out of 1000000 steps (64%)
10:51:42:WU05:FS07:0x21:Completed 3250000 out of 25000000 steps (13%)
10:52:52:WU01:FS00:0x21:Completed 50000 out of 5000000 steps (1%)
10:53:01:WU02:FS05:0x21:Completed 4875000 out of 12500000 steps (39%)
10:53:05:WU03:FS02:0x21:Completed 4125000 out of 12500000 steps (33%)
10:54:59:WU04:FS01:0x21:Completed 750000 out of 5000000 steps (15%)
10:55:27:WU06:FS04:0x21:Completed 750000 out of 5000000 steps (15%)
10:55:51:WU00:FS03:0x21:Completed 650000 out of 1000000 steps (65%)
11:00:56:WU07:FS06:0x21:Completed 400000 out of 5000000 steps (8%)
11:01:31:WU00:FS03:0x21:Completed 660000 out of 1000000 steps (66%)
11:03:11:WU01:FS00:0x21:Completed 100000 out of 5000000 steps (2%)
11:04:24:WU05:FS07:0x21:Completed 3500000 out of 25000000 steps (14%)
11:04:45:WU02:FS05:0x21:Completed 5000000 out of 12500000 steps (40%)
11:04:49:WU03:FS02:0x21:Completed 4250000 out of 12500000 steps (34%)
11:05:21:WU04:FS01:0x21:Completed 800000 out of 5000000 steps (16%)
11:05:49:WU06:FS04:0x21:Completed 800000 out of 5000000 steps (16%)
11:07:16:WU00:FS03:0x21:Completed 670000 out of 1000000 steps (67%)
11:12:57:WU00:FS03:0x21:Completed 680000 out of 1000000 steps (68%)
11:13:30:WU01:FS00:0x21:Completed 150000 out of 5000000 steps (3%)
11:15:40:WU04:FS01:0x21:Completed 850000 out of 5000000 steps (17%)
11:16:09:WU06:FS04:0x21:Completed 850000 out of 5000000 steps (17%)
11:16:31:WU02:FS05:0x21:Completed 5125000 out of 12500000 steps (41%)
11:16:35:WU03:FS02:0x21:Completed 4375000 out of 12500000 steps (35%)
11:17:06:WU05:FS07:0x21:Completed 3750000 out of 25000000 steps (15%)
11:18:42:WU00:FS03:0x21:Completed 690000 out of 1000000 steps (69%)
11:23:49:WU01:FS00:0x21:Completed 200000 out of 5000000 steps (4%)
11:24:22:WU00:FS03:0x21:Completed 700000 out of 1000000 steps (70%)
11:25:59:WU04:FS01:0x21:Completed 900000 out of 5000000 steps (18%)
11:26:30:WU06:FS04:0x21:Completed 900000 out of 5000000 steps (18%)
11:28:15:WU02:FS05:0x21:Completed 5250000 out of 12500000 steps (42%)
11:28:20:WU03:FS02:0x21:Completed 4500000 out of 12500000 steps (36%)
11:29:48:WU05:FS07:0x21:Completed 4000000 out of 25000000 steps (16%)
11:30:07:WU00:FS03:0x21:Completed 710000 out of 1000000 steps (71%)
11:34:10:WU01:FS00:0x21:Completed 250000 out of 5000000 steps (5%)
11:35:47:WU00:FS03:0x21:Completed 720000 out of 1000000 steps (72%)
11:36:19:WU04:FS01:0x21:Completed 950000 out of 5000000 steps (19%)
11:36:50:WU06:FS04:0x21:Completed 950000 out of 5000000 steps (19%)
11:40:02:WU02:FS05:0x21:Completed 5375000 out of 12500000 steps (43%)
11:40:06:WU03:FS02:0x21:Completed 4625000 out of 12500000 steps (37%)
11:41:33:WU00:FS03:0x21:Completed 730000 out of 1000000 steps (73%)
11:42:31:WU05:FS07:0x21:Completed 4250000 out of 25000000 steps (17%)
11:44:32:WU01:FS00:0x21:Completed 300000 out of 5000000 steps (6%)
11:46:38:WU04:FS01:0x21:Completed 1000000 out of 5000000 steps (20%)
11:47:10:WU06:FS04:0x21:Completed 1000000 out of 5000000 steps (20%)
11:47:13:WU00:FS03:0x21:Completed 740000 out of 1000000 steps (74%)
11:51:47:WU02:FS05:0x21:Completed 5500000 out of 12500000 steps (44%)
11:51:51:WU03:FS02:0x21:Completed 4750000 out of 12500000 steps (38%)
11:52:59:WU00:FS03:0x21:Completed 750000 out of 1000000 steps (75%)
11:54:26:WU07:FS06:0x21:Completed 450000 out of 5000000 steps (9%)
11:54:52:WU01:FS00:0x21:Completed 350000 out of 5000000 steps (7%)
11:55:14:WU05:FS07:0x21:Completed 4500000 out of 25000000 steps (18%)
11:56:59:WU04:FS01:0x21:Completed 1050000 out of 5000000 steps (21%)
11:57:33:WU06:FS04:0x21:Completed 1050000 out of 5000000 steps (21%)
11:58:40:WU00:FS03:0x21:Completed 760000 out of 1000000 steps (76%)
12:03:33:WU02:FS05:0x21:Completed 5625000 out of 12500000 steps (45%)
12:03:37:WU03:FS02:0x21:Completed 4875000 out of 12500000 steps (39%)
12:04:26:WU00:FS03:0x21:Completed 770000 out of 1000000 steps (77%)
12:05:11:WU01:FS00:0x21:Completed 400000 out of 5000000 steps (8%)
12:07:17:WU04:FS01:0x21:Completed 1100000 out of 5000000 steps (22%)
12:07:53:WU05:FS07:0x21:Completed 4750000 out of 25000000 steps (19%)
12:07:53:WU06:FS04:0x21:Completed 1100000 out of 5000000 steps (22%)
12:10:06:WU00:FS03:0x21:Completed 780000 out of 1000000 steps (78%)
12:15:18:WU02:FS05:0x21:Completed 5750000 out of 12500000 steps (46%)
12:15:22:WU03:FS02:0x21:Completed 5000000 out of 12500000 steps (40%)
12:15:30:WU01:FS00:0x21:Completed 450000 out of 5000000 steps (9%)
12:15:51:WU00:FS03:0x21:Completed 790000 out of 1000000 steps (79%)
12:17:37:WU04:FS01:0x21:Completed 1150000 out of 5000000 steps (23%)
12:18:14:WU06:FS04:0x21:Completed 1150000 out of 5000000 steps (23%)
12:20:32:WU05:FS07:0x21:Completed 5000000 out of 25000000 steps (20%)
12:21:32:WU00:FS03:0x21:Completed 800000 out of 1000000 steps (80%)
12:25:50:WU01:FS00:0x21:Completed 500000 out of 5000000 steps (10%)
12:27:04:WU02:FS05:0x21:Completed 5875000 out of 12500000 steps (47%)
12:27:08:WU03:FS02:0x21:Completed 5125000 out of 12500000 steps (41%)
12:27:18:WU00:FS03:0x21:Completed 810000 out of 1000000 steps (81%)
12:27:57:WU04:FS01:0x21:Completed 1200000 out of 5000000 steps (24%)
12:28:34:WU06:FS04:0x21:Completed 1200000 out of 5000000 steps (24%)
12:32:58:WU00:FS03:0x21:Completed 820000 out of 1000000 steps (82%)
12:33:11:WU05:FS07:0x21:Completed 5250000 out of 25000000 steps (21%)
12:36:11:WU01:FS00:0x21:Completed 550000 out of 5000000 steps (11%)
12:38:16:WU04:FS01:0x21:Completed 1250000 out of 5000000 steps (25%)
12:38:43:WU00:FS03:0x21:Completed 830000 out of 1000000 steps (83%)
12:38:49:WU02:FS05:0x21:Completed 6000000 out of 12500000 steps (48%)
12:38:53:WU03:FS02:0x21:Completed 5250000 out of 12500000 steps (42%)
12:38:54:WU06:FS04:0x21:Completed 1250000 out of 5000000 steps (25%)
12:44:24:WU00:FS03:0x21:Completed 840000 out of 1000000 steps (84%)
12:45:51:WU05:FS07:0x21:Completed 5500000 out of 25000000 steps (22%)
12:46:31:WU01:FS00:0x21:Completed 600000 out of 5000000 steps (12%)
12:47:55:WU07:FS06:0x21:Completed 500000 out of 5000000 steps (10%)
12:48:38:WU04:FS01:0x21:Completed 1300000 out of 5000000 steps (26%)
12:49:18:WU06:FS04:0x21:Completed 1300000 out of 5000000 steps (26%)
12:50:09:WU00:FS03:0x21:Completed 850000 out of 1000000 steps (85%)
12:50:35:WU02:FS05:0x21:Completed 6125000 out of 12500000 steps (49%)
12:50:41:WU03:FS02:0x21:Completed 5375000 out of 12500000 steps (43%)

[Dark_Vera]

That's called a "memory leak" and it's a bug. Which FAHCore(s) are you running? Just FAHCore_21?

What happens to the memory footprint if you PAUSE / FOLD instead of reboot? What project(s) have you been getting?

I pressed PAUSE and then the RAM usage dropped like a rock - from 10GB to 6GB - as shown in the attached screenshot:

[bruce]

When you unpause, (aka FOLD) does memory jump to the value it was before the pause or does it start to climb gradually from where it was when the projects started

[Dark_Vera]

When you unpause, (aka FOLD) does memory jump to the value it was before the pause or does it start to climb gradually from where it was when the projects started

The RAM usage goes up to where it was over a period of 2-3 seconds.

[bollix47]

FAH should not crash if your swapfile is big enough for your memory. It might slow down but shouldn't crash.
With 12 gig of RAM your swapfile should be at least 12 gig but preferably double that.
How big is your swapfile?

[Dark_Vera]

FAH should not crash if your swapfile is big enough for your memory. It might slow down but shouldn't crash.
With 12 gig of RAM your swapfile should be at least 12 gig but preferably double that.
How big is your swapfile?

I didn't make a swapfile since I didn't think FAH would take up anything close to 12GB of RAM - never saw this level of RAM usage before when I was folding on Windows 10.

I CAN make a swapfile but I'm afraid that could be a temporary band aid solution. I'd like to know if there is a memory leak going on here, and if so, how to fix it permanently.

[bollix47]

Always your choice of course. If you make a 24gig swapfile your problems will disappear.
With 8 GPUs FAH will need access to ~16gig. Any slowdown from using swap shouldn't be too noticable. If you find it too slow for your taste and if possible increase your ram to 16gig.

fyi Windows is a memory hog and the programmers at Microsoft know that so they automatically assign a large swap file and they make it dynamic so if it needs more it grows.
Also, there are some projects on FAH (not many but a few) that use ~2gig of memory to start up ... if you start all 8 at once you've exceded your RAM's capacity without a good size swapfile.

[Dark_Vera]

Always your choice of course. If you make a 24gig swapfile your problems will disappear.
With 8 GPUs FAH will need access to ~16gig. Any slowdown from using swap shouldn't be too noticable. If you find it too slow for your taste and if possible increase your ram to 16gig.

fyi Windows is a memory hog and the programmers at Microsoft know that so they automatically assign a large swap file and they make it dynamic so if it needs more it grows.
Also, there are some projects on FAH (not all) that use ~2gig of memory to start up ... if you start all 8 at once you've exceded you RAM's capacity without a good size swapfile.

Thanks for the suggestion. I went ahead and made a 12GB swapfile (can't do larger since my folding rig is limited to a 60GB SSD and it's already getting quite full). I rebooted and resumed my Folding.

It will take several hours for Fah to "fill" my 12GB of RAM so let's see what happens. Let's hope that a combined 24GB is enough for FAH and these 8 GPUs! Either way I will post back here with the results tomorrow morning.

[bollix47]

...60GB SSD...

That's a bit small and with all the swapping that might take place be prepared for some eventual failures ... when replacing remember all we've discussed.

[bruce]

Since it immediately reallocates the same amount of memory, it's not really a memory leak ... it's the way FAHCore_21 handles larger proteins. (I hoped that the growth in memory allocation went away when the WU was unpaused.) Adding a good sized swap file is the right choice -- or limiting the number of large proteins that fold concurrently.

[MeeLee]

Perhaps related, perhaps not,
I always ran lubuntu 18.10, but lately I had to reinstall, and chose lubuntu 18.04 (since support for 18.10 has been discontinued).
On 18.10 I always had between 150-300MB of RAM usage. On 18.04 I saw numbers equaling 2,2 to 3 GB!
I was wondering if perhaps the newer Linux versions use compressed ram, and don't show true RAM usage?

As far as swap is concerned, on 18.10 I run without a swap, but on 18.04 my swap is 2-3GB in size.

If you have 4GB of RAM in Linux (or more), aside from a power loss, or running tens of programs at once, there is no reason for a swap file. There are almost no Linux programs using up more than a few hundred of MB of RAM, a browser being the largest one. Games or benchmarks being the second one.
The average system idle RAM usage should be below 2GB, and in most cases below 1 GB.
Fact is, Debian doesn't use the swap at all, unless if it's really necessary.
I was hoping the same is true on the majority of Linux versions.

I'll check on my system to see if I have a similar experience. I'm wondering if this is NBidia driver related

[Dark_Vera]

Okay guys, I checked my rig twice more since my last post: once before bed and once upon waking. Basically, the conclusion is that FAH continued to expand in RAM usage but it stabilized and stopped at ~15GB. The SWAP file has been engaged but there is now a new problem - since FAH is swapping so much, it's basically overloading my tiny Celeron processor and PPD drops through the floor (also the system is barely responsive at 100% CPU usage and it semi-hangs).

So, it appears there is no memory leak, but that FAH just is memory hungry, especially when using multiple GPUs.

The solution is to update my second DIMM slot with a Samsung 8GB module, which will bring me in total to 16GB. This should stop the swapping, preserve my CPU cycles and allow me to get back into the 700-800K PPD range.

Anyway this matter is resolved, thank you again for your help!

[JimboPalmer]

I have not been of any help, but I wish to thank you for letting us know the effects of our help. As you might imagine, knowing that it was an issue in the past aides us in the future