I am having trouble getting my two GPUs to both fold.

If you think it might be a driver problem, see viewforum.php?f=79

Moderators: Site Moderators, FAHC Science Team

Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

I have a 1070 and a 980 Ti in the same system that I want to use for folding. I have done this before when I had a 980 Ti and a 970. Worked just fine, now I can't get them to work. Do I have to use a 10 series GPU for it to show up?

I want to use the 980 Ti for 24/7 folding while I gaming on the 1070 and when I don't game I will have the 1070 fold.

BIOS detects both cards, MSI Afterburner does as well.

What do I have to do to make this work?

Thank you
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
7im
Posts: 10189
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by 7im »

Re-install the client so that it auto detects the new hardware.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
ChristianVirtual
Posts: 1596
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: I am having trouble getting my two GPUs to both fold.

Post by ChristianVirtual »

Welcome Bosses_Boss

Looks like you have the same mix of GPU as I have. I assume you use Windows while I use Linux for folding. Both 980TI and 1070 can perfectly be installed in the same system. Given power supply and cooling is sufficient.

What would be helpful if you could share the driver version you are using and the first 100 lines of the folding logfile. Showing us more details about your system and what GPUs are detected.

That link might be helpful viewtopic.php?f=24&t=26036
ImageImage
Please contribute your logs to http://ppd.fahmm.net
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

ChristianVirtual wrote:Welcome Bosses_Boss

Looks like you have the same mix of GPU as I have. I assume you use Windows while I use Linux for folding. Both 980TI and 1070 can perfectly be installed in the same system. Given power supply and cooling is sufficient.

What would be helpful if you could share the driver version you are using and the first 100 lines of the folding logfile. Showing us more details about your system and what GPUs are detected.

That link might be helpful viewtopic.php?f=24&t=26036
Thank you so much for the reply. I am looking through your link, I found it before making the post.

Driver version as in F@H version? That is 7.4.4.

I will look for the log file now. Where would that be exactly? EDIT: I am an idiot... Sorry

Code: Select all

*********************** Log Started 2016-08-02T14:31:20Z ***********************
14:31:20:************************* Folding@home Client *************************
14:31:20:      Website: http://folding.stanford.edu/
14:31:20:    Copyright: (c) 2009-2014 Stanford University
14:31:20:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:31:20:         Args: --open-web-control
14:31:20:       Config: C:/Users/Bosses/AppData/Roaming/FAHClient/config.xml
14:31:20:******************************** Build ********************************
14:31:20:      Version: 7.4.4
14:31:20:         Date: Mar 4 2014
14:31:20:         Time: 20:26:54
14:31:20:      SVN Rev: 4130
14:31:20:       Branch: fah/trunk/client
14:31:20:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
14:31:20:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
14:31:20:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
14:31:20:     Platform: win32 XP
14:31:20:         Bits: 32
14:31:20:         Mode: Release
14:31:20:******************************* System ********************************
14:31:20:          CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
14:31:20:       CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
14:31:20:         CPUs: 12
14:31:20:       Memory: 31.90GiB
14:31:20:  Free Memory: 24.85GiB
14:31:20:      Threads: WINDOWS_THREADS
14:31:20:   OS Version: 6.2
14:31:20:  Has Battery: false
14:31:20:   On Battery: false
14:31:20:   UTC Offset: -6
14:31:20:          PID: 6252
14:31:20:          CWD: C:/Users/Bosses/AppData/Roaming/FAHClient
14:31:20:           OS: Windows 10 Home
14:31:20:      OS Arch: AMD64
14:31:20:         GPUs: 3
14:31:20:        GPU 0: UNSUPPORTED: NV3 [PCI]
14:31:20:        GPU 1: NVIDIA:5 GP104 [GeForce GTX 1070]
14:31:20:        GPU 2: NVIDIA:5 GM200 [GeForce GTX 980 Ti]
14:31:20:         CUDA: 6.1
14:31:20:  CUDA Driver: 8000
14:31:20:Win32 Service: false
14:31:20:***********************************************************************
14:31:20:<config>
14:31:20:  <service-description v='Folding@home Client'/>
14:31:20:  <service-restart v='true'/>
14:31:20:  <service-restart-delay v='5000'/>
14:31:20:
14:31:20:  <!-- Client Control -->
14:31:20:  <client-threads v='6'/>
14:31:20:  <cycle-rate v='4'/>
14:31:20:  <cycles v='-1'/>
14:31:20:  <data-directory v='.'/>
14:31:20:  <disable-sleep-when-active v='true'/>
14:31:20:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
14:31:20:  <exit-when-done v='false'/>
14:31:20:  <fold-anon v='false'/>
14:31:20:  <open-web-control v='true'/>
14:31:20:
14:31:20:  <!-- Configuration -->
14:31:20:  <config-rotate v='true'/>
14:31:20:  <config-rotate-dir v='configs'/>
14:31:20:  <config-rotate-max v='16'/>
14:31:20:
14:31:20:  <!-- Debugging -->
14:31:20:  <assignment-servers>
14:31:20:    assign3.stanford.edu:8080 assign4.stanford.edu:80
14:31:20:  </assignment-servers>
14:31:20:  <auth-as v='true'/>
14:31:20:  <capture-directory v='capture'/>
14:31:20:  <capture-on-error v='false'/>
14:31:20:  <capture-packets v='false'/>
14:31:20:  <capture-requests v='false'/>
14:31:20:  <capture-responses v='false'/>
14:31:20:  <capture-sockets v='false'/>
14:31:20:  <core-exec v='FahCore_$type'/>
14:31:20:  <core-wrapper-exec v='FAHCoreWrapper'/>
14:31:20:  <debug-sockets v='false'/>
14:31:20:  <exception-locations v='true'/>
14:31:20:  <gpu-assignment-servers>
14:31:20:    assign-GPU.stanford.edu:80 assign-GPU2.stanford.edu:80
14:31:20:  </gpu-assignment-servers>
14:31:20:  <stack-traces v='false'/>
14:31:20:
14:31:20:  <!-- Error Handling -->
14:31:20:  <max-slot-errors v='10'/>
14:31:20:  <max-unit-errors v='5'/>
14:31:20:
14:31:20:  <!-- Folding Core -->
14:31:20:  <checkpoint v='5'/>
14:31:20:  <core-dir v='cores'/>
14:31:20:  <core-priority v='idle'/>
14:31:20:  <cpu-affinity v='false'/>
14:31:20:  <cpu-usage v='100'/>
14:31:20:  <gpu-usage v='100'/>
14:31:20:  <no-assembly v='false'/>
14:31:20:
14:31:20:  <!-- Folding Slot Configuration -->
14:31:20:  <cause v='ANY'/>
14:31:20:  <client-subtype v='STDCLI'/>
14:31:20:  <client-type v='normal'/>
14:31:20:  <cpu-species v='X86_PENTIUM_II'/>
14:31:20:  <cpu-type v='AMD64'/>
14:31:20:  <cpus v='-1'/>
14:31:20:  <gpu v='true'/>
14:31:20:  <max-packet-size v='normal'/>
14:31:20:  <os-species v='UNKNOWN'/>
14:31:20:  <os-type v='WIN32'/>
14:31:20:  <project-key v='0'/>
14:31:20:  <smp v='true'/>
14:31:20:
14:31:20:  <!-- GUI -->
14:31:20:  <gui-enabled v='true'/>
14:31:20:
14:31:20:  <!-- HTTP Server -->
14:31:20:  <allow v='127.0.0.1'/>
14:31:20:  <connection-timeout v='60'/>
14:31:20:  <deny v='0/0'/>
14:31:20:  <http-addresses v='0:7396'/>
14:31:20:  <https-addresses v=''/>
14:31:20:  <max-connect-time v='900'/>
14:31:20:  <max-connections v='800'/>
14:31:20:  <max-request-length v='52428800'/>
14:31:20:  <min-connect-time v='300'/>
14:31:20:  <threads v='12'/>
14:31:20:
14:31:20:  <!-- Logging -->
14:31:20:  <log v='log.txt'/>
14:31:20:  <log-color v='false'/>
14:31:20:  <log-crlf v='true'/>
14:31:20:  <log-date v='false'/>
14:31:20:  <log-date-periodically v='21600'/>
14:31:20:  <log-debug v='true'/>
14:31:20:  <log-domain v='false'/>
14:31:20:  <log-header v='true'/>
14:31:20:  <log-level v='true'/>
14:31:20:  <log-no-info-header v='true'/>
14:31:20:  <log-redirect v='false'/>
14:31:20:  <log-rotate v='true'/>
14:31:20:  <log-rotate-dir v='logs'/>
14:31:20:  <log-rotate-max v='16'/>
14:31:20:  <log-short-level v='false'/>
14:31:20:  <log-simple-domains v='true'/>
14:31:20:  <log-thread-id v='false'/>
14:31:20:  <log-thread-prefix v='true'/>
14:31:20:  <log-time v='true'/>
14:31:20:  <log-to-screen v='true'/>
14:31:20:  <log-truncate v='false'/>
14:31:20:  <verbosity v='5'/>
14:31:20:
14:31:20:  <!-- Network -->
14:31:20:  <proxy v=':8080'/>
14:31:20:  <proxy-enable v='false'/>
14:31:20:  <proxy-pass v=''/>
14:31:20:  <proxy-user v=''/>
14:31:20:
14:31:20:  <!-- Process Control -->
14:31:20:  <child v='false'/>
14:31:20:  <daemon v='false'/>
14:31:20:  <pid v='false'/>
14:31:20:  <pid-file v='Folding@home Client.pid'/>
14:31:20:  <respawn v='false'/>
14:31:20:  <service v='false'/>
14:31:20:
14:31:20:  <!-- Remote Command Server -->
14:31:20:  <command-address v='0.0.0.0'/>
14:31:20:  <command-allow-no-pass v='127.0.0.1'/>
14:31:20:  <command-deny-no-pass v='0/0'/>
14:31:20:  <command-enable v='true'/>
14:31:20:  <command-port v='36330'/>
14:31:20:
14:31:20:  <!-- Slot Control -->
14:31:20:  <idle v='false'/>
14:31:20:  <max-shutdown-wait v='60'/>
14:31:20:  <pause-on-battery v='true'/>
14:31:20:  <pause-on-start v='false'/>
14:31:20:  <paused v='false'/>
14:31:20:  <power v='full'/>
14:31:20:
14:31:20:  <!-- User Information -->
14:31:20:  <machine-id v='0'/>
14:31:20:  <passkey v='********************************'/>
14:31:20:  <team v='225605'/>
14:31:20:  <user v='Bosses_Boss'/>
14:31:20:
14:31:20:  <!-- Web Server -->
14:31:20:  <web-allow v='127.0.0.1'/>
14:31:20:  <web-deny v='0/0'/>
14:31:20:  <web-enable v='true'/>
14:31:20:
14:31:20:  <!-- Web Server Sessions -->
14:31:20:  <session-cookie v='sid'/>
14:31:20:  <session-lifetime v='86400'/>
14:31:20:  <session-timeout v='3600'/>
14:31:20:
14:31:20:  <!-- Work Unit Control -->
14:31:20:  <dump-after-deadline v='true'/>
14:31:20:  <max-queue v='16'/>
14:31:20:  <max-units v='0'/>
14:31:20:  <next-unit-percentage v='99'/>
14:31:20:  <stall-detection-enabled v='false'/>
14:31:20:  <stall-percent v='5'/>
14:31:20:  <stall-timeout v='1800'/>
14:31:20:
14:31:20:  <!-- Folding Slots -->
14:31:20:  <slot id='0' type='CPU'>
14:31:20:    <cpus v='5'/>
14:31:20:    <pause-on-start v='true'/>
14:31:20:  </slot>
14:31:20:  <slot id='1' type='GPU'>
14:31:20:    <max-packet-size v='big'/>
14:31:20:  </slot>
14:31:20:</config>
Oh and I know I got the power to run the system, I am running my system on a Corsair AXi 1500w PSU, and have checked the connections to be sure as well.

F@H and program screenshots - https://imgur.com/a/UBuND

PC - http://i.imgur.com/HskumRF.jpg
Last edited by Bosses_Boss on Tue Aug 02, 2016 4:17 pm, edited 4 times in total.
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

7im wrote:Re-install the client so that it auto detects the new hardware.
Tried this, did not work. Any other ideas?
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
7im
Posts: 10189
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by 7im »

He asked about the video driver version from NVidia, especially because Windows 10 has a bad habit of replacing the OEM NV driver that works with a Win 10 driver that doesn't work for folding.

To avoid future problems, you will want to disable video driver updates from MS, and then reinstall the NV drivers.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: I am having trouble getting my two GPUs to both fold.

Post by Joe_H »

Please return the logging verbosity to the default of 3. The higher level does not provide any extra useful information and actually gets in the way of troubleshooting a problem.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

7im wrote:He asked about the video driver version from NVidia, especially because Windows 10 has a bad habit of replacing the OEM NV driver that works with a Win 10 driver that doesn't work for folding.

To avoid future problems, you will want to disable video driver updates from MS, and then reinstall the NV drivers.
I have that disabled. Unless MS has re-enabled which I wouldn't be surprised about.

I have updated to a new driver trying to figure this out as well, didn't change. Also tried to reinstall NV driver and FAH client at the same time.
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

Joe_H wrote:Please return the logging verbosity to the default of 3. The higher level does not provide any extra useful information and actually gets in the way of troubleshooting a problem.
Ah okay, this is my troubleshooting, TRY ALL THE THINGS :p Will this change the log and do you want me to copy it here again?
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: I am having trouble getting my two GPUs to both fold.

Post by bruce »

Bosses_Boss wrote:Will this change the log and do you want me to copy it here again?
I do. If possible, edit your previous post.

Was your reinstall of the NV driver a "clean" install?
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

bruce wrote:
Bosses_Boss wrote:Will this change the log and do you want me to copy it here again?
I do. If possible, edit your previous post.

Was your reinstall of the NV driver a "clean" install?
Thanks for the reply, updated log.

It wasn't a clean install. I will do that now.

Edit: still not working.
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
7im
Posts: 10189
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by 7im »

Remove this for the GPU:

<max-packet-size v='big'/>
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
ChristianVirtual
Posts: 1596
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: I am having trouble getting my two GPUs to both fold.

Post by ChristianVirtual »

Can you please add few more lines after you stopped in the log above ? There will be a list of detected GPUs and the assigned slots. Just for completes.
Some lines like. "Enabled folding slot 01: READY gpu:1:GP104 [GeForce GTX 1070] "

What happen if you just try to add a new GPU slot ? Or two (to cover the unsupported audio part of the 1070 identified as GPU).
What is different to my setup: I have the 980Ti as first card behind the CPU. But based on you description of want 24/7 on 980TI and 1070 for gaming/folding your physical setup seems matching.
ImageImage
Please contribute your logs to http://ppd.fahmm.net
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

7im wrote:Remove this for the GPU:

<max-packet-size v='big'/>
Yeah I just wanted to see what it did. Removed it now.
Last edited by Bosses_Boss on Wed Aug 03, 2016 1:00 am, edited 1 time in total.
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
Bosses_Boss
Posts: 15
Joined: Tue Aug 02, 2016 12:54 pm
Hardware configuration: i7 5820k 4.4GHz under custom loop, 2GHz MSI 1070 Gaming, 1.6GHz 980 Ti Gaming, Corsair AXi 1500

http://ca.pcpartpicker.com/list/GKHvVY

Waiting on a mobo RMA to get my F@H server up.
Location: Canada
Contact:

Re: I am having trouble getting my two GPUs to both fold.

Post by Bosses_Boss »

ChristianVirtual wrote:Can you please add few more lines after you stopped in the log above ? There will be a list of detected GPUs and the assigned slots. Just for completes.
Some lines like. "Enabled folding slot 01: READY gpu:1:GP104 [GeForce GTX 1070] "

What happen if you just try to add a new GPU slot ? Or two (to cover the unsupported audio part of the 1070 identified as GPU).
What is different to my setup: I have the 980Ti as first card behind the CPU. But based on you description of want 24/7 on 980TI and 1070 for gaming/folding your physical setup seems matching.
I am so sorry, I've had a shitty day with ear aches and a migraine headache and am not at my best. I reread the first link you sent me and it had the walkthrough to add a GPU slot.

I just added a GPU slot for GPU 2 [which in the log is the 980 Ti] now and it worked, flawlessly. I don't know how I either forgot this process last time or the 970 was immediately picked up by FAH.

Thank you, I am so sorry for wasting everyones time. She's chugging away now. http://i.imgur.com/uZDve1U.png

Again,

Thank you!

Sincerely,

Bosses_Boss
i7 5820k [4.4GHz] | MSI 1070 Gaming | MSI 980 Ti Sea Hawk | Corsair AXi 1500 | Custom 480mm CPU waterloop
Post Reply