WatchDirectory home page
WatchDirectory Startseite (Deutsche Version)
Site WatchDirectory (Français)
  Welcome, Guest. Please Login or Register
YaBB - Yet another Bulletin Board
   
  HomeHelpSearchLoginRegister  
 
Page Index Toggle Pages: 1
Could not upload file, will reconnect and retry (Read 6770 times)
Verne
Junior Member
**
Offline



Posts: 50
Could not upload file, will reconnect and retry
Feb 10th, 2014 at 5:32pm
 
We upgraded all three of our Application Servers this weekend to Watch Directory 4.7.3. Previously were on 4.6.6.
Two of the servers are Windows 2003 server and one is Windows 2008 server.  We are getting this error on all 3 of our servers.

This error is coming from the Ftp Upload step in all these Watch Directory Tasks.  All of these tasks are multi-tasks.  The first sub-task is usually historical backup of the file and that runs just fine but the next sub-task is the ftp upload.  It initially can't connect but always connects on the 2nd try about a second later.

Just a snippet from one of the log files. Weird that it shows the connected output in the log in different spots for both of these files.

Well I guess I am going to attach the log file. You Forum site doesn't like a single word being all upper case so I can't paste in the log file. 

This has happened over 30 times today.  Doesn't matter what FTP site it is.  If the task has an ftp upload step we get the error every time.
Back to top
 

TaskLog.txt (1 KB | 201 )
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2232
The Netherlands
Re: Could not upload file, will reconnect and retry
Reply #1 - Feb 10th, 2014 at 5:49pm
 
Hello Verne,

So the upload *does* complete ok, you are asking about the warning/error message you get when the subtask first attempts to upload?

I am not 100% sure about this message, we did add/remove/change a lot of reporting for the FTP upload task the last few releases. Please note: only the reporting (warning/error messages), the same issue(s) were likely present in previous releases (but not reported, a silent reconnect and successful upload).

If you can email me a backup of one (!!) task that shows this issue, I can make the reporting a bit more "silent" again for the next release. See http://blog-en.gdpsoftware.com/2010/06/send-task-backup-to-support.html for details.

If it is really annoying, I think you can prevent this by disabling the option "Keep connection open as long as possible". By disabling this option you tell WD to make a new FTP connection for every upload (instead of trying to reuse an existing connection).

Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Verne
Junior Member
**
Offline



Posts: 50
Re: Could not upload file, will reconnect and retry
Reply #2 - Feb 10th, 2014 at 6:23pm
 
I will have to redact some of the config file.  I realize the password is encrypted in there but I can't have anyone accessing client ftp sites or knowing what the server names and paths are.  So I will be editing the config file to put in dummy server names and paths and I will be blanking out the password field.
Back to top
 
 
IP Logged
 
MarshallSupport
YaBB Newbies
*
Offline



Posts: 4
Re: Could not upload file, will reconnect and retry
Reply #3 - Mar 20th, 2014 at 10:26pm
 
I have a new install and am seeing the same thing happen.  When looking through the logs on the FTP server, I see the first login attempt fail and then the next attempt is successful.  Happens at every connection attempt.  Here is a snippet from the ftp server logs:

[03] Thu 20Mar14 15:01:49 - (001031) IP-Name: servername (x.x.x.x)
[30] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_REQUEST: user: novo; service: ssh-connection; type: none
[31] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_FAILURE: login failed
[30] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_REQUEST: user: novo; service: ssh-connection; type: password
[02] Thu 20Mar14 15:01:50 - (001031) User "novo" logged in
[31] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_SUCCESS: successful login
[30] Thu 20Mar14 15:01:50 - (001031) SSH_FXP_INIT: client version 3 (WeOnlyDo)
[31] Thu 20Mar14 15:01:50 - (001031) SSH_FXP_VERSION: server version 3
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2232
The Netherlands
Re: Could not upload file, will reconnect and retry
Reply #4 - Mar 21st, 2014 at 7:59am
 
Hi,

Beta 2 should fix this issue:
http://www.watchdirectory.net/cgi-bin/yabb25/YaBB.pl?num=1394863717/1#1

The problem is that we can not reproduce the issue at all. It looks to me it is some kind of combination of FTP server and operating system.

Please disable the option "keep connection open as long as possible" and try the beta mentioned above.

mmmm, I now looked a little better at your log. Perhaps you are seeing something different. The issue Verne described was a memory access problem.
Please see section 2.4 on this page: http://sock-raw.org/papers/openssh_library
Specially this part:
OpenSSH tries to get that list of supported methods by sending a "none"
method request and then moving on to try the best available way to
authenticate.
.
That is exactly what we see in your log:

[30] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_REQUEST: user: novo; service: ssh-connection; type: none
[31] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_FAILURE: login failed
[30] Thu 20Mar14 15:01:50 - (001031) SSH2_MSG_USERAUTH_REQUEST: user: novo; service: ssh-connection; type: password

First an "attempt" with login type "none" (to list the connect types) and then trying the best available ("password" in this case). I will see if there is a way to skip the initial "none" connect and directly try to authenticate with a password.

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
MarshallSupport
YaBB Newbies
*
Offline



Posts: 4
Re: Could not upload file, will reconnect and retry
Reply #5 - Mar 21st, 2014 at 9:47pm
 
Okay fair enough.  Please let us know if this function can be removed.
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2232
The Netherlands
Re: Could not upload file, will reconnect and retry
Reply #6 - Mar 24th, 2014 at 1:36pm
 
It is not really possible to remove this "none" call, it is part of the normal sequence for logging in.
As the above is from your FTP server side logs, I am interested why you decided to look there. Perhaps you were affected by the same issue that Verne was and in that case the beta mentioned earlier will fix this.
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
MarshallSupport
YaBB Newbies
*
Offline



Posts: 4
Re: Could not upload file, will reconnect and retry
Reply #7 - Mar 24th, 2014 at 3:26pm
 
I went to the server side logs because the WatchDirectory log windows was very informative about what the issue may be.  I knew since I had access to the FTP logs also that it would most definitely tell me what was going on.

I will try the Beta you posted and let you know how it works.
Back to top
 
 
IP Logged
 
MarshallSupport
YaBB Newbies
*
Offline



Posts: 4
Re: Could not upload file, will reconnect and retry
Reply #8 - Mar 24th, 2014 at 7:49pm
 
Okay. So I loaded beta 3.  I no longer get errors in the WatchDirectory History Viewer and no longer get emails regarding the error.  However, I do see that the problem still exists according to the FTP logs.  As long as the uploads work and my Inbox is getting these error emails, I have no issue with this.

Thanks for your help.
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2232
The Netherlands
Re: Could not upload file, will reconnect and retry
Reply #9 - Mar 25th, 2014 at 11:45am
 
The "none" call has nothing to do with the error you saw previously. The "none" call is (and always has been) part of the normal login process.

Glad to hear the beta fixes the issue for you. We will probably release it officially later this or next week.
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Page Index Toggle Pages: 1