WatchDirectory home page
WatchDirectory Startseite (Deutsche Version)
Site WatchDirectory (Français)
  Welcome, Guest. Please Login or Register
YaBB - Yet another Bulletin Board
   
  HomeHelpSearchLoginRegister  
 
Page Index Toggle Pages: 1
FTP Server Rejects File (Read 6032 times)
aaronjwithrow
YaBB Newbies
*
Offline



Posts: 4
FTP Server Rejects File
Mar 21st, 2011 at 5:18pm
 
I work at a television station - I am using watchdirectoy to monitor a directory for video files - when one of the employees pastes in several files - they are ftp'd to our video server - works great -

However we have had a few errant bad files and the video servers FTP gateway rejects them. 
The application the tries i believe 10 times to resend the file before it quits and moves on -

Where is that setting and can it be made to not retry ?  The reason is because those video files are time sensitive and the delay caused by the retry of the bad file holds up the other good video files -
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: FTP Server Rejects File
Reply #1 - Mar 21st, 2011 at 5:40pm
 
Hi,

Currently, files are retried automatically on several cases (depending on error code from the FTP server).
What is the reason those files are rejected?
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
aaronjwithrow
YaBB Newbies
*
Offline



Posts: 4
Re: FTP Server Rejects File
Reply #2 - Mar 21st, 2011 at 6:53pm
 
the FTP server is a gateway to our main video server - The watchdirectory application sees it as "plugin returned errorcode 6. Error message = no further info." 

the rejection is valid because of an internally corrupt file -
I just want it to skip all of the retries because of the delay of getting the other news stories to air -


here is part of the log
104140 3/19/2011 8:56:39 PMInfo PROGRESS 158072832/159383552 bytes (99%)
104141 3/19/2011 8:56:39 PMInfo PROGRESS 158334976/159383552 bytes (99%)
104142 3/19/2011 8:56:39 PMInfo PROGRESS 158597120/159383552 bytes (99%)
104143 3/19/2011 8:56:40 PMInfo PROGRESS 158859264/159383552 bytes (99%)
104144 3/19/2011 8:56:40 PMInfo PROGRESS 159383552/159383552 bytes (100%)
104145 3/19/2011 8:56:41 PMInfo FTPREPLY: cmd: STOR 1NS10E3.MXF; Code: 550; Text: 550 STOR failed(TRANSACTION_ABORTED)
104146 3/19/2011 8:56:41 PMInfo STATECHANGE: Connected to server - idle
104147 3/19/2011 8:56:41 PMError DONE, Error=40550 (STOR failed(TRANSACTION_ABORTED))
104148 3/19/2011 8:56:41 PMWarning Could not upload file, will reconnect and retry
104149 3/19/2011 8:56:41 PMInfo STATECHANGE: Checking if remote directory exists
104150 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: CWD /MXF/; Code: 200; Text: 200 directory changed
104151 3/19/2011 8:56:42 PMInfo STATECHANGE: Connected to server - idle
104152 3/19/2011 8:56:42 PMInfo DONE, Error=40200 (directory changed)
104153 3/19/2011 8:56:42 PMInfo STATECHANGE: Connecting to server
104154 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: ; Code: 220; Text: 220 Connected to - FTP Server V1.6.27.7140(Unicode)
104155 3/19/2011 8:56:42 PMInfo STATECHANGE: Sending authentication data
104156 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: USER anonymous; Code: 331; Text: 331 if anonymous access, send email name as PASS
104157 3/19/2011 8:56:42 PMInfo 230 ==========================
104158 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: PASS ****; Code: 230; Text: 230-logon successful
104159 3/19/2011 8:56:42 PMInfo 211 End.
104160 3/19/2011 8:56:42 PMInfo UTF8
104161 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: FEAT; Code: 211; Text: 211-Extensions supported:
104162 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: OPTS UTF8 ON; Code: 200; Text: 200 This server is strictly UTF8(always ON)
104163 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: PWD; Code: 257; Text: 257 "/"
104164 3/19/2011 8:56:42 PMInfo STATECHANGE: Connected to server - idle
104165 3/19/2011 8:56:42 PMInfo CONNECTED
104166 3/19/2011 8:56:42 PMInfo STATECHANGE: Sending data to server
104167 3/19/2011 8:56:42 PMInfo STATECHANGE: Setting transfer mode
104168 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: TYPE I; Code: 200; Text: 200 TYPE command successful
104169 3/19/2011 8:56:42 PMInfo STATECHANGE: Changing current directory
104170 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: CWD /MXF/; Code: 200; Text: 200 directory changed
104171 3/19/2011 8:56:42 PMInfo STATECHANGE: Sending data to server
104172 3/19/2011 8:56:42 PMInfo STATECHANGE: Getting secondary data channel
104173 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: PASV; Code: 227; Text: 227 Entering Passive Mode (10,45,96,60,56,85).
104174 3/19/2011 8:56:42 PMInfo STATECHANGE: Sending data to server
104175 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: STOR 1NS10E3.MXF; Code: 150; Text: 150 STOR command opening data connection
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: FTP Server Rejects File
Reply #3 - Mar 22nd, 2011 at 9:00am
 
aaronjwithrow wrote on Mar 21st, 2011 at 6:53pm:
the FTP server is a gateway to our main video server - The watchdirectory application sees it as "plugin returned errorcode 6. Error message = no further info."  

the rejection is valid because of an internally corrupt file -
I just want it to skip all of the retries because of the delay of getting the other news stories to air -

How can an FTP server know the file's content is invalid? Is the server specially programmed to look "inside" the file?
aaronjwithrow wrote on Mar 21st, 2011 at 6:53pm:
here is part of the log
104140 3/19/2011 8:56:39 PMInfo PROGRESS 158072832/159383552 bytes (99%)
104141 3/19/2011 8:56:39 PMInfo PROGRESS 158334976/159383552 bytes (99%)
104142 3/19/2011 8:56:39 PMInfo PROGRESS 158597120/159383552 bytes (99%)
104143 3/19/2011 8:56:40 PMInfo PROGRESS 158859264/159383552 bytes (99%)
104144 3/19/2011 8:56:40 PMInfo PROGRESS 159383552/159383552 bytes (100%)

104145 3/19/2011 8:56:41 PMInfo FTPREPLY: cmd: STOR 1NS10E3.MXF; Code: 550; Text: 550 STOR failed(TRANSACTION_ABORTED)
104146 3/19/2011 8:56:41 PMInfo STATECHANGE: Connected to server - idle
104147 3/19/2011 8:56:41 PMError DONE, Error=40550 (STOR failed(TRANSACTION_ABORTED))
104148 3/19/2011 8:56:41 PMWarning Could not upload file, will reconnect and retry


104149 3/19/2011 8:56:41 PMInfo STATECHANGE: Checking if remote directory exists
104150 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: CWD /MXF/; Code: 200; Text: 200 directory changed
104151 3/19/2011 8:56:42 PMInfo STATECHANGE: Connected to server - idle


Perhaps I can add something to the next beta so you can tell WatchDirectory to ignore certain messages (treat them as if the FTP server says "success!").
So, in this case you would tell WD the following is OK:
PMError DONE, Error=40550 (STOR failed(TRANSACTION_ABORTED))

Would that help?
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
aaronjwithrow
YaBB Newbies
*
Offline



Posts: 4
Re: FTP Server Rejects File
Reply #4 - Mar 22nd, 2011 at 8:00pm
 
Gert wrote on Mar 22nd, 2011 at 9:00am:
aaronjwithrow wrote on Mar 21st, 2011 at 6:53pm:
the FTP server is a gateway to our main video server - The watchdirectory application sees it as "plugin returned errorcode 6. Error message = no further info."  

the rejection is valid because of an internally corrupt file -
I just want it to skip all of the retries because of the delay of getting the other news stories to air -

How can an FTP server know the file's content is invalid? Is the server specially programmed to look "inside" the file?
aaronjwithrow wrote on Mar 21st, 2011 at 6:53pm:
Yes - The ftpserver in question is a Harris Media Gateway - it is their FTP server application that specificially looks at the files coming in - it identifies the media type because it will transcode them with the appropriate wrapper for playout -

What i have done while waiting is built a dynamic CMD file that creates an FTP script that processes the files
@echo off

echo open 10.xx.xx.xx 2121>download.ftp
echo anonymous>>download.ftp
echo anonymous>>download.ftp
echo cd MXF>>download.ftp
echo lcd "%WD_DIR%">>download.ftp
echo bin>>download.ftp
echo put "%WD_FILE_N%" >>download.ftp
echo dis>>download.ftp
echo quit>>download.ftp
ftp -i -s:download.ftp
del download.ftp
move "%WD_FILE%" n:\zbackup


doing it this way - it doesnt care if the file is ok or if it fails - it just moves on -

here is part of the log
104140 3/19/2011 8:56:39 PMInfo PROGRESS 158072832/159383552 bytes (99%)
104141 3/19/2011 8:56:39 PMInfo PROGRESS 158334976/159383552 bytes (99%)
104142 3/19/2011 8:56:39 PMInfo PROGRESS 158597120/159383552 bytes (99%)
104143 3/19/2011 8:56:40 PMInfo PROGRESS 158859264/159383552 bytes (99%)
104144 3/19/2011 8:56:40 PMInfo PROGRESS 159383552/159383552 bytes (100%)

104145 3/19/2011 8:56:41 PMInfo FTPREPLY: cmd: STOR 1NS10E3.MXF; Code: 550; Text: 550 STOR failed(TRANSACTION_ABORTED)
104146 3/19/2011 8:56:41 PMInfo STATECHANGE: Connected to server - idle
104147 3/19/2011 8:56:41 PMError DONE, Error=40550 (STOR failed(TRANSACTION_ABORTED))
104148 3/19/2011 8:56:41 PMWarning Could not upload file, will reconnect and retry


104149 3/19/2011 8:56:41 PMInfo STATECHANGE: Checking if remote directory exists
104150 3/19/2011 8:56:42 PMInfo FTPREPLY: cmd: CWD /MXF/; Code: 200; Text: 200 directory changed
104151 3/19/2011 8:56:42 PMInfo STATECHANGE: Connected to server - idle


Perhaps I can add something to the next beta so you can tell WatchDirectory to ignore certain messages (treat them as if the FTP server says "success!").
So, in this case you would tell WD the following is OK:
PMError DONE, Error=40550 (STOR failed(TRANSACTION_ABORTED))

Would that help?

Back to top
 
 
IP Logged
 
aaronjwithrow
YaBB Newbies
*
Offline



Posts: 4
Re: FTP Server Rejects File
Reply #5 - Mar 22nd, 2011 at 8:02pm
 
Forgot the add the other part -

If would be nice that if a specific line was returned - you could mark it as failed but skip the retries -
that way i could get an email of the failure but it wouldnt stop the other files from being processed -

Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: FTP Server Rejects File
Reply #6 - Mar 23rd, 2011 at 7:53am
 
I am not sure if that will be easy to implement, but I will have a look.
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Page Index Toggle Pages: 1