WatchDirectory home page
WatchDirectory Startseite (Deutsche Version)
Site WatchDirectory (Franais)
  Welcome, Guest. Please Login or Register
YaBB - Yet another Bulletin Board
   
  HomeHelpSearchLoginRegister  
 
Page Index Toggle Pages: 1
Zip daily sets of files (Read 5069 times)
hmurray
YaBB Newbies
*
Offline



Posts: 5
Zip daily sets of files
Jul 5th, 2011 at 10:37am
 
Hi,

We have a system which produces 3000 output files of the same type each day which land in an Archive\Outbound folder after upload to an FTP site.  We would like to zip each day's batch of files into a zip file and delete this zip file after 3 days from the archive.

We have tried to do this with three WatchDirectory jobs,

1. move files from Archive\Outbound to Archive\Outbound\Temp
2. watch the Temp folder using default monitoring method and zip the complete directory once a day into a dynamically named zip file in the archive\outbound folder named \\server\directory\subdir\Archive\Outbound\HMEI{year}{month}{day}{hour24}.ZIP using the quiet event set at 43,200 seconds (12 hours)
3. watch the archive\outbound folder and delete zip files that are 3 days old using the file age method

Job 1 works fine but job 2 doesn't do anything at all, where are we going wrong?

Many thanks
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: Zip daily sets of files
Reply #1 - Jul 5th, 2011 at 11:21am
 
Hard to say.

Can you send me a backup of task 2? See http://blog-en.gdpsoftware.com/2010/06/send-task-backup-to-support.html
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Dirk
YaBB Administrator
*****
Offline



Posts: 658
South Germany
Re: Zip daily sets of files
Reply #2 - Jul 5th, 2011 at 11:38am
 
hmurray,

I have a similar job running fine at a customer place which zips files every night at a definite time.
Here my settings:

- do not use "QUIET" event, only "FILENEW"
- use "File Age" montitor methode with "Trigger files older than: 1 minute", "calculate age using: lates of creation/modified", "poll every: 1 minute", do NOT  enable "remember triggered files"
- tab "Scheduler": run task only from 11:50 - 11:59 pm (you need to set a time period that matched to your needs)

Maybe that helps.
Back to top
 

Viele Gre / Best regards
Dirk - GdP Software

dirk [at] gdpsoftware [dot] com
http://blog-de.gdpsoftware.com
Webseite: http://www.gdpsoftware.com
WWW WWW  
IP Logged
 
hmurray
YaBB Newbies
*
Offline



Posts: 5
Re: Zip daily sets of files
Reply #3 - Jul 5th, 2011 at 12:31pm
 
Hi,

I've changed the setup to that suggested by Dirk and run the job with debugging turned on, again, the files remained where they were in the Temp folder and no zip file was created. I've created a backup file but it's too big to upload, should I create a copy of the job and run again so the history is smaller?

Many thanks
Back to top
 
 
IP Logged
 
Dirk
YaBB Administrator
*****
Offline



Posts: 658
South Germany
Re: Zip daily sets of files
Reply #4 - Jul 5th, 2011 at 12:40pm
 
Note that the task need to be running when the original files arrive! If you start the task when the files are already present WatchDirectory will not see those files.
You can enable "start FILENEW/DIRNEW at startup" on "Other settings" tab once (!) for a test, this will force WatchDirectory to read the directory at every startup so all present files will be procesed. Remove that setting after the test.
Back to top
 

Viele Gre / Best regards
Dirk - GdP Software

dirk [at] gdpsoftware [dot] com
http://blog-de.gdpsoftware.com
Webseite: http://www.gdpsoftware.com
WWW WWW  
IP Logged
 
hmurray
YaBB Newbies
*
Offline



Posts: 5
Re: Zip daily sets of files
Reply #5 - Jul 5th, 2011 at 1:00pm
 
I moved the files out of the temp folder and while the job was running moved some back in but it still didn't create a zip file.

In the history I can see that it is seeing the files and now that debug is turned on it is putting a message for each one of TTC: Plugin returned OK but there are no errors in the history.

Thanks
Back to top
 
 
IP Logged
 
Dirk
YaBB Administrator
*****
Offline



Posts: 658
South Germany
Re: Zip daily sets of files
Reply #6 - Jul 5th, 2011 at 1:09pm
 
Is your task running as a windows-service? If so, please start it "normal" (only for the moment, we will switch back later)
I will later post here my exact zip settings when I am back in the office agsin.
Back to top
 

Viele Gre / Best regards
Dirk - GdP Software

dirk [at] gdpsoftware [dot] com
http://blog-de.gdpsoftware.com
Webseite: http://www.gdpsoftware.com
WWW WWW  
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: Zip daily sets of files
Reply #7 - Jul 5th, 2011 at 1:25pm
 
One thought.....

If you have selected the option
"Create ZIPs for complete directories, not files"
You must also enable the QUIET option (set it to for example 1 minute). In that case the detected files are just added to a list. When the directory is quiet, the zip is created.

If you did NOT select the option
"Create ZIPs for complete directories, not files"
make sure the option "add files to existing zip" is selected.
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
hmurray
YaBB Newbies
*
Offline



Posts: 5
Re: Zip daily sets of files
Reply #8 - Jul 5th, 2011 at 1:52pm
 
That worked!  Thank you very much, we just need to tweak the timings now I think but at least we have managed to create a zip file.

Thank you both very much for your help.
Back to top
 
 
IP Logged
 
Dirk
YaBB Administrator
*****
Offline



Posts: 658
South Germany
Re: Zip daily sets of files
Reply #9 - Jul 5th, 2011 at 1:55pm
 
Thanks for letting us know - attached my settings as promised (it is nearly the same Gerd said above)
Back to top
 

Viele Gre / Best regards
Dirk - GdP Software

dirk [at] gdpsoftware [dot] com
http://blog-de.gdpsoftware.com
Webseite: http://www.gdpsoftware.com
WWW WWW  
IP Logged
 
Page Index Toggle Pages: 1