WatchDirectory home page
WatchDirectory Startseite (Deutsche Version)
Site WatchDirectory (Français)
  Welcome, Guest. Please Login or Register
YaBB - Yet another Bulletin Board
   
  HomeHelpSearchLoginRegister  
 
Page Index Toggle Pages: 1
WD not completing the job ? (Read 6968 times)
koalit
YaBB Newbies
*
Offline



Posts: 11
WD not completing the job ?
Feb 13th, 2006 at 9:15pm
 
Using WD to monitor folders on a network drive, a file comes into fldr-1, starts a BAT (which starts a VBS) that will generate single page PDF's of the incoming PDF file, saving each PDF in fldr-2, monitored by WD to start a BAT to create thumbnails of each page.

Stange things happen : I drop a 30 page PDF file (1 file), WD starts the BAT that starts the VBS, the file is split into 30 PDF files, they are saved in fldr-2, now WD starts the BAT for fldr-2 right away, no problem. But it only starts the BAT ex. 26 times, allthough theres 30 files. In the history I can see that the event has been removed "The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer), the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.

Is there any way to make sure WD will keep a folder "cleaned/empty" so, that if any files exists, a event will be fired ??

Using (licensed) Version 4.041 on Windows 2000 Server, fileserver is a Windows2003 server, using same domain, logged on as domain administrator.

Thanks for any help you can provide!

Cheers,
Mark
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: WD not completing the job ?
Reply #1 - Feb 14th, 2006 at 4:45am
 
Quote:
"The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer),

Is this a message about the folder that is monitored, or about a file inside the directory? It sounds like some other program (your .vbs?) has an exclusive lock on the directory or file. Or, maybe, your PDF processing rapidly renames the files. Perhaps you can generate those pdf's to some temporary working dir, and move them to the monitored directory once they are complete.

Quote:
the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.

Are you using the default monitoring method ? You may try, for the moment, to use the "Polling" method instead. The Default method will wait until Windows tells it "something has changed" (you dropped the new files) to scan the directory for changes. So, if WD "missed" a few files during its first scan (the files were still locked by your .vbs), it will not see them until the next scan of the directory.

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
koalit
YaBB Newbies
*
Offline



Posts: 11
Re: WD not completing the job ?
Reply #2 - Feb 14th, 2006 at 8:04am
 
Gert wrote on Feb 14th, 2006 at 4:45am:
Quote:
"The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer),

Is this a message about the folder that is monitored, or about a file inside the directory? It sounds like some other program (your .vbs?) has an exclusive lock on the directory or file. Or, maybe, your PDF processing rapidly renames the files. Perhaps you can generate those pdf's to some temporary working dir, and move them to the monitored directory once they are complete.

I'm not sure if it's the folder or file thats gone missing, but I guess it's the file, since it says "The file \\...." ??
I have tried to build a workflow, where each step is saving to a new folder:
1-pdfin
WD triggers BAT/VBS - splitting PDF to multiple files saved in
2-pdfsplit
WD triggers BAT/VBS - Converting each page to JPG saved in
3-pdf2jpg

Quote:
the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.

Gert wrote on Feb 14th, 2006 at 4:45am:
[quote]Are you using the default monitoring method ? You may try, for the moment, to use the "Polling" method instead. The Default method will wait until Windows tells it "something has changed" (you dropped the new files) to scan the directory for changes. So, if WD "missed" a few files during its first scan (the files were still locked by your .vbs), it will not see them until the next scan of the directory.

I will try the various options, though I'm quite sure I did use the polling method.

Thanks for your quick reply!
Mark
Back to top
 
 
IP Logged
 
koalit
YaBB Newbies
*
Offline



Posts: 11
WD "missing" some files now
Reply #3 - Feb 14th, 2006 at 12:09pm
 
Hi Gert.

I have setup WD to poll every 5 seconds, running as a service (domain admin user), watching network shares.
The first script creates 30 new files in dir-2, but WD only "see" most of them, leaving behind pages 8 + 26-32 ?

If I copy 30 files to input fld 2, WD also leaves behind some files (actually 16 of 30 is left untouched!)

Please advice on what to do ?

Cheers,
Mark
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: WD not completing the job ?
Reply #4 - Feb 14th, 2006 at 5:01pm
 
The files that are "missed" are reported again as "The file \\..... does not exist any more, event removed"???
Does everything work correctly if you work on a local drive? It sounds a bit like your network (or the network drive) is not 100% stable.

Perhaps you can try to create a new task that monitors your network drive and copies the files to C:\Work\dir-1
Change your existing tasks to monitor the local directories (C:\Work\dir-1, C:\Work\dir-2 etcetera), and also output their results to those local directories.
Create a final task that copies the result files back to the network.

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
koalit
YaBB Newbies
*
Offline



Posts: 11
Re: WD not completing the job ?
Reply #5 - Feb 14th, 2006 at 8:27pm
 
Hi Gert!
Thanks for your reply.

I have done as you suggested and set up the workflow on local C drive.!

Basicly - Same result, even though the script produced 32 files in C:\workflow\2-pdfsplit, WD only registrer the first 18 files !?

Even if I copy 30 files to the directory using Explorer, WD will only registrer a number of them. Maybe 12 of 30 files !!

BTW, using FAST method now, think I'll try using polling also.

Very frustrating, do you have any suggestions ?

Cheers,
Mark
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: WD not completing the job ?
Reply #6 - Feb 15th, 2006 at 4:42am
 
This is weird.

Can you please enable "write debug info" on this page and then "do a run" that doesn't detect all files.

Now you please send me
<task dir>\TASKNAME.config
<task dir>\TASKNAME\history.db
<task dir>\TASKNAME\wd.bat
and the .bat file that should process the files in C:\workflow\2-pdfsplit

replace <task dir> by the location of your task directoy - press CTRL+9 inside the Control Center
replace TASKNAME by the name of the task that monitors C:\workflow\2-pdfsplit

Please ZIP the above files!

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2225
The Netherlands
Re: WD not completing the job ?
Reply #7 - Feb 19th, 2006 at 1:29pm
 
This issue has been fixed in the latest (4.0.43) version of watchDirectory.

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
koalit
YaBB Newbies
*
Offline



Posts: 11
Excellent Service
Reply #8 - Feb 20th, 2006 at 10:51pm
 
Grin
Just wanted to add that Gert provided excellent service, way beyond what anyone could expect !!.

Thanks Gert.

Mark
Back to top
 
 
IP Logged
 
Page Index Toggle Pages: 1