WatchDirectory Forum
http://www.watchdirectory.net/cgi-bin/yabb25/YaBB.pl
watchDirectory forums >> Bug Reports >> WD not completing the job ?
http://www.watchdirectory.net/cgi-bin/yabb25/YaBB.pl?num=1139861740

Message started by koalit on Feb 13th, 2006 at 9:15pm

Title: WD not completing the job ?
Post by koalit on Feb 13th, 2006 at 9:15pm
Using WD to monitor folders on a network drive, a file comes into fldr-1, starts a BAT (which starts a VBS) that will generate single page PDF's of the incoming PDF file, saving each PDF in fldr-2, monitored by WD to start a BAT to create thumbnails of each page.

Stange things happen : I drop a 30 page PDF file (1 file), WD starts the BAT that starts the VBS, the file is split into 30 PDF files, they are saved in fldr-2, now WD starts the BAT for fldr-2 right away, no problem. But it only starts the BAT ex. 26 times, allthough theres 30 files. In the history I can see that the event has been removed "The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer), the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.

Is there any way to make sure WD will keep a folder "cleaned/empty" so, that if any files exists, a event will be fired ??

Using (licensed) Version 4.041 on Windows 2000 Server, fileserver is a Windows2003 server, using same domain, logged on as domain administrator.

Thanks for any help you can provide!

Cheers,
Mark

Title: Re: WD not completing the job ?
Post by Gert on Feb 14th, 2006 at 4:45am

Quote:
"The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer),

Is this a message about the folder that is monitored, or about a file inside the directory? It sounds like some other program (your .vbs?) has an exclusive lock on the directory or file. Or, maybe, your PDF processing rapidly renames the files. Perhaps you can generate those pdf's to some temporary working dir, and move them to the monitored directory once they are complete.


Quote:
the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.

Are you using the default monitoring method ? You may try, for the moment, to use the "Polling" method instead. The Default method will wait until Windows tells it "something has changed" (you dropped the new files) to scan the directory for changes. So, if WD "missed" a few files during its first scan (the files were still locked by your .vbs), it will not see them until the next scan of the directory.

Gert

Title: Re: WD not completing the job ?
Post by koalit on Feb 14th, 2006 at 8:04am

Gert wrote on Feb 14th, 2006 at 4:45am:

Quote:
"The file \\..... does not exist any more, event removed", (needless to say, I can still access the dir using explorer),

Is this a message about the folder that is monitored, or about a file inside the directory? It sounds like some other program (your .vbs?) has an exclusive lock on the directory or file. Or, maybe, your PDF processing rapidly renames the files. Perhaps you can generate those pdf's to some temporary working dir, and move them to the monitored directory once they are complete.

I'm not sure if it's the folder or file thats gone missing, but I guess it's the file, since it says "The file \\...." ??
I have tried to build a workflow, where each step is saving to a new folder:
1-pdfin
WD triggers BAT/VBS - splitting PDF to multiple files saved in
2-pdfsplit
WD triggers BAT/VBS - Converting each page to JPG saved in
3-pdf2jpg


Quote:
the strange thing is, that if I drop a new file into fldr-1, lets say a 4 page PDF, WD will fire events for all the files, also the 4 remaining from the last run.


Gert wrote on Feb 14th, 2006 at 4:45am:
[quote]Are you using the default monitoring method ? You may try, for the moment, to use the "Polling" method instead. The Default method will wait until Windows tells it "something has changed" (you dropped the new files) to scan the directory for changes. So, if WD "missed" a few files during its first scan (the files were still locked by your .vbs), it will not see them until the next scan of the directory.

I will try the various options, though I'm quite sure I did use the polling method.

Thanks for your quick reply!
Mark

Title: WD "missing" some files now
Post by koalit on Feb 14th, 2006 at 12:09pm
Hi Gert.

I have setup WD to poll every 5 seconds, running as a service (domain admin user), watching network shares.
The first script creates 30 new files in dir-2, but WD only "see" most of them, leaving behind pages 8 + 26-32 ?

If I copy 30 files to input fld 2, WD also leaves behind some files (actually 16 of 30 is left untouched!)

Please advice on what to do ?

Cheers,
Mark

Title: Re: WD not completing the job ?
Post by Gert on Feb 14th, 2006 at 5:01pm
The files that are "missed" are reported again as "The file \\..... does not exist any more, event removed"???
Does everything work correctly if you work on a local drive? It sounds a bit like your network (or the network drive) is not 100% stable.

Perhaps you can try to create a new task that monitors your network drive and copies the files to C:\Work\dir-1
Change your existing tasks to monitor the local directories (C:\Work\dir-1, C:\Work\dir-2 etcetera), and also output their results to those local directories.
Create a final task that copies the result files back to the network.

Gert

Title: Re: WD not completing the job ?
Post by koalit on Feb 14th, 2006 at 8:27pm
Hi Gert!
Thanks for your reply.

I have done as you suggested and set up the workflow on local C drive.!

Basicly - Same result, even though the script produced 32 files in C:\workflow\2-pdfsplit, WD only registrer the first 18 files !?

Even if I copy 30 files to the directory using Explorer, WD will only registrer a number of them. Maybe 12 of 30 files !!

BTW, using FAST method now, think I'll try using polling also.

Very frustrating, do you have any suggestions ?

Cheers,
Mark

Title: Re: WD not completing the job ?
Post by Gert on Feb 15th, 2006 at 4:42am
This is weird.

Can you please enable "write debug info" on this page and then "do a run" that doesn't detect all files.

Now you please send me
<task dir>\TASKNAME.config
<task dir>\TASKNAME\history.db
<task dir>\TASKNAME\wd.bat
and the .bat file that should process the files in C:\workflow\2-pdfsplit

replace <task dir> by the location of your task directoy - press CTRL+9 inside the Control Center
replace TASKNAME by the name of the task that monitors C:\workflow\2-pdfsplit

Please ZIP the above files!

Gert

Title: Re: WD not completing the job ?
Post by Gert on Feb 19th, 2006 at 1:29pm
This issue has been fixed in the latest (4.0.43) version of watchDirectory.

Gert

Title: Excellent Service
Post by koalit on Feb 20th, 2006 at 10:51pm
;D
Just wanted to add that Gert provided excellent service, way beyond what anyone could expect !!.

Thanks Gert.

Mark

WatchDirectory Forum » Powered by YaBB 2.5.2!
YaBB Forum Software © 2000-2017. All Rights Reserved.