WatchDirectory Forum
http://www.watchdirectory.net/cgi-bin/yabb25/YaBB.pl
watchDirectory forums >> How to... >> Multiple jobs vs multiple sub-tasks?
http://www.watchdirectory.net/cgi-bin/yabb25/YaBB.pl?num=1485834194

Message started by IPA on Jan 31st, 2017 at 4:43am

Title: Multiple jobs vs multiple sub-tasks?
Post by IPA on Jan 31st, 2017 at 4:43am
I have a single folder (i.e. D:\export) that another system will export multiple types of files to.  Each type of file with start with a set of characters. For example:

File type A -->  ABC123_*.txt
File type B -->  BR549_*.txt
File type c -->  CATDOG_*.txt

Each type of file needs to processed (copied and possibly sent via FTP) differently.  We expect easily over a 15 file types being exported to the one monitored folder and each type will have at least three sub-tasks.

I had assumed I would create a separate job with multiple sub-tasks for each file type.  However, that means multiple jobs will all be monitoring the same folder but each job will have different file mask.  Do you recommend this approach or a single job with many many sub-tasks? 

Title: Re: Multiple jobs vs multiple sub-tasks?
Post by Gert on Jan 31st, 2017 at 7:52am
The benefit of one task with subtasks is (mostly) using less system resources. Also, if you want to run the tasks as a Windows Service there are limitations how many services you can configure. See http://blog-en.gdpsoftware.com/2010/04/watchdirectory-tasks-as-windows-service.html

If reaction-time is important, multiple tasks are better as a task can handle only 1 detected file at a time.

WatchDirectory Forum » Powered by YaBB 2.5.2!
YaBB Forum Software © 2000-2017. All Rights Reserved.