WatchDirectory home page
WatchDirectory Startseite (Deutsche Version)
Site WatchDirectory (Français)
  Welcome, Guest. Please Login or Register
YaBB - Yet another Bulletin Board
   
  HomeHelpSearchLoginRegister  
 
Page Index Toggle Pages: 1
Zipping large files not working. (Read 11474 times)
mpc
YaBB Newbies
*
Offline



Posts: 6
Zipping large files not working.
May 21st, 2009 at 10:22pm
 
I'm having an issue with zipping large files. Files that are less than about 5gbs compress ok. But when I try to compress a file that is more than 5gbs, the Zip plugin service stops. I get the following Windows Application Event Errors:
Event Type:      Error
Event Source:      watchDirectory:2005-SQL-Archive-ZIP
Event Category:      None
Event ID:      1
Date:            5/21/2009
Time:            2:04:24 PM
User:            MPSSF2\watchDirectory
Computer:      MPC-IT
Description:
onefile
------------------------------------------------------------------
Event Type:      Error
Event Source:      watchDirectory:2005-SQL-Archive-ZIP
Event Category:      None
Event ID:      1
Date:            5/21/2009
Time:            2:04:24 PM
User:            MPSSF2\watchDirectory
Computer:      MPC-IT
Description:
Plugin returned errorcode -1. Error message=No further info. watchDirectory will abort
--------------------------------------------------------------------------------
----------------------
Event Type:      Error
Event Source:      watchDirectory:2005-SQL-Archive-ZIP
Event Category:      None
Event ID:      1
Date:            5/21/2009
Time:            2:04:24 PM
User:            MPSSF2\watchDirectory
Computer:      MPC-IT
Description:
Plugin returned errorcode -1. Error message=No further info. watchDirectory will abort
--------------------------------------------------------------------------------
------------------------

Has anybody seen this before and or have a solution to the problem?
Thanks
Brian

Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: Zipping large files not working.
Reply #1 - May 22nd, 2009 at 12:44pm
 
Hi,

Large files *should* not be an issue for the ZIP task. I have to admit we do not currently test with large files. I will see what we can do to make this work.

Gert
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: Zipping large files not working.
Reply #2 - Jun 5th, 2009 at 2:09pm
 
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
mpc
YaBB Newbies
*
Offline



Posts: 6
Re: Zipping large files not working.
Reply #3 - Jun 22nd, 2009 at 6:57pm
 
Thanks for getting this fixed so quickly.
FYI: I have been able to zip up files as large as 94gb so far. I have some that are 200+ gb I will let ya know if I have any issues with these.

Thanks
Brian
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: Zipping large files not working.
Reply #4 - Jul 16th, 2009 at 1:48pm
 
The beta has now been released as v4.5.9
I expect zipping and unzipping will have no real limits anymore. There was a bug in both plugins that caused them to "loose position" for truly large files (~4gb seems to be the limit, but it also depended on the amount of free memory). The current version reads "chunks" of the file to compress and writes them to the ZIP immediately.
This new technique might cause slightly less compression on large files.

Obviously, if your file-system doesn't allow big files, WD does not support them. NTFS supports terabyte sized files (but we are not testing Smiley ).
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
mpc
YaBB Newbies
*
Offline



Posts: 6
Re: Zipping large files not working.
Reply #5 - Jan 28th, 2010 at 8:52pm
 
I upgrade to 4.6 and  now I'm having problems zipping large files again. I'm getting the following.:
openzip ChilkatLog:
  OpenZip:
    DllDate: Mar 21 2009
    UnlockPrefix: GDPSOFTWARZIP
    Username: watchdirectory
    Component: Visual C++ 6.0
    zipFilename: WSS_Content_IAT_backup.zip
    OemCodePage: 437
    ZipStructure:
     FirstSignature: 0x4034b50
     FirstSigAddr: 0
     File access error: did not read full requested amount of data.
     curAddr64: 4911716953
     Failed to read Zip (10)
    Failed.

Date/Time: 1/28/2010 12:21:10 PM
Computer: MPC-IT



[watchDirectory:2005-SQL-ArcSite-ZIP] ERROR Plugin returned errorc...
Plugin returned errorcode -1. Error message=No further info. watchDirectory will abort
Date/Time: 1/28/2010 12:21:10 PM
Back to top
 
 
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: Zipping large files not working.
Reply #6 - Jan 29th, 2010 at 8:20am
 
Hi,

You can downgrade here (4.5.9):
http://www.watchdirectory.net/downloads/SetupWatchDirectoryVersion459.exe
or (4.5.10):
http://www.watchdirectory.net/downloads/SetupWatchDirectoryVersion4510.exe


Do you always get this error or do you get it on some zips?
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
Gert
YaBB Administrator
*****
Offline



Posts: 2239
The Netherlands
Re: Zipping large files not working.
Reply #7 - Jan 29th, 2010 at 8:34am
 
By the way....

I just tested v4.6 with an 8GB file and it zipped fine. Also, the zip task had only the following changes for 4.6:
* new copyright statement (include 2010)
* it now writes the new zip filename to the history db

I can not imagine how this would break functionality of the zip task.

Is it possible another program was writing to the file being zipped?
Back to top
 

Gert Rijs - gert (at) gdpsoftware (dot) com
Blog: http://blog-en.gdpsoftware.com/
End Alzheimer's: http://www.alz.org&&...
WWW WWW GdPSoftware  
IP Logged
 
mpc
YaBB Newbies
*
Offline



Posts: 6
Re: Zipping large files not working.
Reply #8 - Feb 1st, 2010 at 6:00pm
 
The zipping was working fine prior to the upgrade. Seems I'm having this problem with only the really large files. Large = 100gb and larger. I will continue to monitor and debug ans much as I can.
Back to top
 
 
IP Logged
 
Page Index Toggle Pages: 1