How-to Archives - File transfer tool from Limagito

06 Dec
Advanced Moving Rule Temporary Directory Option
Advanced Moving Rule Temporary Directory Option
Q: Regarding the temporary folder. This location, that I’m going to change it to a new D:, but just curious, what happens if this location does fill up. What happens to the job that’s running and using it?
Temporary Directory Option:
This folder is uses as temporary storage between Source and Destination. Each Rule uses multiple threads so we can handle Source and Destination files at the same time. Never use a network folder as Temporary Directory.
This option needs to be set for each Rule separately
A: It will give an OS error because we are not able to write the stream from the source to this temporary directory. To prevent it from filling up you could enable the on error event and send an e-mail if something goes wrong.
Q: Will enable the event. I’am using AWSS3 as Source but don’t have any control over how much data they put in that S3 bucket, if there is 1 TB of files and the d: drive is only 100 GB, does Limagito just divide that up in to manageable chunks based on the free space of the D: drive? I know the first iteration of the job was close to 1 TB and the drive is only 100 GB, but it succeeded.
A: That is because the temp files were moved to the destination. Multiple threads are working at the same time getting files from the Source and moving them to their Destination (s). You could enable our precondition and check the free size of the D drive. Then you would set the max files for a single scan to for example 50 files or more so it would recheck the free space every 50 files.
Enable ‘Check Free Disk Space’. In this example:
scanning of source files would be allowed when free disk space on Y:\ is more than 15%
scanning of source files would be skipped when free disk space on Y:\ is 10% or lower
Schedule Setup > Advanced Tab > Max. Files processed in Once Scan is set to 50 as an example
Each scan will handle 50 files and will check the precondition first
If you need any help with this “temporary directory” question, please let us know.
Best Regards,
Limagito Team
#managedfiletransfer #filetransfer #filemanagement
By Limagito-Team How-to temporary
21 Nov
How to to skip files if they already exist at the destination
How to to skip files if they already exist at the destination
Q: I’m looking to setup a nightly schedule that will copy files from source to destination. Is there a way to skip files if they already exist at the destination?
A: If you start with a fresh setup, meaning no files available in the Destination when you first trigger the Rule then we really recommend our ‘File Memory’ option. This way our tool remembers which files were already copied to the destination and this is also the fastest way.
If some destination files already exist then you could fill the File Memory database first. This is only possible with [WIN] as Source!
1.Enable ‘Enable File Memory’ option (previous screenshot). This option must stay enabled.
2.Enable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>
3. Enable the Rule and trigger it once, the Rule will run and fill the file memory database. With the ‘Skip Destination when filename isn’t in the database (WIN)’ enabled the Rule will skip the destination during this scan and only fill the file memory database.
4. Next, Disable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>
This way the file memory database was filled with the existing [WIN] Source files. Any new files in the source will be copied once during the next scan.

If you need any help with this “skip files if they already exist” question, please let us know.
Best Regards,
Limagito Team
#managedfiletransfer #filetransfer #filemanagement
By Limagito-Team How-to already exist
20 Jul
How to halt moving too many files and send an alert
How to halt moving too many files and send an alert
Q: I have a job that moves files from an external S3 bucket into our local storage. The other day a vendor hiccupped and sent 8000 files. Limagito did it’s job and moved them over, which ended up gumming up our systems. Is there any way to limit transfers? I’ve been looking through Help and haven’t seen anything yet.
For instance…I know this vendor normally sends around 10 a month. Anything over 50 would obviously be abnormal and It would be great to throttle them, even better to send an alert and let us know, so we can correct the issue.
Any help would be greatly appreciated.
A: Please have a look at the following setup. So we’ll allow only a maximum of files per month.
We used a Windows folder as Source:
– Function Setup > set Destination Options to ‘Destination Memory & Exit Cyclus on Error’
– Destination Setup:
First Destination: Pascal Script
This script will check the month and the amount of files it successfully moved
You can adjust the “ctMaxFilesAllowed” Const value to allow more or less files per month
Second Destination: your output, can be any Destination type.
Third Destination: Pascal Script
Will increase the internal counter (VIA) if a file is successfully moved
Link to both scripts, for the first and third Destination.
First Destination (Pascal Script):
Third Destination (Pascal Script):
– Open Our Rule Events option:
– Select and enable ‘On Pascal Script Error’ event. Enable ‘Enable Mail’ and adjust the mail setup. There is a test button available.
Enable the ‘Error event memory’ because otherwise you’ll get too many emails in case the maximum of files is reached.
FYI: When you would test this setup and max files are reached we added a way to reset the internal counter (max files allowed per month).
Right click on the Counter value below and select ‘Reset Counter’.
This is is just an example of what is possible. If you need any help with this ‘halt moving too many files’ setup, please let us know.
Best Regards,
Limagito Team
#managedfiletransfer #filetransfer #filemanagement
By Limagito-Team Events How-to Pascal Script halt moving, too many files