File Mover Blog

  • 06 Dec

    Advanced Moving Rule Temporary Directory Option

    Advanced Moving Rule Temporary Directory Option

    Q: Regarding the temporary folder.  This location, that I’m going to change it to a new D:, but just curious, what happens if this location does fill up.  What happens to the job that’s running and using it?

    limagito file mover moving rule advanced setup

    • Temporary Directory Option:
      • This folder is uses as temporary storage between Source and Destination. Each Rule uses multiple threads so we can handle Source and Destination files at the same time. Never use a network folder as Temporary Directory.
      • This option needs to be set for each Rule separately

    limagito file mover temporary directory option

    A: It will give an OS error because we are not able to write the stream from the source to this temporary directory. To prevent it from filling up you could enable the on error event and send an e-mail if something goes wrong.

    Q: Will enable the event. I’am using AWSS3 as Source but don’t have any control over how much data they put in that S3 bucket, if there is 1 TB of files and the d: drive is only 100 GB, does Limagito just divide that up in to manageable chunks based on the free space of the D: drive?  I know the first iteration of the job was close to 1 TB and the drive is only 100 GB, but it succeeded.

    A: That is because the temp files were moved to the destination. Multiple threads are working at the same time getting files from the Source and moving them to their Destination (s). You could enable our precondition and check the free size of the D drive. Then you would set the max files for a single scan to for example 50 files or more so it would recheck the free space every 50 files.

    limagito file mover precondition option

    • Enable ‘Check Free Disk Space’. In this example:
      • scanning of source files would be allowed when free disk space on Y:\ is more than 15%
      • scanning of source files would be skipped when free disk space on Y:\ is 10% or lower

    limagito file mover precondition setup

    • Schedule Setup > Advanced Tab > Max. Files processed in Once Scan is set to 50 as an example
      • Each scan will handle 50 files and will check the precondition first

    limagito file mover max files processed

    If you need any help with this “temporary directory” question, please let us know.

    Best Regards,

    Limagito Team

    #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team How-to
  • 06 Dec

    How to add a record to a csv file

    How to add a record to a csv file

    Q: I have a job which is processed through another bit of software, I get 1 file in and at the end of the process, I can have over 100 data files.

    I need to add a record to the start of each file with the same structure, the fields can be empty but I do need to populate 2 of the fields.

    • Sequence fields needs to be 000000
    • Outname fields needs to be the name of the data file

    I then need to add a record at the end of the file but only 1 field needs to be populated

    • Sequence = 999999

    Is this achievable in Limagito? I can do this within the software that processes the data but it will be a very long process to set up.

    A: This should be possible using our scripting option.

    • We used a Windows folder as Source:

    limagito file mover windows folder as source

    • We added the following Include Filename filter because we want to be sure we only are going to handle csv files:

    limagito filemover filename filter

    • As Destination we used our PScript (Pascal Script) option:

    limagito filemover destination setup

    • Please add the following Pascal Script
      • Please add the following script: link
      • Do not forget to adjust the ctOutputPath ( path must end with a \ )
        • This is the path where the adjusted csv files will be saved

    limagito file mover add a record to a csv file

    • Example content of csv source file before changes:

    limagito filemover csv example file

    • Example content of csv destination file after changes:

    limagito file mover example csv file

    Feedback customer:

    You are an absolute legend. Thank you very much

    If you need any help with this “add a record to a csv file” question, please let us know.

    Best Regards,

    Limagito Team

    #csv #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team CSV Pascal Script ,
  • 21 Nov

    How to to skip files if they already exist at the destination

    How to to skip files if they already exist at the destination

    Q: I’m looking to setup a nightly schedule that will copy files from source to destination.  Is there a way to skip files if they already exist at the destination?

    A: If you start with a fresh setup, meaning no files available in the Destination when you first trigger the Rule then we really recommend our ‘File Memory’ option. This way our tool remembers which files were already copied to the destination and this is also the fastest way.

    skip files if they already exist

    If some destination files already exist then you could fill the File Memory database first. This is only possible with [WIN] as Source!

    1.Enable ‘Enable File Memory’ option (previous screenshot). This option must stay enabled.

    2.Enable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>

    limagito file mover file memory option

    3. Enable the Rule and trigger it once, the Rule will run and fill the file memory database. With the ‘Skip Destination when filename isn’t in the database (WIN)’ enabled the Rule will skip the destination during this scan and only fill the file memory database.

    limagito file mover manual trigger

    4. Next, Disable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>

    limagito file mover file memory option

    This way the file memory database was filled with the existing [WIN] Source files. Any new files in the source will be copied once during the next scan.

     

    If you need any help with this “skip files if they already exist” question, please let us know.

    Best Regards,

    Limagito Team

    #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team How-to
1 2 3 4 5 6 7 149
SEARCH