File Mover Blog

  • 21 Nov

    How to to skip files if they already exist at the destination

    How to to skip files if they already exist at the destination

    Q: I’m looking to setup a nightly schedule that will copy files from source to destination.  Is there a way to skip files if they already exist at the destination?

    A: If you start with a fresh setup, meaning no files available in the Destination when you first trigger the Rule then we really recommend our ‘File Memory’ option. This way our tool remembers which files were already copied to the destination and this is also the fastest way.

    skip files if they already exist

    If some destination files already exist then you could fill the File Memory database first. This is only possible with [WIN] as Source!

    1.Enable ‘Enable File Memory’ option (previous screenshot). This option must stay enabled.

    2.Enable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>

    limagito file mover file memory option

    3. Enable the Rule and trigger it once, the Rule will run and fill the file memory database. With the ‘Skip Destination when filename isn’t in the database (WIN)’ enabled the Rule will skip the destination during this scan and only fill the file memory database.

    limagito file mover manual trigger

    4. Next, Disable ‘Skip Destination when filename isn’t in the database (WIN)’ and click <Save>

    limagito file mover file memory option

    This way the file memory database was filled with the existing [WIN] Source files. Any new files in the source will be copied once during the next scan.

     

    If you need any help with this “skip files if they already exist” question, please let us know.

    Best Regards,

    Limagito Team

    #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team How-to
  • 20 Oct

    Problem copying a file due to a folder tree that is too long

    Problem copying a file due to a folder tree that is too long

    Q: I’m contacting you because we’re experiencing a problem when retrieving and copying a file stored on AWS (bucket) via LimagitoX v2023.5.12.0 (screenshot attached). The problem seems to be linked to the length of the folder tree containing the file. In fact, when we test with a shorter tree path, the file is copied successfully. Unfortunately, according to AWS, it is not possible to modify the path length of the tree structure.

    To give you more information on the problem, I’ve attached two log files:

    • Log_OK_SrvLimagitoX.Ruleld : short tree path with which the copy works.
    • Log_KO_SrvLimagitoX.Ruleld: tree path imposed by AWS that generates the error (which doesn’t work).

    A: We found some renaming errors in the log file.

    2024-04-26 15:26:18 AMS_BI_AMAZON_TEST_S3_VGO [AWSS3GET] Rename Exception Error: Rename C:\Users\Admin_Limagito\AppData\Local\Temp\LimagitoX\LimagitoX.740\aps-download-publisher-11111111-5ce6-49d8-8037-111111111\versionId=c36c10e4-d59c-4f20-82f4-111111111111\executionDate=20240426\part-00000-111111111111111111111111111111111111.c000.csv.tmpdwnld To C:\Users\Admin_Limagito\AppData\Local\Temp\LimagitoX\LimagitoX.740\aps-download-publisher-11111111-5ce6-49d8-8037-111111111111\versionId=c36c10e4-d59c-4f20-82f4-111111111111\executionDate=20240426\part-00000-111111111111111111111111111111111111.c000.csv Error

    When downloading files from AWSS3, we first store the stream of data we are downloading locally on the system. The same counts for all non-Windows folders as source, like AZURE, SFTP, FTP, … . During the download, the file has a temporary extension (.tmpdwnld). After a successful download, the file will be renamed to its original extension. The problem here is that Windows doesn’t like very long path + filenames, please check: link.

    Solution: Please update to the latest build first (v2024.10.17.0 or higher)
    • Could you please open the Advanced option of this AWSS3 Rule:

    limagito filemover advanced rule options

    • Please add  \\%\  as prefix to your ‘Temporary Directory’ setup. Please, always keep the temporary folder on the local system where the file mover is installed!

    limagito file mover folder tree that is too long

    If you need any help with this “folder tree that is too long” question, please let us know.

    Best Regards,

    Limagito Team

    #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team Error , , ,
  • 20 Oct

    How to verify the pgp signature during decryption

    How to verify the pgp signature during decryption

    Q: I use PGP decryption in some rules and I need to activate the signature checking. Can you tell me if this is available and how to do it ?

    A: We added this option in v2024.10.19.0

    • PGP Decryption, Added Verify Signature option (v2024.10.19.0) [+]

    We added some screenshots in this blog article to get you started.

    • We used a Windows Folder as Destination:

    limagito file mover destination setup

    • We enabled ‘Enable Encrypt – Decrypt’ and selected ‘Decrypt Files’. As Encryption Algorithm we chose  ‘PGP (Pretty Good Privacy)’.

    limagito file mover crypto setup

    • Under the PGP tab we:
      • Added our Private Key file (and password) to decrypt the received files. The files we received were encrypted by a third party using our corresponding public key.
      • Added the Public Key file we received, from this third party, to check the signature. The files we received were signed by the third party using their private key file.
      • Enabled the ‘Verify Signature (Decryption)’ option.

    Important: When ‘Verify Signature’ is enabled then all files must have a valid signature. Also files without a signature will not be allowed (error).

    limagito file mover verify the pgp signature

    • RunTime log example of files with an invalid signature:

    limagito file mover verify the pgp signature

    If you need any help with this “verify the pgp signature” question, please let us know.

    Best Regards,

    Limagito Team

    #pgp #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team PGP
1 2 3 4 145
SEARCH