AWS S3

  • 18 Oct

    The x-amz-content-sha256 header does not match what was computed

    The provided x-amz-content-sha256 header does not match what was computed

    Q: I was able to setup a non aws s3 (wasabi) as source but I’m not able to do so as destination. Is it possible to have some help?

    A: The customer was using an older version so we first asked him to update his version. We created a new build with extra logging information for AWS as Destination (v2024.10.14.0 or higher).

    <Error><Code>XAmzContentSHA256Mismatch</Code><Message>The provided &apos;x-amz-content-sha256&apos; header does not match what was computed.</Message><ClientComputedContentSHA256>8AFBD736EC2917807F5FF5D8A9018846AA9D6B25EC839506DACE0D588DE491C5</ClientComputedContentSHA256><S3ComputedContentSHA256>8afbd736ec2917807f5ff5d8a9018846aa9d6b25ec839506dace0d588de491c5</S3ComputedContentSHA256><RequestId>1CF8F37CAA85D906:A</RequestId><HostId>KKwBla460dUwWRytyBUsvPQBw/z9QNkAg8mFuYQtBNOUHDXQhPG1vYAHfC5djS/fwa0VH2J0qIHx</HostId><CMReferenceId>MTcyODkyMjIzMDgxOCAxMzAuMTE3LjE4NS4xMDIgQ29uSUQ6ODA5NDI1OTAwL0VuZ2luZUNvbklEOjc5MDkwODgvQ29yZTo0Ng==</CMReferenceId></Error>

    We found out that Wasabi was expecting the lowercase of the sha256 hash. This was adjusted in version v2024.10.17.0 and since this version we are using the lowercase of the sha256 hash.

    If you need any help with this question, please let us know.

    Best Regards,

    Limagito Team

    #awss3 #managedfiletransfer #filetransfer #filemanagement

  • 17 Mar

    How to add tags to AWS S3 files after upload or download

    How to add tags to AWS S3 files after upload or download

    We received a request to add an option which allows to add tags after upload. This option was added in version v2024.3.17.0. This option allows you to add tags to an AWS S3 object after a successful upload or download.

    Please open your AWS S3 Destination Setup and switch to the new ‘Tags’ tab:

    • Check ‘Enable Set Tags’
      • Allowed characters: 0-9, a-z, A-Z, and + – = . _ : / @
      • Tags are Case Sensitive
      • Maximum 10 Tags allowed
    • Select ‘Set Tags Method’
      • Overwrite existing Tags
        • All existing tags will be deleted and replaced by the tags you added in Limagito.
      • Merge existing Tags, prio AWSS3
        • If a tag already exists then we’ll not adjust them. AWS S3 gets a higher priority.
      • Merge existing Tags, prio Limagito
        • If a tag already exist then we’ll adjust its value. Limagito gets a higher priority.

    Be sure your account has permissions to perform the s3:PutBucketTagging (and s3:GetBucketTagging) action(s). The bucket owner has this permission by default and can grant this permission to others. For more information about permissions, see Permissions Related to Bucket Subresource Operations and Managing Access Permissions to Your Amazon S3 Resources.

    add tags to aws s3

    Result in the AWS console:

    add tags to AWS S3

    RunTime Log Result:

    limagito file mover runtime log result

    If you need any help with this new option, please let us know.

    Best Regards,

    Limagito Team

    #awss3 #managedfiletransfer #filetransfer #filemanagement

    By Limagito-Team AWS S3 , ,
  • 31 Jan

    AWS S3 MD5 digest with multipart uploads

    AWS S3 MD5 digest with multipart uploads

    In version v2023.1.31.0 we added Verify support for multipart uploads. Some very interesting information can be found here:

    So ..

    1. If an object is created by a Multipart Upload operation, the ETag is not an MD5 digest, regardless of the method of encryption.
    2. For multipart uploads the ETag is the MD5 hexdigest of each part’s MD5 digest concatenated together, followed by the number of parts separated by a dash.

    We added code to recalculate the MD5 hex digest using the Filesize of the download and the ETag ‘stripped number of parts’ we received from the S3 object. This way we could calculate the size and MD5 checksum for each part. This information was used to calculate the MD5 hex digest of the concatenated checksums.

    By default ‘Verify File after Copy / Move’ is enabled which uses the ETag of the S3 object (File) as MD5 hash to compare the download result.

    Limagito File Mover AWS S3 MD5 digest

    #FileTransfer #awss3

    If you need any info about this ‘AWS S3 compatible storage providers’ option, please let us know.

    Best regards,

    Limagito Team

     

    By Limagito-Team AWS S3
1 2 3
SEARCH