AWS S3 Archives - File transfer tool from Limagito

16 Aug
How to look for dated folders in AWSS3 using directory and file Prefix
Q: If we write a Pascal Script, “on rule begin” can use insert a variable in the “Directory & File Prefix” setup?
Our S3 bucket has ~600,000 items and takes about 3 minutes per scan just to transverse the files, and we’re trying to speed that up 🙂
We’re looking for dated folders, but I don’t see any “allow parameters” like you can in the directory filtering.
A: Yes, you can add date parameters in the ‘Directory & File Prefix’ field like %TCD:YYYYMMDD:
Reply customer:
You’re correct, that “Directory & File prefix” is linked to the file filter setup tab. So any changes in source are duplicated there, And we can check the “allow parameters” under the advanced tab.
AND it works

Best Regards,
Limagito Team
#AWSS3 #managedfiletransfer #filetransfer #filemanagement
By Limagito-Team AWS S3 directory and file prefix, S3 prefix
18 Oct
The x-amz-content-sha256 header does not match what was computed
The provided x-amz-content-sha256 header does not match what was computed
Q: I was able to setup a non aws s3 (wasabi) as source but I’m not able to do so as destination. Is it possible to have some help?
A: The customer was using an older version so we first asked him to update his version. We created a new build with extra logging information for AWS as Destination (v2024.10.14.0 or higher).
<Error><Code>XAmzContentSHA256Mismatch</Code><Message>The provided 'x-amz-content-sha256' header does not match what was computed.</Message><ClientComputedContentSHA256>8AFBD736EC2917807F5FF5D8A9018846AA9D6B25EC839506DACE0D588DE491C5</ClientComputedContentSHA256><S3ComputedContentSHA256>8afbd736ec2917807f5ff5d8a9018846aa9d6b25ec839506dace0d588de491c5</S3ComputedContentSHA256><RequestId>1CF8F37CAA85D906:A</RequestId><HostId>KKwBla460dUwWRytyBUsvPQBw/z9QNkAg8mFuYQtBNOUHDXQhPG1vYAHfC5djS/fwa0VH2J0qIHx</HostId><CMReferenceId>MTcyODkyMjIzMDgxOCAxMzAuMTE3LjE4NS4xMDIgQ29uSUQ6ODA5NDI1OTAwL0VuZ2luZUNvbklEOjc5MDkwODgvQ29yZTo0Ng==</CMReferenceId></Error>
We found out that Wasabi was expecting the lowercase of the sha256 hash. This was adjusted in version v2024.10.17.0 and since this version we are using the lowercase of the sha256 hash.
If you need any help with this question, please let us know.
Best Regards,
Limagito Team
#awss3 #managedfiletransfer #filetransfer #filemanagement
By Limagito-Team AWS S3 wasabi, x-amz-content-sha256
17 Mar
How to add tags to AWS S3 files after upload or download
How to add tags to AWS S3 files after upload or download
We received a request to add an option which allows to add tags after upload. This option was added in version v2024.3.17.0. This option allows you to add tags to an AWS S3 object after a successful upload or download.
Please open your AWS S3 Destination Setup and switch to the new ‘Tags’ tab:
Check ‘Enable Set Tags’
Allowed characters: 0-9, a-z, A-Z, and + – = . _ : / @
Tags are Case Sensitive
Maximum 10 Tags allowed
Select ‘Set Tags Method’
Overwrite existing Tags
All existing tags will be deleted and replaced by the tags you added in Limagito.
Merge existing Tags, prio AWSS3
If a tag already exists then we’ll not adjust them. AWS S3 gets a higher priority.
Merge existing Tags, prio Limagito
If a tag already exist then we’ll adjust its value. Limagito gets a higher priority.
Be sure your account has permissions to perform the s3:PutBucketTagging (and s3:GetBucketTagging) action(s). The bucket owner has this permission by default and can grant this permission to others. For more information about permissions, see Permissions Related to Bucket Subresource Operations and Managing Access Permissions to Your Amazon S3 Resources.
Result in the AWS console:
RunTime Log Result:
If you need any help with this new option, please let us know.
Best Regards,
Limagito Team
#awss3 #managedfiletransfer #filetransfer #filemanagement
By Limagito-Team AWS S3 aws s3, AWSS3, tags