0
Answered
Jazzity 2 months ago in Scrapy Cloud • updated by Pablo Vaz (Support Engineer) 2 months ago 4

Hey everybody,


I am trying to store scraped images to S3. However, I get the following error message:


The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256.


Initial research tells me that this means that AWS4-HMAC-SHA256 (aka "V4") is one of two authentication schemes in S3, the other one being the older scheme, Signature Version 2 ("V2").


Does anybody know how I can switch to V4 - or any other hints that help me upload my images to S3?


My test project is called "S3_test" and has the ID 178090.


Any help is greatly appreciated.


Best wishes


Sebastian

Answer

Answer

Hey Glad to hear that works!

Was a pleasure to help Sebastian!

Thanks for your nice feedback,


Best,


Pablo Vaz

GOOD, I'M SATISFIED
Satisfaction mark by Jazzity 2 months ago
Searching answer

Hey Sebastian!


I'm asking to our Scrapy Cloud gurus and will get back to you as soon as I receive an answer.


Have you checked: https://github.com/aws/aws-sdk-android/issues/192
This seems an issue with AWS...

Let me know if you find something also, thanks!


Best regards!


Pablo Vaz

Support team

Answered

Some of our sysadmin gurus have spoken about it:


"This issue is probably related to trying to use a Version 4 S3 bucket with Version 2 software.

For example, Frankfurt region is V4 only, but Ireland is V2 + V4, you can use V4 with boto2 with some tricks, or use boto3 that is a bit better"


Let me know if this information could be helpful.


Best regards!


Pablo

+1

Hey Pablo,

awesome! Switching to a new bucket with region "EU (Ireland)" did the trick.

Thanks a lot for your support!

Best wishes,

Sebastian

Answer

Hey Glad to hear that works!

Was a pleasure to help Sebastian!

Thanks for your nice feedback,


Best,


Pablo Vaz