RGW S3: Features Vs Deep Compatibility

on YouTube ↗25m

" summary

Built an HAProxy plugin that parses headers before bodies to log and classify S3 feature use and to patch broken clients; it injects a content-length: 0 for ACL writes and records that server-side encryption is rarely used despite frequent requests. Finds AWS behavior differs by region (create-bucket returns 200 vs 409), signature V4 quirks require stripping extra spaces, multipart uploads keep breaking, and an accept-wrong-signature toggle was added to restore compatibility; proxy approach works but cannot measure upload bandwidth after handoff.

AI-written summary · about

" chapters (18)

1. 0:00Introduction to S3 compatibility
2. 1:03Feature support in RGW
3. 2:49API usage analysis methods
4. 5:58AWS vs specification inconsistencies
5. 8:11Content-Length header handling
6. 9:17Signature and region issues
7. 10:23Robustness principle in S3
8. 11:30HTTP 1.0 compatibility gaps
9. 12:11Missing feature feedback
10. 13:21Encryption and data corruption
11. 14:48Signature compatibility toggles
12. 15:37Multipart upload breakages
13. 16:41Data compatibility over time
14. 17:44Silent data discards and corruption
15. 19:09Swift vs S3 interoperability
16. 21:02QoS implementation in RGW
17. 23:44Concurrency and race conditions
18. 24:56Q&A session