In a previous post, I had explored uploading files to S3 using putObject and its limitations. As recommended by AWS for any files larger than 100MB we should use multipart upload. There are a couple of ways to achieve this. I’ll start with the simplest approach.
S3 multipart upload As the name suggests we can use the SDK to upload our object in parts instead of one big request. The AWS APIs require a lot of redundant information to be sent with every request, so I wrote a small abstraction layer.