Amazon S3

From IndieWeb

Amazon S3 is a file hosting service from Amazon.

IndieWeb Examples

Leonardo Zangrando hosts his website on S3.

These are the notes that I took while creating my S3 Jekyll Indieweb site.

Other sources

Date Edge

Date Edge is a straighteedge dating website made by Shane Becker and Bookis. It uses S3 for serving assets (images now, audio/videos later) and Cloudfront as a CDN. They pay $0.12 per GB transferred up to 10 TB. The first 1 GB transferred is free. For the month of 2014-05, they transferred 27.941 GB and paid $3.35 USD.

Use local copy or rsync to S3

Frédéric de Villamil is hosting a static website on S3 using plain html pages.

This setup allows to sync the pages using your operating system file manager using drag and drop or local rsync:

- Create an account on AWS – Create bucket in AS3 and initialise Cloudfront for website delivery via AWS - If you don't have it done yet, setup your domain on Amazon Route53. - Install S3 Fuse on your system. It was tested sucessfully on Mac OS, Linux and FreeBSD. - Create a directory to mount the remote file system (the S3 bucket) on the local machine. - Mount the remote file system locally. - Locally copy the files from your work directory to the remote one. Uing rxync here avoids you to transfer the whole files each time.

This setup is quite slow because Fuse is slow, but it was made for someone not really tech savvy who had to update the HTML and push the files on S3. Since that person already had to learn HTML, it was decided to make the process easier by allowing the local copy

Emma Kuo has been hosting her personal site on S3 since March 2015. She is using Skein to publish static html to S3.

Jonathan LaCour

Jonathan LaCour uses S3 to store his generated website files and his location logs.

Michael Bishop

Michael Bishop uses S3 to store and serve images uploaded to his WP instance


  • If your site has modest traffic then you will have a low hosting bill. There is no minimum cost per month.
  • Amazon is responsible for keeping the hardware and software running, and Amazon probably has more resources for fixing problems than you do :-)
  • Content on S3 is stored redundantly.
  • It is very difficult to serve custom HTTP status codes (e.g. 301 redirects): you must create a dummy file at the appropriate URL and then use Amazon’s web-based management system to set up the status.
  • It is not possible to serve HTTP Link headers for webmention or micropub, you will need to use <link> elements in the html.
  • It is not possible to serve HTTPS directly from S3, you will need to use Cloudfront.
  • It is not possible to perform advanced URL rewriting on the server.
  • You cannot run your own software (e.g. PHP or Perl scripts) server-side.


S3 as a Media Endpoint

After trying AWS Lambda as a media endpoint, Eddie Hinkle decided to try Amazon s3 as a media endpoint. The idea was that the micropub endpoint would return a presigned s3 url inside the Micropub config query for the media endpoint. This would allow a user that retrieves the url to be able to upload a file directly to s3. This would be less secure because there would be no way to verify the authorization token so it would be assuming the person has access simply because they had a valid access token when they fetched the Micropub config query.

The issue with this is that Micropub clients tend to hold onto Media Endpoint urls for awhile and presigned s3 urls expire in a maximum of 7 days, which means I would need a new Media Endpoint url every 7 days which doesn't work with most Micropub apps currently.


Times when there was a noticeable S3 outage:

  • ...
  • 2017-02-28 Portions of S3 were down for quite a while, causing lots of sites to stop working. [1] [2]. Sites that folks noticed were not working:
  • ...

See Also