storage

Simple Storage Service (S3):

S3 provides developers and IT teams with secure, durable, highly-scalable object storage. Amazon S3 is easy to use, with a simple web services interfaces to store and retrieve any amount of data from anywhere on the web. S3 Essentials —

1. S3 is Object based i.e. allows you to upload files and stored file on the platform.
2. Files can be from 1 Byte to 5Tb in size.
3. There is unlimited storage.
4. Files are stored in Buckets. (Buckets like directory any windows and linux file system).
5. Buckets have a unique namespace for each given region (eg if i want to create a bucket izapcloudguru in the eu-west-1 region that namespace with then be reserved so somebody else with using another amazon account could not go in and create a izapcloudguru bucket. https://s3-eu-west-1.amazonaws.com/bucketname/)
6. Amazon guarantees 99.99% availability for the S3 platform. S3 buckets essentially spread across availability zone. So if availability zone goes down you don’t have to worry your S3 bucket is stored in the other availability zone and amazon do this automatically on a region bases you don’t have to worry about configuring this.
7. Amazon also guarantees 99.999999999% durability for S3 information. Durability is simply if you think of storing of file on a disk set i.e Raid 1 and you lose one of the disk because in Raid 1 configuration which mirror all your information is stored across two disks so you can loss of 1 disk now the way amazon structure S3 is that if you stored 10000 files the guarantee those 10000 files stay there with the 99.999999999% durability.
8. S3 can have metadata (key value pairs) on each storage (eg file).
9. S3 allows you to do Lifecycle Management.
10. Versioning
11. Encryption (S3 also allows you to do encrypt your buckets. You can store your files encrypted at rest.)

S3 Storage Types

1. Standard S3 storage which gives you 99.99% availability, and the 99.999999999% durability
2. Reduced Redundancy storage – Still has 99.99% availability and your buckets replicated across different availability zones automatically but they use different disk sets the only give you 99.99% durability over a given year. So it’s little bit cheaper to use reduced redundancy storage but you only stored files on that not important if you lose them.
3. Only use Reduced Redundancy Storage for replaceable data. For example if you have 10,000 files, you could expect to lose 100 files over 1 year as opposed to 0.00001 file with standard S3 durability.

S3 Versioning

1. Stores all versions of an object (including all writes and even if you delete an object)
2. Great backup tool.
3. Once enabled, Versioning cannot be disabled, only suspended that’s quite important to know.

S3 Lifecycle Management

1. Lifecycle Management can be used in conjunction with versioning.
2. Lifecycle Management can be applied to current versions and previous versions.
3. Following actions are allowed in conjunction with or without versioning;
4. Archive Only
5. Permanently Delete Only
6. Archive and then permanently delete.

S3 Encryption

1. You can upload/download your data to S3 via SSL Encrypted Endpoints and S3 can automatically encrypt your data at rest. S3 gives you the choice of managing your keys through AWS key Management Service (AWS Key Management Service), having Amazon S3 manage them for you, or providing your own keys.

S3 Security

1. All buckets are private by default.
2. Allows Access Control Lists (an individual user, can only have access to 1 bucket and only have read only access).
3. Integrates with IAM (using roles for example allows EC2 users to have access S3 buckets by roles).
4. All endpoints are encrypted by SSL.

S3 Functionality

1. Static Websites can be hosted on S3. No need for web servers, you can just upload a static .html to an S3 bucket and take advantage of AWS S3’s durability and High Availability.
2. S3 also Integrates with Cloud Front which is amazon content delivering network.
3. Multipart uploads, allows you to upload parts of a file concurrently.
4. Suggested for files a 100Mb over. It is required for any file over 5Gbs.
5. Allows us to resume a stopped file upload.
6. S3 is spread across multiple availability zones and i guarantee you have Eventual Consistency you just have to remember the sometimes you might upload a file to an S3 bucket and then you go to try and access that file pro-grammatically because you trying to do that so fast it might not replicated across other availability zones. So just important to remember that all AZ’s will eventually be consistent. Put/Write/Delete requests will eventually be consistent across AZ’s.

S3 Use Cases

1. File Shares for networks
2. Backup/Archiving
3. Origin for CloudFront CDN’s
4. Hosting Static Files
5. Hosting Static Websites