top

Search

AWS Tutorials

Amazon Web Services S3 is a service from Amazon that provides efficient storage facilities to the user’s resources.IntroductionThe amount of data which is generated on a daily basis is increasing exponentially. A major part of this data (if not the entire data set) is essential for analysis, understanding users, making important decisions, observing the trends, making predictions, extracting useful insights, designing further applications based on the requirement, and much more. This means most of the data needs to be stored efficiently, in addition to making it easy to retrieve the data, provide relevant security to sensitive/private data, and making sure that no other process slows down due to this storage.This is when Amazon came up with the very idea of S3 that not just stores data efficiently, but helps in scaling up or down the data, providing high levels of security, and the ability to retrieve any amount of information at any point in time, anywhere from the Internet (data that is publicly available). It can also be used as a backup and data recovery service since data storage is highly durable on AWS S3.This service, in addition to being compatible with other AWS services, supports third-party solutions too.Pre-requisitesIt is essential to understand how the AWS S3 service stores data, which makes it so efficient to retrieve and use.Amazon S3 stores data in the form of ‘objects’, and these objects are housed inside an entity known as a  ‘bucket’. An object refers to the file (that contains data) and some metadata with regards to the data inside the file (example- type of data, characters, and bytes). If a user wishes to store their data in the Amazon S3 bucket, they will first need to upload their data file to a bucket. After this, the permissions on the file (inside the bucket) can be set, which will decide whether this data can be changed by others or not.Steps to use Amazon S3Following are the steps to use Amazon S3:1. If you don’t have an account with AWS, sign up for one.2. Follow the steps and create an AWS account.3. If you already have an account with AWS, sign in and click on the ‘Get Started with Amazon S3’.4. Create a bucket that will store the user’s uploaded file. Once the file is uploaded to the bucket, the charging starts.5. After creating a bucket and giving a name to it (make sure the name is unique and the region is ‘US West (Oregon), click on the ‘Create’ button and then ‘Create bucket’.6. The ‘configure options’ and ‘set permissions’ have been shown below. In the end, the S3 is reviewed and can be put to use.Permissions are shown below:7. The next step is to upload a data file into the created bucket. This data file can be anything ranging from a text file to a video file. The bucket which you would have previously created can be seen on the console. Click on it and then click on the ‘upload’ button.8. Add files to your bucket from your local machine or any other resource and click on ‘Upload’ as in the below screenshot:9. This uploaded object’s file information can be seen on the console. This can be done by clicking on the bucket you created and checking the ‘Name’ list. It can be downloaded onto your local machine as well. A sample looks like this:Now that we have seen how to create a bucket, and upload a data file into the bucket, we will understand how an object can be moved from one place to another.1. Click on the bucket you created previously.2. Click on ‘Create folder’, give a name to your folder, choose encryption as ‘None’ and click on ‘Save’.3. The objects list will now have the folder you created and the file which was uploaded to the S3 bucket. Click on the object that needs to be copied to the newly created folder, click on ‘More’ and click on ‘Copy’.4. Now click on the new folder which was created (it is the destination where the uploaded file needs to be copied to), click on ‘More’->’Paste’. A ’Copy and paste’ dialog box appears.5. Click on ‘Paste’ after the file is uploaded to the folder.After looking at transfer of data file from one bucket to another folder, we will look at how an object can be deleted from a bucket.  Click on the bucket name that contains the file which you wish to delete.Under the ‘Name’, click on the check-box of the file that you wish to delete.Click on ‘More’->’Delete’.Similar to ‘Paste’ option in the Paste operation, a ‘Delete objects’ dialog box appears. Click on the ‘Delete’ button to delete one of the objects from the S3 bucket:Emptying the bucketIf you wish to retain the name of the bucket, but wish to change the contents/objects present in the bucket, the bucket can be emptied.Click on the bucket icon next to the bucket name which you wish to delete.Now click on the ‘Empty bucket’ option. The ‘Empty bucket’ dialog box will appear.Enter the name of the bucket and click on ‘Confirm’. This will empty the contents of the bucket, but will retain the bucket (which would be empty).Deleting the entire bucketIf you wish to delete the entire bucket, instead of just emptying the bucket, the below steps could be followed:Click on the bucket icon next to the bucket name which you wish to delete.Now click on the ‘Delete Bucket’ option. The ‘Delete bucket’ dialog box will appear.Enter the name of the bucket and click on ‘Confirm’.Some of the salient features of Amazon S3:For the purpose of security, AWS supports 3 encryption forms. AWS has a machine learning service which automatically discovers, arranges and secures data which is present in AWS.AWS helps monitor costs and reduce them.Storage administrators which are present in AWS help provide analysis of the data usage visually.Uploading data to S3 is an easy process. They have multiple ways of transferring required data over the internet. They have direct connections, APIs, AWS Snowball service, and an AWS Storage Gateway.Analysis on large amounts of data can be done without the need of moving it to a different system.AWS works on a global cloud infrastructure, which means it is extremely durable.The flowchart for the Amazon S3 looks like this:ConclusionIn this, we understood the importance of AWS S3, and how it has changed the face of storage in the world of computing.
logo

AWS Tutorials

What is Amazon Web Services ?

Amazon Web Services S3 is a service from Amazon that provides efficient storage facilities to the user’s resources.

Introduction

The amount of data which is generated on a daily basis is increasing exponentially. A major part of this data (if not the entire data set) is essential for analysis, understanding users, making important decisions, observing the trends, making predictions, extracting useful insights, designing further applications based on the requirement, and much more. This means most of the data needs to be stored efficiently, in addition to making it easy to retrieve the data, provide relevant security to sensitive/private data, and making sure that no other process slows down due to this storage.

This is when Amazon came up with the very idea of S3 that not just stores data efficiently, but helps in scaling up or down the data, providing high levels of security, and the ability to retrieve any amount of information at any point in time, anywhere from the Internet (data that is publicly available). It can also be used as a backup and data recovery service since data storage is highly durable on AWS S3.

This service, in addition to being compatible with other AWS services, supports third-party solutions too.

Pre-requisites

It is essential to understand how the AWS S3 service stores data, which makes it so efficient to retrieve and use.

Amazon S3 stores data in the form of ‘objects’, and these objects are housed inside an entity known as a  ‘bucket’. An object refers to the file (that contains data) and some metadata with regards to the data inside the file (example- type of data, characters, and bytes). If a user wishes to store their data in the Amazon S3 bucket, they will first need to upload their data file to a bucket. After this, the permissions on the file (inside the bucket) can be set, which will decide whether this data can be changed by others or not.

Steps to use Amazon S3

Following are the steps to use Amazon S3:

1. If you don’t have an account with AWS, sign up for one.

Amazon Web Services S3

2. Follow the steps and create an AWS account.

3. If you already have an account with AWS, sign in and click on the ‘Get Started with Amazon S3’.

Amazon Web Services S3

4. Create a bucket that will store the user’s uploaded file. Once the file is uploaded to the bucket, the charging starts.

Amazon Web Services S3

5. After creating a bucket and giving a name to it (make sure the name is unique and the region is ‘US West (Oregon), click on the ‘Create’ button and then ‘Create bucket’.

Amazon Web Services S3

6. The ‘configure options’ and ‘set permissions’ have been shown below. In the end, the S3 is reviewed and can be put to use.

Amazon Web Services S3

Permissions are shown below:

Amazon Web Services S3

7. The next step is to upload a data file into the created bucket. This data file can be anything ranging from a text file to a video file. The bucket which you would have previously created can be seen on the console. Click on it and then click on the ‘upload’ button.

Amazon Web Services S3

8. Add files to your bucket from your local machine or any other resource and click on ‘Upload’ as in the below screenshot:

Amazon Web Services S3

9. This uploaded object’s file information can be seen on the console. This can be done by clicking on the bucket you created and checking the ‘Name’ list. It can be downloaded onto your local machine as well. A sample looks like this:

Amazon Web Services S3

Now that we have seen how to create a bucket, and upload a data file into the bucket, we will understand how an object can be moved from one place to another.

1. Click on the bucket you created previously.

2. Click on ‘Create folder’, give a name to your folder, choose encryption as ‘None’ and click on ‘Save’.

Amazon Web Services S33. The objects list will now have the folder you created and the file which was uploaded to the S3 bucket. Click on the object that needs to be copied to the newly created folder, click on ‘More’ and click on ‘Copy’.

Amazon Web Services S3

4. Now click on the new folder which was created (it is the destination where the uploaded file needs to be copied to), click on ‘More’->’Paste’. A ’Copy and paste’ dialog box appears.

5. Click on ‘Paste’ after the file is uploaded to the folder.

Amazon Web Services S3

After looking at transfer of data file from one bucket to another folder, we will look at how an object can be deleted from a bucket.  

  1. Click on the bucket name that contains the file which you wish to delete.
  2. Under the ‘Name’, click on the check-box of the file that you wish to delete.
  3. Click on ‘More’->’Delete’.
    Amazon Web Services S3
  4. Similar to ‘Paste’ option in the Paste operation, a ‘Delete objects’ dialog box appears. Click on the ‘Delete’ button to delete one of the objects from the S3 bucket:

Amazon Web Services S3

Emptying the bucket

If you wish to retain the name of the bucket, but wish to change the contents/objects present in the bucket, the bucket can be emptied.

  1. Click on the bucket icon next to the bucket name which you wish to delete.
  2. Now click on the ‘Empty bucket’ option. The ‘Empty bucket’ dialog box will appear.Amazon Web Services S3
  3. Enter the name of the bucket and click on ‘Confirm’. This will empty the contents of the bucket, but will retain the bucket (which would be empty).

Amazon Web Services S3

Deleting the entire bucket

If you wish to delete the entire bucket, instead of just emptying the bucket, the below steps could be followed:

  1. Click on the bucket icon next to the bucket name which you wish to delete.
  2. Now click on the ‘Delete Bucket’ option. The ‘Delete bucket’ dialog box will appear.
    Amazon Web Services S3
  3. Enter the name of the bucket and click on ‘Confirm’.

Amazon Web Services S3

Some of the salient features of Amazon S3:

  • For the purpose of security, AWS supports 3 encryption forms. AWS has a machine learning service which automatically discovers, arranges and secures data which is present in AWS.
  • AWS helps monitor costs and reduce them.
  • Storage administrators which are present in AWS help provide analysis of the data usage visually.
  • Uploading data to S3 is an easy process. They have multiple ways of transferring required data over the internet. They have direct connections, APIs, AWS Snowball service, and an AWS Storage Gateway.
  • Analysis on large amounts of data can be done without the need of moving it to a different system.
  • AWS works on a global cloud infrastructure, which means it is extremely durable.

The flowchart for the Amazon S3 looks like this:

Amazon Web Services S3

Conclusion

In this, we understood the importance of AWS S3, and how it has changed the face of storage in the world of computing.

Leave a Reply

Your email address will not be published. Required fields are marked *

Comments

tenzin nyima

Whoever has contributed to this article...I would like to say thank you... it has been of good help to the readers.

alvi

This blog is very helpful and informative, and I really learned a lot from it.

alvi

It is very helpful and very informative, and I really learned a lot from this article.

alvi

Such a very useful article. I would like to thank you for the efforts you made in writing this awesome blog.

Jeanne

Very useful and awesome blog!