Posts

Showing posts from February, 2020

Rclone: Sync files from ftp server to AWS S3 bucket

Introduction Rclone  is a very good command line tool to move files and directories to and from cloud storage. In this post, I will explain the steps involved in setting up of rclone on mac machine and using it for syncing the files from a free ftp server to AWS S3 bucket Steps Install rclone command line Create source remote(ftp server) Create destination remote(AWS S3 bucket) Use rclone command to sync file from source remote(ftp server) to destination remote(AWS S3 bucket).  Installation of rclone Use curl command to install rclone on mac machine curl https://rclone.org/install.sh | sudo bash Create source remote Here source is ftp server, so a remote needs to be created with ftp configuration. Use command rclone config Follow the instructions and opt FTP when you get option to select storage. Use 'speedtest.tele2.net' as host, 'anonymous' for user and password can be anything. Create destination remote Destination remote is AWS S3 bucket. Fo