iRODS With Wasabi

Wasabi has been validated with the Integrated Rule-Oriented Data System (iRODS), a policy-based, open-source data management software designed to manage large, important, and complex data sets, used by research, commercial, and governmental organizations worldwide.

Requirements

• Active Wasabi Cloud Storage Account

• Wasabi Bucket - See our Bucket Creation Guide

• Access & Secret Key Pair - See our Access Keys Guide

• iRODS Software Version 4.2.11

• iRODS S3 Plugin Version 4.2.11.3

Reference Architecture

Single iRODS Zone with two servers configured to connect to Wasabi

Configuration

1. Install the latest version of the iRODS S3 Plugin on all iRODS servers by performing the following command.

   sudo apt-get install irods-resource-plugin-s3

2. Save your Wasabi access key and secret access key (obtained from Wasabi) into a file accessible by the iRODS server.  The file should contain the access key and the secret access key, one on each of two separate lines. 

   For the example below, the access key and secret access key are saved to/var/lib/irods/wasabi.keypair.

3. Create an iRODS S3 resource that connects to the Wasabi backend.

4. Create a resource using the following pattern.

   iadmin mkresc  s3 :/ 

   The example below creates an iRODS resource named wasabiresc1. It assumes the target bucket is named mybucket, the connection will use the secure https protocol to connect with s3.wasabisys.com in the us-east-1 region, and that the keypair is stored in /var/lib/irods/wasabi. keypair:

   iadmin mkresc wasabiresc1 s3 `hostname`:/mybucket “S3_DEFAULT_HOSTNAME=s3.wasabisys.com;S3_AUTH_FILE=/var/lib/irods/wasabi.keypair;S3_REGIONNAME=us-east-1;S3_RETRY_COUNT=2;S3_WAIT_TIME_SECONDS=3;S3_PROTO=HTTPS;HOST_MODE=cacheless_attached;S3_SIGNATURE_VERSION=4;S3_ENABLE_MPU=1;S3_MPU_THREADS=30”

   Note: This example uses Wasabi’s us-east-1 storage region. To use other Wasabi storage regions, use the appropriate Wasabi service URL as described in our Wasabi Service URLs.

5. Test put/get of a file into the iRODS resource wasabiresc1.

   $ echo 'this is a test' > test.txt 
   
   $ iput –R wasabiresc1 test.txt 
   
   $ iget test.txt - 
   
   this is a test

   Assuming you were in the rods home collection in iRODS, the file should be visible in Wasabi at /mybucket/home/rods/test.txt.