Fivetran With Wasabi

Fivetran facilitates securely moving, managing, and transforming data to power analytics, operations, and AI at scale. Data can be sourced from Wasabi and routed to many different destinations with the S3-compatible storage connector. This article describes how to configure Fivetran to work with Wasabi.

Requirements

• Active Wasabi Cloud Storage account.

• Wasabi bucket (For more information, review 2—Working With Buckets and Objects.)

• Access to the Wasabi Console as the account root user.

• Fivetran portal access with appropriate permissions to create connectors.

• Access to your connector’s destination user-interface.

Configuring Wasabi

1. Log in to the Wasabi Console as the account root user.

2. Configure a policy for a “fivetran” user (that will be created in the next step) using the following policy. Change YOUR_WASABI_BUCKET_NAME to your own Wasabi bucket name. See Creating a Policy for instructions on how to create a policy.

   {
     "Version": "2012-10-17",
     "Statement": [
       {
         "Effect": "Allow",
         "Action": "s3:ListAllMyBuckets",
         "Resource": "arn:aws:s3:::*"
       },
       {
         "Effect": "Allow",
         "Action": [
           "s3:Get*",
           "s3:List*"
         ],
         "Resource": [
           "arn:aws:s3:::YOUR_WASABI_BUCKET_NAME",
           "arn:aws:s3:::YOUR_WASABI_BUCKET_NAME/*"
         ]
       }
     ]
   }

3. Create a fivetran user and attach the previously created policy to it. Use the following settings for the user. For more information, see Creating a User.

   • Allow programmatic-only access, not console access.

   • Do not require Multi-Factor Authentication (MFA).

   • It is not necessary to assign the user to a group.

   • Save the access and secret keys in a secure location.

Configuring Fivetran

1. Log in to the Fivetran Dashboard.

2. Click Connections.

3. Click Add Connection.

   

4. Search for s3-compatible.

5. Hover your cursor over the S3-Compatible Storage connector to see the buttons. Click Set up.

   

6. Select the destination that is appropriate for your connector. Hover your cursor over the destination and click Select.

   

7. Select the values appropriate for your connection. The values shown below correspond to Snowflake as the destination and will vary for other destination types.  

   

8. Scroll down and enter the following information for Wasabi. When finished, click Run connection test and verify there are green checkmarks next to Validate Credentials and Test Success.

   This configuration example uses Wasabi’s us-east-2 storage region. To use another Wasabi storage region, select the appropriate URL for your bucket region, as described in Service URLs for Wasabi's Storage Regions.

   • Endpoint URL.

   • Select Access Key and Secret from the drop-down menu for the Access approach.

   • Wasabi Access Key ID (created above).

   • Wasabi Access Key Secret (created above).

   

9. Scroll down and continue entering the information appropriate for your connection. Select the appropriate format for the File Type.

   

10. Scroll down. Under the Configure files section, click + Add files.

    

11. Enter the appropriate details (such as a Table name) for your connection. Click Preview Files. Fivetran will attempt to automatically find a file in your Wasabi bucket to use as a template. Once it does, click Save.

    

12. Click Save and Test.

    

13. After all connection tests pass, click Continue.

    

14. Select Start syncing all my data now.

15. Click Start initial sync.

    

16. Verify that the next screen says Successful historical sync after the initial sync has run.

    

17. Log in to the destination user interface and verify that the data has been received.