Dremio With Wasabi
    • 18 Jun 2024
    • 1 Minute to read
    • PDF

    Dremio With Wasabi

    • PDF

    Article summary

    How do I use Dremio with Wasabi?

    Dremio is validated for use with Wasabi. Dremio is a data lake engine that delivers analytics directly on your data lake storage.

    Pre-Requisites

    • Active Wasabi cloud storage account

    • Operational Dremio server

    Configuration

    1. Log in to the Dremio Server GUI.

    mceclip0.png
    1. Click Add Source to add Wasabi as a data source.

    mceclip1.png
    1. Select Amazon S3.

    mceclip3.png
    1. Before we enter the credentials (access and secret key) we have to make a couple of changes in the Advanced Options to enable S3 compatible support. Click on Advanced Options as shown below.

    mceclip4.png
    1. Check the “Enable compatibility mode” box. Click Add property.

    mceclip5.png
    1. Under Connection Properties, add fs.s3a.path.style.access and set the value to true

    mceclip6.png
    1. Add the fs.s3a.endpoint property and Wasabi service URL as value. Review Service URLs for Wasabi's Storage Regions for more information on Wasabi service URLs. Click Save when done.

    mceclip7.png
    1. Enter the name and credentials for your Wasabi account in the General tab. Click Save.

    mceclip8.png
    1. At this point, the Dremio home page should display all your buckets, as shown below.

    mceclip9.png
    1. You can directly use the data within your buckets to run queries and analysis. For example, a .csv file is in one of the buckets below.

    mceclip13.png
    1. Clicking on the file displays the content for editing purposes. Click Save when done.

    mceclip11.png
    1. The saved output can then be used to run analytics within the Dremio application interface.

    mceclip12.png