Contents x
      Dremio With Wasabi
      • 18 Jun 2024
      • 1 Minute to read
      • Print
      • PDF
      Contents

      Dremio With Wasabi

      • Updated on 18 Jun 2024
      • 1 Minute to read
      • Print
      • PDF
      Article summary

      How do I use Dremio with Wasabi?

      Dremio is validated for use with Wasabi. Dremio is a data lake engine that delivers analytics directly on your data lake storage.

      Pre-Requisites

      • Active Wasabi cloud storage account

      • Operational Dremio server

      Configuration

      1. Log in to the Dremio Server GUI.

      mceclip0.png

      1. Click Add Source to add Wasabi as a data source.

      mceclip1.png

      1. Select Amazon S3.

      mceclip3.png

      1. Before we enter the credentials (access and secret key) we have to make a couple of changes in the Advanced Options to enable S3 compatible support. Click on Advanced Options as shown below.

      mceclip4.png

      1. Check the “Enable compatibility mode” box. Click Add property.

      mceclip5.png

      1. Under Connection Properties, add fs.s3a.path.style.access and set the value to true. 

      mceclip6.png

      1. Add the fs.s3a.endpoint property and Wasabi service URL as value. Review Service URLs for Wasabi's Storage Regions for more information on Wasabi service URLs. Click Save when done.

      mceclip7.png

      1. Enter the name and credentials for your Wasabi account in the General tab. Click Save.

      mceclip8.png

      1. At this point, the Dremio home page should display all your buckets, as shown below.

      mceclip9.png

      1. You can directly use the data within your buckets to run queries and analysis. For example, a .csv file is in one of the buckets below.

      mceclip13.png

      1. Clicking on the file displays the content for editing purposes. Click Save when done.

      mceclip11.png

      1. The saved output can then be used to run analytics within the Dremio application interface.

      mceclip12.png

       

      What's Next
      Copyright © 2024 by Wasabi Technologies LLC
      75 Arlington Street, Suite 810, Boston, MA 02116 USA
      All Rights Reserved
      Visit us at https://wasabi.com.
      WASABI and the WASABI logo are trademarks of Wasabi Technologies LLC and may not be used without permission of Wasabi Technologies. All other names are used for identification purposes only and are trademarks or registered trademarks of their respective companies.

      Information presented herein is subject to change without notice. Companies, names, and data used in examples are fictitious unless otherwise noted. No part of this information may be reproduced or transmitted in any form by means electronic or mechanical, for any purpose, without express written permission of Wasabi Technologies.