SoDA With Wasabi

Prev Next

Wasabi has been validated for use with SoDA. SoDA’s data management software is storage agnostic, providing unprecedented insight into a company’s storage ecosystem. To learn more about the Wasabi - SoDA solution, refer to our joint solution brief. To use this product with Wasabi, follow the instructions below.

Reference Architecture

Screen_Shot_2022-03-29_at_9.31.19_PM.png

Requirements

  • SoDA v 22.1.1

  • An active Wasabi account

Configuration

Adding Wasabi Storage

  1. Log in to the SoDA User Interface.

  2. Click Storage.

    Screen_Shot_2022-03-29_at_9.37.02_PM.png

  3. Click Price Books.

    Screen_Shot_2022-03-29_at_9.38.12_PM.png

  4. Click Add Price Book.

    Screen_Shot_2022-03-29_at_9.39.06_PM.png

  5. Fill out the Add Price Book page as shown below, checking for any updated pricing from Wasabi. Click Save to finalize the updates.

    Screen_Shot_2022-03-29_at_9.39.59_PM.png

  6. Click Storage.

    Screen_Shot_2022-03-29_at_9.41.21_PM.png

  7. Click Add Storage.

    Screen_Shot_2022-03-29_at_9.42.45_PM.png

  8. Fill out the page as shown below. If you want to use a prefix (or folder), you can specify one. Use your own SoDA Storage Name and the bucket you created in Wasabi.

    Screen_Shot_2022-03-29_at_9.43.59_PM.png

  9. Click Save to finalize your updates. After clicking Save, the corresponding Storage card view appears.

    Screen_Shot_2022-03-29_at_9.45.00_PM.png

  10. Click Agents.  

    Screen_Shot_2022-03-29_at_9.45.45_PM.png

  11. Click Accessors.

    Screen_Shot_2022-03-29_at_9.46.40_PM.png

  12. Click Add Accessor.

    Screen_Shot_2022-03-29_at_9.47.19_PM.png

  13. Enter the fields as shown below.

    • Provide a name for your access method.

    • Select Accessor Type Custom S3.

    • Enter the appropriate URL for your Wasabi region in the Api URL field. 

    • Use the Access Key ID and Secret Access Key for your bucket that Wasabi provided.

    • Click the Configure Accessor button to finalize your updates.

    Note: Each Agent can have a different access key if desired.

    Screen_Shot_2022-03-29_at_9.48.43_PM.png

    Note: This config example uses Wasabi’s us-west-1 storage region. To use other Wasabi storage regions, use the appropriate Wasabi service URL as described in Service URLs for Wasabi's Storage Regions.

  14. Your newly-created Accessor is listed.

    Screen_Shot_2022-03-29_at_9.50.11_PM.png

  15. Click Agents.

    Screen_Shot_2022-03-29_at_9.50.59_PM.png

  16. Click on any Agent to access the Wasabi bucket.

    Screen_Shot_2022-03-29_at_9.51.40_PM.png

  17. Click the Attach Storage button.

    Screen_Shot_2022-03-29_at_9.52.30_PM.png

  18. Select the Wasabi storage you created and your accessor.

    Screen_Shot_2022-03-29_at_9.53.18_PM.png

  19. Click Attach Storage, confirm it is attached, then close the window.

    Screen_Shot_2022-03-29_at_9.54.08_PM.png

  20. Click Storage.

    Screen_Shot_2022-03-29_at_9.56.05_PM.png

  21. Click Wasabi storage.

    Screen_Shot_2022-03-29_at_9.56.54_PM.png

  22. Click on the 3 dots to open the additional options. Click Enable.

    Screen_Shot_2022-03-29_at_9.57.59_PM.png

  23. Your Wasabi bucket is now online, as indicated by the icon.

    Screen_Shot_2022-03-29_at_9.58.48_PM.png

Adding Local Storage

Before creating file storage, SoDA allows you to create a price book for file-based storage. Follow the instructions in the Wasabi Price Book, select a local price book. Once finished, follow the instructions below to add local storage.

  1. Click Storage.

    Screen_Shot_2022-04-01_at_12.32.27_PM.png

  2. Click Add Storage.

    Screen_Shot_2022-04-01_at_12.33.21_PM.png

  3. Give your Storage a name and select File as the Storage Type. If you configured a local price book, select it here and click Save.

    Screen_Shot_2022-04-01_at_12.34.17_PM.png

  4. Your new storage appears, as shown below.

    Screen_Shot_2022-04-01_at_12.35.23_PM.png

  5. Click Agents.

    Screen_Shot_2022-04-01_at_12.36.06_PM.png

  6. Click Accessors.

    Screen_Shot_2022-04-01_at_12.36.55_PM.png

  7. Click Add Accessor.

    Screen_Shot_2022-04-01_at_12.37.42_PM.png

    Enter the fields as shown below.

    Give your access method a name.

    • Select Local as the Accessor Type.

    • Enter the appropriate mount path in the Path field

    • For Linux, use the root path.

    • For Windows, use the Volume letter and folder V:\Files.

    Screen_Shot_2022-04-01_at_12.38.58_PM.png

  8. Click Configure Accessor to create the Accessor. The new Accessor appears below.

    Screen_Shot_2022-04-01_at_12.39.58_PM.png

  9. Click Agents.

    Screen_Shot_2022-04-01_at_12.40.41_PM.png

  10. Click any Agent you want to access.

    Screen_Shot_2022-04-01_at_12.41.28_PM.png

  11. Click Attach Storage.

    Screen_Shot_2022-04-01_at_12.42.41_PM.png

  12. Select the File Storage you created and the Accessor, and click Attach.

    Screen_Shot_2022-04-01_at_12.43.20_PM.png

  13. When the Attach Agent to Storage screen closes, you see the newly attached Agent listed as attached in the previous Agent display, as shown below, and close the window.

    Screen_Shot_2022-04-01_at_12.44.10_PM.png

  14. Click Storage.

    Screen_Shot_2022-04-01_at_12.45.22_PM.png

  15. Click My Local Storage storage card.

    Screen_Shot_2022-04-01_at_12.46.19_PM.png

  16. Click on the 3 dots to open additional options. Click Enable.

    Screen_Shot_2022-04-01_at_12.47.54_PM.png

  17. Your file-based storage is now online.

    Screen_Shot_2022-04-01_at_12.48.52_PM.png

Moving Data into Wasabi

You can move data in and out of Wasabi using SoDA by establishing a Policy or by using a one-time Quick Transfer. To do so using a Quick Transfer, follow the procedure below, or proceed to the Moving Data via Policy procedure.

Moving Data via Quick Transfer

  1. Click Jobs.

    image.png

  2. Click Quick Transfer.

    Screen_Shot_2022-04-05_at_10.14.39_PM.png

  3. On the Quick Transfer Page, complete the following

    • Select your Source as My Local Storage.

    • Select your Target as My Wasabi Bucket.

    • Select Copy, Move, Sync between the Source and Target fields to indicate how to transfer the data.

      Copy and Move use conflict handling of Overwrite/Rename/Skip for identical files already on the Target.

      Sync creates a Smart Duplicate of the Source to the Target, including propagation of deletes.

    • Click on the right of the Source to select the folders to transfer.

    • Click on the right of the Target to select folders to create or to put data into.

    • Select Filters to filter the data set as desired.

      Click Dry Run, which simulates the transfer and calculates the cost and time of the transfer, without actually executing the transfer.

    Screen_Shot_2022-04-05_at_10.17.48_PM.png

  4. The results of the dry run are shown below.

    Screen_Shot_2022-04-05_at_10.18.31_PM.png

  5. Determine if the dry run was successful. If so, proceed to the next step; otherwise, return to the previous step to reconfigure your Quick Transfer.

  6. When satisfied with the dry run results, click Transfer Now to begin the transfer.

    Screen_Shot_2022-04-05_at_10.19.58_PM.png

  7. The Jobs page is displayed, where you can see the current job process.

    Screen_Shot_2022-04-05_at_10.20.43_PM.png

  8. Click job record to display information.

    Screen_Shot_2022-04-05_at_10.21.41_PM.png

  9. Log in to the Wasabi UI to verify data.

    Screen_Shot_2022-04-05_at_10.22.25_PM.png

Moving Data via Policy

  1. Click Policies.  

    Screen_Shot_2022-04-06_at_9.12.52_AM.png

  2. Click Add Policy.

    Screen_Shot_2022-04-06_at_9.13.43_AM.png

  3. On the Policy page, update the following elements.

    • Give the Policy a name.

      • Select your Source as My Local Storage.

      • Select your Target as My Wasabi Bucket.

      • Select Copy/Move/Sync in the drop-down between the Source and Target fields to indicate how to transfer the data.

        • Copy and Move use conflict handling of Overwrite/Rename/Skip for identical files already on the Target.

        • Sync creates a Smart Duplicate of the Source to the Target, including propagation of deletes.

      • Click on the right of the Source to select the folders to transfer.

      • Click on the right of the Target to select folders to create or to put data into.

      • Select Filters to filter the Data Set as desired.

  4. Click the Dry Run, which simulates the transfer and calculates the cost and time of the transfer before it happens, without actually executing the transfer.

  5. Determine if the dry run is successful. If so, proceed to the next step; otherwise, reconfigure your Policy by returning to the previous step.

  6. Click Deploy.

    Screen_Shot_2022-04-06_at_9.22.20_AM.png

  7. The Deploy Policy window opens. Enter the information in the fields, and click Deploy.

  8. Select the desired start time.

    • Select the cadence at which the policy should run.

    • Activate the policy.

      Screen_Shot_2022-04-06_at_9.24.03_AM.png

  9. The Deploy Policy window closes. You can see the new policy configured on the Policies page.

    Screen_Shot_2022-04-06_at_9.24.52_AM.png