Restarting Incomplete Backups to Wasabi
    • 19 Jun 2024
    • 2 Minutes to read
    • PDF

    Restarting Incomplete Backups to Wasabi

    • PDF

    Article summary

    How do I restart incomplete backups to Wasabi?

    This article provides guidelines for MSP360 (formerly known as Cloudberry) customers who are using Wasabi for their Cloud Storage and have received "More than 65535 total parts uploaded for a single object" error on their backups. 

    Below is one example of how this error looks like on MSP360 Backup application:

    InvalidArgumentMore than 65535 total parts uploaded for a single objectF3308D7D16A0152AUjav9ni0OglVUrSB2GcRjEVxzYWVyi0Cx3hLjykVcVzTGAh4UTEtNK6F1xGk8MBmEEMD2gjiPpS1
    CloudBerryLab.S3Client.Exceptions.S3WebException
    More than 65535 total parts uploaded for a single object
    System.Net.WebException
    The remote server returned an error: (400) Bad Request.

    This documents shows steps starting from creating a new storage entity in Cloudberry (MSP360) explorer but you do NOT need to create this new entity to see your interrupted backups, you can see that with your existing one.

    The only reason to demonstrate this here is to highlight the fact that NOT all functionalities/regions are added in "Wasabi" storage entity yet but are in generic S3 compatible. So this shows steps if you were creating a new storage entity in such regions that are not added yet

    1. Open the Cloudberry explorer application and select "New Storage Account"

    Screen_Shot_2020-02-25_at_2.19.56_PM.png
    1. Select "S3 Compatible"

    Note: The reason we are selecting "S3 Compatible" instead of "Wasabi" which is an option here is due to some of the newer Wasabi regions are yet to be available via the application.
    Screen_Shot_2020-02-25_at_2.20.11_PM.png 

    1. Add all the info required here to create this connection with the right service endpoint (Note: endpoints URLs for each region is listed here).

      Make sure to test the connection to see if you successfully connect to your account

    Screen_Shot_2020-02-25_at_2.21.12_PM.png
    Screen_Shot_2020-02-25_at_2.21.19_PM.png

    Now you can see your new connection listed here in Accounts as shown in the screenshot

    Screen_Shot_2020-02-25_at_2.21.31_PM.png
    1. Go back to the source and select the newly created connection

    Screen_Shot_2020-02-25_at_2.21.46_PM.png
    1. From Tools on top, select "Multipart Uploads" option

    Screen_Shot_2020-02-25_at_2.22.18_PM.png
    1. Select your right account that you just created and then select the Bucket on the right which has the incomplete multi-parts from your backup job

    Screen_Shot_2020-02-25_at_2.22.59_PM.png
    Screen_Shot_2020-02-25_at_2.23.14_PM.png
    1. Once you see the list of job(s) that were incomplete due to 65535 total part issue, delete the incomplete backup

    Screen_Shot_2020-02-25_at_2.23.30_PM.png

    Note that this image shows two different incomplete backups, you may have one or many backups going which may end up here if incomplete

    1. Go ahead and "delete" the incomplete backup that is having issue

    Screen_Shot_2020-02-25_at_2.23.42_PM.png

     

    Screen_Shot_2020-02-25_at_2.23.59_PM.png

    Note: When you delete an incomplete backup here, it deletes all the chunks that are successfully uploaded but have NOT reached concatenation/reassembly stage due to retries/failures in upload but counter that has reached 65535 +1. So now, everything for that backup is flushed, counter is set to 0 and you start again.

    1. Start the backup again using the Cloudberry Backup Application