Utilization: Seeing Downloads Without Performing a Data Download

Prev Next

Downloads are not necessarily only GET requests. For utilization, a download also means reading any kind of data from storage servers or databases (metadata) that accounts for data READs.

While you may not be downloading any files/objects from your bucket(s), it is common for most S3 applications to perform regular LIST operations during the upload and synchronization processes. The S3 applications are designed to LIST the objects consistently before performing any operation(s) or regular synchronization scans. This means your S3 application is READing metadata of stored objects from the Wasabi database through LIST operations to verify your objects are there, which sets the stage for the next action as appropriately seen by the application.

For example, note that these CDR statistics indicate no files/objects downloaded via GET operation, but the metadata for the objects is consistently read by the application using LIST operations.

You can monitor these API calls by setting up Bucket Logging. If you see a high frequency of LIST calls made to the Wasabi database, consult with your S3 application technical team to isolate the issue and try to reduce the rate of LIST operations.