Zum Hauptinhalt wechseln

1.5 Fixes

Unterversionm

von Thomas Kunath

Einleitung

With the update to Silent Brick Version 2.57 an optimized S3 Implementation for S3 shares with object locking is available.

The usage of the new S3 Implementation is optional but highly recommended due to an optimization in performance and disk space usage. In order to use the new Implementation, a new share has to be set up.

This guide describes the steps of how to migrate existing S3 data to a new S3 share if needed.

    • In Silent Brick Version 2.57 the S3 server is updated to a new version. This version offers increased performance and a significantly reduced overhead for S3 shares with object locking.

    • Existing S3 shares with object locking can still be accessed and used. In order to utilise the performance and overhead advantages a new share has to be created. This guide describes how to migrate existing S3 data to such a new share.

    • Be aware of your Object Locks. When migrating data to a new share on the same volume you may end up in duplicated data since the original data can not be deleted due to Object Locks!

    • These instructions should only be used if no deleted data is to be transferred. If deleted data or data intended for deletion is also to be transferred, please use the other instruction which copies using the replication feature.

  1. First of all check the available space on the volume
    • First of all check the available space on the volume

    • If there are no more 60% free, please contact FAST Support since data can not duplicated.

    • If 60% or more space is available, go to the next step in this manual

    • Keep in mind that existing data may underly an object locking retention and may not be deleteable within time.

    • Alternatively create a new Volume on an empty Silent Brick as copy target.

  2. MinIO provides a client which will be used in this manual to copy the data If you are already using an add-on for S3 in Windows Explorer, the data can be copied using this tool. We recommend to write down the share settings and to rename the share and to alter the port. So a new share can be set up with the original settings.
    • MinIO provides a client which will be used in this manual to copy the data

    • If you are already using an add-on for S3 in Windows Explorer, the data can be copied using this tool.

    • We recommend to write down the share settings and to rename the share and to alter the port. So a new share can be set up with the original settings.

    • In this example, the existing S3 share old_data_object_lock is to be copied

    • Right-click on the old share to display the existing buckets using Manage Buckets

    • Write down the bucket names of the existing share

  3. Now create a new share on the target Volume. The share name cannot be changed later. Therefore, use a share name that can be easily customised at the source
    • Now create a new share on the target Volume.

    • The share name cannot be changed later. Therefore, use a share name that can be easily customised at the source

    • Use the settings of the old share to make a later connection as simple as possible

  4. Now generate the same buckets on the new share as on the old existing share Right-click on the new share.
    • Now generate the same buckets on the new share as on the old existing share

    • Right-click on the new share.

    • Klick on Manage Buckets

    • Use Create New Bucket

    • Now enter the bucket name and save the changes.

    • Do this for each bucket of the old share

  5. Download the MinIO client for your Operating System from the  Minio Download Page Install the Client and follow the following step (here described for Windows):
    • Download the MinIO client for your Operating System from the Minio Download Page

    • Install the Client and follow the following step (here described for Windows):

    • Now copy the mc.exe file to the path

    • C:\Users\<my_user>\mc\

    • This is necessary so that the mc config file located in this folder can be accessed.

    • To configure the client, we now need some data from the old S3 share. Click on the S3 share to open the share info

    • We now need the share name (old_data_object_lock) here, the IP address or machine name and the S3 port

    • Then we need the access key and the secret key

  6. This data must now be entered in the mc Config file. This file is located in Windows under  C:\Users\&lt;my_user&gt;\mc\config.json
    • This data must now be entered in the mc Config file. This file is located in Windows under

    • C:\Users\<my_user>\mc\config.json

    • Switch to C:\Users\<my_user>\mc\

    • Run the following command to fill the mc config,json with the needed data

    • mc config host add <S3 share name> https://<IP_address:port> <access_key> <secret_key> --api S3v4 --insecure

    • In this example: mc config host add old_data_object_lock https://172.20.44.167:9001 abcd1234 secretkey --api S3v4 --insecure

    • If the command runs through cleanly, a confirmation appears

  7. We now have to do the same steps for the new share Click on the S3 share to open the share info
    • We now have to do the same steps for the new share

    • Click on the S3 share to open the share info

    • We now need the share name (new_data_object_lock) here, the IP address or machine name and the S3 port

    • Then we need the access key and the secret key

  8. The information for the new S3 share must now also be entered in the mc Config file. Switch to  C:\Users\&lt;my_user&gt;\mc\
    • The information for the new S3 share must now also be entered in the mc Config file.

    • Switch to C:\Users\<my_user>\mc\

    • Run the following command to fill the mc config,json with the needed data

    • mc config host add <S3 share name> https://<IP_address:port> <access_key> <secret_key> --api S3v4 --insecure

    • In this example: mc config host add new_data_object_lock https://172.20.44.167:9002 abcd1234 secretkey --api S3v4 --insecure

    • If the command runs through cleanly, a confirmation appears

  9. To copy a bucket, execute the following command mc cp &lt;Source S3 share name\bucket name\&gt; &lt; Target S3 share name\bucket name\&gt; --insecure --recursive For this example
    • To copy a bucket, execute the following command

    • mc cp <Source S3 share name\bucket name\> < Target S3 share name\bucket name\> --insecure --recursive

    • For this example

    • mc cp old_data_object_lock\bucket1\ new_data_object_lock\bucket1\ --insecure --recursive

    • If the command runs through cleanly, a confirmation appears

    • You can now use mc ls to check the contents of the bucket

    • mc ls <share name>/<bucket name> --insecure

    • Now carry out the step for all your shares. Pay attention to the fill quantity of your volume

  10. In the new S3 share, you can now see that it is no longer empty because data has been transferred.
    • In the new S3 share, you can now see that it is no longer empty because data has been transferred.

Ziellinie

Thomas Kunath

Mitglied seit: 06.02.2017

1.895 Reputation

15 Anleitungen geschrieben

Team

FAST_Dozuki_Admins Mitglied von FAST_Dozuki_Admins

8 Mitglieder

73 Anleitungen geschrieben

0 Kommentare

Kommentar hinzufügen

Seitenaufrufe:

Letzten 24 Stunden: 0

Letzten 7 Tage: 0

Letzten 30 Tage: 3

Insgesamt: 64

© 2019 FAST LTA | Alle Rechte vorbehalten | Änderungen jederzeit ohne vorherige Ankündigung möglich