Storage: Difference between revisions

From bwCloud-OS
Jump to navigation Jump to search
No edit summary
Line 27: Line 27:
* You can create snapshots of both instances and attached volumes using the web interface.
* You can create snapshots of both instances and attached volumes using the web interface.
* Instance snapshots are saved as images and can be downloaded using the CLI, see here for instructions
* Instance snapshots are saved as images and can be downloaded using the CLI, see here for instructions
* You can also convert volumes into images (→ ''Create Image from Volume'') and download them the same way.
* You can also convert volumes into images and download them the same way.


🔹 '''Export data directly from the instance'''
🔹 '''Export data directly from the instance'''

Revision as of 12:46, 19 October 2025

In a Nutshell
  • If you need more storage, create and attach additional volumes — root disks cannot be enlarged. Using a larger root disk via special flavors is also not recommended in general.
  • All data is stored redundantly (e.g., 3× replication in Ceph), but no automatic backups are performed — you are responsible for your own data protection.
  • Back up your data regularly using snapshots or by downloading volumes/images via the OpenStack client as explained here.


Volumes (Block Devices)

What should I do if the root disk of my VM is/becomes too small?

Quickstart: attach volume

Backups

Does bwCloud-OS provide a dedicated interface for backups or data protection?

No, bwCloud-OS does not offer a dedicated interface for backups or data protection. However, you can back up your instance data using standard tools and methods, see below.

How can I back up my virtual machines?

You can back up your VMs in bwCloud-OS in several ways:

🔹 Snapshots via the Dashboard

  • You can create snapshots of both instances and attached volumes using the web interface.
  • Instance snapshots are saved as images and can be downloaded using the CLI, see here for instructions
  • You can also convert volumes into images and download them the same way.

🔹 Export data directly from the instance

For large volumes or more control, it's often easier and more efficient to back up data directly from inside the VM using standard tools such as rsync, scp, or other backup utilities.

Download Volumes or Images

Connect to bwCloud-OS using the openstack-client. Create an image from your volume.

# openstack volume list
# openstack image create \
    --volume <UUID> \
    my_volume_as_image

Download the image:

# openstack image list
# openstack image save \
    --file my_image_file.img \
    <UUID>

Use the following command to upload a local image file to the image catalog of the selected region and create the metadata entry. The image is not copied to an existing VM.

# openstack image create \
    --property os_distro=linux \
    --property ssh_user=<USER> \
    --property hw_video_model=cirrus \
    --file my_image_file.img \
    <NAME>

Upload Image to bwCloud-OS

Log in to the dashboard and navigate through the GUI as follows:

'Compute' -> 'Images' -> 'Create Image'

What about the security (= integrity) of my data in bwCloud-OS?

Both the runtime environment (root disk) of a virtual machine and the attached storage are stored in our CEPH storage systems. This is organized in such a way that each piece of information is stored on three different hard disks (redundancy level 3). This means that the data is well against hardware failure protected. Furthermore, the virtual machine data (both root disk and attached storage) is not backed up anymore! So please make sure that you have an appropriate backup of the data.

In general, the bwCloud-OS is operated as a "best-effort resource". This means: To be able to offer an appropriate amount of read-only memory for the performance, no high redundancy is built in. In certain and very rare scenarios (software errors of the CEPH storage system, several disks fail), no recovery is possible, which is why we recommend to store all valuable data on corresponding external storage systems (such as all relevant configurations required to recover the machine are needed, ....).

Performance

Throttling of Data Throughput

Due to the internal architecture, all data (root disks of instances, attached storage volumes, etc.) resides in the Ceph storage of the respective region. Ceph is a network-based distributed storage system connected to the compute hosts via the network.. The available storage throughput is therefore shared among all active users. The more parallel write operations there are, the lower the throughput for each individual. This is logical, as the network capacity and bandwidth are limited overall.

To provide roughly equal performance to all users, the storage throughput per instance is limited to either 100 MB/s in both directions (full duplex) or 800 IOPS.

Requesting Higher Data Throughput

If justified, users can request higher data throughput. Please submit a ticket to us. In the ticket, include the following information:

  • You would like to receive higher data throughput.
  • Description of the use case or application: Why do you need higher throughput?
  • OpenStack identifier (ideally the user ID).
  • In which region do you need higher throughput?

The above points are mandatory.