Export/Import/Edit etcd directory as JSON/YAML/TOML and validate directory using JSON schema.

Use cases

• Backup/Restore in a format which is not database or version specific.
• Migration of data from production to testing.
• Store configuration in Git and use import to populate etcd.
• Validate directory entries using JSON schema.

In this post I will explain how to transfer a multi terabyte size database between two MySQL instances using mydumper, which is a logical backup and restore tool that works in parallel. I will also cover the case where you need to transfer only a subset of data.

Big tables are often problematic because of the amount of time needed to do mysqldump/restore which is single threaded. It is not uncommon for this type of process to take several days.

A simple exemple to make Replication for RBD.

Based on this post from scuttlemonkey : http://ceph.com/dev-notes/incremental-snapshots-with-rbd/, here is a sample script to synchronize rbd image on a remote cluster (eg for backups). In the example below, the sync is made to an “archive” pool on the same cluster. (For remote host, you need to use ssh key.)