Commit c233d159 authored by tobinski's avatar tobinski
Browse files

Change snapshot config

parent c55ce335
Pipeline #6333 passed with stages
in 2 minutes and 51 seconds
......@@ -19,6 +19,7 @@ kubectl create secret generic s3-secret-key --from-literal=s3.client.default.sec
## Config Snapshots S3
To use the [s3 plugin](https://www.elastic.co/guide/en/elasticsearch/plugins/6.8/repository-s3-repository.html) with Digital Ocean we need to configure a s3 repository for the backup. We use the official helm repo. Checkout the docu for [snapshots](https://github.com/elastic/helm-charts/tree/master/elasticsearch#how-to-enable-snapshotting).
We need to set chunk and buffer size to not trigger [DO's rate limit](https://discuss.elastic.co/t/snapshot-to-aws-s3-fails-es-1-5-2-aws-cloud-plugin-2-5-1/49541/2).
```bash
kubectl port-forward service/elasticsearch-master-headless 9200:9200
curl --location --request PUT 'localhost:9200/_snapshot/metagrid-backup-es-7' \
......@@ -27,7 +28,12 @@ curl --location --request PUT 'localhost:9200/_snapshot/metagrid-backup-es-7' \
"type": "s3",
"settings": {
"endpoint": "fra1.digitaloceanspaces.com",
"bucket": "metagrid-backup-es-7"
"bucket": "metagrid-backup-es-7",
"chunk_size": "1gb",
"max_restore_bytes_per_sec": "8000mb",
"max_retries": "30",
"buffer_size": "100mb",
"max_snapshot_bytes_per_sec": "1000mb"
}
}'
```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment