Commit 14139a8d authored by Lena Heizmann's avatar Lena Heizmann
Browse files

Update readme

parent aab9e122
# Es-sink
After allot of struggles and debuggable problems with [kafka-connect](https://docs.confluent.io/current/connect/kafka-connect-elasticsearch/index.html) we implemented our own elasticsearch sink. It's a very simple kafka-consumer who forwards documents from the kafka topic `geolinker` to an elasticsearch index `geolinker-new`
After a lot of struggles and debuggable problems with [kafka-connect](https://docs.confluent.io/current/connect/kafka-connect-elasticsearch/index.html) we implemented our own elasticsearch sink. It's a very simple kafka-consumer who forwards documents from the kafka topic `geolinker` to an elasticsearch index `geolinker-new`
## Before you start
Before you deploy the sink, be sure you created the kafka topic (done by [topicoperator](https://source.dodis.ch/histhub/deploy-geolinker/wikis/deployment-manual#install-the-operator)) with the corresponding [elastic search mapping](https://source.dodis.ch/histhub/deploy-geolinker/wikis/Elastic-search-mapping)!
......@@ -17,4 +17,4 @@ docker push source.dodis.ch:4577/histhub/es-sink
We have a build pipeline in gitlab. So manually building the image is no longer necessary.
## Deploy to k8
This streaming app is part of the [nodeks helm chart](https://source.dodis.ch/histhub/charts/tree/master/charts/nodejs). More about the deployment you can find under [deploy-geolinker](https://source.dodis.ch/histhub/deploy-geolinker/wikis/deployment-manual#es-sink)
This streaming app is part of the [nodeks helm chart](https://source.dodis.ch/histhub/charts/tree/master/charts/nodejs). You can find more about the deployment under [deploy-geolinker](https://source.dodis.ch/histhub/deploy-geolinker/wikis/deployment-manual#es-sink)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment