Commit c1e11d67 authored by Tobinsk's avatar Tobinsk
Browse files

Merge branch '5-rradme' into 'master'

Resolve "Readme"

Closes #5

See merge request !6
parents 8bf7ded3 14139a8d
# Es sink
After alotof struggles and undebuggable prolem wit kafka-connect we implemented our own elastsearch sink. Its a very simple kafka-consumer who forward documents to elasticsearch
# Es-sink
After a lot of struggles and debuggable problems with [kafka-connect](https://docs.confluent.io/current/connect/kafka-connect-elasticsearch/index.html) we implemented our own elasticsearch sink. It's a very simple kafka-consumer who forwards documents from the kafka topic `geolinker` to an elasticsearch index `geolinker-new`
## Before you start
Before you deploy the sink, be sure you created the kafka topic (done by [topicoperator](https://source.dodis.ch/histhub/deploy-geolinker/wikis/deployment-manual#install-the-operator)) with the corresponding [elastic search mapping](https://source.dodis.ch/histhub/deploy-geolinker/wikis/Elastic-search-mapping)!
## Docker
To build the image use the following command. The container is based on the [histub/ node-kafka-docker-base](https://source.dodis.ch/histhub/node-kafka-docker-base).
```bash
docker build -t source.dodis.ch:4577/histhub/es-sink .
# Upload to the registry
docker push source.dodis.ch:4577/histhub/es-sink
```
## CD
We have a build pipeline in gitlab. So manually building the image is no longer necessary.
## Deploy to k8
This streaming app is part of the [nodeks helm chart](https://source.dodis.ch/histhub/charts/tree/master/charts/nodejs). You can find more about the deployment under [deploy-geolinker](https://source.dodis.ch/histhub/deploy-geolinker/wikis/deployment-manual#es-sink)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment