Commit 62fbaa03 authored by Tobinsk's avatar Tobinsk
Browse files

Merge branch 'tobias.steiner-master-patch-51668' into 'master'

Update readme

See merge request !4
parents 4302fb3a 0cb69437
# CSV-link-producer
This small scripts streams the a collection of links, done by phillip to kafka linker topic. So we make the data available for the linker
# Fundmuenzen
This small scripts streams the a [csv-collection](https://www.muenzfunde.ch/downloads/thesauri/ch_municipalities.csv) of links from the fundmuenzen to kafka.
## Docker
To build the image use following command. The images will fetch data from the dump, decompress it and stream a normalized version to kafka. The container based on linux alpine.
To build the image use following command. The images will fetch data from the csv, normalized the data und streams the links and data to kafka.
```bash
docker build -t source.dodis.ch:4577/histhub/csv-link-producer .
docker build -t source.dodis.ch:4577/histhub/fundmuenzen .
# Upload to the registry
docker push source.dodis.ch:4577/histhub/csv-link-producer
docker push source.dodis.ch:4577/histhub/fundmuenzen
```
## Deploy to k8
We execute a job on k8 to stream the dump into kafka
```bash
kubectl create -f csv-link-producer.yaml
```
This streming app is part of the [data helm chart](https://source.dodis.ch/histhub/charts/tree/master/charts/data).
\ No newline at end of file
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment