This app gets all the links from dodis and extracts the fetched resources.
This app gets all the geographical items from [dodis](https://dodis.ch) and extracts the fetched resources to kafka.
## Sitemap
The first step is to generate a sitemap. The links are published to magpie.
## Extractor
The extractor takes the fetched resource from magpie and normalized the data frrom dodis. The result is published to geolinker topic
## SitemapReader
The SitemapReader (node stream readable) generates a list of geographical entities in dodis.
## DodisNormalizerTransformer
The normalizer takes the fetched resource from the SitemapReader and normalized the data. The result is published to geolinker topic in kafka
## Docker
To build the image use following command. The image will fetch data from a wikidata topic and streams the result back into kafka. The containerbased on linux alpine.
To build the image use following command. The container based on the [histub/ node-kafka-docker-base](https://source.dodis.ch/histhub/node-kafka-docker-base).