Code gardening
Do some code gardening. We need to refactor a bit and perhaps add some abstraction if needed. The providers have some duplicated code and the concordance could need some abstraction
We have some memory problems for bulk jobs. The first queries to ES takes too long and the process allocates too much memory. We could use eager loading to prevent this. https://www.elastic.co/guide/en/elasticsearch/guide/current/preload-fielddata.html. Is this still relevant? I guess, after we changed the collection process the issue resolved. This was a work around. The issue is not relevant at the moment, but has some impact
Refactor the API endpoints. Perhaps add a big service and keep controller slim
-
We need to decouple our base structs. The dependency between the packages are too big -
Check for unwanted exported fields. Export just needed fields in the go api - [ ]