Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
histhub
wikidata-lib
Commits
ac3121e4
Commit
ac3121e4
authored
Oct 08, 2019
by
tobinski
Browse files
Update signature of the normalizer and tests
parent
10419744
Changes
2
Hide whitespace changes
Inline
Side-by-side
src/wikidata-normalizer-transformer.ts
View file @
ac3121e4
...
...
@@ -24,10 +24,10 @@ class WikidataNormalizerTransformer extends Transform {
*/
private
logger
:
LoggerInstance
;
constructor
(
options
,
logger
:
LoggerInstance
,
wikidataProperties
:
WikidataProperties
)
{
constructor
(
options
)
{
super
(
options
);
this
.
logger
=
logger
;
this
.
properties
=
wikidataProperties
;
this
.
logger
=
options
.
logger
;
this
.
properties
=
options
.
wikidataProperties
Instance
;
}
/**
...
...
@@ -69,8 +69,8 @@ class WikidataNormalizerTransformer extends Transform {
location
:
geohash
.
encode
(
lat
,
lon
,
9
),
};
}
catch
(
err
)
{
this
.
logger
.
error
(
`Transformer Error`
);
this
.
logger
.
error
(
err
);
this
.
logger
.
warn
(
`Transformer Error`
);
this
.
logger
.
warn
(
err
);
return
callback
(
null
);
}
return
callback
(
null
,
result
);
...
...
test/wikidata-normalizer-transformer.spec.ts
View file @
ac3121e4
...
...
@@ -32,7 +32,7 @@ describe('Test WikiNormalizer', () => {
});
it
(
'
Try to transform data
'
,
(
done
)
=>
{
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
}
,
coreMock
.
getLogger
(),
wikidataTimeProperties
);
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
,
logger
:
coreMock
.
getLogger
(),
wikidataPropertiesInstance
:
wikidataTimeProperties
}
);
// listener to check output
normalizer
.
on
(
'
data
'
,
(
data
)
=>
{
...
...
@@ -46,14 +46,14 @@ describe('Test WikiNormalizer', () => {
// build chunk
const
chunck
=
{
parsed
:
{
data
:
new
Buffer
(
fs
.
readFileSync
(
__dirname
+
'
/fixtures/place.json
'
)),
data
:
Buffer
.
from
(
fs
.
readFileSync
(
__dirname
+
'
/fixtures/place.json
'
)),
},
};
normalizer
.
write
(
chunck
);
});
it
(
'
Try to transform in a pipline
'
,
(
done
)
=>
{
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
}
,
coreMock
.
getLogger
(),
wikidataTimeProperties
);
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
,
logger
:
coreMock
.
getLogger
(),
wikidataPropertiesInstance
:
wikidataTimeProperties
}
);
const
mockReporter
=
new
MockReporter
();
const
writeable
=
new
MockWriteable
({
objectMode
:
true
});
...
...
@@ -65,7 +65,7 @@ describe('Test WikiNormalizer', () => {
// build chunk
const
chunck
=
{
parsed
:
{
data
:
new
Buffer
(
fs
.
readFileSync
(
__dirname
+
'
/fixtures/place.json
'
)),
data
:
Buffer
.
from
(
fs
.
readFileSync
(
__dirname
+
'
/fixtures/place.json
'
)),
},
};
normalizer
.
write
(
chunck
);
...
...
@@ -79,7 +79,7 @@ describe('Test WikiNormalizer', () => {
});
it
(
'
Try to transform in a wrong data
'
,
(
done
)
=>
{
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
}
,
coreMock
.
getLogger
(),
wikidataTimeProperties
);
const
normalizer
=
new
WikidataNormalizerTransformer
({
objectMode
:
true
,
logger
:
coreMock
.
getLogger
(),
wikidataPropertiesInstance
:
wikidataTimeProperties
}
);
const
mockReporter
=
new
MockReporter
();
const
writeable
=
new
MockWriteable
({
objectMode
:
true
});
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment