Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add flux for creating gnd-geograpicnames map RPB-151 #74

Merged
merged 4 commits into from
Mar 27, 2024

Conversation

TobiasNx
Copy link
Contributor

@TobiasNx TobiasNx commented Mar 27, 2024

I added a workflow for creating a map gndId -> preferredName of all geographicNames without BuildingsOrMemorials or WayBorderOrLine.

Higher version of MF was needed since the old version does not support gzip in open-http.

@TobiasNx TobiasNx requested a review from fsteeg March 27, 2024 08:21
fsteeg added 3 commits March 27, 2024 12:34
Edited test data without changing the encoding with:
`sed -i 's/1nqRegensburg/1nqhttps:\/\/d-nb.info\/gnd\/4048989-9/'`
Copy link
Member

@fsteeg fsteeg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! That's a nice little lobid-request-to-lookup-map flux!

Since the build was failing due to the dependency updates, and those would require additional testing since all productive transformations could be affected, I've reverted the versions, removed the gzip option, and re-created gndGeograpicName.tsv (we're not running the transformation automatically for now, so size is no issue here).

I've also added the lookups to the RPPD transformation and deployed the result to test, looks good (example from https://jira.hbz-nrw.de/browse/RPB-151): http://test.rppd.lobid.org/10001058X

@fsteeg fsteeg merged commit 4aa23e3 into main Mar 27, 2024
1 check passed
@fsteeg fsteeg deleted the RPB-151_lookupGndPlaceOrGeographicName branch March 27, 2024 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants