knudmoeller

CKAN-Queries via package_search

Allgemein

• https://docs.ckan.org/en/2.9/api/index.html#ckan.logic.action.get.package_search
• https://solr.apache.org/guide/8_11/common-query-parameters.html

Grundsätzlich bekommt man gepagete JSON-Reponses zurück (Default für Page-Größe ist 10):

knudmoeller

knudmoeller

https://daten.berlin.de/datensaetze/20-grune-hauptwege-wanderkarte-wfs-99a22ff0
https://daten.berlin.de/datensaetze/20-grune-hauptwege-wanderkarte-wms-1f028343
https://daten.berlin.de/datensaetze/3d-gebaudemodelle-im-level-of-detail-1-lod-1-atom-e2a1e24e
https://daten.berlin.de/datensaetze/3d-gebaudemodelle-im-level-of-detail-2-lod-2-atom-3c7c49af
https://daten.berlin.de/datensaetze/3d-gebaudemodelle-im-level-of-detail-2-lod-2-wms-f2a8a483
https://daten.berlin.de/datensaetze/abstellflachen-fur-mikromobilitatsangebote-wfs-6185b5fb
https://daten.berlin.de/datensaetze/abstellflachen-fur-mikromobilitatsangebote-wms-e45c2176
https://daten.berlin.de/datensaetze/adressen-berlin-wfs-634ab8ba
https://daten.berlin.de/datensaetze/adressen-berlin-wms-130748fb
https://daten.berlin.de/datensaetze/adressen-im-inspire-datenmodell-atom-3bd15407

knudmoeller

https://daten.berlin.de/datensaetze/abstellflachen-fur-mikromobilitatsangebote-wfs-6185b5fb
https://daten.berlin.de/datensaetze/abstellflachen-fur-mikromobilitatsangebote-wms-e45c2176
https://daten.berlin.de/datensaetze/adressen-berlin-wfs-634ab8ba
https://daten.berlin.de/datensaetze/adressen-berlin-wms-130748fb
https://daten.berlin.de/datensaetze/adressen-im-inspire-datenmodell-wms-ee802686
https://daten.berlin.de/datensaetze/adressen-regionales-bezugssystem-rbs-wfs-c43966c4
https://daten.berlin.de/datensaetze/adressen-regionales-bezugssystem-rbs-wms-d1c67d30
https://daten.berlin.de/datensaetze/afis-berlin-wfs-1408ef18
https://daten.berlin.de/datensaetze/afis-berlin-wms-c4897b9f
https://daten.berlin.de/datensaetze/alkis-berlin-bezirke-wfs-ced31d7d

knudmoeller

Installing CKAN from Source + Deployment

The installation instructions on https://docs.ckan.org/en/2.9/maintaining/installing/install-from-source.html are fine, except:

Solr

• I don't install Solr locally on the same machine, so I don't need to install Solr, Jetty or Java. Installing the required packages is therefore done like this:

$ sudo apt-get install python3-dev postgresql libpq-dev python3-pip python3-venv git-core redis-server

knudmoeller

Get WGS84-GeoJSON from WFS with Soldner-Coordinates

The problem: get GeoJSON data from a WFS that uses a projection other than WGS84. This is e.g. true for all geo data in Berlin's FIS-Broker GIS. The data there uses the "Soldner" projection (or EPSG:25833).

Download as XML

• You need to know the URL of the WFS you want to get the data from.
• Consider Baumbestand Berlin - Straßenbäume - Sachdaten zur Karte - [WFS]:
• The URL is https://fbinter.stadt-berlin.de/fb/wfs/data/senstadt/s_wfs_baumbestand.
• The last bit of the URL is also the name of the layer: s_wfs_baumbestand.

knudmoeller

# Planets of the solar system

SELECT DISTINCT ?planet ?planetLabel ?child ?childLabel
WHERE {
  SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". }

  {
    # things that are instances of planets (or subclasses thereof)
    # and are part of the solar system (or parts of parts) 
    ?planet wdt:P31/wdt:P279* wd:Q634 .

knudmoeller

import subprocess

# read the dictionary file:
result = subprocess.run(['egrep', '^.{5}$', "/usr/share/dict/words"], stdout=subprocess.PIPE)
words = result.stdout.decode('utf-8').splitlines()

present = ['a', 'n', 'g', 't']  # letters that we know are in the word
not_present = ['o', 'i', 's', 'e', 'u']  # letters we know are not in the word

# filter words with all() and not any()

knudmoeller

• Input data are multiple json files in sorted/ with this minimal structure:

{
  "dump_finished": "2021-12-14T10:43:42+01:00",
  "datasets": [
    ...
  ]
}

knudmoeller

jq "{date: .dump_finished, count: .datasets | length}" sorted/*.json | jq -s