Number of business entities (STIRData) and population (Wikidata) by NUTS level 3
type: Pipeline
tag: consumption demo
tag: wikidata
version: 5
created: 2022-09-20T08:16:42.508
last update: 2023-06-13T17:02:37.401129581
profile: default

Text holder
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: 1477
y: 1684
description: Prepare output dataset definition

RDF to file
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-rdfToFile/0.0.0
x: 2940
y: 1655
description: Store output RDF in file

Text holder
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: 1557
y: 1546
description: Prepare output data structure definition

SPARQL select
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlSelect/0.0.0
x: 2947
y: 1763
description: Create output CSV file

Union
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-singleGraphUnion/0.0.0
x: 2563
y: 1733
description: Create final RDF

Files to RDF single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-filesToRdfGraph/0.0.0
x: 1871
y: 1684
description: Transform output dataset definition to graph

Files to RDF single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-filesToRdfGraph/0.0.0
x: 1973
y: 1534
description: Transform output data structure definition to graph

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/0651-b02e
type: Connection
source binding: OutputRdf
source component: Files to RDF single graph
target binding: InputRdf
target component: Union

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/3c27-bd78
type: Connection
source binding: OutputRdf
target binding: InputRdf
target component: Union

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/3c45-b975
type: Connection
source binding: FilesOutput
source component: Text holder
target binding: InputFiles
target component: Files to RDF single graph

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/932e-a958
type: Connection
source binding: OutputRdf
source component: Files to RDF single graph
target binding: InputRdf
target component: Union

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/95bc-b31a
type: Connection
source binding: OutputRdf
source component: Files to RDF single graph
target binding: InputRdf
vertex: https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/vertex/c65a-adff
vertex: https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/vertex/38ba-a598

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/9680-bc54
type: Connection
source binding: OutputRdf
source component: Union
target binding: InputRdf
target component: RDF to file

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/be6f-8638
type: Connection
source binding: FilesOutput
source component: Text holder
target binding: InputFiles
target component: Files to RDF single graph

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/connection/c04f-b0f1
type: Connection
source binding: OutputRdf
source component: Union
target binding: InputRdf
target component: SPARQL select

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/vertex/38ba-a598
order: 2
x: 1788
y: 1804

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-0002/vertex/c65a-adff
order: 1
x: 2258
y: 1781

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-000204e7-8551
type: Connection
source binding: FilesOutput
target binding: InputFiles

SPARQL endpoint - EDP
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpoint/0.0.0
x: -543
y: 1573
description: Extract compliant endpoints from catalog

Text holder
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: -695
y: 1874

SPARQL endpoint - STIRData
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpoint/0.0.0
x: -714
y: 1707
description: Extract compliant endpoints from catalog

Union
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-singleGraphUnion/0.0.0
x: -186
y: 1803

Files to RDF single graph
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/t-filesToRdfGraph/0.0.0
x: -439
y: 1869

Union
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-singleGraphUnion/0.0.0
x: 1382
y: 1835
description: Union LAU, population and number of business entities

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-0001569d-8c91
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-0001aa50-a166
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-0001b61b-85c7
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-0001cb6a-8730
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-0001e5a6-9930
type: Connection
source binding: FilesOutput
target binding: InputFiles

SPARQL endpoint list to single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpointList/0.0.0
x: 450
y: 1717
description: Execute query tasks to get the number of business entities in administrative regions

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00023610-a59f
type: Connection
source binding: OutputRdf
target binding: Tasks

Graph merger
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-graphMerger/0.0.0
x: 1030
y: 1875
description: Merge LAU data

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00025e52-8339
type: Connection
source binding: FilesOutput
target binding: InputFiles

HTTP get
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-httpGetFile/0.0.0
x: 427
y: 1942
description: Download LAU data

Files to RDF
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-filesToRdf/0.0.0
x: 716
y: 1906
description: Transform LAU data to graph

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: 1868
y: 1835
description: Construct statistical observations

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: -9
y: 1752
description: Prepare query tasks to get number of business entities in administrative regions

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-000280c4-ac96
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-000285ee-949c
type: Connection
source binding: OutputRdf
target binding: InputRdf

Text holder - only CZ
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: -687
y: 1940

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-0002ac40-a666
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-0002c421-b192
type: Connection
source binding: OutputRdf
target binding: InputRdf

SPARQL endpoint
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpoint/0.0.0
x: 951
y: 1671
description: Extract population in NUTS from Wikidata

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-0002d22f-bdac
type: Connection
source binding: OutputRdf
target binding: InputRdf

configuration
type: Configuration
content: @prefix qb: <http://purl.org/linked-data/cube#> . <https://stirdata.opendata.cz/resource/dataset/number-of-business-entities-and-population-in-nuts3> a qb:DataSet; qb:structure <https://stirdata.opendata.cz/resource/dsd/number-of-business-entities-and-population-in-nuts3> .
content control: None
file name: ds.ttl
file name control: None

configuration
type: Configuration
file name: number-of-business-entities-and-population-in-nuts3.ttl
file name control: None
file type: text/turtle
file type control: None
graph uri control: None

configuration
type: Configuration
content: @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> . @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> . @prefix qb: <http://purl.org/linked-data/cube#> . @prefix sdmx-dimension: <http://purl.org/linked-data/sdmx/2009/dimension#> . @prefix stirdata: <https://w3id.org/stirdata/vocabulary/statistical/> . <https://stirdata.opendata.cz/resource/dsd/number-of-business-entities-and-population-in-nuts3> a qb:DataStructureDefinition ; # The dimensions qb:component [ qb:dimension sdmx-dimension:refArea ; qb:order 1 ]; qb:component [ qb:dimension sdmx-dimension:refPeriod ; qb:order 2 ]; qb:component [ qb:dimension stirdata:sourceBusinessEntitiesDataSet ; qb:order 3 ]; # The measures qb:component [ qb:measure stirdata:population ] ; qb:component [ qb:measure stirdata:numberOfBusinessEntities ] . stirdata:sourceBusinessEntitiesDataSet a rdf:Property, qb:DimensionProperty ; rdfs:label "Source data set"@en ; rdfs:comment "The data set that is the source of the data about business entities used to compute the statistics."@en . stirdata:population a rdf:Property, qb:MeasureProperty ; rdfs:label "Population"@en ; rdfs:comment "The population in a given administrative unit"@en . stirdata:numberOfBusinessEntities a rdf:Property, qb:MeasureProperty ; rdfs:label "Number of business entities"@en ; rdfs:comment "The number of business entities"@en .
content control: None
file name: dsd.ttl
file name control: None

configuration
type: Configuration
file name: number-of-business-entities-and-population-in-nuts.csv
file name control: None
query: PREFIX qb: <http://purl.org/linked-data/cube#> PREFIX sdmx-dimension: <http://purl.org/linked-data/sdmx/2009/dimension#> PREFIX stirdata: <https://w3id.org/stirdata/vocabulary/statistical/> SELECT ?sourceBusinessEntitiesDataSet ?refArea ?refPeriod ?population ?numberOfBusinessEntities WHERE { ?observation a qb:Observation ; qb:dataSet ?qbDataSet ; sdmx-dimension:refArea ?refArea ; sdmx-dimension:refPeriod ?refPeriod ; stirdata:sourceBusinessEntitiesDataSet ?sourceBusinessEntitiesDataSet ; stirdata:population ?population ; stirdata:numberOfBusinessEntities ?numberOfBusinessEntities . }
query control: None

configuration
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
default graph control: None
encode rdf: false
encode rdf control: None
endpoint: https://data.europa.eu/sparql
endpoint control: None
handle invalid data: false
handle invalid data control: None
header accept control: None
password control: None
query: PREFIX dcterms: <http://purl.org/dc/terms/> PREFIX dcat: <http://www.w3.org/ns/dcat#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> CONSTRUCT { ?endpoint <urn:stirdata:endpoint> ?endpointString ; <urn:stirdata:dataset> ?dataset . } WHERE { ?dataset a dcat:Dataset ; dcterms:title ?title ; dcterms:conformsTo <https://stirdata.github.io/data-specification/> ; dcat:distribution/dcat:accessService ?service . ?service a dcat:DataService ; dcterms:conformsTo <https://www.w3.org/TR/sparql11-protocol/> ; dcat:endpointURL ?endpoint . FILTER(langMatches(LANG(?title), "en")) BIND(STR(?endpoint) AS ?endpointString) }
query control: None
use authentication: false
use authentication control: None
use tolerant repository: false
use tolerant repository control: None
user name control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-000114c3-8589/1
type: Configuration
content: <https://obchodní-rejstřík.stirdata.opendata.cz/sparql> <urn:stirdata:endpoint> "https://obchodní-rejstřík.stirdata.opendata.cz/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/ee/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/ee/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/be/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/be/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/uk/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/uk/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/be/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/be/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/el/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/el/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/fi/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/fi/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/md/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/md/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/lv/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/lv/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/fr/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/fr/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/cy/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/cy/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/no/sparql> <urn:stirdata:endpoint> "https://stirdata-semantic.ails.ece.ntua.gr/api/content/no/sparql" . <https://stirdata-semantic.ails.ece.ntua.gr/api/content/nl/sparql> <urn:stirdata:endpoint> "https://st…
content control: None
file name: file.ttl
file name control: None

configuration
type: Configuration
default graph control: None
encode rdf: false
encode rdf control: None
endpoint: https://stirdata.opendata.cz/sparql
endpoint control: None
handle invalid data: false
handle invalid data control: None
header accept control: None
password control: None
query: PREFIX dcterms: <http://purl.org/dc/terms/> PREFIX dcat: <http://www.w3.org/ns/dcat#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> CONSTRUCT { ?endpoint <urn:stirdata:endpoint> ?endpointString ; <urn:stirdata:dataset> ?dataset . } WHERE { ?dataset a dcat:Dataset ; dcterms:title ?title ; dcterms:conformsTo <https://stirdata.github.io/data-specification/> ; dcat:distribution/dcat:accessService ?service . ?service a dcat:DataService ; dcterms:conformsTo <https://www.w3.org/TR/sparql11-protocol/> ; dcat:endpointURL ?endpoint . FILTER(langMatches(LANG(?title), "en")) BIND(STR(?endpoint) AS ?endpointString) }
query control: None
use authentication: false
use authentication control: None
use tolerant repository: false
use tolerant repository control: None
user name control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1681989155073-00021681989155073-00021681480283590-00011681480283590-00013ea1-9724/1
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
commit size: 0
commit size control: None
encode rdf: false
encode rdf control: None
password control: None
task per group limit: 1
task per group limit control: None
threads: 8
threads control: None
time limit: 600
time limit control: None
use authentication: false
use authentication control: None
use tolerant repository: true
use tolerant repository control: None
user name control: None

configuration
type: Configuration
encode url: false
encode url control: None
file name: lau.ttl
file name control: None
file uri: https://stirdata.github.io/data-specification/lau.ttl
file uri control: None
hard redirect: false
hard redirect control: None
user agent control: None
utf8 redirect: false
utf8 redirect control: None

configuration
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
query: PREFIX qb: <http://purl.org/linked-data/cube#> PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> PREFIX sdmx-dimension: <http://purl.org/linked-data/sdmx/2009/dimension#> PREFIX stirdata: <https://w3id.org/stirdata/vocabulary/statistical/> PREFIX : <urn:stirdata:> PREFIX wd: <urn:stirdata:wikidata:> CONSTRUCT { ?observation a qb:Observation ; qb:dataSet ?qbDataSet ; sdmx-dimension:refArea ?adminUnitNuts ; sdmx-dimension:refPeriod ?refPeriod ; stirdata:sourceBusinessEntitiesDataSet ?sourceDataSet ; stirdata:population ?population ; stirdata:numberOfBusinessEntities ?numberOfBusinessEntitiesNuts . } WHERE { { SELECT ?sourceDataSet ?adminUnitNuts (SUM(?numberOfBusinessEntities) AS ?numberOfBusinessEntitiesNuts) WHERE { ?adminUnitLau :numberOfBusinessEntities ?numberOfBusinessEntities ; :dataset ?sourceDataSet . ?adminUnitLau skos:inScheme <https://w3id.org/stirdata/resource/lau/scheme/LAU2021> ; skos:broadMatch ?adminUnitNuts . } GROUP BY ?sourceDataSet ?adminUnitNuts } ?wdAdminUnit wd:nuts ?adminUnitNuts ; wd:population ?population . ?qbDataSet a qb:DataSet . BIND(IRI(CONCAT("https://stirdata.opendata.cz/resource/observation/", STRUUID())) AS ?observation) BIND(STRDT(REPLACE(STR(NOW()), "^([0-9]{4}-[0-9]{2}-[0-9]{2})T.*$", "$1"), xsd:date) AS ?refPeriod) }
query control: None

configuration
type: Configuration
query: PREFIX esl: <http://plugins.linkedpipes.com/ontology/e-sparqlEndpointList#> PREFIX : <urn:stirdata:> CONSTRUCT { ?task a esl:Task ; esl:query ?query ; esl:group ?uritext ; esl:endpoint ?uritext . } WHERE { ?s :endpoint ?uritext ; :dataset ?dataset . BIND("numberOfLegalEntities" AS ?metric) BIND(UUID() AS ?task) BIND(IRI(?uritext) as ?uri) BIND(CONCAT("""PREFIX : <urn:stirdata:> PREFIX legal: <http://www.w3.org/ns/legal#> PREFIX m8g: <http://data.europa.eu/m8g/> PREFIX org: <http://www.w3.org/ns/org#> PREFIX locn: <http://www.w3.org/ns/locn#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> PREFIX stirdata: <https://w3id.org/stirdata/vocabulary/> CONSTRUCT { ?adminUnit a skos:Concept ; :numberOfBusinessEntities ?numberOfBusinessEntities ; :dataset <""", STR(?dataset) ,"""> . } WHERE { { SELECT ?adminUnit (COUNT(DISTINCT ?resource) AS ?numberOfBusinessEntities) WHERE { ?resource a legal:LegalEntity . { ?resource m8g:registeredAddress ?registeredAddress . } UNION { ?resource stirdata:postalAddress ?postalAddress . } UNION { ?resource stirdata:streetAddress ?streetAddress . } UNION { ?resource org:hasRegisteredSite/org:siteAddress ?registeredSiteAddress . } UNION { ?resource org:hasSite/org:siteAddress ?siteAddress . } BIND(COALESCE(?registeredAddress,?postalAddress,?streetAddress,?registeredSiteAddress,?siteAddress) AS ?address) . ?address m8g:adminUnit ?adminUnit . } GROUP BY ?adminUnit } }""") as ?query) }
query control: None

configuration
type: Configuration
content: <https://obchodní-rejstřík.stirdata.opendata.cz/sparql> <urn:stirdata:endpoint> "https://obchodní-rejstřík.stirdata.opendata.cz/sparql" ; <urn:stirdata:dataset> <https://stirdata.opendata.cz/resource/dataset/czechia/obchodní-rejstřík/ebg> .
content control: None
file name: file.ttl
file name control: None

configuration
type: Configuration
default graph control: None
encode rdf: false
encode rdf control: None
endpoint: https://query.wikidata.org/sparql
endpoint control: None
handle invalid data: false
handle invalid data control: None
header accept: text/turtle
header accept control: None
password control: None
query: PREFIX wdt: <http://www.wikidata.org/prop/direct/> PREFIX wd: <urn:stirdata:wikidata:> CONSTRUCT { ?region wd:nuts ?nuts ; wd:population ?population . } WHERE { ?region wdt:P605 ?nutsCode ; wdt:P1082 ?population . BIND(IRI(CONCAT("http://data.europa.eu/nuts/code/", ?nutsCode)) AS ?nuts) }
query control: None
use authentication: false
use authentication control: None
use tolerant repository: false
use tolerant repository control: None
user name control: None