Searching for business entities across STIRdata data sources, Wikidata and DBpedia
type: Pipeline
tag: consumption demo
version: 5
created: 2022-09-20T08:16:42.508
last update: 2023-06-14T15:19:41.53893261
profile: default

SPARQL endpoint list to single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpointList/0.0.0
x: 1365
y: 1411
description: Execute query tasks to search for business entities by their identifier (DBpedia)

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: 958
y: 1404
description: Prepare query tasks to search for business entities by their identifier (DBpedia)

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: 44
y: 1594
description: Prepare query tasks to search for business entities by their identifier (Wikidata)

SPARQL endpoint list to single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpointList/0.0.0
x: 549
y: 1505
description: Execute query tasks to search for business entities by their identifier (Wikidata)

Mustache
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-mustache/0.0.0
x: 2494
y: 1450
description: Construct final JSON output file

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/0a79-9da7
type: Connection
source binding: OutputRdf
source component: SPARQL construct
target binding: Tasks
target component: SPARQL endpoint list to single graph

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/31ca-a6bb
type: Connection
source binding: OutputRdf
target binding: InputRdf
target component: SPARQL construct

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/5e1b-8063
type: Connection
source binding: OutputRdf
source component: SPARQL endpoint list to single graph
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/8e16-a664
type: Connection
source binding: OutputRdf
source component: SPARQL construct
target binding: Tasks
target component: SPARQL endpoint list to single graph

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/c0bb-b436
type: Connection
source binding: OutputRdf
source component: SPARQL endpoint list to single graph
target binding: InputRdf
target component: SPARQL construct

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/c238-89e4
type: Connection
source binding: OutputRdf
source component: SPARQL endpoint list to single graph
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-0002/connection/e091-8000
type: Connection
source binding: OutputRdf
target binding: InputRdf
target component: Mustache

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: 1967
y: 1655
description: Construct output representation of business entities

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Connection
source binding: FilesOutput
target binding: InputFiles

SPARQL endpoint - EDP
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpoint/0.0.0
x: -410
y: 1611
description: Extract compliant endpoints from catalog

SPARQL endpoint - STIRData
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpoint/0.0.0
x: -464
y: 1722
description: Extract compliant endpoints from catalog

Union
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-singleGraphUnion/0.0.0
x: 3
y: 1867

Files to RDF single graph
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/t-filesToRdfGraph/0.0.0
x: -372
y: 1839

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Connection
source binding: OutputRdf
target binding: InputRdf

SPARQL endpoint list to single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-sparqlEndpointList/0.0.0
x: 549
y: 1774
description: Execute query tasks to search for business entities by their identifier (STIRData)

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Connection
source binding: OutputRdf
target binding: Tasks

SPARQL construct
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-sparqlConstruct/0.0.0
x: 167
y: 1779
description: Prepare query tasks to search for business entities by their identifier (STIRData)

Text holder - only CZ
type: Component
configuration graph: configuration
disabled: true
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: -630
y: 1880

Files to RDF single graph
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/t-filesToRdfGraph/0.0.0
x: -400
y: 1441
description: Transform identifiers to graph

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00028bfb-b78c
type: Connection
source binding: FilesOutput
target binding: InputFiles

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00029e08-9180
type: Connection
source binding: OutputRdf
target binding: InputRdf

Text holder
type: Component
configuration graph: configuration
template: http://etl.linkedpipes.com/resources/components/e-textHolder/0.0.0
x: -785
y: 1431
description: Set identifiers

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-0002ee29-804d
type: Connection
source binding: OutputRdf
target binding: InputRdf

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-0002f1ce-8b48
type: Connection
source binding: OutputRdf
target binding: InputRdf

configuration
type: Configuration
commit size: 0
commit size control: None
encode rdf: false
encode rdf control: None
password control: None
task per group limit: 1
task per group limit control: None
threads: 8
threads control: None
time limit: 600
time limit control: None
use authentication: false
use authentication control: None
use tolerant repository: true
use tolerant repository control: None
user name control: None

configuration
type: Configuration
query: PREFIX esl: <http://plugins.linkedpipes.com/ontology/e-sparqlEndpointList#> PREFIX : <urn:stirdata:> CONSTRUCT { ?task a esl:Task ; esl:query ?query ; esl:group "https://dbpedia.org/sparql" ; esl:endpoint "https://dbpedia.org/sparql" . } WHERE { ?companyWD :identifier ?identifier . BIND(UUID() AS ?task) BIND(CONCAT("""PREFIX dbo: <http://dbpedia.org/ontology/> PREFIX owl: <http://www.w3.org/2002/07/owl#> PREFIX stirdbp: <urn:stirdata:dbpedia:> CONSTRUCT { <""", STR(?companyWD), """> stirdbp:abstract ?abstract . } WHERE { ?company owl:sameAs <""", STR(?companyWD), """> ; dbo:abstract ?abstract . }""") as ?query) }
query control: None

configuration
type: Configuration
query: PREFIX esl: <http://plugins.linkedpipes.com/ontology/e-sparqlEndpointList#> PREFIX : <urn:stirdata:> CONSTRUCT { ?task a esl:Task ; esl:query ?query ; esl:group "https://query.wikidata.org/sparql" ; esl:endpoint "https://query.wikidata.org/sparql" . } WHERE { [] :identifier ?identifier . BIND(UUID() AS ?task) BIND(CONCAT("""PREFIX wdt: <http://www.wikidata.org/prop/direct/> PREFIX wd: <http://www.wikidata.org/entity/> PREFIX p: <http://www.wikidata.org/prop/> PREFIX psv: <http://www.wikidata.org/prop/statement/value/> PREFIX ps: <http://www.wikidata.org/prop/statement/> PREFIX wikibase: <http://wikiba.se/ontology#> PREFIX stirwd: <urn:stirdata:wikidata:> PREFIX : <urn:stirdata:> CONSTRUCT { ?company stirwd:numberOfEmployees ?numberOfEmployees ; stirwd:netProfit [ stirwd:amount ?netProfitAmount ; stirwd:unit ?netProfitUnit ] ; :identifier \"""", STR(?identifier), """\" . } WHERE { VALUES ?identifyingWDProperty {wd:Q21745557 wd:Q26235166 wd:Q106035765} ?company ?directIdentifier \"""", STR(?identifier), """\" ; wdt:P1128 ?numberOfEmployees ; wdt:P2295 ?netProfitAmount ; p:P2295 ?netProfitStatement . ?netProfitStatement ps:P2295 ?netProfitAmount ; psv:P2295/wikibase:quantityUnit/wdt:P498 ?netProfitUnit . ?identifier wikibase:directClaim ?directIdentifier ; wdt:P31 ?identifyingWDProperty . }""") as ?query) }
query control: None

configuration
type: Configuration
commit size: 0
commit size control: None
encode rdf: false
encode rdf control: None
password control: None
task per group limit: 1
task per group limit control: None
threads: 8
threads control: None
time limit: 600
time limit control: None
use authentication: false
use authentication control: None
use tolerant repository: true
use tolerant repository control: None
user name control: None

configuration
type: Configuration
add first flag: true
add first flag control: None
class: urn:stirdata:OutputList
class control: None
escape for json: false
escape for json control: None
template: [ {{#urn:stirdata:item}} {{^http://plugins.linkedpipes.com/ontology/t-mustache#first}} , {{/http://plugins.linkedpipes.com/ontology/t-mustache#first}} { "identifier": "{{urn:stirdata:identifier}}", "legalName": [ {{^http://plugins.linkedpipes.com/ontology/t-mustache#first}} , {{/http://plugins.linkedpipes.com/ontology/t-mustache#first}} {{#urn:stirdata:legalName}} { "value": "{{urn:stirdata:value}}", "lang": "{{urn:stirdata:lang}}" } {{/urn:stirdata:legalName}} ], "dataSet": "{{urn:stirdata:dataset}}", "netProfit": { {{#urn:stirdata:netProfit}} "amount": "{{urn:stirdata:amount}}", "unit": "{{urn:stirdata:unit}}" {{/urn:stirdata:netProfit}} }, "abstract": [ {{#urn:stirdata:abstract}} {{^http://plugins.linkedpipes.com/ontology/t-mustache#first}} , {{/http://plugins.linkedpipes.com/ontology/t-mustache#first}} { "value": "{{urn:stirdata:value}}", "lang": "{{urn:stirdata:lang}}" } {{/urn:stirdata:abstract}} ] } {{/urn:stirdata:item}} ]
template control: None

configuration
type: Configuration
query: PREFIX : <urn:stirdata:> PREFIX stirwd: <urn:stirdata:wikidata:> PREFIX stirdbp: <urn:stirdata:dbpedia:> PREFIX legal: <http://www.w3.org/ns/legal#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> CONSTRUCT { :outputList0 a :OutputList ; <http://plugins.linkedpipes.com/ontology/t-mustache#fileName> ?fileName ; :item ?legalEntity . ?legalEntity a legal:LegalEntity ; :identifier ?identifier ; :legalName ?legalNameIRI ; :dataset ?datasetStr ; :netProfit ?netProfit ; :abstract ?abstractIRI . ?netProfit :amount ?netProfitAmount ; :unit ?netProfitUnit . ?legalNameIRI :value ?legalName ; :lang ?legalNameLang . ?abstractIRI :value ?abstract ; :lang ?abstractLang . } WHERE { ?legalEntity a legal:LegalEntity ; :identifier ?identifier ; :legalName ?legalName ; :dataset ?dataset . ?legalEntityWikidata stirwd:numberOfEmployees ?numberOfEmployees ; stirwd:netProfit ?netProfit ; :identifier ?identifier ; stirdbp:abstract ?abstract . ?netProfit stirwd:amount ?netProfitAmount ; stirwd:unit ?netProfitUnit . BIND(STR(?dataset) AS ?datasetStr) BIND(LANG(?abstract) AS ?abstractLang) BIND(LANG(?legalName) AS ?legalNameLang) BIND(IRI(CONCAT(STR(?legalEntity), "/legalname/", ?legalNameLang)) AS ?legalNameIRI) BIND(IRI(CONCAT(STR(?legalEntity), "/abstract/", ?abstractLang)) AS ?abstractIRI) BIND("companies.json" AS ?fileName) }
query control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Configuration
default graph control: None
encode rdf: false
encode rdf control: None
endpoint: https://data.europa.eu/sparql
endpoint control: None
handle invalid data: false
handle invalid data control: None
header accept control: None
password control: None
query: PREFIX dcterms: <http://purl.org/dc/terms/> PREFIX dcat: <http://www.w3.org/ns/dcat#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> CONSTRUCT { ?endpoint <urn:stirdata:endpoint> ?endpointString ; <urn:stirdata:dataset> ?dataset . } WHERE { ?dataset a dcat:Dataset ; dcterms:title ?title ; dcterms:conformsTo <https://stirdata.github.io/data-specification/> ; dcat:distribution/dcat:accessService ?service . ?service a dcat:DataService ; dcterms:conformsTo <https://www.w3.org/TR/sparql11-protocol/> ; dcat:endpointURL ?endpoint . FILTER(langMatches(LANG(?title), "en")) BIND(STR(?endpoint) AS ?endpointString) }
query control: None
use authentication: false
use authentication control: None
use tolerant repository: false
use tolerant repository control: None
user name control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Configuration
default graph control: None
encode rdf: false
encode rdf control: None
endpoint: https://stirdata.opendata.cz/sparql
endpoint control: None
handle invalid data: false
handle invalid data control: None
header accept control: None
password control: None
query: PREFIX dcterms: <http://purl.org/dc/terms/> PREFIX dcat: <http://www.w3.org/ns/dcat#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> CONSTRUCT { ?endpoint <urn:stirdata:endpoint> ?endpointString ; <urn:stirdata:dataset> ?dataset . } WHERE { ?dataset a dcat:Dataset ; dcterms:title ?title ; dcterms:conformsTo <https://stirdata.github.io/data-specification/> ; dcat:distribution/dcat:accessService ?service . ?service a dcat:DataService ; dcterms:conformsTo <https://www.w3.org/TR/sparql11-protocol/> ; dcat:endpointURL ?endpoint . FILTER(langMatches(LANG(?title), "en")) BIND(STR(?endpoint) AS ?endpointString) }
query control: None
use authentication: false
use authentication control: None
use tolerant repository: false
use tolerant repository control: None
user name control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
commit size: 0
commit size control: None
encode rdf: false
encode rdf control: None
password control: None
task per group limit: 1
task per group limit control: None
threads: 8
threads control: None
time limit: 600
time limit control: None
use authentication: false
use authentication control: None
use tolerant repository: true
use tolerant repository control: None
user name control: None

configuration
type: Configuration
query: PREFIX esl: <http://plugins.linkedpipes.com/ontology/e-sparqlEndpointList#> PREFIX : <urn:stirdata:> CONSTRUCT { ?task a esl:Task ; esl:query ?query ; esl:group ?uritext ; esl:endpoint ?uritext . } WHERE { ?s :endpoint ?uritext ; :dataset ?dataset . [] :identifier ?identifier . BIND(UUID() AS ?task) BIND(IRI(?uritext) as ?uri) BIND(CONCAT("""PREFIX : <urn:stirdata:> PREFIX legal: <http://www.w3.org/ns/legal#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> CONSTRUCT { ?resource a legal:LegalEntity ; :identifier \"""", STR(?identifier), """\" ; :legalName ?legalName ; :dataset <""", STR(?dataset) ,"""> . } WHERE { ?resource a legal:LegalEntity ; legal:legalIdentifier/skos:notation \"""", STR(?identifier), """\" ; legal:legalName ?legalName . }""") as ?query) }
query control: None

https://stirdata.opendata.cz/etl/resources/pipelines/1686233582005-00021686233582005-00021682095059683-00051682095059683-00051682090585905-00041682090585905-00041681989406323-00031681989406323-0003168…
type: Configuration
content: <https://obchodní-rejstřík.stirdata.opendata.cz/sparql> <urn:stirdata:endpoint> "https://obchodní-rejstřík.stirdata.opendata.cz/sparql" ; <urn:stirdata:dataset> <https://stirdata.opendata.cz/resource/dataset/czechia/obchodní-rejstřík/ebg> .
content control: None
file name: file.ttl
file name control: None

configuration
type: Configuration
commit size: 50000
commit size control: None
mime type control: None
soft fail: false
soft fail control: None

configuration
type: Configuration
content: @prefix xsd: <http://www.w3.org/2001/XMLSchema#> . [] <urn:stirdata:identifier> "26185610", "10421629" .
content control: None
file name: identifiers.ttl
file name control: None