- Convert JSON to CSV format and file merge
42cc3f9d-1dd2-1d69-e404-dc0660f76664
SmartCity_NiFi_Template-14
5832ee7f-5579-33d8-0000-000000000000
8dfc8fd3-163b-349f-0000-000000000000
0.0
0.0
- Convert JSON to CSV format and file merge
12e1df32-9c08-3525-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
b214a038-ee76-39a3-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
5832ee7f-5579-33d8-0000-000000000000
e6b8c698-5eb8-3ac7-0000-000000000000
PROCESSOR
0
268fe16b-8f94-3868-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
5905ad2f-45e4-358a-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
5832ee7f-5579-33d8-0000-000000000000
d9c72b14-af66-3dbc-0000-000000000000
PROCESSOR
0
2e6ab741-9fbf-341a-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
fa7a2c60-34fc-3173-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
5832ee7f-5579-33d8-0000-000000000000
5905ad2f-45e4-358a-0000-000000000000
PROCESSOR
0
57de04e7-e437-35f9-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
c35d88b1-7549-31bf-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
failure
5832ee7f-5579-33d8-0000-000000000000
fa7a2c60-34fc-3173-0000-000000000000
PROCESSOR
0
5f5c07ca-8b28-3102-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
1159fbc7-e6ef-35a8-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
merged
5832ee7f-5579-33d8-0000-000000000000
b214a038-ee76-39a3-0000-000000000000
PROCESSOR
0
90da063a-1456-3f2c-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
b7a6142f-ccfa-377a-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
failure
5832ee7f-5579-33d8-0000-000000000000
b214a038-ee76-39a3-0000-000000000000
PROCESSOR
0
9ad96f06-c57e-3326-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
99000fee-0c84-3353-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
failure
5832ee7f-5579-33d8-0000-000000000000
e6b8c698-5eb8-3ac7-0000-000000000000
PROCESSOR
0
9bcfc0f0-5605-3dce-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
f9ed91f8-649b-39e0-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
merged
5832ee7f-5579-33d8-0000-000000000000
fa7a2c60-34fc-3173-0000-000000000000
PROCESSOR
0
b46c434c-8a79-3f71-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
76.50000999046517
33.035358134283854
228.50000999046517
33.035358134283854
5832ee7f-5579-33d8-0000-000000000000
5905ad2f-45e4-358a-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
failure
5832ee7f-5579-33d8-0000-000000000000
5905ad2f-45e4-358a-0000-000000000000
PROCESSOR
0
c890f05a-3b71-3940-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1 GB
10000
5832ee7f-5579-33d8-0000-000000000000
e6b8c698-5eb8-3ac7-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
5832ee7f-5579-33d8-0000-000000000000
5905ad2f-45e4-358a-0000-000000000000
PROCESSOR
0
4819756e-96ca-336f-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
nifi-record-serialization-services-nar
org.apache.nifi
1.11.4
schema-access-strategy
schema-access-strategy
schema-registry
org.apache.nifi.schemaregistry.services.SchemaRegistry
schema-registry
schema-name
schema-name
schema-version
schema-version
schema-branch
schema-branch
schema-text
schema-text
csv-reader-csv-parser
csv-reader-csv-parser
Date Format
Date Format
Time Format
Time Format
Timestamp Format
Timestamp Format
CSV Format
CSV Format
Value Separator
Value Separator
Skip Header Line
Skip Header Line
ignore-csv-header
ignore-csv-header
Quote Character
Quote Character
Escape Character
Escape Character
Comment Marker
Comment Marker
Null String
Null String
Trim Fields
Trim Fields
csvutils-character-set
csvutils-character-set
CSVReader
false
schema-access-strategy
schema-registry
schema-name
schema-version
schema-branch
schema-text
csv-reader-csv-parser
Date Format
Time Format
Timestamp Format
CSV Format
Value Separator
Skip Header Line
ignore-csv-header
Quote Character
Escape Character
Comment Marker
Null String
Trim Fields
csvutils-character-set
ENABLED
org.apache.nifi.csv.CSVReader
774978a5-0c6f-30ae-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
nifi-record-serialization-services-nar
org.apache.nifi
1.11.4
Schema Write Strategy
Schema Write Strategy
schema-cache
org.apache.nifi.serialization.RecordSchemaCacheService
schema-cache
schema-access-strategy
schema-access-strategy
schema-registry
org.apache.nifi.schemaregistry.services.SchemaRegistry
schema-registry
schema-name
schema-name
schema-version
schema-version
schema-branch
schema-branch
schema-text
schema-text
Date Format
Date Format
Time Format
Time Format
Timestamp Format
Timestamp Format
CSV Format
CSV Format
Value Separator
Value Separator
Include Header Line
Include Header Line
Quote Character
Quote Character
Escape Character
Escape Character
Comment Marker
Comment Marker
Null String
Null String
Trim Fields
Trim Fields
Quote Mode
Quote Mode
Record Separator
Record Separator
Include Trailing Delimiter
Include Trailing Delimiter
csvutils-character-set
csvutils-character-set
CSVRecordSetWriter
false
Schema Write Strategy
schema-cache
schema-access-strategy
schema-registry
schema-name
schema-version
schema-branch
schema-text
Date Format
Time Format
Timestamp Format
CSV Format
Value Separator
Include Header Line
Quote Character
Escape Character
Comment Marker
Null String
Trim Fields
Quote Mode
Record Separator
Include Trailing Delimiter
csvutils-character-set
ENABLED
org.apache.nifi.csv.CSVRecordSetWriter
d4a55e2a-8ff1-3957-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
nifi-record-serialization-services-nar
org.apache.nifi
1.11.4
schema-access-strategy
schema-access-strategy
schema-registry
org.apache.nifi.schemaregistry.services.SchemaRegistry
schema-registry
schema-name
schema-name
schema-version
schema-version
schema-branch
schema-branch
schema-text
schema-text
schema-inference-cache
org.apache.nifi.serialization.RecordSchemaCacheService
schema-inference-cache
Date Format
Date Format
Time Format
Time Format
Timestamp Format
Timestamp Format
JsonTreeReader
false
schema-access-strategy
schema-registry
schema-name
schema-version
schema-branch
schema-text
schema-inference-cache
Date Format
Time Format
Timestamp Format
ENABLED
org.apache.nifi.json.JsonTreeReader
1159fbc7-e6ef-35a8-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
1408.0
136.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
5905ad2f-45e4-358a-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
-8.0
136.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
jolt-transform
jolt-transform
jolt-custom-class
jolt-custom-class
jolt-custom-modules
jolt-custom-modules
jolt-spec
jolt-spec
Transform Cache Size
Transform Cache Size
pretty_print
pretty_print
ALL
false
30 sec
jolt-transform
jolt-transform-chain
jolt-custom-class
jolt-custom-modules
jolt-spec
[{
"operation": "shift",
"spec" : {
"representation" : {
"*" : "&"
}
}
}
]
Transform Cache Size
1
pretty_print
false
0
0 sec
TIMER_DRIVEN
1 sec
false
JoltTransformJSON
false
failure
false
success
STOPPED
org.apache.nifi.processors.standard.JoltTransformJSON
99000fee-0c84-3353-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
480.0
-48.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
b214a038-ee76-39a3-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
936.0
136.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
record-reader
org.apache.nifi.serialization.RecordReaderFactory
record-reader
record-writer
org.apache.nifi.serialization.RecordSetWriterFactory
record-writer
merge-strategy
merge-strategy
correlation-attribute-name
correlation-attribute-name
Attribute Strategy
Attribute Strategy
min-records
min-records
max-records
max-records
min-bin-size
min-bin-size
max-bin-size
max-bin-size
max-bin-age
max-bin-age
max.bin.count
max.bin.count
ALL
false
30 sec
record-reader
4819756e-96ca-336f-0000-000000000000
record-writer
774978a5-0c6f-30ae-0000-000000000000
merge-strategy
Bin-Packing Algorithm
correlation-attribute-name
Attribute Strategy
Keep Only Common Attributes
min-records
1
max-records
1000
min-bin-size
0 B
max-bin-size
max-bin-age
max.bin.count
10
0
0 sec
TIMER_DRIVEN
1 sec
false
MergeRecord
false
failure
false
merged
true
original
STOPPED
org.apache.nifi.processors.standard.MergeRecord
b7a6142f-ccfa-377a-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
936.0
-48.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
c35d88b1-7549-31bf-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
480.0
536.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
d9c72b14-af66-3dbc-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
-464.0
136.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
File Size
File Size
Batch Size
Batch Size
Data Format
Data Format
Unique FlowFiles
Unique FlowFiles
generate-ff-custom-text
generate-ff-custom-text
character-set
character-set
ALL
false
30 sec
File Size
0B
Batch Size
1
Data Format
Text
Unique FlowFiles
false
generate-ff-custom-text
{
"@context": [
"http://uri.etsi.org/ngsi-ld/core-context.jsonld",
"http://cityhub.kr/ngsi-ld/weather.jsonld"
],
"id": "urn:datahub:WeatherForecast:6279",
"type": "WeatherForecast",
"createdAt": "2018-11-15T20:10:00",
"modifiedAt": "2018-11-15T20:10:00",
"location": {
"type": "GeoProperty",
"value": {
"type": "Point",
"coordinates": [
127.1293735,
37.4114423
]
}
},
"address": {
"type": "Property",
"value": {
"addressCountry": "KR",
"addressRegion": "Gyeonggi-do",
"addressLocality": "Seongnam-si",
"streetAddress": "8th Seungin-ro",
"addressTown": "Yatap-dong"
}
},
"weatherPrediction": {
"type": "Property",
"value": [
{
"temperature": 10.1,
"lowestTemperature": -3.0,
"highestTemperature": 7.0,
"windSpeed": 0.2,
"humidity": 68,
"rainfall": 10,
"rainfallProbability": 60,
"rainType": "비",
"snowfall": 0,
"predictedAt": "2019-06-08T06:00:00"
},
{
"temperature": 14.1,
"lowestTemperature": -3.0,
"highestTemperature": 7.0,
"windSpeed": 0.3,
"humidity": 65,
"rainfall": 20,
"rainfallProbability": 60,
"rainType": "비",
"snowfall": 0,
"predictedAt": "2019-06-08T09:00:00"
}
],
"observedAt": "2018-11-15T20:09:55"
}
}
character-set
UTF-8
0
5 sec
TIMER_DRIVEN
1 sec
false
GenerateFlowFile
false
success
STOPPED
org.apache.nifi.processors.standard.GenerateFlowFile
e6b8c698-5eb8-3ac7-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
480.0
136.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
record-reader
org.apache.nifi.serialization.RecordReaderFactory
record-reader
record-writer
org.apache.nifi.serialization.RecordSetWriterFactory
record-writer
include-zero-record-flowfiles
include-zero-record-flowfiles
ALL
false
30 sec
record-reader
d4a55e2a-8ff1-3957-0000-000000000000
record-writer
774978a5-0c6f-30ae-0000-000000000000
include-zero-record-flowfiles
true
0
0 sec
TIMER_DRIVEN
1 sec
false
ConvertRecord
false
failure
false
success
STOPPED
org.apache.nifi.processors.standard.ConvertRecord
f9ed91f8-649b-39e0-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
952.0
352.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
fa7a2c60-34fc-3173-0000-000000000000
5832ee7f-5579-33d8-0000-000000000000
480.0
352.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
record-reader
org.apache.nifi.serialization.RecordReaderFactory
record-reader
record-writer
org.apache.nifi.serialization.RecordSetWriterFactory
record-writer
merge-strategy
merge-strategy
correlation-attribute-name
correlation-attribute-name
Attribute Strategy
Attribute Strategy
min-records
min-records
max-records
max-records
min-bin-size
min-bin-size
max-bin-size
max-bin-size
max-bin-age
max-bin-age
max.bin.count
max.bin.count
ALL
false
30 sec
record-reader
d4a55e2a-8ff1-3957-0000-000000000000
record-writer
774978a5-0c6f-30ae-0000-000000000000
merge-strategy
Bin-Packing Algorithm
correlation-attribute-name
Attribute Strategy
Keep Only Common Attributes
min-records
1
max-records
1000
min-bin-size
0 B
max-bin-size
max-bin-age
max.bin.count
10
0
0 sec
TIMER_DRIVEN
1 sec
false
MergeRecord
false
failure
false
merged
true
original
STOPPED
org.apache.nifi.processors.standard.MergeRecord
SmartCity_NiFi_Template-14
11/09/2020 09:32:13 KST