- JSON transformation and file merge
42cc3f9d-1dd2-1d69-e404-dc0660f76664
SmartCity_NiFi_Template-13
c798c405-8177-3ed7-0000-000000000000
8dfc8fd3-163b-349f-0000-000000000000
0.0
0.0
- JSON transformation and file merge
168e9a9c-8319-3f05-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1 GB
10000
c798c405-8177-3ed7-0000-000000000000
c8efc7fa-0545-3c72-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
c798c405-8177-3ed7-0000-000000000000
acf7c660-e9a0-3f90-0000-000000000000
PROCESSOR
0
2cead287-f9a0-3aa4-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1 GB
10000
c798c405-8177-3ed7-0000-000000000000
4d3e1b0b-2a3f-3328-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
c798c405-8177-3ed7-0000-000000000000
c8efc7fa-0545-3c72-0000-000000000000
PROCESSOR
0
72d3101f-3c15-3a41-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1 GB
10000
c798c405-8177-3ed7-0000-000000000000
acf7c660-e9a0-3f90-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
success
c798c405-8177-3ed7-0000-000000000000
dee27947-dfe4-3e61-0000-000000000000
PROCESSOR
0
87bfaa45-6b24-3d87-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1 GB
10000
656.0
28.54710866595417
808.0
28.54710866595417
c798c405-8177-3ed7-0000-000000000000
acf7c660-e9a0-3f90-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
failure
c798c405-8177-3ed7-0000-000000000000
acf7c660-e9a0-3f90-0000-000000000000
PROCESSOR
0
9f56a56d-9f2f-3264-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1 GB
10000
c798c405-8177-3ed7-0000-000000000000
f8d4f6c3-3d6b-3cd0-0000-000000000000
PROCESSOR
0 sec
1
DO_NOT_COMPRESS
LOAD_BALANCE_NOT_CONFIGURED
DO_NOT_LOAD_BALANCE
merged
c798c405-8177-3ed7-0000-000000000000
4d3e1b0b-2a3f-3328-0000-000000000000
PROCESSOR
0
4d3e1b0b-2a3f-3328-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1520.0
128.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Merge Strategy
Merge Strategy
Merge Format
Merge Format
Attribute Strategy
Attribute Strategy
Correlation Attribute Name
Correlation Attribute Name
mergecontent-metadata-strategy
mergecontent-metadata-strategy
Minimum Number of Entries
Minimum Number of Entries
Maximum Number of Entries
Maximum Number of Entries
Minimum Group Size
Minimum Group Size
Maximum Group Size
Maximum Group Size
Max Bin Age
Max Bin Age
Maximum number of Bins
Maximum number of Bins
Delimiter Strategy
Delimiter Strategy
Header File
Header File
Footer File
Footer File
Demarcator File
Demarcator File
Compression Level
Compression Level
Keep Path
Keep Path
Tar Modified Time
Tar Modified Time
ALL
false
30 sec
Merge Strategy
Bin-Packing Algorithm
Merge Format
Binary Concatenation
Attribute Strategy
Keep Only Common Attributes
Correlation Attribute Name
mergecontent-metadata-strategy
Do Not Merge Uncommon Metadata
Minimum Number of Entries
1000
Maximum Number of Entries
10000
Minimum Group Size
5 MB
Maximum Group Size
Max Bin Age
20 secs
Maximum number of Bins
1000
Delimiter Strategy
Text
Header File
Footer File
Demarcator File
Compression Level
1
Keep Path
false
Tar Modified Time
${file.lastModifiedTime}
0
0 sec
TIMER_DRIVEN
1 sec
false
MergeContent
true
failure
false
merged
true
original
STOPPED
org.apache.nifi.processors.standard.MergeContent
acf7c660-e9a0-3f90-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
568.0
128.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
jolt-transform
jolt-transform
jolt-custom-class
jolt-custom-class
jolt-custom-modules
jolt-custom-modules
jolt-spec
jolt-spec
Transform Cache Size
Transform Cache Size
pretty_print
pretty_print
ALL
false
30 sec
jolt-transform
jolt-transform-chain
jolt-custom-class
jolt-custom-modules
jolt-spec
[{
"operation": "shift",
"spec" : {
"representation" : {
"*" : "&"
}
}
}
]
Transform Cache Size
1
pretty_print
false
0
0 sec
TIMER_DRIVEN
1 sec
false
JoltTransformJSON
false
failure
false
success
STOPPED
org.apache.nifi.processors.standard.JoltTransformJSON
c8efc7fa-0545-3c72-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1072.0
128.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Regular Expression
Regular Expression
Replacement Value
Replacement Value
Character Set
Character Set
Maximum Buffer Size
Maximum Buffer Size
Replacement Strategy
Replacement Strategy
Evaluation Mode
Evaluation Mode
Line-by-Line Evaluation Mode
Line-by-Line Evaluation Mode
ALL
false
30 sec
Regular Expression
(?s)(^.*$)
Replacement Value
Character Set
UTF-8
Maximum Buffer Size
1 MB
Replacement Strategy
Append
Evaluation Mode
Line-by-Line
Line-by-Line Evaluation Mode
All
0
0 sec
TIMER_DRIVEN
1 sec
false
ReplaceText
true
failure
false
success
STOPPED
org.apache.nifi.processors.standard.ReplaceText
dee27947-dfe4-3e61-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
112.0
128.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
File Size
File Size
Batch Size
Batch Size
Data Format
Data Format
Unique FlowFiles
Unique FlowFiles
generate-ff-custom-text
generate-ff-custom-text
character-set
character-set
ALL
false
30 sec
File Size
0B
Batch Size
1
Data Format
Text
Unique FlowFiles
false
generate-ff-custom-text
{
"@context": [
"http://uri.etsi.org/ngsi-ld/core-context.jsonld",
"http://cityhub.kr/ngsi-ld/weather.jsonld"
],
"id": "urn:datahub:WeatherForecast:6279",
"type": "WeatherForecast",
"createdAt": "2018-11-15T20:10:00",
"modifiedAt": "2018-11-15T20:10:00",
"location": {
"type": "GeoProperty",
"value": {
"type": "Point",
"coordinates": [
127.1293735,
37.4114423
]
}
},
"address": {
"type": "Property",
"value": {
"addressCountry": "KR",
"addressRegion": "Gyeonggi-do",
"addressLocality": "Seongnam-si",
"streetAddress": "8th Seungin-ro",
"addressTown": "Yatap-dong"
}
},
"weatherPrediction": {
"type": "Property",
"value": [
{
"temperature": 10.1,
"lowestTemperature": -3.0,
"highestTemperature": 7.0,
"windSpeed": 0.2,
"humidity": 68,
"rainfall": 10,
"rainfallProbability": 60,
"rainType": "비",
"snowfall": 0,
"predictedAt": "2019-06-08T06:00:00"
},
{
"temperature": 14.1,
"lowestTemperature": -3.0,
"highestTemperature": 7.0,
"windSpeed": 0.3,
"humidity": 65,
"rainfall": 20,
"rainfallProbability": 60,
"rainType": "비",
"snowfall": 0,
"predictedAt": "2019-06-08T09:00:00"
}
],
"observedAt": "2018-11-15T20:09:55"
}
}
character-set
UTF-8
0
5 sec
TIMER_DRIVEN
1 sec
false
GenerateFlowFile
false
success
STOPPED
org.apache.nifi.processors.standard.GenerateFlowFile
f8d4f6c3-3d6b-3cd0-0000-000000000000
c798c405-8177-3ed7-0000-000000000000
1984.0
128.0
nifi-standard-nar
org.apache.nifi
1.11.4
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
false
LogAttribute
true
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
SmartCity_NiFi_Template-13
11/09/2020 09:28:44 KST