Pull Tweets from Twitter and Dump Them Into Solr and HDFSTwitter_Flow713fe8ba-da16-4080-8cb9-5712359df8ee77e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4d65cd8fd7-a62f-4b44-b41e-1109ce307e03PROCESSOR0 sec1success070ba16e9-af43-4fa2-9540-28a4ecdd191477e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4d47e7881f-d6de-4e1a-8051-deb7c14ec100PROCESSOR0 sec1success02fa513c3-0df6-4c6b-9a42-feac268eef9177e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB01860.9996337890625467.081481933593751849.42138671875511.740753173828177e7a39a-ecd8-4413-84a3-cff768e49f4d9d7dc3cc-734a-4340-a3a7-a88636731ae1PROCESSOR0 sec1failure0cf234b8d-cb0d-466f-af30-6a5c2b6e0fb677e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4ddbbd3d99-7f11-48b5-8cb4-5f900a286169PROCESSOR0 sec1matched04343f24e-ed95-460a-9def-957f9768948077e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4d9d7dc3cc-734a-4340-a3a7-a88636731ae1PROCESSOR0 sec1merged0984b91a9-e926-4c3f-90c2-108797a17b3377e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4d6744869f-2185-41f0-ac62-7749cdfe0b00PROCESSOR0 sec1merged00ba04318-7bdd-4695-875c-26d9bdd2ec0377e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB077e7a39a-ecd8-4413-84a3-cff768e49f4dca69d622-5f96-4f41-ac78-945e408470e5PROCESSOR0 sec1tweet028733ecb-8b18-490e-aa51-c95381922e5777e7a39a-ecd8-4413-84a3-cff768e49f4d0 MB0162.293701171875675.491394042968877e7a39a-ecd8-4413-84a3-cff768e49f4dba4eeecf-ce6f-4508-91ed-66f6996256c4PROCESSOR0 sec0tweet047e7881f-d6de-4e1a-8051-deb7c14ec10077e7a39a-ecd8-4413-84a3-cff768e49f4d904.5484143070107438.48594021087104WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Footer FileFilename specifying the footer to use. If not specified, no footer is supplied. This property is valid only when using the binary-concatenation merge strategy; otherwise, it is ignored.FooterfalseFooter FilefalsefalsetrueCorrelation Attribute NameIf specified, like FlowFiles will be binned together, where 'like FlowFiles' means FlowFiles that have the same value for this Attribute. If not specified, FlowFiles are bundled by the order in which they are pulled from the queue.Correlation Attribute NamefalseCorrelation Attribute NamefalsefalsefalseMaximum number of Bins100Specifies the maximum number of bins that can be held in memory at any one timeMaximum number of BinsfalseMaximum number of BinstruefalsefalseCompression Level001122334455667788991Specifies the compression level to use when using the Zip Merge Format; if not using the Zip Merge Format, this value is ignoredCompression LevelfalseCompression LeveltruefalsefalseMax Bin AgeThe maximum age of a Bin that will trigger a Bin to be complete. Expected format is <duration> <time unit> where <duration> is a positive integer and time unit is one of seconds, minutes, hoursMax Bin AgefalseMax Bin AgefalsefalsefalseMaximum Group SizeThe maximum size for the bundle. If not specified, there is no maximum.Maximum Group SizefalseMaximum Group SizefalsefalsefalseMinimum Number of Entries1The minimum number of files to include in a bundleMinimum Number of EntriesfalseMinimum Number of EntriestruefalsefalseMinimum Group Size0 BThe minimum size of for the bundleMinimum Group SizefalseMinimum Group SizetruefalsefalseDelimiter StrategyThe values of Header, Footer, and Demarcator will be retrieved from the contents of a fileFilenameFilenameThe values of Header, Footer, and Demarcator will be specified as property valuesTextTextFilenameDetermines if Header, Footer, and Demarcator should point to files containing the respective content, or if the values of the properties should be used as the content.Delimiter StrategyfalseDelimiter StrategytruefalsefalseDemarcator FileFilename specifying the demarcator to use. If not specified, no demarcator is supplied. This property is valid only when using the binary-concatenation merge strategy; otherwise, it is ignored.DemarcatorfalseDemarcator FilefalsefalsetrueMerge FormatA bin of FlowFiles will be combined into a single TAR file. The FlowFiles' <path> attribute will be used to create a directory in the TAR file if the <Keep Paths> property is set to true; otherwise, all FlowFiles will be added at the root of the TAR file. If a FlowFile has an attribute named <tar.permissions> that is 3 characters, each between 0-7, that attribute will be used as the TAR entry's 'mode'.TARTARA bin of FlowFiles will be combined into a single ZIP file. The FlowFiles' <path> attribute will be used to create a directory in the ZIP file if the <Keep Paths> property is set to true; otherwise, all FlowFiles will be added at the root of the ZIP file. The <Compression Level> property indicates the ZIP compression to use.ZIPZIPA bin of FlowFiles will be combined into a single Version 3 FlowFile StreamFlowFile Stream, v3FlowFile Stream, v3A bin of FlowFiles will be combined into a single Version 2 FlowFile StreamFlowFile Stream, v2FlowFile Stream, v2A bin of FlowFiles will be combined into a single Version 1 FlowFile PackageFlowFile Tar, v1FlowFile Tar, v1The contents of all FlowFiles will be concatenated together into a single FlowFileBinary ConcatenationBinary ConcatenationThe Avro contents of all FlowFiles will be concatenated together into a single FlowFileAvroAvroBinary ConcatenationDetermines the format that will be used to merge the content.Merge FormatfalseMerge FormattruefalsefalseHeader FileFilename specifying the header to use. If not specified, no header is supplied. This property is valid only when using the binary-concatenation merge strategy; otherwise, it is ignored.HeaderfalseHeader FilefalsefalsetrueMaximum Number of EntriesThe maximum number of files to include in a bundle. If not specified, there is no maximum.Maximum Number of EntriesfalseMaximum Number of EntriesfalsefalsefalseMerge StrategyGenerates 'bins' of FlowFiles and fills each bin as full as possible. FlowFiles are placed into a bin based on their size and optionally their attributes (if the <Correlation Attribute> property is set)Bin-Packing AlgorithmBin-Packing AlgorithmCombines fragments that are associated by attributes back into a single cohesive FlowFile. If using this strategy, all FlowFiles must have the attributes <fragment.identifier>, <fragment.count>, and <fragment.index> or alternatively (for backward compatibility purposes) <segment.identifier>, <segment.count>, and <segment.index>. All FlowFiles with the same value for "fragment.identifier" will be grouped together. All FlowFiles in this group must have the same value for the "fragment.count" attribute. All FlowFiles in this group must have a unique value for the "fragment.index" attribute between 0 and the value of the "fragment.count" attribute.DefragmentDefragmentBin-Packing AlgorithmSpecifies the algorithm used to merge content. The 'Defragment' algorithm combines fragments that are associated by attributes back into a single cohesive FlowFile. The 'Bin-Packing Algorithm' generates a FlowFile populated by arbitrarily chosen FlowFilesMerge StrategyfalseMerge StrategytruefalsefalseAttribute StrategyKeep Only Common AttributesKeep Only Common AttributesKeep All Unique AttributesKeep All Unique AttributesKeep Only Common AttributesDetermines which FlowFile attributes should be added to the bundle. If 'Keep All Unique Attributes' is selected, any attribute on any FlowFile that gets bundled will be kept unless its value conflicts with the value from another FlowFile. If 'Keep Only Common Attributes' is selected, only the attributes that exist on all FlowFiles in the bundle, with the same value, will be preserved.Attribute StrategyfalseAttribute StrategytruefalsefalseKeep PathtruetruefalsefalsefalseIf using the Zip or Tar Merge Format, specifies whether or not the FlowFiles' paths should be included in their entry names; if using other merge strategy, this value is ignoredKeep PathfalseKeep Pathtruefalsefalsefalse30 secFooter FileCorrelation Attribute NameMaximum number of Bins100Compression Level1Max Bin Age120 secondsMaximum Group SizeMinimum Number of Entries20Minimum Group Size0 BDelimiter StrategyFilenameDemarcator FileMerge FormatBinary ConcatenationHeader FileMaximum Number of Entries1000Merge StrategyBin-Packing AlgorithmAttribute StrategyKeep Only Common AttributesKeep Pathfalse00 secTIMER_DRIVEN1 secMergeContenttrueIf the bundle cannot be created, all FlowFiles that would have been used to created the bundle will be transferred to failurefailurefalseThe FlowFile containing the merged contentmergedtrueThe FlowFiles that were used to create the bundleoriginalSTOPPEDfalsetrueorg.apache.nifi.processors.standard.MergeContentba4eeecf-ce6f-4508-91ed-66f6996256c477e7a39a-ecd8-4413-84a3-cff768e49f4d8.94345980834396478.8681905650364WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Solr TypeA SolrCloud instance.CloudCloudA stand-alone Solr instance.StandardStandardStandardThe type of Solr instance, Cloud or Standard.Solr TypefalseSolr TypetruefalsefalseCollectionThe Solr collection name, only used with a Solr Type of CloudCollectionfalseCollectionfalsefalsetruef.9Specifies the value to send for the 'f.9' request parameterf.9truef.9falsefalsetruef.8Specifies the value to send for the 'f.8' request parameterf.8truef.8falsefalsetruef.2Specifies the value to send for the 'f.2' request parameterf.2truef.2falsefalsetruef.3Specifies the value to send for the 'f.3' request parameterf.3truef.3falsefalsetruef.1Specifies the value to send for the 'f.1' request parameterf.1truef.1falsefalsetruef.6Specifies the value to send for the 'f.6' request parameterf.6truef.6falsefalsetruef.7Specifies the value to send for the 'f.7' request parameterf.7truef.7falsefalsetruef.10Specifies the value to send for the 'f.10' request parameterf.10truef.10falsefalsetrueSolr LocationThe Solr url for a Solr Type of Standard (ex: http://localhost:8984/solr/gettingstarted), or the ZooKeeper hosts for a Solr Type of Cloud (ex: localhost:9983).Solr LocationfalseSolr Locationtruefalsefalsef.4Specifies the value to send for the 'f.4' request parameterf.4truef.4falsefalsetrueCommit WithinThe number of milliseconds before the given update is committedCommit WithinfalseCommit WithinfalsefalsetrueContent Stream Path/update/json/docsThe path in Solr to post the ContentStreamContent Stream PathfalseContent Stream Pathtruefalsetruef.5Specifies the value to send for the 'f.5' request parameterf.5truef.5falsefalsetruef.11Specifies the value to send for the 'f.11' request parameterf.11truef.11falsefalsetruesplitSpecifies the value to send for the 'split' request parametersplittruesplitfalsefalsetrueContent-Typeapplication/jsonContent-Type being sent to SolrContent-TypefalseContent-Typetruefalsetruefalse30 secSolr TypeCloudCollectiontweetsf.9geo_s:/geof.8source_s:/sourcef.2text_t:/textf.3screenName_s:/user/screen_namef.1id:/idf.6tag_ss:/entities/hashtagsf.7originalposter_s:/retweeted_status/user/screen_namef.10coordinates_s:/coordinatesSolr Locationlocalhost:2181f.4language_s:/langCommit Within1000Content Stream Path/update/json/docsf.5twitter_created_at_dt:/created_atf.11place_s:/placesplit/Content-Typeapplication/json00 secTIMER_DRIVEN1 secPutSolrContentStreamtrueFlowFiles that failed because Solr is unreachableconnection_failuretrueFlowFiles that failed for any reason other than Solr being unreachablefailuretrueThe original FlowFilesuccessSTOPPEDfalsetrueorg.apache.nifi.processors.solr.PutSolrContentStreamca69d622-5f96-4f41-ac78-945e408470e577e7a39a-ecd8-4413-84a3-cff768e49f4d903.8317862847355629.2076492542651WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Evaluation ModeLine-by-LineLine-by-LineEntire textEntire textEntire textRun the 'Replacement Strategy' against each line separately (Line-by-Line) or buffer the entire file into memory (Entire Text) and run against that.Evaluation ModefalseEvaluation ModetruefalsefalseMaximum Buffer Size1 MBSpecifies the maximum amount of data to buffer (per file or per line, depending on the Evaluation Mode) in order to apply the replacement. If 'Entire Text' (in Evaluation Mode) is selected and the FlowFile is larger than this value, the FlowFile will be routed to 'failure'. In 'Line-by-Line' Mode, if a single line is larger than this value, the FlowFile will be routed to 'failure'. A default value of 1 MB is provided, primarily for 'Entire Text' mode. In 'Line-by-Line' Mode, a value such as 8 KB or 16 KB is suggested. This value is ignored if the <Replacement Strategy> property is set to one of: Append, Prepend, Always ReplaceMaximum Buffer SizefalseMaximum Buffer SizetruefalsefalseRegular Expression(?s:^.*$)The Search Value to search for in the FlowFile content. Only used for 'Literal Replace' and 'Regex Replace' matching strategiesSearch ValuefalseRegular ExpressiontruefalsetrueReplacement Value$1The value to insert using the 'Replacement Strategy'. Using "Regex Replace" back-references to Regular Expression capturing groups are supported, but back-references that reference capturing groups that do not exist in the regular expression will be treated as literal value. Back References may also be referenced using the Expression Language, as '$1', '$2', etc. The single-tick marks MUST be included, as these variables are not "Standard" attribute names (attribute names must be quoted unless they contain only numbers, letters, and _).Replacement ValuefalseReplacement ValuetruefalsetrueReplacement StrategyInsert the Replacement Value at the beginning of the FlowFile or the beginning of each line (depending on the Evaluation Mode). For "Line-by-Line" Evaluation Mode, the value will be prepended to each line. For "Entire Text" evaluation mode, the value will be prepended to the entire text.PrependPrependInsert the Replacement Value at the end of the FlowFile or the end of each line (depending on the Evluation Mode). For "Line-by-Line" Evaluation Mode, the value will be appended to each line. For "Entire Text" evaluation mode, the value will be appended to the entire text.AppendAppendInterpret the Search Value as a Regular Expression and replace all matches with the Replacement Value. The Replacement Value may reference Capturing Groups used in the Search Value by using a dollar-sign followed by the Capturing Group number, such as $1 or $2. If the Search Value is set to .* then everything is replaced without even evaluating the Regular Expression.Regex ReplaceRegex ReplaceSearch for all instances of the Search Value and replace the matches with the Replacement Value.Literal ReplaceLiteral ReplaceAlways replaces the entire line or the entire contents of the FlowFile (depending on the value of the <Evaluation Mode> property) and does not bother searching for any value. When this strategy is chosen, the <Search Value> property is ignored.Always ReplaceAlways ReplaceRegex ReplaceThe strategy for how and what to replace within the FlowFile's text content.Replacement StrategyfalseReplacement StrategytruefalsefalseCharacter SetUTF-8The Character Set in which the file is encodedCharacter SetfalseCharacter Settruefalsefalsefalse30 secEvaluation ModeEntire textMaximum Buffer Size1 MBRegular Expression(?s:^(.*)$)Replacement Value${twitter.tweet_id}|${twitter.unixtime}|${twitter.time}|${twitter.language}|${twitter.handle}|${twitter.time_zone}|${twitter.msg:replace('$',''):replace('\n','')}|$1Replacement StrategyCharacter SetUTF-800 secTIMER_DRIVEN1 secReplaceTexttrueFlowFiles that could not be updated are routed to this relationshipfailurefalseFlowFiles that have been successfully processed are routed to this relationship. This includes both FlowFiles that had text replaced and those that did not.successSTOPPEDtruetrueorg.apache.nifi.processors.standard.ReplaceText17f6d19f-6a6f-46df-b03d-0ebdf9313e6177e7a39a-ecd8-4413-84a3-cff768e49f4d387.96490478515625130.0WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Consumer KeyThe Consumer Key provided by TwitterConsumer KeyfalseConsumer KeytruefalsefalseIDs to FollowA comma-separated list of Twitter User ID's to follow. Ignored unless Endpoint is set to 'Filter Endpoint'.IDs to FollowfalseIDs to FollowfalsefalsefalseTwitter EndpointThe endpoint that provides public data, aka a 'garden hose'Sample EndpointSample EndpointThe endpoint that provides access to all tweetsFirehose EndpointFirehose EndpointEndpoint that allows the stream to be filtered by specific terms or User IDsFilter EndpointFilter EndpointSample EndpointSpecifies which endpoint data should be pulled fromTwitter EndpointfalseTwitter EndpointtruefalsefalseTerms to Filter OnA comma-separated list of terms to filter on. Ignored unless Endpoint is set to 'Filter Endpoint'. The filter works such that if any term matches, the status update will be retrieved; multiple terms separated by a space function as an 'AND'. I.e., 'it was, hello' will retrieve status updates that have either 'hello' or both 'it' AND 'was'Terms to Filter OnfalseTerms to Filter OnfalsefalsefalseAccess TokenThe Access Token provided by TwitterAccess TokenfalseAccess TokentruefalsefalseConsumer SecretThe Consumer Secret provided by TwitterConsumer SecretfalseConsumer SecrettruetruefalseAccess Token SecretThe Access Token Secret provided by TwitterAccess Token SecretfalseAccess Token SecrettruetruefalseLanguagesA comma-separated list of languages for which tweets should be fetchedLanguagesfalseLanguagesfalsefalsefalseLocations to Filter OnA comma-separated list of coordinates specifying one or more bounding boxes to filter on.Each bounding box is specified by a pair of coordinates in the format: swLon,swLat,neLon,neLat. Multiple bounding boxes can be specified as such: swLon1,swLat1,neLon1,neLat1,swLon2,swLat2,neLon2,neLat2.Ignored unless Endpoint is set to 'Filter Endpoint'.Locations to Filter OnfalseLocations to Filter Onfalsefalsefalsefalse30 secConsumer KeyIDs to FollowTwitter EndpointFilter EndpointTerms to Filter OnAAPL,ORCL,GOOG,MSFT,DELLAccess TokenConsumer SecretAccess Token SecretLanguagesLocations to Filter On2500 secTIMER_DRIVEN1 secGrab Garden HosefalseAll status updates will be routed to this relationshipsuccessSTOPPEDfalsetrueorg.apache.nifi.processors.twitter.GetTwitterdbbd3d99-7f11-48b5-8cb4-5f900a28616977e7a39a-ecd8-4413-84a3-cff768e49f4d383.25604248046875628.2585792541504WARN2TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Routing StrategyA copy of the FlowFile will be routed to each relationship whose corresponding expression evaluates to 'true'Route to Property nameRoute to Property nameRequires that all user-defined expressions evaluate to 'true' for the FlowFile to be considered a matchRoute to 'matched' if all matchRoute to 'match' if all matchRequires that at least one user-defined expression evaluate to 'true' for hte FlowFile to be considered a matchRoute to 'matched' if any matchesRoute to 'match' if any matchesRoute to Property nameSpecifies how to determine which relationship to use when evaluating the Expression LanguageRouting StrategyfalseRouting Strategytruefalsefalsetweettweettruetweetfalsefalsetruefalse30 secRouting StrategyRoute to Property nametweet${twitter.msg:isEmpty():not()}250 secTIMER_DRIVEN1 secFind only TweetsfalsetweettrueFlowFiles that do not match any user-define expression will be routed hereunmatchedSTOPPEDtruetrueorg.apache.nifi.processors.standard.RouteOnAttribute9d7dc3cc-734a-4340-a3a7-a88636731ae177e7a39a-ecd8-4413-84a3-cff768e49f4d1441.080831282235440.9114254672113WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Kerberos PrincipalKerberos principal to authenticate as. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesKerberos PrincipalfalseKerberos PrincipalfalsefalsefalseRemote GroupChanges the group of the HDFS file to this value after it is written. This only works if NiFi is running as a user that has HDFS super user privilege to change groupRemote GroupfalseRemote GroupfalsefalsefalseConflict Resolution StrategyreplacereplaceignoreignorefailfailfailIndicates what should happen when a file with the same name already exists in the output directoryConflict Resolution StrategyfalseConflict Resolution StrategytruefalsefalseReplicationNumber of times that HDFS will replicate each file. This overrides the Hadoop ConfigurationReplicationfalseReplicationfalsefalsefalseCompression codecNONENONEDEFAULTDEFAULTBZIPBZIPGZIPGZIPLZ4LZ4SNAPPYSNAPPYAUTOMATICAUTOMATICNONECompression codecfalseCompression codectruefalsefalseIO Buffer SizeAmount of memory to use to buffer file contents during IO. This overrides the Hadoop ConfigurationIO Buffer SizefalseIO Buffer SizefalsefalsefalseHadoop Configuration ResourcesA file or comma separated list of files which contains the Hadoop file system configuration. Without this, Hadoop will search the classpath for a 'core-site.xml' and 'hdfs-site.xml' file or will revert to a default configuration.Hadoop Configuration ResourcesfalseHadoop Configuration ResourcesfalsefalsefalseKerberos KeytabKerberos keytab associated with the principal. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesKerberos KeytabfalseKerberos KeytabfalsefalsefalsePermissions umaskA umask represented as an octal number which determines the permissions of files written to HDFS. This overrides the Hadoop Configuration dfs.umaskmodePermissions umaskfalsePermissions umaskfalsefalsefalseRemote OwnerChanges the owner of the HDFS file to this value after it is written. This only works if NiFi is running as a user that has HDFS super user privilege to change ownerRemote OwnerfalseRemote OwnerfalsefalsefalseBlock SizeSize of each block as written to HDFS. This overrides the Hadoop ConfigurationBlock SizefalseBlock SizefalsefalsefalseDirectoryThe parent HDFS directory to which files should be writtenDirectoryfalseDirectorytruefalsetrueKerberos Relogin Period4 hoursPeriod of time which should pass before attempting a kerberos reloginKerberos Relogin PeriodfalseKerberos Relogin Periodfalsefalsefalsefalse30 secKerberos PrincipalRemote GroupConflict Resolution StrategyreplaceReplication1Compression codecIO Buffer SizeHadoop Configuration Resources/etc/hadoop/conf/core-site.xmlKerberos KeytabPermissions umaskRemote OwnerBlock SizeDirectory/tmp/tweets_stagingKerberos Relogin Period00 secTIMER_DRIVEN1 secPutHDFSfalseFiles that could not be written to HDFS for some reason are transferred to this relationshipfailuretrueFiles that have been successfully written to HDFS are transferred to this relationshipsuccessSTOPPEDfalsetrueorg.apache.nifi.processors.hadoop.PutHDFS65cd8fd7-a62f-4b44-b41e-1109ce307e0377e7a39a-ecd8-4413-84a3-cff768e49f4d386.0377.9703254699707ERROR4TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?twitter.unixtimetwitter.unixtimetruetwitter.unixtimefalsefalsefalsetwitter.usertwitter.usertruetwitter.userfalsefalsefalsetwitter.msgtwitter.msgtruetwitter.msgfalsefalsefalsetwitter.tweet_idtwitter.tweet_idtruetwitter.tweet_idfalsefalsefalsetwitter.languagetwitter.languagetruetwitter.languagefalsefalsefalsetwitter.time_zonetwitter.time_zonetruetwitter.time_zonefalsefalsefalseReturn Typeauto-detectauto-detectjsonjsonscalarscalarauto-detectIndicates the desired return type of the JSON Path expressions. Selecting 'auto-detect' will set the return type to 'json' for a Destination of 'flowfile-content', and 'scalar' for a Destination of 'flowfile-attribute'.Return TypefalseReturn Typetruefalsefalsetwitter.handletwitter.handletruetwitter.handlefalsefalsefalseNull Value Representationthe string 'null'the string 'null'empty stringempty stringempty stringIndicates the desired representation of JSON Path expressions resulting in a null value.Null Value RepresentationfalseNull Value RepresentationtruefalsefalsePath Not Found BehaviorwarnwarnignoreignoreignoreIndicates how to handle missing JSON path expressions when destination is set to 'flowfile-attribute'. Selecting 'warn' will generate a warning when a JSON path expression is not found.Path Not Found BehaviorfalsePath Not Found Behaviortruefalsefalsetwitter.hashtagstwitter.hashtagstruetwitter.hashtagsfalsefalsefalsetwitter.locationtwitter.locationtruetwitter.locationfalsefalsefalseDestinationflowfile-contentflowfile-contentflowfile-attributeflowfile-attributeflowfile-contentIndicates whether the results of the JsonPath evaluation are written to the FlowFile content or a FlowFile attribute; if using attribute, must specify the Attribute Name property. If set to flowfile-content, only one JsonPath may be specified, and the property name is ignored.DestinationfalseDestinationtruefalsefalsetwitter.timetwitter.timetruetwitter.timefalsefalsefalsefalse30 sectwitter.unixtime$.timestamp_mstwitter.user$.user.nametwitter.msg$.texttwitter.tweet_id$.idtwitter.language$.langtwitter.time_zone$.user.time_zoneReturn Typeauto-detecttwitter.handle$.user.screen_nameNull Value Representationempty stringPath Not Found Behaviorignoretwitter.hashtags$.entities.hashtags[0].texttwitter.location$.user.locationDestinationflowfile-attributetwitter.time$.created_at250 secTIMER_DRIVEN1 secPull Key AttributestrueFlowFiles are routed to this relationship when the JsonPath cannot be evaluated against the content of the FlowFile; for instance, if the FlowFile is not valid JSONfailurefalseFlowFiles are routed to this relationship when the JsonPath is successfully evaluated and the FlowFile is modified as a resultmatchedtrueFlowFiles are routed to this relationship when the JsonPath does not match the content of the FlowFile and the Destination is set to flowfile-contentunmatchedSTOPPEDtruetrueorg.apache.nifi.processors.standard.EvaluateJsonPath6744869f-2185-41f0-ac62-7749cdfe0b0077e7a39a-ecd8-4413-84a3-cff768e49f4d904.5567046986291250.05827461343438WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Last Modified TimeSets the lastModifiedTime on the output file to the value of this attribute. Format must be yyyy-MM-dd'T'HH:mm:ssZ. You may also use expression language such as ${file.lastModifiedTime}.Last Modified TimefalseLast Modified TimefalsefalsetrueOwnerSets the owner on the output file to the value of this attribute. You may also use expression language such as ${file.owner}.OwnerfalseOwnerfalsefalsetrueConflict Resolution StrategyreplacereplaceignoreignorefailfailfailIndicates what should happen when a file with the same name already exists in the output directoryConflict Resolution StrategyfalseConflict Resolution StrategytruefalsefalseCreate Missing DirectoriestruetruefalsefalsetrueIf true, then missing destination directories will be created. If false, flowfiles are penalized and sent to failure.Create Missing DirectoriesfalseCreate Missing DirectoriestruefalsefalsePermissionsSets the permissions on the output file to the value of this attribute. Format must be either UNIX rwxrwxrwx with a - in place of denied permissions (e.g. rw-r--r--) or an octal number (e.g. 644). You may also use expression language such as ${file.permissions}.PermissionsfalsePermissionsfalsefalsetrueDirectoryThe directory to which files should be written. You may use expression language such as /aa/bb/${path}DirectoryfalseDirectorytruefalsetrueGroupSets the group on the output file to the value of this attribute. You may also use expression language such as ${file.group}.GroupfalseGroupfalsefalsetrueMaximum File CountSpecifies the maximum number of files that can exist in the output directoryMaximum File CountfalseMaximum File Countfalsefalsefalsefalse30 secLast Modified TimeOwnerConflict Resolution StrategyfailCreate Missing DirectoriestruePermissionsDirectory/tmp/tweetsGroupMaximum File Count00 secTIMER_DRIVEN1 secPutFiletrueFiles that could not be written to the output directory for some reason are transferred to this relationshipfailuretrueFiles that have been successfully written to the output directory are transferred to this relationshipsuccessSTOPPEDfalsetrueorg.apache.nifi.processors.standard.PutFile01/06/2016 16:48:33 UTC