reads from a directory, parses the file into segments, and sends to Solr for indexingSend HL7 Messages to Solra211bd5e-ccb8-4598-9c96-6718f6cf945b7c84501d-d10c-407c-b9f3-1d80e38fe36a886.3008422851562313.78572845458984081d527a3-5678-4c99-b847-07ec79b67804a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b08a9d0f8-7640-482c-8d60-56820c8bd8ffPROCESSOR0 sec1success0b37ddcf9-b52a-4aa8-804e-c794112f0480a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945ba1c53cab-a36a-4491-a386-d682dc84eb72PROCESSOR0 sec1success0c787ec36-1cd3-4158-8b8c-244204ec859ca211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0706.8973541259766211.4637680053711706.8973541259766261.4637680053711a211bd5e-ccb8-4598-9c96-6718f6cf945b649afa15-bb81-4cf7-abe8-8e3f84978d9ePROCESSOR0 sec1failure01d6e5381-2847-4400-8d96-d707362e64d3a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b2ecbfa8d-d307-4518-9d6e-99199e8c7a84PROCESSOR0 sec1failuresuccess0d88aec46-21b8-4d93-9389-233c21229e82a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b649afa15-bb81-4cf7-abe8-8e3f84978d9ePROCESSOR0 sec1success0e9a86b7f-36f7-42a8-8318-5db311bbb1a9a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0714.5389191962981548.1452739084466714.5389191962981598.1452739084466a211bd5e-ccb8-4598-9c96-6718f6cf945ba1c53cab-a36a-4491-a386-d682dc84eb72PROCESSOR0 sec1connection_failure0ea87ffa1-8c59-4acd-b708-144c3e3f61c2a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b2ecbfa8d-d307-4518-9d6e-99199e8c7a84PROCESSOR0 sec0success0e5d936e5-ad3f-4068-a334-47b034e04918a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b68cc4a53-4a9e-4cca-be78-28a683548c9aPROCESSOR0 sec1success05b4f1d60-d93f-4cfd-bbce-0d5a44f67e54a211bd5e-ccb8-4598-9c96-6718f6cf945b0 MB0a211bd5e-ccb8-4598-9c96-6718f6cf945b93587486-8011-4596-9dff-9d9e5e448e7cPROCESSOR0 sec1success0649afa15-bb81-4cf7-abe8-8e3f84978d9ea211bd5e-ccb8-4598-9c96-6718f6cf945b297.89735412597656186.4637680053711WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?File to Fetch${absolute.path}/${filename}The fully-qualified filename of the file to fetch from the file systemFile to FetchfalseFile to FetchtruefalsetrueCompletion StrategyLeave the file as-isNoneNoneMoves the file to the directory specified by the <Move Destination Directory> propertyMove FileMove FileDeletes the original file from the file systemDelete FileDelete FileNoneSpecifies what to do with the original file on the file system once it has been pulled into NiFiCompletion StrategyfalseCompletion StrategytruefalsefalseMove Destination DirectoryThe directory to the move the original file to once it has been fetched from the file system. This property is ignored unless the Completion Strategy is set to "Move File". If the directory does not exist, it will be created.Move Destination DirectoryfalseMove Destination DirectoryfalsefalsetrueMove Conflict StrategyThe existing destination file should remain intact. The newly ingested file should be moved to the destination directory but be renamed to a random filenameRenameRenameThe newly ingested file should replace the existing file in the Destination DirectoryReplace FileReplace FileThe existing file should in the Destination Directory should stay intact and the newly ingested file should be deletedKeep ExistingKeep ExistingThe existing destination file should remain intact and the incoming FlowFile should be routed to failureFailFailRenameIf Completion Strategy is set to Move File and a file already exists in the destination directory with the same name, this property specifies how that naming conflict should be resolvedMove Conflict StrategyfalseMove Conflict Strategytruefalsefalsefalse30 secFile to Fetch${absolute.path}/${filename}Completion StrategyDelete FileMove Destination DirectoryMove Conflict StrategyRename00 secTIMER_DRIVEN1 secFetchFilefalseAny FlowFile that could not be fetched from the file system for any reason other than insufficient permissions or the file not existing will be transferred to this Relationship.failuretrueAny FlowFile that could not be fetched from the file system because the file could not be found will be transferred to this Relationship.not.foundtrueAny FlowFile that could not be fetched from the file system due to the user running NiFi not having sufficient permissions will be transferred to this Relationship.permission.deniedfalseAny FlowFile that is successfully fetched from the file system will be transferred to this Relationship.successSTOPPEDfalsetrueorg.apache.nifi.processors.standard.FetchFile08a9d0f8-7640-482c-8d60-56820c8bd8ffa211bd5e-ccb8-4598-9c96-6718f6cf945b-247.35449413401184523.9437946136436WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Attributes ListComma separated list of attributes to be included in the resulting JSON. If this value is left empty then all existing Attributes will be included. This list of attributes is case sensitive. If an attribute specified in the list is not found it will be be emitted to the resulting JSON with an empty string or NULL value.Attributes ListfalseAttributes ListfalsefalsefalseDestinationflowfile-attributeflowfile-attributeflowfile-contentflowfile-contentflowfile-attributeControl if JSON value is written as a new flowfile attribute 'JSONAttributes' or written in the flowfile content. Writing to flowfile content will overwrite any existing flowfile content.DestinationfalseDestinationtruefalsefalseInclude Core AttributestruetruefalsefalsetrueDetermines if the FlowFile org.apache.nifi.flowfile.attributes.CoreAttributes which are contained in every FlowFile should be included in the final JSON value generated.Include Core AttributesfalseInclude Core AttributestruefalsefalseNull ValuetruetruefalsefalsefalseIf true a non existing or empty attribute will be NULL in the resulting JSON. If false an empty string will be placed in the JSONNull ValuefalseNull Valuetruefalsefalsefalse30 secAttributes ListDestinationflowfile-contentInclude Core AttributesfalseNull Valuefalse00 secTIMER_DRIVEN1 secAttributesToJSONtrueFailed to convert attributes to JSONfailurefalseSuccessfully converted attributes to JSONsuccessSTOPPEDtruetrueorg.apache.nifi.processors.standard.AttributesToJSON68cc4a53-4a9e-4cca-be78-28a683548c9aa211bd5e-ccb8-4598-9c96-6718f6cf945b-253.07370692876148349.9410311543918WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Delete Attributes ExpressionRegular expression for attributes to be deleted from flowfiles.Delete Attributes ExpressionfalseDelete Attributes ExpressionfalsefalsetruemyDatemyDatetruemyDatefalsefalsetruepatientpatienttruepatientfalsefalsetruetexttexttruetextfalsefalsetruefalse30 secDelete Attributes ExpressionmyDate${TXA.4:toDate("yyyyMMddHHmmss"):format("yyyy-MM-dd HH:mm:ss")}patient${PID.5:replaceAll('\^', ' ')}text${OBX_1.5:replaceAll('(~|\^)', ' ')}00 secTIMER_DRIVEN1 secUpdateAttributefalseAll FlowFiles are routed to this relationshipsuccessSTOPPEDtruetrueorg.apache.nifi.processors.attributes.UpdateAttribute25896a03-a296-4149-a5ef-3ec9679f8284a211bd5e-ccb8-4598-9c96-6718f6cf945b-246.97191689021633704.4929698125834WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?CommandSpecifies the command to be executed; if just the name of an executable is provided, it must be in the user's environment PATH.CommandfalseCommandtruefalsefalseCommand ArgumentsThe arguments to supply to the executable delimited by white space. White space can be escaped by enclosing it in double-quotes.Command ArgumentsfalseCommand ArgumentsfalsefalsefalseBatch DurationIf the process is expected to be long-running and produce textual output, a batch duration can be specified so that the output will be captured for this amount of time and a FlowFile will then be sent out with the results and a new FlowFile will be started, rather than waiting for the process to finish before sending out the resultsBatch DurationfalseBatch DurationfalsefalsefalseRedirect Error StreamtruetruefalsefalsefalseIf true will redirect any error stream output of the process to the output stream. This is particularly helpful for processes which write extensively to the error stream or for troubleshooting.Redirect Error StreamfalseRedirect Error StreamfalsefalsefalseArgument DelimiterDelimiter to use to separate arguments for a command [default: space]. Must be a single character.Argument DelimiterfalseArgument Delimitertruefalsefalsefalse30 secCommand/usr/lib/jvm/jre-1.8.0/bin/javaCommand Arguments -cp /var/ftp/pub/hl7-generator-1.0-SNAPSHOT-shaded.jar com.hortonworks.example.Main 10 /tmp/hl7-messagesBatch DurationRedirect Error StreamArgument Delimiter01 secTIMER_DRIVEN1 secExecuteProcessfalseAll created FlowFiles are routed to this relationshipsuccessSTOPPEDfalsetrueorg.apache.nifi.processors.standard.ExecuteProcessefcd50a8-1b6e-4871-885c-a44aca4c92eca211bd5e-ccb8-4598-9c96-6718f6cf945b-248.8973388671875186.16737365722656WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Input DirectoryThe input directory from which files to pull filesInput DirectoryfalseInput DirectorytruefalsetrueRecurse SubdirectoriestruetruefalsefalsetrueIndicates whether to list files from subdirectories of the directoryRecurse SubdirectoriesfalseRecurse SubdirectoriestruefalsefalseFile Filter[^\.].*Only files whose names match the given regular expression will be picked upFile FilterfalseFile FiltertruefalsefalsePath FilterWhen Recurse Subdirectories is true, then only subdirectories whose path matches the given regular expression will be scannedPath FilterfalsePath FilterfalsefalsefalseMinimum File Age0 secThe minimum age that a file must be in order to be pulled; any file younger than this amount of time (according to last modification date) will be ignoredMinimum File AgefalseMinimum File AgetruefalsefalseMaximum File AgeThe maximum age that a file must be in order to be pulled; any file older than this amount of time (according to last modification date) will be ignoredMaximum File AgefalseMaximum File AgefalsefalsefalseMinimum File Size0 BThe minimum size that a file must be in order to be pulledMinimum File SizefalseMinimum File SizetruefalsefalseMaximum File SizeThe maximum size that a file can be in order to be pulledMaximum File SizefalseMaximum File SizefalsefalsefalseIgnore Hidden FilestruetruefalsefalsetrueIndicates whether or not hidden files should be ignoredIgnore Hidden FilesfalseIgnore Hidden Filestruefalsefalsefalse30 secInput Directory/tmp/hl7-messages/Recurse SubdirectoriestrueFile Filter[^\.].*Path FilterMinimum File Age0 secMaximum File AgeMinimum File Size0 BMaximum File SizeIgnore Hidden Filestrue00 secTIMER_DRIVEN1 secListFilefalseAll FlowFiles that are received are routed to successsuccessSTOPPEDfalsefalseorg.apache.nifi.processors.standard.ListFile2ecbfa8d-d307-4518-9d6e-99199e8c7a84a211bd5e-ccb8-4598-9c96-6718f6cf945b312.10374450683594691.4822463989258WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Log LeveltracetracedebugdebuginfoinfowarnwarnerrorerrorinfoThe Log Level to use when logging the AttributesLog LevelfalseLog LeveltruefalsefalseLog PayloadtruetruefalsefalsefalseIf true, the FlowFile's payload will be logged, in addition to its attributes; otherwise, just the Attributes will be logged.Log PayloadfalseLog PayloadtruefalsefalseAttributes to LogA comma-separated list of Attributes to Log. If not specified, all attributes will be logged.Attributes to LogfalseAttributes to LogfalsefalsefalseAttributes to IgnoreA comma-separated list of Attributes to ignore. If not specified, no attributes will be ignored.Attributes to IgnorefalseAttributes to IgnorefalsefalsefalseLog prefixLog prefix appended to the log lines. It helps to distinguish the output of multiple LogAttribute processors.Log prefixfalseLog prefixfalsefalsetruefalse30 secLog LevelinfoLog PayloadfalseAttributes to LogAttributes to IgnoreLog prefix00 secTIMER_DRIVEN1 secLogAttributetrueAll FlowFiles are routed to this relationshipsuccessSTOPPEDtruetrueorg.apache.nifi.processors.standard.LogAttributea1c53cab-a36a-4491-a386-d682dc84eb72a211bd5e-ccb8-4598-9c96-6718f6cf945b305.53891919629814523.1452739084466WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Solr TypeA SolrCloud instance.CloudCloudA stand-alone Solr instance.StandardStandardStandardThe type of Solr instance, Cloud or Standard.Solr TypefalseSolr TypetruefalsefalseSolr LocationThe Solr url for a Solr Type of Standard (ex: http://localhost:8984/solr/gettingstarted), or the ZooKeeper hosts for a Solr Type of Cloud (ex: localhost:9983).Solr LocationfalseSolr LocationtruefalsefalseCollectionThe Solr collection name, only used with a Solr Type of CloudCollectionfalseCollectionfalsefalsetrueContent Stream Path/update/json/docsThe path in Solr to post the ContentStreamContent Stream PathfalseContent Stream PathtruefalsetrueContent-Typeapplication/jsonContent-Type being sent to SolrContent-TypefalseContent-TypetruefalsetrueCommit WithinThe number of milliseconds before the given update is committedCommit WithinfalseCommit Withinfalsefalsetruef.1Specifies the value to send for the 'f.1' request parameterf.1truef.1falsefalsetruef.2Specifies the value to send for the 'f.2' request parameterf.2truef.2falsefalsetruef.4Specifies the value to send for the 'f.4' request parameterf.4truef.4falsefalsetruef.7Specifies the value to send for the 'f.7' request parameterf.7truef.7falsefalsetruesplitSpecifies the value to send for the 'split' request parametersplittruesplitfalsefalsetruefalse30 secSolr TypeCloudSolr Locationlocalhost:2181Collectionhl7_messagesContent Stream Path/update/json/docsContent-Typeapplication/jsonCommit Within1000f.1patient_s:/patientf.2visit_date_dt:/myDatef.4note_txt:/textf.7insert_date_dt:/file.creationTimesplit/00 secTIMER_DRIVEN1 secPutSolrContentStreamfalseFlowFiles that failed because Solr is unreachableconnection_failurefalseFlowFiles that failed for any reason other than Solr being unreachablefailurefalseThe original FlowFilesuccessSTOPPEDfalsetrueorg.apache.nifi.processors.solr.PutSolrContentStream93587486-8011-4596-9dff-9d9e5e448e7ca211bd5e-ccb8-4598-9c96-6718f6cf945b298.4203796386719329.9868392944336WARN1TIMER_DRIVEN1EVENT_DRIVEN0CRON_DRIVEN1TIMER_DRIVEN0 secCRON_DRIVEN* * * * * ?Character EncodingUTF-8The Character Encoding that is used to encode the HL7 dataCharacter EncodingfalseCharacter Encodingtruefalsetruefalse30 secCharacter EncodingUTF-800 secTIMER_DRIVEN1 secExtractHL7AttributestrueA FlowFile is routed to this relationship if it cannot be mapped to FlowFile Attributes. This would happen if the FlowFile does not contain valid HL7 datafailurefalseA FlowFile is routed to this relationship if it is properly parsed as HL7 and its attributes extractedsuccessSTOPPEDfalsetrueorg.apache.nifi.processors.hl7.ExtractHL7Attributes0000HL707c84501d-d10c-407c-b9f3-1d80e38fe36aNiFi Flow0802/29/2016 04:21:39 UTC