ML Developer Manual
DL Developer Manual
DP Developer Manual
Library Search
Options
Case Sensitive
Type
All
Heading
Code
Table
Figure
Text
Introduction
Legal Disclaimer
User Target
Manual Configuration
Notation Conventions
Additional Description and Guidance
Revision History
1.
Overview
1.1
Overview and Purpose of Use
1.2
System Requirement
1.3
Related Terms
2.
Develop NiFi Custom Processor
2.1
Major Nifi Properties
2.2
Custom Processor Development Tip
2.3
Develop Custom Processor
Develop Processor
Test Case
Add Meta Information
3.
NiFi Controller Service Dependency
3.1
Use Nifi-related Controller Service
nifi-site-nar
nifi-site-processors
3.2
Use Kylo-related Controller Service
nifi-site-nar
nifi-site-processors
4.
NiFi Concurrent Tasks Guide
4.1
Concurrent Tasks
4.2
Things to be cautious when creating the Custom Processor
4.3
Supplement
5.
Example of NiFi Template Development
5.1
Write Template (Using Reusable Template)
Create Collection Template
Collect and Connect Data Source
Preprocess Data
Initialize Feed Parameters
Add Attribute Tasks
Output port (ingest)
Trigger Cleanup
Initialize Cleanup Parameters
Output port (cleanup)
Register NiFi Template
5.2
Template Example (Basic Template)
Write Nifi Flow
Get File
Convert Csv To ORC
Update Attribute
Drop Table (Execute HQL Statement)
Create Table (Execute HQL Statement)
Put Hdfs
Analyze Table
Register Template
Check Execution Result
Check HDFS
Check Table Contents on the DP Screen
5.3
Template Example (Distributed Processing)
Clustering Publish Template
Execute SQL
Scheduling : Set Execution as the Primary Node
Properties
Split Avro
Convert Avro To JSON
Evaluate Json Path
Publish Kafka_0_10
Clustering Consume Template for Data Ingest
Consume Kafka_0_10
6.
Develop Spark Custom Function
6.1
Develop
Data Types
6.2
Function Definition
Write Tern JSON File
Spark Conversion String Syntax
Add Function Library
6.3
Check Function
7.
REST API Link Guide
7.1
REST API List
7.2
Major REST API
Base URL
Category API
Feed & Execution API
Datasource & Catalog API
2.
Develop NiFi Custom Processor
No Caption
No Caption
No Caption
5.
Example of NiFi Template Development
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
No Caption
6.
Develop Spark Custom Function
No Caption
No Caption
No Caption
Brightics DP v3.8 Application Developer Manual
