Operator Matrix
Operator Categories
Source & Sink Operators
All source/sink operators share the same UI pattern — config is driven dynamically by the backend configSchema.
| Operator | Category | SVG Icon | Config Panel | Config Source |
|---|---|---|---|---|
| Kafka | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| JDBC / Database | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| File | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| REST API | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Dragonfly | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| AWS S3 | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Azure Data Lake | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Snowflake | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Ceph | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| HDFS | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| FTP | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| OpenSearch | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Apache Paimon | SOURCE / SINK | Yes | FormRenderer | Dynamic from backend |
| Lookup | SOURCE only | Yes | FormRenderer | Dynamic from backend |
Processor Operators
| Operator | SVG Icon | Config Panel | Logic Editor | SQL Parser |
|---|---|---|---|---|
| Transformer | Yes | Yes | SQL + Visual Builder + Expression | Implemented |
| Filter | Yes | Yes | SQL + Visual Builder | Implemented (via transformer) |
| Aggregator | Yes | Yes | Visual Builder (AggregationBuilder) | TODO |
| Joiner | Yes | Yes | Visual Builder (JoinMappingTable) | TODO |
| Router | Yes | Yes | Condition builder | N/A |
| Schema Mapper | Yes | Yes | Mapping table | N/A |
| Enrichment | Yes | Yes | Lookup config | N/A |
| SQL Script | Yes | Yes | Monaco SQL editor (multi-output) | N/A |
| Decision | Yes | Yes | Condition builder | TODO |
| Lookup | Yes | Yes | Visual Builder (LookupOutputPanel) | N/A |
| Union | Yes | Yes | Visual Builder (UnionOutputPanel) | TODO |
warning
4 SQL parsers are TODO stubs: Decision, Aggregator, Join, Union. Only the Transformer parser is fully implemented.
Tester Operators
| Operator | SVG Icon | Config Panel | Integration |
|---|---|---|---|
| Data Generator | Yes | SDG generator selector | Full SDG service integration |
Configuration Stages per Category
All operators go through a multi-stage configuration flow in the OperatorConfigPanel:
| Stage | SOURCE | PROCESSOR | SINK | TESTER |
|---|---|---|---|---|
| Info (name, description, tags) | Yes | Yes | Yes | Yes |
| Input (schema selection) | Yes | Yes | Yes* | Yes |
| Logic (SQL / visual / expressions) | — | Yes | — | — |
| Output (schema definition) | Yes | Yes | Yes | — |
| Config (operator-specific settings) | Yes | Yes | Yes | Yes |
| Rejection (DLQ config) | Yes | Yes | — | — |
| Preview (test data) | Yes | — | Yes | Yes |
| Tester (SDG generator) | — | — | — | Yes |
*Sink input comes from upstream operator output.
Static Assets
Operator SVG icons are in public/assets/images/adaptors/:
| Category | Icons |
|---|---|
source/ | 15 SVG icons |
sink/ | 14 SVG icons |
processor/ | 11 SVG icons (transformer, filter, aggregator, joiner, router, schema-mapper, enrichment, sql-script, decision, lookup, union) |