6.Flume Channel Selectors

r囧r小猫 2022-06-14 01:40 164阅读 0赞

### Flume Channel Selectors ###

If the type is not specified, then defaults to “replicating”.

#### Replicating Channel Selector (default) ####

Required properties are in **bold**.

Example for agent named a1 and it’s source called r1:

a1.sources = r1
    a1.channels = c1 c2 c3
    a1.sources.r1.selector.type = replicating
    a1.sources.r1.channels = c1 c2 c3
    a1.sources.r1.selector.optional = c3

In the above configuration, c3 is an optional channel. Failure to write to c3 is simply ignored. Since c1 and c2 are not marked optional, failure to write to those channels will cause the transaction to fail.

#### Multiplexing Channel Selector ####

Required properties are in **bold**.

<table style="border:0px; border-collapse:collapse">      
 <thead> 
  <tr> 
   <th style="text-align:left; padding:1px 8px 1px 5px; background-color:rgb(238,221,238); border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> Property Name</th> 
   <th style="text-align:left; padding:1px 8px 1px 5px; background-color:rgb(238,221,238); border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> Default</th> 
   <th style="text-align:left; padding:1px 8px 1px 5px; background-color:rgb(238,221,238); border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> Description</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> selector.type</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> replicating</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> The component type name, needs to be&nbsp;<span>multiplexing</span></td> 
  </tr> 
  <tr> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> selector.header</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> flume.selector.header</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> &nbsp;</td> 
  </tr> 
  <tr> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> selector.default</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> –</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> &nbsp;</td> 
  </tr> 
  <tr> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> selector.mapping.*</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> –</td> 
   <td style="padding:1px 8px 1px 5px; border-width:0px 0px 1px; border-top-style:initial; border-top-color:initial; border-left-style:initial; border-left-color:initial; border-right-style:initial; border-right-color:initial; border-bottom-style:solid; border-bottom-color:rgb(170,170,170)"> &nbsp;</td> 
  </tr> 
 </tbody> 
</table>

Example for agent named a1 and it’s source called r1:

a1.sources = r1
    a1.channels = c1 c2 c3 c4
    a1.sources.r1.selector.type = multiplexing
    a1.sources.r1.selector.header = state
    a1.sources.r1.selector.mapping.CZ = c1
    a1.sources.r1.selector.mapping.US = c2 c3
    a1.sources.r1.selector.default = c4

#### Custom Channel Selector ####

A custom channel selector is your own implementation of the ChannelSelector interface. A custom channel selector’s class and its dependencies must be included in the agent’s classpath when starting the Flume agent. The type of the custom channel selector is its FQCN.

Example for agent named a1 and its source called r1:

a1.sources = r1
    a1.channels = c1
    a1.sources.r1.selector.type = org.example.MyChannelSelector