Advertisement

Flume--Flume安装+nc测试

阅读量:

Flume安装教程

1.获取资源

链接: https://pan.baidu.com/s/10fpZ0Iq2G96Z6PdEgzTAHw

提取码: gx8b

2.解压并移动 flume 安装包
复制代码
    tar -zxf flume-ng-1.6.0-cdh5.14.2.tar.gz
    mv apache-flume-1.6.0-cdh5.14.2-bin/ soft/flume160
3.修改包下相关配置文件
复制代码
    #进入conf目录
    cd /opt/soft/flume160/conf
    
    #复制env备份文件,形成正式文件
    cp flume-env.sh.template flume-env.sh
    
    #进入env文件,修改配置信息
    vi flume-env.sh
    ==>(添加信息)
    export JAVA_HOME=/opt/soft//opt/soft/jdk180	//注意核对自己jdk的地址
4.测试 flume版本信息
复制代码
    #进入bin目录
    cd ../bin
    ./flume-ng version
    ==>(命令反馈信息)
    Flume 1.6.0-cdh5.14.2
    Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git
    Revision: 50436774fa1c7eaf0bd9c89ac6ee845695fbb687
    Compiled by jenkins on Tue Mar 27 13:55:10 PDT 2018
    From source with checksum 30217fe2b34097676ff5eabb51f4a11d
5.修改环境变量配置文件,并初始化(使命令可以全局使用)
复制代码
    #添加环境变量
    vi /etc/profile
    ==>(添加信息)
    export FLUME_HOME=/opt/soft/flume160
    export PATH=$PATH:$FLUME_HOME/bin	//注意核对自己的相关地址
    
    #激活环境变量
    source /etc/profile
6.全局变量测试
复制代码
    #任意目录下测试命令
    flume-ng version
    ==>(命令反馈)
    Flume 1.6.0-cdh5.14.2
    Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git
    Revision: 50436774fa1c7eaf0bd9c89ac6ee845695fbb687
    Compiled by jenkins on Tue Mar 27 13:55:10 PDT 2018
    From source with checksum 30217fe2b34097676ff5eabb51f4a11d
7.恭喜你安装成功!!!

Flume数据收集测试(想要测试的可以继续)

复制代码
下载 ncat (模拟输入端的小程序)
    yum install nmap-ncat.x86_64 -y
    
    2.新建配置文件目录,并添加Agent参数(配置信息可以去官网上复制)
    mkdir /opt/flumeconf
    cd /opt/flumeconf/
    vi conf_0804_simple.properties
    ==>
    # example.conf: A single-node Flume configuration
    
    # Name the components on this agent
    a1.sources = r1
    a1.sinks = k1
    a1.channels = c1
    
    # Describe/configure the source
    a1.sources.r1.type = netcat
    a1.sources.r1.bind = 192.168.56.104	//一定要修改成主机ip
    a1.sources.r1.port = 6666	//设置一个数据监控的端口号,注意端口号不能重复,并且不能超过65536
    
    # Describe the sink
    a1.sinks.k1.type = logger
    
    # Use a channel which buffers events in memory
    a1.channels.c1.type = memory
    a1.channels.c1.capacity = 1000
    a1.channels.c1.transactionCapacity = 100
    
    # Bind the source and sink to the channel
    a1.sources.r1.channels = c1
    a1.sinks.k1.channel = c1
    
    3.启动flume
    flume-ng agent -n a1 -c conf -f /opt/flumeconf/conf_0804_simple.properties -Dflume.root.logger=INFO,console
    
    4.另起窗口,启动nc
    nc 192.168.56.104 6666
    
    5.随意在nc窗口输入字符,回车,查看flume窗口是否可以监控到数据

全部评论 (0)

还没有任何评论哟~