在虚拟机中配置FastDFS+Nginx模块

kingforce

　　先上部署图

　　提示一下, ip 192.168.72.138 上面部署了两个group, 分别为 group1和g2. 另外, 同组之内的 port 要保持一致.
　　
一.安装准备
1. #每台机器都添加两个用户 fastdfs 和  nginx
useradd fastdfs -M -s /sbin/nologin & useradd nginx -M -s /sbin/nologin
2. #为了方便测试 请关闭防火墙
service iptables stop && chkconfig iptables off
3.本次采用的架构
IP安装组件添加用户
tracker192.168.72.140libfastcommonfastdfsNginx(用作反向代理)useradd fastdfs -M -s /sbin/nologin & useradd nginx -M -s /sbin/nologin
storage 192.168.72.138libfastcommonfastdfsNginx(用作接受请求)fastdfs-nginx-moduleuseradd fastdfs -M -s /sbin/nologin & useradd nginx -M -s /sbin/nologin
192.168.72.139libfastcommonfastdfsNginx(用作接受请求)fastdfs-nginx-moduleuseradd fastdfs -M -s /sbin/nologin & useradd nginx -M -s /sbin/nologin
　　
　　二. 使用余庆的安装包, 进行 libfastcommon 和 FastDFS 安装
1. cd /usr/local/src/
2. unzip libfastcommon-master.zip
3. cd libfastcommon-master
4. ./make.sh
5. ./make.sh install
6. cd ..
7. tar xzf FastDFS_v5.05.tar.gz
8. cd FastDFS
9. ./make.sh
10. ./make.sh install
　　11.相关文件的下载链接:
　　nginx-1.7.8.tar.gz
　　libfastcommon-master.zip
　　fastdfs-nginx-module_v1.16.tar.gz
　　FastDFS_v5.05.tar.gz
　　三. 安装 Nginx
1.在 tracker 上安装 Nginx
#安装 Nginx 依赖包, 可以先配置Nginx,如果配置不成功再安装依赖包
1. yum install –y openssl-devel pcre-devel zlib-devel
2. cd /usr/local/src/
3. tar xf nginx-1.7.8.tar.gz
4. cd nginx-1.7.8
5. ./configure --user=nginx --group=nginx --prefix=/usr/local/nginx  #配置Nginx
6. make && make install

2.在 storage 上安装 Nginx
#安装 Nginx 依赖包, 可以先配置Nginx,如果配置不成功再安装依赖包
1. yum install –y openssl-devel pcre-devel zlib-devel
2. cd /usr/local/src/
3. tar xzf fastdfs-nginx-module_v1.16.tar.gz
4.#默认prefix安装路径为/usr（可以从FastDFS下的make.sh中找到）,需要删除多余的/local路径
#需要修改 fastdfs-nginx-module/src/config ,
#把  CORE_INCS="$CORE_INCS /usr/local/include/fastdfs /usr/local/include/fastcommon/" 改为 CORE_INCS="$CORE_INCS /usr/include/fastdfs /usr/include/fastcommon/"

5. tar xzf nginx-1.7.8.tar.gz
6. cd nginx-1.7.8
7. ./configure --user=nginx --group=nginx --prefix=/usr/local/nginx --add-module=../fastdfs-nginx-module/src  #配置Nginx
8. make
9. 如果第7步不成功, 就执行
yum groupinstall"Development Tools"
ldd $(which /usr/local/nginx/sbin/nginx)
10. make install
11. #修改 Nginx 配置文件,
vi /usr/local/nginx/conf/nginx.conf
添加:
location /group1/M00 {
alias /home/data/fdfs/data;
ngx_fastdfs_module;
}
12.使用linx命令把 FastDFS/conf 中的 anti-steal.jpg/http.conf/mie.types/storage-ids.conf 复制到 /etc/fdfs/
使用linx命令把 fastdfs-nginx-module/src/mod_fastdfs.conf 复制到 /etc/fdfs/

13. 启动 Nginx
cd /usr/local/nginx/sbin
~./nginx

四. 配置 tracker 和 storage
1. 配置 tracker (192.168.72.140)
mkdir /home/data/fdfs -p
#复制一个配置文件
cp /etc/fdfs/tracker.conf.sample /etc/fdfs/tracker.conf
#修改 base_path=/mnt/fastdfs_tracker
vim /etc/fdfs/tracker.conf

使用linx命令把 FastDFS/conf 中的 anti-steal.jpg/http.conf/mie.types/storage-ids.conf 复制到 /etc/fdfs/

#启动 tracker
fdfs_trackerd /etc/fdfs/tracker.conf
#错误日志保存在：
/mnt/fastdfs_tracker/logs/tracker.log

配置 Nginx, 使用 tracker 上的 nginx 作反向代理
user nginx nginx; //此处为已经建立好的用户 和分组
worker_processes 2;
pid /usr/local/nginx/logs/nginx.pid;
worker_rlimit_nofile 1024;
events {
use epoll; // epoll是Linux内核为处理大批量文件描述符而作了改进的poll
worker_connections 1024;
}
　　http {
include mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log /usr/local/nginx/logs/access.log main;

upstream server_g1{
server 192.168.72; //这里配置的是storage的IP 可以配多台
server 192.168.80.102:80;
}
　　server {
listen 80;
server_name localhost;
location /g1 {
proxy_redirect off;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_pass http://server_g1;
}
}
}
　　
　　

2. 配置 storage (192.168.72.138 和 192.168.72.139)
mkdir /home/data/fdfs -p
#复制一个配置文件
cp /etc/fdfs/storage.conf.sample /etc/fdfs/storage.conf
#修改配置 /etc/fdfs/storage.conf
group_name=group1
port=23000 #端口号, 注意,每个组内的port要使用同一个端口号
base_path=/home/data/fdfs
store_path0=/home/data/fdfs
tracker_server=192.168.72.140:22122

修改 /etc/fdfs/mod_fastdfs.conf
base_path=/home/data/fdfs
tracker_server=192.168.72.140:22122
group_name=group1
url_have_group_name = true
store_path0=/home/data/fdfs
ln -s /home/data/fdfs/data /home/data/fdfs/data/M00


#启动 storage
fdfs_storaged /etc/fdfs/storage.conf
#错误日志保存在：
/mnt/fastdfs_storage_info/logs/storage.log

vim /etc/rc.d/rc.local
添加一行
fdfs_storaged /etc/fdfs/storage.conf

3. 如果同一台服务器上配置添加一个组, 需要在 /etc/fdfs/mod_fastdfs.conf 增加一个 group 节
如:
[group2]
group_name=g2
storage_server_port=23001
store_path_count=1
store_path0=/home/data/fdfs_g2
4. /etc/fdfs/clinet.conf 里面一般配置 tracker_server=192.168.72.140:22122 和 load_fdfs_parameters_from_tracker=true 就可以了

5. 启动
启动 tracker: fdfs_trackerd /etc/fdfs/tracker.conf
/usr/local/nginx/sbin/nginx
iptables -A INPUT -m state --state NEW -m tcp -p tcp --dport 22122 -j ACCEPT && /etc/init.d/iptables save

逐个启动 storage: fdfs_storaged /etc/fdfs/storage
/usr/local/nginx/sbin/nginx
iptables -A INPUT -m state --state NEW -m tcp -p tcp --dport 23000 -j ACCEPT && /etc/init.d/iptables save
6.添加启动项:
修改 /etc/rc.d/rc.local,添加内容:
192.168.72.140: fdfs_trackerd /etc/fdfs/tracker.conf
192.168.72.138: fdfs_storaged /etc/fdfs/storage.conf
fdfs_storaged /etc/fdfs/storage_g2.conf
192.168.72.139: fdfs_storaged /etc/fdfs/storage.conf
192.168.72.141: fdfs_storaged /etc/fdfs/storage.conf

#调整防火墙的规则,开放端口:23000
  iptables -A INPUT -m state --state NEW -m tcp -p tcp --dport 23001 -j ACCEPT && /etc/init.d/iptables save
  
五. 测试
1. 在 tracker(192.168.72.140) 上启动 tracker，nginx
service fdfs_trackerd start
/usr/local/nginx/sbin/nginx
　　2. 在 storage(192.168.72.138, 139)上面分别启动storage和nginx
service fdfs_storaged start
/usr/local/nginx/sbin/nginx
　　3. 在tracker上配置一个client
vim /etc/fdfs/client.conf
base_path=/mnt/fastdfs_tracker
tracker_server=192.168.70.140:22122
　　4. 查看集群详细
fdfs_monitor /etc/fdfs/client.conf

5. 测上传
fdfs_upload_file /etc/fdfs/client.conf aa.jpg

6. 通过浏览器访问
http://192.168.80.101/g1/M00/AC/2F/wKgKDVMppoGAMCFNAAIFvJcyojY165.jpg
　　http://192.168.80.102/g1/M00/AC/2F/wKgKDVMppoGAMCFNAAIFvJcyojY165.jpg

六. 命令详解
1.Tracker server启动
/usr/local/FastDFS/bin/fdfs_trackerd /etc/fdfs/tracker.conf

2. Storage server启动
/usr/local/FastDFS/bin/fdfs_storaged /etc/fdfs/storage.conf
　　3. 查看是否启动成功
netstat -ntpl | grep fdfs
　　4. Storage server 上面启动 Nginx
cd /usr/local/nginx/sbin
~./nginx

5. 不打开直接下载文件：
Nginx.conf
location/
{
if($request_filename ~* ^.*?\.(txt|doc|pdf|rar|gz|zip|docx|exe|xlsx|ppt|pptx)$){
add_headerContent-Disposition: 'attachment;';
}
}

#调整防火墙的规则,开放端口:22122
  iptables -A INPUT -m state --state NEW -m tcp -p tcp --dport 22122 -j ACCEPT && /etc/init.d/iptables save

#调整防火墙的规则,开放端口:23000
  iptables -A INPUT -m state --state NEW -m tcp -p tcp --dport 23000 -j ACCEPT && /etc/init.d/iptables save
  
#启动tracker进程:
  /etc/init.d/fdfs_trackerd start

#查看trackerd状态:
  /etc/init.d/fdfs_trackerd status

#查看trackerd监听的端口:
  netstat -plantu | grep tracker

#启动Storage进程:
  /etc/init.d/fdfs_storaged start

#查看Storage进程:
  ps -ef | grep storaged | grep -v grep


七. 到此安装结束
IP配置文件base_pathstore_path0port启动命令group_nametracker_server
trackerCentOS_64_1192.168.72.140/etc/fdfs/tracker.conf /home/data/fdfs/home/data/fdfs22122fdfs_storaged 配置文件
storage CentOS_64_2192.168.72.138/etc/fdfs/storage.conf /home/data/fdfs/home/data/fdfs23000fdfs_storaged 配置文件group1192.168.70.140:22122
CentOS_64_4192.168.72.139/etc/fdfs/storage.conf /home/data/fdfs/home/data/fdfs23000fdfs_storaged 配置文件group1192.168.70.140:22122

CentOS_64_2192.168.72.138/etc/fdfs/storage_g2.conf /home/data/fdfs_g2/home/data/fdfs_g223001fdfs_storaged 配置文件g2192.168.70.140:22122
CentOS_64_5192.168.72.141/etc/fdfs/storage.conf /home/data/fdfs/home/data/fdfs23001fdfs_storaged 配置文件g2192.168.70.140:22122
Nginx 安装在各自机器的目录:/usr/local/nginx/
　　
八. 其它
将tracker交给service管理并且设置开机启动
echo fdfs_trackerd /etc/fdfs/tracker.conf >> /etc/rc.d/rc.local

去掉 #号注释
grep -v '^#' /etc/fdfs/tracker.conf |grep -v '^$' > a.txt
　　
user nginx nginx; //此处为已经建立好的用户 和分组
worker_processes 2;
pid /usr/local/nginx/logs/nginx.pid;
worker_rlimit_nofile 1024;
events {
use epoll; // epoll是Linux内核为处理大批量文件描述符而作了改进的poll
worker_connections 1024;
}
　　http {
include mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log /usr/local/nginx/logs/access.log main;
upstream server_g1{
server 192.168.80.101:80; //这里配置的是storage的IP 可以配多台
server 192.168.80.102:80;
}
　　server {
listen 80;
server_name localhost;
location /g1 {
proxy_redirect off;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_pass http://server_g1;
}
}
}
　　
　　本机复制到远程机器
scp [可选参数] file_source file_target   -r 复制目录
scp /usr/java/jdk1.6.0_22/jre/lib/fonts/fallback/* root@192.168.4.29:/usr/java/jdk16/jre/lib/fonts/fallback/
从远程机器复制到本机
scp 本地用户名 @IP 地址 : 文件名 1 远程用户名 @IP 地址 : 文件名 2
　　
　　
　　大家如果在配置过程中有疑问,可以问我 qq: wujialongcn@126.com