gitlab搭建之旅

Rainie999

gitlab搭建之旅
　　前言：由于公司项目需求，需要自行维护一套git环境，调研了目前现有的git托管工具，最终确定使用gitlab这个开源平台。So，之后就尝试搭建一套测试环境，不过此中过程并非一帆风顺（虽早有心理准备），确是经历了一番波折。为了提高后续的部署效率，避免重复错误，在此记个随笔以备忘。
　　搭建环境：
　　服务器 -- RedHat 5.4
　　内核版本 -- linux 2.6.18 x86_64
　　参考文档：https://github.com/gitlabhq/gitlabhq/blob/stable/doc/install/installation.md 基本上是照着官方这个文档做的，不过官方文档的标准环境是debian环境，所以会有些微区别

概要：
　　gitlab的安装包括以下几步：

• 安装依赖包
  
• 安装Ruby
  
• 创建系统账户
  
• 安装Gitolite
  
• 搭建数据库环境
  
• 搭建GitLab
  
• 搭建Nginx
  

1. 安装依赖包
　　搭建gitlab环境需要安装以下库： （这些安装包都需要事先检查下，否则在后面会出现返工的问题，缺少这些包在编译ruby的时候不会报错，但是在搭建gitlab环境的时候会提示你缺少XXX库，然后还要重新编译ruby，很麻烦）



yum groupinstall "Development Tools"  #等同于 apt-get install build-essential，如果没有此group，则分别安装make.gcc,g++,libc等开发包
yum install kernel-devel kernel-headers
yum install zlib-devel.x86_64
yum install libyaml.x86_64
yum install openssl-devel.x86_64
yum install gdbm-devel.x86_64
yum install readline-devel.x86_64
yum install ncurses-devel.x86_64
yum install libffi-devel.x86_64 #可能需要手动下载rpm包安装
yum install git.x86_64
yum install curl.x86_64
yum install openssh-server.x86_64
yum install redis.x86_64
yum install postfix.x86_64
yum install libxml2-devel.x86_64
yum install libxslt-devel.x86_64
yum install curl-devel.x86_64
yum install libicu-devel.x86_64
yum install mysql-devel.x86_64

2. 安装ruby （必须是1.9.3+版本）





mkdir /tmp/ruby && cd /tmp/ruby
curl --progress http://ftp.ruby-lang.org/pub/ruby/1.9/ruby-1.9.3-p327.tar.gz | tar xz
cd ruby-1.9.3-p327
./configure
make
sudo make install

Install the Bundler Gem:




sudo gem install bundler

3.创建系统账户



sudo useradd -r -m git
sudo useradd -g git gitlab
#Add x privilege to /home/git
sudo chmod g+x /home/git

# Generate the SSH key
sudo -u gitlab -H ssh-keygen -q -N '' -t rsa -f /home/gitlab/.ssh/id_rsa
4. 安装Gitolite
　　下载gitolite的源代码



cd /home/git
sudo -u git -H git clone -b gl-v320 git://github.com/gitlabhq/gitolite.git /home/git/gitolite
　　安装gitolite



# Add Gitolite scripts to $PATH
sudo -u git -H mkdir /home/git/bin
sudo -u git -H sh -c 'printf "%b\n%b\n" "PATH=\$PATH:/home/git/bin" "export PATH" >> /home/git/.profile'
sudo -u git -H sh -c 'gitolite/install -ln /home/git/bin'
# Copy the gitlab user's (public) SSH key ...
sudo cp /home/gitlab/.ssh/id_rsa.pub /home/git/gitlab.pub
sudo chmod 0444 /home/git/gitlab.pub
# ... and use it as the admin key for the Gitolite setup
sudo -u git -H sh -c "PATH=/home/git/bin:$PATH; gitolite setup -pk /home/git/gitlab.pub"
　　配置gitolite相关路径的权限



# Make sure the Gitolite config dir is owned by git
sudo chmod 750 /home/git/.gitolite/
sudo chown -R git:git /home/git/.gitolite/
　　配置仓库路径的权限



# Make sure the repositories dir is owned by git and it stays that way
sudo chmod -R ug+rwXs,o-rwx /home/git/repositories/
sudo chown -R git:git /home/git/repositories/
sudo chmod -R ug-s /home/git/repositories/
find /home/git/repositories/ -type d -print0 | sudo xargs -0 chmod g+s
　　将域名加到gitlab账户的known_hosts列表中



sudo -u gitlab -H ssh git@localhost
sudo -u gitlab -H ssh git@YOUR_DOMAIN_NAME
sudo -u gitlab -H ssh git@YOUR_GITOLITE_DOMAIN_NAME
　　测试是否安装成功



# Clone the admin repo so SSH adds localhost to known_hosts ...
# ... and to be sure your users have access to Gitolite
sudo -u gitlab -H git clone git@localhost:gitolite-admin.git /tmp/gitolite-admin
# If it succeeded without errors you can remove the cloned repo
sudo rm -rf /tmp/gitolite-admin
　　如果测试失败，不要继续往下走，请查看https://github.com/gitlabhq/gitlab-public-wiki/wiki/Trouble-Shooting-Guide帮助解决问题

5. 搭建数据库
　　gitlab支持两种数据库：Mysql和PostgreSQL
　　Mysql：



# Install the database packages
sudo yum install mysql.x86_64 mysql-devel.x86_64 mysql-server.x86_64
# Login to MySQL
$ mysql -u root -p
# Create a user for GitLab. (change $password to a real password)
mysql> CREATE USER 'gitlab'@'localhost' IDENTIFIED BY '$password';
# Create the GitLab production database
mysql> CREATE DATABASE IF NOT EXISTS `gitlabhq_production` DEFAULT CHARACTER SET `utf8` COLLATE `utf8_unicode_ci`;
# Grant the GitLab user necessary permissopns on the table.
mysql> GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, INDEX, ALTER ON `gitlabhq_production`.* TO 'gitlab'@'localhost';
# Quit the database session
mysql> \q
# Try connecting to the new database with the new user
sudo -u gitlab -H mysql -u gitlab -p -D gitlabhq_production
　　PostgreSQL:



# Install the database packages
sudo yum install postgresql.x86_64 postgresql-devel.x86_64 postgresql-server.x86_64
# Login to PostgreSQL
sudo -u postgres psql -d template1
# Create a user for GitLab. (change $password to a real password)
template1=# CREATE USER gitlab WITH PASSWORD '$password';
# Create the GitLab production database & grant all privileges on database
template1=# CREATE DATABASE gitlabhq_production OWNER gitlab;
# Quit the database session
template1=# \q
# Try connecting to the new database with the new user
sudo -u gitlab -H psql -d gitlabhq_production
6. 搭建GitLab
　　下载代码:



# We'll install GitLab into home directory of the user "gitlab"
cd /home/gitlab
# Clone GitLab repository
sudo -u gitlab -H git clone git://github.com/gitlabhq/gitlabhq.git gitlab

# Go to gitlab dir
cd /home/gitlab/gitlab
# Checkout to stable release
sudo -u gitlab -H git checkout 4-1-stable
　　设置配置项:



cd /home/gitlab/gitlab
# Copy the example GitLab config
sudo -u gitlab -H cp config/gitlab.yml.example config/gitlab.yml
# Make sure to change "localhost" to the fully-qualified domain name of your
# host serving GitLab where necessary
sudo -u gitlab -H vim config/gitlab.yml
# Make sure GitLab can write to the log/ and tmp/ directories
sudo chown -R gitlab log/
sudo chown -R gitlab tmp/
sudo chmod -R u+rwX  log/
sudo chmod -R u+rwX  tmp/
# Make directory for satellites
sudo -u gitlab -H mkdir /home/gitlab/gitlab-satellites
# Copy the example Unicorn config
sudo -u gitlab -H cp config/unicorn.rb.example config/unicorn.rb
　　配置数据库:



# Mysql
sudo -u gitlab cp config/database.yml.mysql config/database.yml
# PostgreSQL
sudo -u gitlab cp config/database.yml.postgresql config/database.yml
　　//待续…
　　安装Gems：



cd /home/gitlab/gitlab
sudo gem install charlock_holmes --version '0.6.9'
# For MySQL (note, the option says "without")
sudo -u gitlab -H bundle install --deployment --without development test postgres
# Or for PostgreSQL
sudo -u gitlab -H bundle install --deployment --without development test mysql
　　配置Git：
　　gitlab需要能够提交代码到gitolite，所以我们需要设置一个全局的用户信息: email和username (建议直接使用config/gitlab.yml配置文件中的email.from值)



sudo -u gitlab -H git config --global user.name "GitLab"
sudo -u gitlab -H git config --global user.email "gitlab@localhost"
　　设置Gitlab的Hooks：



sudo cp ./lib/hooks/post-receive /home/git/.gitolite/hooks/common/post-receive
sudo chown git:git /home/git/.gitolite/hooks/common/post-receive
　　初始化数据库和激活高级特性：



sudo -u gitlab -H bundle exec rake gitlab:setup RAILS_ENV=production
　　安装启动脚本：



sudo curl --output /etc/init.d/gitlab https://raw.github.com/gitlabhq/gitlab-recipes/4-1-stable/init.d/gitlab
sudo chmod +x /etc/init.d/gitlab
　　检查应用状态：
　　检查gitlab和其运行环境是否配置正确：



sudo -u gitlab -H bundle exec rake gitlab:env:info RAILS_ENV=production
　　确保没有遗漏：



sudo -u gitlab -H bundle exec rake gitlab:check RAILS_ENV=production
　　如果所有的检查结果都是绿色，那个恭喜你已经成功安装了Gitlab，但是下面仍有一些工作要完成
　　启动Mysql



sudo service mysql start
# or
sudo /etc/init.d/mysql start
　　启动Redis



sudo service redis-server start
# or
sudo /etc/init.d/redis restart
　　启动GitLab



sudo service gitlab start
# or
sudo /etc/init.d/gitlab start
7. 搭建Nginx
　　安装:



sudo yum install nginx
　　设置配置文件:



#Download an example site config:
sudo curl --output /etc/nginx/conf.d/gitlab.conf https://raw.github.com/gitlabhq/gitlab-recipes/4-1-stable/nginx/gitlab

#Make sure to edit the config file to match your setup:
# Change **YOUR_SERVER_IP** and **YOUR_SERVER_FQDN**
# to the IP address and fully-qualified domain name
# of your host serving GitLab
sudo vim /etc/nginx/conf.d/gitlab.conf
　　启动Nginx:



sudo service nginx start
sudo /etc/init.d/nginx start
8. 搭建完成
　　现在你可以使用管理员账户访问你的gitlab网站了:



admin@local.host
5iveL!fe
9. FQA
　　1. 用http协议上传代码的时候会hung住，服务器也没反应？
　　这是因为客户端上传的代码太大，超过了服务器和客户端的限制
　　解决方案：
　　增加客户端的buffer大小   



git config http.postBuffer 524288000

　　增加服务端的限制  conf/gitlab.xml



git:
bin_path: /usr/bin/git
# Max size of git object like commit, in bytes
# This value can be increased if you have a very large commits
max_size: 524288000 # 500.megabytes
# Git timeout to read commit, in seconds
timeout: 10

　　2.  用http协议push时服务器报411错误
　　这是因为nginx的http头检查为通过
　　解决方案：重新编译nginx，添加chunkin-nginx-module:  https://github.com/agentzh/chunkin-nginx-module
　　3.  用http协议push时服务器包413错误
　　这是因为push文件大小超过了nginx的限制
　　解决方案：
　　修改nginx配置 /etc/nginx.conf



client_max_body_size  200M;
　　4. 在线浏览代码的时候，当遇到*.md文件，报错 DistributionNotFound: MarkupSafe>=0.9.2
　　这是因为本机的python缺少MarkupSafe库
　　解决方案：
　　从https://pypi.python.org/pypi/MarkupSafe上下载最新的库安装
　　5. 在线提交代码时报错：Gitlab::SatelliteNotExistError (Satellite doesn't exist)
　　可能是post-receive中的命令执行出错：
　　vi /home/git/.gitolite/hooks/common/post-receive , 确定redis-cli的路径正确



#!/usr/bin/env bash
# Version 4.1
# This file was placed here by GitLab. It makes sure that your pushed commits
# will be processed properly.
while read oldrev newrev ref
do
# For every branch or tag that was pushed, create a Resque job in redis.
repo_path=`pwd`
env -i /usr/local/bin/redis-cli rpush "resque:gitlab:queue:post_receive" "{\"class\":\"PostReceive\",\"args\":[\"$repo_path\",\"$oldrev\",\"$newrev\",\"$ref\",\"$GL_USER\"]}" > /dev/null 2>&1
done