Another How to Install MogileFS

桐华3116

　　coofucoo: because china government block this tech site, i access itvery slow. So i copy the content from offical wiki to make me and youconveniently.
　　This is created from a bunch of sources. You may notice that some ofit comes from the other How To. I have tested this many times and itworks great!
　　Doug Kersten
　　INSTALLING MOGILEFS
　　If you haven't already done so add user mogilefsd:
　　adduser mogilefsd
　　mkdir /etc/mogilefs
　　cd /etc/mogilefs
　　Apt-get install subversion
　　svn checkout http://code.sixapart.com/svn/mogilefs/trunk/
　　now you have the code.
　　apt-get install liblinux-aio-perl
　　apt-get install libbsd-resource-perl
　　apt-get install libcompress-zlib-perl
　　apt-get install libnet-netmask-perl
apt-get install libio-stringy-perl
apt-get install libwww-perl
　　perl -MCPAN -e shell;
　　Answer default to all questions until you get to the locationinformation and then choose your country and then your default ftp site.
　　at the > prompt do this:
　　install X::Y
　　Do this with the following:
　　install Danga::Socket
　　install DBI
　　Where X::Y is the name of the missing module.  You may have to do this several
　　times.
　　exit
　　Install PerlBal
　　Mkdir /etc/perlbal
　　cd /etc/perlbal
　　svn checkout http://code.sixapart.com/svn/perlbal/trunk
　　cd /etc/perlbal/trunk
　　perl Makefile.PL
　　make
make test
　　make install
　　Install MogileFS (mogilefsd and mogstored)
　　cd /etc/mogilefs/trunk/server
　　perl Makefile.PL
　　make
　　make install
　　now as root
　　mkdir /var/mogdata/dev1
　　As you add more devices add more of these directories
　　Now for the interesting part.
　　Install Mogadm (Mogile Utilities):
　　cd /etc/mogilefs/trunk/utils
　　perl Makefile.PL
　　make
　　make install
　　CREATE MYSQL DATABASE
　　You should have mysql installed.  I'm going to assume you do.
　　Using phpadmin create a mog user (mog_user)
　　create a password for mog user (mogpass)
　　OR
　　Grant access to remote user by doing:
$> mysql -u root -prootpassword
　　$> GRANT usage ON .to mog_user@www.domainname.com (put the correct user/domain(source) here)
$> IDENTIFIED BY 'mogpassword';
　　$> GRANT ALL PRIVILEGES
　　$> ON .TO mog_uer@www.domainname.com WITH GRANT OPTION;
　　exit
　　/etc/init.d/mysql restart
　　Automatically create a database for the mogilefs:
　　cd etc/mogilefs/trunk/server
　　vi mogdbsetup
　　edit the following:
　　dbhost => "localhost",
　　dbname => "mogilefs",
　　dbrootuser => "root",
　　dbrootpass => "root_password",
　　dbuser => "mog_user",
　　dbpass => "mogpass",
　　save and run /etc/mogilefs/trunk/server/mogdbsetup
　　you will be asked a series of questions.  Answer yes to them all.
　　The mogilefs database should be created.  Check in phpmyadmin to verify.
　　Remove the id and password information when you are finished from mogdbsetup.
　　YOU MUST DO THIS it solves errors about lib path when running mogadm are solved by the following:
　　Do this - to set up MogileFS.pm go to the /etc/mogilefs/trunk/api/perl directory and do
　　perl Makefile.PL
　　make
　　make test
　　make install (assuming all goes well).
　　You may have to cpan install something based on the errors from perl Makefile.PL.
　　Install Mogilefs utils:
　　cd /etc/mogilefs/trunk/utils
　　perl Makefile.PL
　　make
　　make test
　　make install
　　Configure Mogstored:
　　On each storage server, create a configuration file at /etc/mogilefs/mogstored.conf with the following:
　　httplisten=0.0.0.0:7500
　　mgmtlisten=0.0.0.0:7501
　　docroot=/var/mogdata
　　Startup Mogstored:
　　open a putty session as root and type mogstored.  Mogstored should start.
　　Configure MogileFS:
　　edit the bold areas of the mogilefsd.conf file:
　　cp /etc/mogilefs/trunk/server/conf/mogilefsd.conf /etc/mogilefs/mogilefsd.conf
　　#daemonize = 1
　　db_dsn = DBI:mysql:mogilefs:host=127.0.0.1
　　db_user = mog_user
　　db_pass = dbpass
　　conf_port = 7001
　　listener_jobs = 10
　　delete_jobs = 1
　　replicate_jobs = 5
　　mog_root = var/mogdata
　　reaper_jobs = 1
　　launch new putty session ( I use putty: http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html
　　for my ssh sessions to the server.).
　　login as mogilefsd
　　at the command prompt run mogilefsd
　　Use 'mogadm' to add each storage server to the database.
　　The following example would add the host mogilestorage.yourdomain.comas a storage server, assuming that mogilestorage.yourdomain.comhad an IP address of 192.168.42.3 (listening on port 7500) and yourtracker had an IP address of 192.168.42.1 (listening on port 6001):
　　# mogadm --lib=/usr/local/share/perl/5.8.4--trackers=192.168.42.1:6001 host add mogilestorage --ip=192.168.42.3--port=7500 --status=alive
　　You can confirm that your host(s) were added with the following command;
　　# mogadm --lib=/usr/local/share/perl/5.8.4 --trackers=192.168.42.1:6001 host list
　　You also need to add devices for each storage host. If you don'tprovide a device id mogadm is supposed to do it for you... in practiceI find it dies with an error, so you will need to manually add a uniquedevice id after the host:
# mogadm --lib=/usr/local/share/perl/5.8.4 --trackers=192.168.42.1:6001 device add mogilestorage 1
　　Finally, add the correctly-name device (folder) to each storagehost. I have been unable to get the tools to handle this well, so I amprobably doing something wrong. As a workaround, I used the modadmdevice list command to see what device names were assigned and then Iadded the folders to my storage hosts. Run the following command:
　　# mogadm --lib=/usr/local/share/perl/5.8.4 --trackers=192.168.42.1:6001 device list
　　It will list each host and the device name followed by its status and storage available. Here is example output:
　　mogilestorage 1: alive
　　used(G) free(G) total(G)
　　dev1: alive 0.892 67.772 68.664
　　This means "mogilestorage" has a host id of "1" and it has onedevice named "dev1" on it and that device is in the "alive" state (yourother statistics will probably be zeros). Using the example outputabove, you would simply create the directory on mogilestorage.yourdomain.com:
　　You can also test using mogadm:
　　mogadm -–trackers=127.0.0.1:7001 check
　　use mogadm to add the host:
mogadm --trackers=127.0.0.1:7001 host add host1
domain:
mogadm --trackers=127.0.0.1:7001 domain add storage
and class:
mogadm --trackers=127.0.0.1:7001 class add storage files.
　　Go into phpmyadmin, open the hosts table and change the host statusto alive and add a device with device id 1, host id 1 and status =alive in the device table.
　　OR
　　mogadm -–trackers=127.0.0.1:7001 device add device1 1
　　and mark the device alive
　　mogadm -–trackers=127.0.0.1:7001 device mark host1,cin 1 alive
　　check your devices:
　　mogadm -–trackers=127.0.0.1:7001 device list
　　Check it out:
　　mogadm -–trackers=127.0.0.1:7001 check
　　If everything checks out ok you will see the following:
　　Checking trackers...
　　127.0.0.1:7001 ... OK
　　Checking hosts...
　　1host1 ... OK
　　Checking devices...
　　host device            size(G)    used(G)    free(G)   use%
　　1dev1              138.236      0.143    138.094   0.10%
　　total:   138.236      0.143    138.094   0.10%
　　Once everything is working you can daemonize mogilefsd:
　　edit the mogilefsd.conf file and remove the # in front of daemonize:
　　vi /etc/mogilefs/mogilefsd.conf
　　daemonize = 1
　　db_dsn = DBI:mysql:mogilefs:host=127.0.0.1
　　db_user = mog_user
　　db_pass = dbpass
　　conf_port = 7001
　　listener_jobs = 10
　　delete_jobs = 1
　　replicate_jobs = 5
　　mog_root = var/mogdata
　　reaper_jobs = 1
　　To start mogstored as a daemon type:
　　mogstored -d
　　To test and see if it's mogstored that's messed up or something along
　　the way, try telnetting to your mogstored (port 7500 by default) and
　　doing this:
　　PUT /dev1/test HTTP/1.0
　　Content-length: 4
　　test
　　See if that creates the 'test' file in your /var/mogdata/dev1 directory.
　　If it works, good, if it doesn't, you should get back a 404/something with
　　a more detailed error message.
　　Now put a file onto mogstored via mogilefsd (tracker):
　　cd /etc
　　mogtool –-trackers=127.0.0.1:7001  --domain=domainname –-class=classname inject motd motd
　　check /var/mogdata/dev1/0/000/000 for a file named xxxxxxxxxx.fid . If the file exists everything is successful.
　　Now delete the file:
　　mogtool –-trackers=127.0.0.1:7001  --domain=domainname –-class=classname delete motd
　　check /var/mogdata/dev1/0/000/000 and the file should be gone.
　　It's all good!