手撕包菜磁力链接搜索网站
演示站 www.cili66.com
演示站用nginx做反代，缓存静态资源。
请忽略演示站中的热门搜索关键字，那些关键字是搜索引擎来的量,与我无关啊，我还是个孩子啊~~。QAQ
###这是 www.shousibaocai.com 的网站源代码,作者是https://github.com/78/ssbc 在原作者基础上制作了一键安装脚本及修复了部分BUG： BUG1:搜索中文报错 'ascii' codec can't encode characters in position 42-43: ordinal not in range(128) 解决办法： 如果是centos7系统，修改/usr/lib64/python2.7/site.py vi /usr/lib64/python2.7/site.py 在import sys下添加2行： reload(sys) sys.setdefaultencoding('utf8')
BUG2:爬虫运行时 可能会遇到如下问题：
Python and Django OperationalError (2006, 'MySQL server has gone away')
解决方法：
http://stackoverflow.com/questions/14163429/python-and-django-operationalerror-2006-mysql-server-has-gone-away
/etc/my.cnf 在最后一行的下面添加
wait_timeout=2880000
interactive_timeout = 2880000
max_allowed_packet = 512M
##一键安装脚本
#!/bin/bash
#changelog:
#1.1添加开机自启动功能
#1.2修改pip获取方式
#1.3添加linode主机repo源的问题，改为用阿里云的repo源
#1.4取代nohup使用supervisor来管理索引，爬虫和web。
#确认python版本，获取ssbc源代码，关闭防火墙
python -V
systemctl stop firewalld.service
systemctl disable firewalld.service
systemctl stop iptables.service
systemctl disable iptables.service
yum -y install wget
#如果使用linode主机，请取消下面4行的注释
# wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
# wget -qO /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo
# yum clean metadata
# yum makecache
cd ~
wget https://github.com/78/ssbc/archive/master.zip
yum -y install unzip
unzip master.zip
#安装MariaDB，创建数据库
yum -y install gcc
yum -y install gcc-c++
yum -y install python-devel
yum -y install mariadb
yum -y install mariadb-devel
yum -y install mariadb-server
cd ssbc-master
yum -y install epel-release
yum -y install python-pip
pip install -r requirements.txt
pip install pygeoip
systemctl start mariadb.service
mysql -uroot -e"create database ssbc default character set utf8;"
sed -i '/!includedir/a\wait_timeout=288000\ninteractive_timeout = 288000\nmax_allowed_packet = 256M' /etc/my.cnf
mkdir -p /data/bt/index/db /data/bt/index/binlog /tem/downloads
chmod 755 -R /data
chmod 755 -R /tem
#安装Sphinx
yum -y install unixODBC unixODBC-devel postgresql-libs
wget http://sphinxsearch.com/files/sphinx-2.2.11-1.rhel7.x86_64.rpm
rpm -ivh sphinx-2.2.9-1.rhel7.x86_64.rpm
#生成索引
systemctl restart mariadb.service
systemctl enable mariadb.service
searchd --config ./sphinx.conf
python manage.py makemigrations
python manage.py migrate
indexer -c sphinx.conf --all
ps aux|grep searchd|awk '{print $2}'|xargs kill -9
searchd --config ./sphinx.conf
#安装supervisor
yum -y install supervisor
supervisord -c /etc/supervisord.conf
mkdir /data/logs
echo "files = /root/ssbc/supervisor/*.conf" >> /etc/supervisord.conf
#创建账户密码
cd ..
python manage.py createsuperuser
#启动3个进程，index索引，simdht爬虫，web网站
supervisorctl update
#开机自启动
chmod +x /etc/rc.d/rc.local
echo "systemctl start mariadb.service " >> /etc/rc.d/rc.local
echo "cd /root/ssbc-master " >> /etc/rc.d/rc.local
echo "indexer -c sphinx.conf --all " >> /etc/rc.d/rc.local
echo "searchd --config ./sphinx.conf " >> /etc/rc.d/rc.local
echo "supervisorctl update " >> /etc/rc.d/rc.local