Easiest Way 2 Transfer???

**stickyfingerz** · 07-16-2007, 05:35 AM

Talk to your host they can probably do the transfer. We were looking at having to do the same thing but just ended up using the host that the sites were on. Pretty happy with them.

**directfiesta** · 07-16-2007, 05:36 AM

rsync if you have shell on both ....

100 gigs should take about a day.

**ServerGenius** · 07-16-2007, 05:41 AM

Here's a shell script to do the transfer of ssh with rsync. If you need help
with it hit me up.

Code:

#!/bin/bash
#
# Hans Waasdorp : [email protected]
#
# rsync transfer script
# script can also run from cron to sync content over multiple servers
# it only updates files that have been changed since the last run, will
# preserve permissions and ownership. It will remove files that are no
# no longer available on the source server. 



source /root/.bashrc

# Path we want to transfer
SOURCE="/www/"

# Path where we want to store the transfer
DESTINATION="[email protected]:/www/"

# Debug for verbose transfer stats 
DEBUG=0

# Testrun if set to 1 it will do a dry run without transferring anything
TESTRUN=0

LOCKFILE="/tmp/rsynch.lock"

# any stuff you don't want to transfer
EXCLUDEPATTERNS="--exclude=*.log"

if [ "x$DEBUG" == "x1" ]; then
        OPTIONS="--stats --progress"
fi
if [ "x$TESTRUN" == "x1" ]; then
        OPTIONS="-n --stats --progress"
fi

if [ ! -f $LOCKFILE ]; then

        touch $LOCKFILE
        trap 'rm -f ${LOCKFILE} >/dev/null 2>&1' 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
        rsync -e "ssh -i /root/.ssh/id_dsa" -u -aH $EXCLUDEPATTERNS --delete --force --partial $OPTIONS $SOURCE $DESTINATION
else
        exit 1
fi

**Way3** · 07-16-2007, 05:49 AM

Originally posted by directfiesta

rsync if you have shell on both ....

100 gigs should take about a day.

In most cases, rsync wiil be your best option! Best of Luck!

**Barefootsies** · 07-16-2007, 06:05 AM

Thanks gents. Bookmarked.

Well I have been happy with my main host for the better part of a decade. But with my billing changes over the past couple of years, and more competitive pricing I am looking at moving my hosting on almost all sites.

Since I am trying to get all of my sites redesigned, adding in CMS, and some extra spice, I figured now is a good time to look into moving everything as well. Obviously the amount of time to move all this on ONE site, much less half a dozen would be extremely time consuming. So I do not want to have to spend months doing that, or hiring people.

The main issue is that with the new scripts, I will not be able to just transfer over, and tada it is up and working. I would have to get new script installed on new host. Then move/post/catagorize old stuff into the new format, and once it's complete, end old hosting.

I know when I did this on my celebrity site a few years back it took a good 3-4 months to get 5000+ celebs, 100's of thousands of pictures, all their movies, and shit into the new script (considering the time available for such a task).

**ServerGenius** · 07-16-2007, 06:08 AM

Originally posted by Barefootsies

Thanks gents. Bookmarked.

Well I have been happy with my main host for the better part of a decade. But with my billing changes over the past couple of years, and more competitive pricing I am looking at moving my hosting on almost all sites.

Since I am trying to get all of my sites redesigned, adding in CMS, and some extra spice, I figured now is a good time to look into moving everything as well. Obviously the amount of time to move all this on ONE site, much less half a dozen would be extremely time consuming. So I do not want to have to spend months doing that, or hiring people.

The main issue is that with the new scripts, I will not be able to just transfer over, and tada it is up and working. I would have to get new script installed on new host. Then move/post/catagorize old stuff into the new format, and once it's complete, end old hosting.

I know when I did this on my celebrity site a few years back it took a good 3-4 months to get 5000+ celebs, 100's of thousands of pictures, all their movies, and shit into the new script (considering the time available for such a task).

doesn't have to be hard at all, first setup the webserver with vhost containers then use the rsync script for the content. I can get you
a script for mysql databases as well. Most scripts will just work if you don't
change the structure...except if they have have static ips defined somewhere
but that's easy to fix.

**Barefootsies** · 07-16-2007, 06:13 AM

Originally posted by ServerGenius

doesn't have to be hard at all, first setup the webserver with vhost containers then use the rsync script for the content. I can get you
a script for mysql databases as well. Most scripts will just work if you don't
change the structure...except if they have have static ips defined somewhere
but that's easy to fix.

Awesome.

**ServerGenius** · 07-16-2007, 06:13 AM

Quick and easy mysql backup script

Code:

#!/bin/bash

#
# Mysql Backup Script
# Hans Waasdorp [email protected]
#

TODAY=`/bin/date +%d-%m-%y`

BACKUP_MYSQL=1

DEST_DIR="/path/to/backup/dir"

DESTINATION_DIR="$DEST_DIR/$TODAY"
KEEP_DAYS=7

# edit below PASSWD="password" and USER="username" to your mysql username and password 

if [ $BACKUP_MYSQL -eq 1 ]; then
  PASSWD="password"
  USER="username"
  DATABASES=`mysql -BN -u $USER --password=$PASSWD -e 'SHOW DATABASES;'`

  if [ -x /usr/bin/mysqldump ]; then
    for db in $DATABASES; do
      mkdir -p $DESTINATION_DIR
      cd $DESTINATION_DIR
      /usr/bin/mysqldump --opt -u $USER --password=$PASSWD $db | gzip - | cat - > mysql.$db.dump.gz
    done
  fi
fi

/usr/bin/find $DEST_DIR/ -type d -mtime +$KEEP_DAYS | xargs rm -rf 2>&1 > /dev/null

**ServerGenius** · 07-16-2007, 06:25 AM

Fuck it if you have a debian linux box you can use this for creating the apache
vhost container from a shell command. If you have other linux quite easy to
adapt so that it will work.

Code:

#!/bin/sh

# --(( Apache VirtualHost Configuration Tool v1.0 ))--
#
# Hans Waasdorp [email protected]
#
# Vhost is a very simple shell script to easily add virtual hosts to an 
# Apache webserver. It prompts for a domain name and root directory,   
# appends a virtual host entry to httpd.conf, and restarts Apache. 

# variables - edit these to fit your environment

CONF=/etc/apache2/vhost.conf    # location of Apache conf file
[email protected]             # email appended to server errors,etc.
INDEX1=index.html               # default index file
INDEX2=index.php                # alternate index file
PID=/var/run/apache2.pid        # location of httpd.pid

# Don't edit anything below

SERVER="$1"
DOCROOT="$2"
USER="$3"
IP="$4"

if [ ! "$*" ]
then
echo
echo " --(( Apache VirtualHost Configuration Tool v1.0 ))--"
echo
echo "      Usage: vhost [domain] [webroot] [username] [ipaddress]" 
echo
echo "      domain = yourdomain.com (leave out www)" 
echo "      webroot = path to website directory, i.e. /home/username/www/yourdomain.com"
echo "      username = your username"
echo "      ipaddress = ipaddress to use for vhost"
echo
exit 1
fi

if [ -e "$CONF" ]
        then
                cp $CONF $CONF.bak
        else
                echo "No changes made - vhost.conf file not found!"
                exit 1
fi

echo "
<VirtualHost $IP>
    ServerAdmin $EMAIL
    ServerName $SERVER 
    ServerAlias www.$SERVER
    DocumentRoot $DOCROOT 
    DirectoryIndex $INDEX1 $INDEX2 
        ErrorLog /var/log/apache2/vhosts/$SERVER.error.log
        CustomLog /var/log/apache2/vhosts/$SERVER.access.log combined
   <Directory />
      Options -Indexes +FollowSymLinks
      AllowOverride None
      Order allow,deny
      allow from all
   </Directory>
   <Directory $DOCROOT>
      Options All -Indexes +FollowSymLinks +MultiViews
      AllowOverride All
      Order allow,deny
      allow from all
   </Directory>
</VirtualHost>
" >> $CONF

mkdir -p $DOCROOT
chown -R $USER:$USER $DOCROOT

if [ -e "$PID" ]
        then
                kill -HUP `cat $PID`
                echo
                echo "- added VirtualHost to vhost.conf"
                echo "- old vhost.conf renamed to vhost.conf.bak"
                echo "- restarted Apache"
                echo
                exit 0
        else
                echo "Couldn't restart Apache - apache2.pid not found!"
                exit 1
fi

**ServerGenius** · 07-16-2007, 06:25 AM

who said I never contribute

**ServerGenius** · 07-16-2007, 06:37 AM

Apache vhost tool once again.....i forgot to build in a check before creating
the new vhost docroot.

Code:

#!/bin/sh

# --(( Apache VirtualHost Configuration Tool v1.0 ))--
#
# Hans Waasdorp [email protected]
#
# Vhost is a very simple shell script to easily add virtual hosts to an 
# Apache webserver. It prompts for a domain name and root directory,   
# appends a virtual host entry to httpd.conf, and restarts Apache. 

# variables - edit these to fit your environment

CONF=/etc/apache2/vhost.conf    # location of Apache conf file
[email protected]             # email appended to server errors,etc.
INDEX1=index.html               # default index file
INDEX2=index.php                # alternate index file
PID=/var/run/apache2.pid        # location of httpd.pid

# Don't edit anything below

SERVER="$1"
DOCROOT="$2"
USER="$3"
IP="$4"

if [ ! "$*" ]
then
echo
echo " --(( Apache VirtualHost Configuration Tool v1.0 ))--"
echo
echo "      Usage: vhost [domain] [webroot] [username] [ipaddress]" 
echo
echo "      domain = yourdomain.com (leave out www)" 
echo "      webroot = path to website directory, i.e. /home/username/www/yourdomain.com"
echo "      username = your username"
echo "      ipaddress = ipaddress to use for vhost"
echo
exit 1
fi

if [ -e "$CONF" ]
        then
                cp $CONF $CONF.bak
        else
                echo "No changes made - vhost.conf file not found!"
                exit 1
fi

echo "
<VirtualHost $IP>
    ServerAdmin $EMAIL
    ServerName $SERVER 
    ServerAlias www.$SERVER
    DocumentRoot $DOCROOT 
    DirectoryIndex $INDEX1 $INDEX2 
        ErrorLog /var/log/apache2/vhosts/$SERVER.error.log
        CustomLog /var/log/apache2/vhosts/$SERVER.access.log combined
   <Directory />
      Options -Indexes +FollowSymLinks
      AllowOverride None
      Order allow,deny
      allow from all
   </Directory>
   <Directory $DOCROOT>
      Options All -Indexes +FollowSymLinks +MultiViews
      AllowOverride All
      Order allow,deny
      allow from all
   </Directory>
</VirtualHost>
" >> $CONF


if [ ! -d "$DOCROOT" ]
        then
                echo "Creating vhost docroot"
                mkdir -p $DOCROOT
                chown -R $USER:$USER $DOCROOT
        else
                exit 1
fi

if [ -e "$PID" ]
        then
                kill -HUP `cat $PID`
                echo
                echo "- added VirtualHost to vhost.conf"
                echo "- old vhost.conf renamed to vhost.conf.bak"
                echo "- restarted Apache"
                echo
                exit 0
        else
                echo "Couldn't restart Apache - apache2.pid not found!"
                exit 1
fi

**ServerGenius** · 07-16-2007, 08:50 AM

bump for people who can use some simple but handy shell scripts

Easiest Way 2 Transfer???

Easiest Way 2 Transfer???

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment