bash | Blog – Piotr Grabski-Gradziński

Posts tagged with: bash

Feb 18, 2017 |

Comparing two directories with rsync

If you want to compare two directories using rsync.

rsync -avun $SOURCE $TARGET

# content checsum check
rsync -avnc $SOURCE $TARGET

source: StackExchange

administration bash

Feb 9, 2017 |

0 comments

Repetitive rsync

Some time ago I’ve been moving from one hosting provider to another. I had to transfer the files from A to B and used rsync for that. But unfortunately rsync command was crashing due to some timeouts. So I’ve found really nice script for auto restore.

rsync-auto.sh

#!/bin/bash

while [ 1 ]
do
    /usr/bin/rsync -avz --progress $1 $2
    if [ "$?" = "0" ] ; then
        echo "rsync completed normally"
        exit
    else
        echo "Rsync failure. Backing off and retrying..."
        sleep 10
    fi
done

Execute

rsync-auto.sh SOURCE DESTINATION

source: stackoverflow.com

administration bash

May 28, 2016 |

0 comments

PHP console output colouring

If you want to have nice output colouring of your PHP scripts or those from Symfony Console, you should install POSIX extension to your PHP version.

sudo port install php56-posix

administration bash php

May 25, 2015 |

0 comments

SFTP bash basics

So, you have to use SFTP in your console? Very good article!

https://www.digitalocean.com/community/tutorials/how-to-use-sftp-to-securely-transfer-files-with-a-remote-server

administration bash

Apr 23, 2015 |

0 comments

wget – downloading whole website

$ wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains website.org \
     --no-parent \
         www.website.org/tutorials/html/

source: Linux Journal

bash

Apr 8, 2015 |

0 comments

Removing .git / .svn directories

Sometimes you have to remove directories from your VCS tool.

find . -name .svn -exec rm -rf {} \;

Listing affected directories

find . -name .svn -exec echo {} \;

bash

Apr 2, 2015 |

0 comments

Useful curl

Headers only

--head – performs HEAD http request (not GET).

curl --head https://www.wp.pl/

Content + headers

--get – performs GET request
-i – include headers

curl --get -i https://www.wp.pl/

administration bash

Sep 30, 2014 |

0 comments

Low bandwidth copy

So, you have to copy one directory into another on your server and you don’t want to kill the machine?

Instead of

cp -r master master_copy

use

rsync --bwlimit=30000 -av master/ master_copy/

The –bwlimit=KBPS switch is for limiting I/O bandwidth.

administration bash

Feb 10, 2014 |

0 comments

Grep with context

Small thing but extremely useful. Getting context with grep.

-C – Print num lines of leading and trailing context surrounding each match. The default is 2 and is equivalent to -A 2 -B 2. Note: no whitespace may be given between the option and its argument.

grep -C 5 file.txt

bash

Jan 15, 2014 |

0 comments

Deleting large number of files without killing the server

If you have to remove large number of files, like hundreds of thousands, and don’t want to kill your production server, instead of rm -fr DIR you can use this little fella.

while [ true ]; do ionice -c 3 find DIRECTORY_TO_BE_DELETED -type f -print | head -50000 | xargs rm -f; sleep 50; done

administration bash