Edit .inputrc and add:

## arrow up
"\e[A":history-search-backward

## arrow down
"\e[B":history-search-forward

From: https://askubuntu.com/questions/59846/bash-history-search-partial-up-arrow