To have VI(M) in Debian to act like it does in Redhat, create a file named .vimrc (Note the dot) in your home directory and add this to it:

syntax on
au BufReadPost * if line("'\"") >  0|if line("'\"") <= line("$")|exe("norm '\"")|else|exe "norm  $"|endif|endif