Sometimes you need to remove a package from your System, this is the way.

First discover the packages which are bothering you:

dpkg -l | grep ruby

Once you catched them, purge them from the system (removing binaries and configuration files):

sudo dpkg -P libruby1.8