With the Access Key & Secret Key located at my home directory, when I run the following in the command line:
from boto.ec2.connection import EC2Connection
conn = EC2Connection()
I just solve my problem after taking a short break. Yeah~!
sudo apt-get install python-boto
Python-boto package must be install for the connection to work.