If you are new to Joomla, there is a message at the end of the installation process which states "Please remember to completely remove the installation folder." You may ask... where is the installation folder? It is located in the root directory of the website folder. It can be deleted through an FTP connection. Locate your FTP credentials, login to the server, and simply delete the folder that named "Installation." Then you are good.