If you want to change the "Meta" section widget, add or remove links from it (like the wordepress link), Go to file: site/wp-includes/default-widgets.php The part you want to edit starts at line 272.you can add links here or delete some you don't like.
Add-Meta-Tags WordPress Plugin
Add-Meta-Tags is a great plugin i use on this site:http://www.adverfix.com/
WordPress installation
This is the simple guide to install WordPress, taken from the WordPress site. If you are not comfortable with renaming files, Steps 3 and 4 are optional and you can skip them as the install program will create wp-config.php file.