Using a meta robots tag also ensures that your link equity is not being lost, with the use of the 'follow' command. Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages.