During a pentest, you discover a sitemap.xml file and a crossdomain.xml file. These files can provide useful information for mapping out web directories and files that would otherwise have to be brute-forced. What is the name of another file that can provide URLs and URI locations that restricts search engines from crawling certain locations?

🎲 Try a Random Question  |  Total Questions in Quiz: 8  |  🧠 Study this quiz with Flashcards
This question is part of a full practice quiz:
CompTIA PenTest+ Certification Exam: Information Gathering and Vulnerability Scanning — practice the complete quiz, review flashcards, or try a random question.


During a pentest, you discover a sitemap.xml file and a crossdomain.xml file. These files can provide useful information for mapping out web directories and files that would otherwise have to be brute-forced. What is the name of another file that can provide URLs and URI locations that restricts search engines from crawling certain locations?