Search engines use bots (crawlers, spiders) to reach out to websites to find out what kind of structure and content a website has. This happens so that search engines know how to deliver the website. Well optimized websites make it easy for bots to crawl, resulting in higher authority and search rankings (SEO).