The effectiveness of web search and the speed of content delivery depend on technical standards and optimization strategies. Website administrators use various tools to guide search engines, while modern image formats help maintain a balance between visual quality and network performance.
(a) the specific role of each of the following in optimizing a website for search engines: Robots.txt files, XML Sitemaps, and meta tags (e.g., title and description).
(b) how a search engine can use a web crawler and an index to retrieve relevant pages for a user’s query.