What is the function of a web crawler in a search engine? MCQ with Answer and Explanation

What is the function of a web crawler in a search engine?
A. To display ads
B. To manage user queries
C. To rank search results
D. To discover and retrieve web pages for indexing
Answer: Option D
Solution (By JKExamLibrary)
A web crawler (spider) systematically browses the web to collect pages for the search engine's index.

This question belongs to: Computer Internet and Web Technologies

Discuss this Question (0)

No comments yet. Be the first to start the discussion!

Practice More Internet and Web Technologies Questions

Question #1 Report Error
What is the purpose of the 'Host' header in an HTTP/1.1 request?
A. To set the connection type
B. To enable virtual hosting by specifying the domain name
C. To indicate the client's hostname
D. To define the content encoding

Correct Answer: Option B


Explanation:
The Host header is mandatory in HTTP/1.1 to differentiate between websites hosted on the same IP address.

This question belongs to: Computer Internet and Web Technologies
Question #2 Report Error
Which of the following refers to a specific web software asset used to provide localized data charts, real-time stock prices, or news items directly embedded into a sidebar workspace?
A. SMTP Routing Tag
B. FTP Directory Link
C. Robots Indexer
D. Web Widget

Correct Answer: Option D


Explanation:
A web widget is a small, portable application snippet embedded within a web page to display real-time information or specific dynamic tools.

This question belongs to: Computer Internet and Web Technologies
Question #3 Report Error
Which HTTP status code is returned by a web server to indicate that the requested resource could not be found?
A. 200 OK
B. 301 Moved Permanently
C. 404 Not Found
D. 500 Internal Server Error

Correct Answer: Option C


Explanation:
The 404 Not Found status code indicates that the server cannot find the specific resource or page requested by the client browser.

This question belongs to: Computer Internet and Web Technologies