While in the past there were other types of search engines or directories that relied more on human input/curation, search engines as we know them today all rely, in one way or another, on Spiders or Crawlers to index the internet for searching. 

The most visible search engines available today, Google, Bing, Yahoo!, and many more, deploy their own spiders to create an index of the internet.