Skip to main content
miji.be

Search Engine

A service that finds and ranks web pages matching a user's query. Search engines use crawling, indexing, and ranking algorithms to deliver results.

Oct 3, 2026 / About 1 min read

SEO

A search engine is a service that helps you find information on the internet by searching through billions of web pages to match your query. Think of it as a librarian for the entire internet - you describe what you are looking for, and the search engine finds the most relevant pages in seconds.

Search engines operate through three main steps. The first step is crawling. Automated programs called crawlers (or spiders) follow links from page to page across the web, discovering and downloading content. The second step is indexing. The search engine analyzes the content of each crawled page and organizes it in a massive database, categorized by keywords and topics. The third step is ranking. When you enter a search query, the engine retrieves matching pages from its index and ranks them by relevance. Google says its ranking systems look at many factors and signals, including the words of the query, the relevance and usability of pages, the expertise of sources, and the user's location and settings.

Google dominates the search market with approximately 90% global share according to StatCounter's 2024 data. In Japan, Yahoo! JAPAN is also popular, but it actually uses Google's search technology under the hood. Microsoft's Bing and others hold much smaller shares.

The relationship between short URLs and search engines matters for SEO (Search Engine Optimization). When a search engine crawler encounters a short URL, it follows the redirect to discover the destination page. The type of redirect affects how search engines treat the link. Google explains that it uses permanent redirects such as 301 as a signal that the redirect target should be canonical, and does not use temporary redirects such as 302 as that signal. If search visibility matters, check which type of redirect a URL shortening service uses.

Search engines cannot index everything on the web. Pages with noindex tags stay out of search results, and pages blocked by robots.txt are not crawled, although their URLs can still appear without a description.

Was this article helpful?

Related Terms

Web Crawler

An automated program that systematically browses the web to discover and index pages for search engines.

Indexing

The process by which search engines store and organize web page content in their database for retrieval in search results.

SERP

Search Engine Results Page - the page displayed by a search engine in response to a user's query.

SEO-Friendly URL

A URL structure designed to be easily understood by both search engines and human users.

Redirect Budget

The maximum number of redirects a search engine crawler will follow in a single crawl session. Exceeding this limit negatively impacts indexing.

Meta Tag

An HTML element in the head section that provides metadata about a web page to browsers and search engines.

Related Articles

URL Shorteners and SEO - How Short Links Affect Search Rankings and Link Equity

Analyze the impact of short URLs on search engine optimization. Covers 301 redirect link equity, crawl budget effects, and SEO best practices.

Short URLs and SEO - Understanding Link Juice, Social Signals, and Canonical Tags

How short URLs affect SEO: 301 redirects and link juice, Google's official stance, nofollow vs dofollow, social signals, and canonical URL best practices.

The Great Invention of Hyperlinks - How They Connected Information Worldwide

Why hyperlinks were revolutionary. From book indexes to Tim Berners-Lee's free WWW, how links weave the world's information, and the issue of link lifespans.

FAQ

Why do Google and Yahoo show different results in Japan?
Yahoo! JAPAN licenses Google's search technology, so the core search results are nearly identical. The differences come from Yahoo's own content mixed into the results, such as Yahoo! News articles and Yahoo! Chiebukuro (Q&A) answers, which can make the overall search experience feel different.
How are search result rankings determined?
According to Google, rankings combine many factors, such as how well the page content matches the query, the usability of the page, and the expertise of the source. Google also names links from other prominent websites as one of the signals used to judge quality. The exact algorithm is not public.
Are there web pages that search engines cannot find?
Yes. Pages that have not been crawled yet and pages with noindex tags do not appear, and content behind login screens stays out when crawlers cannot read it. Pages blocked by robots.txt are not crawled, but Google's robots.txt guide notes that their URLs can still appear without a description if other pages link to them. Additionally, content in apps, private databases, and some social media posts is not accessible to search engine crawlers.

Put the terms to work

Shorten a URL for Free