In technical SEO, robots.txt is a text file used by websites to instruct search engine bots on which pages or sections of a site to crawl or avoid. It helps control crawling behavior, preventing search engines from indexing content that you want to keep private or irrelevant for ranking purposes.