[Advanced SEO] [Part-2] Robots.txt file setup and important tips.

In today's episode, you will find that SEO is a very important concept of Robot.txt, and this post is about how important it is for a website SEO.

At first,

What is a robots.txt file?

You may know about many Robots.txt files. Because, it was used by the WAPKA function too.

## What is Googlebot in the last post? I talked about that. And the file that can be controlled by Googlebot is Robots.txt

## This is a simple text file that combines some commands. (.txt)

## Links to your site's Robots.txt file:

http://yoursitedomain.com/robots.txt

Examples of Robots.txt file:

User-agent: *
Disallow: /folder/xxx.jpeg
Disallow: /login.php
Allow:

User-agent: Googlebot
Disallow: /css/html.js

sitemap: https://trickbd.com/sitemap.xml

Use of Robots.txt:

Look at the example above!

Here the user-agent is referred to Googlebot.

And nine Googlebots that were posted in the previous post were all released together *.

## This means, User-agent: * means you're pointing all the Googlebot to you.

Again,

Disallow: / folder You are preventing those 9 Googlebots from accessing this folder.

## User-agent: Googlebot

Disallow: /css/html.js
User-agent: Google-Images
Disallow: /adult/photos

** You can restrict access to files or folders to certain boats if you wish.

1. How do I allow everything?

User-agent: *
Disallow:

Or,

User-agent: *
Allow:

** Nothing is given here or spatial = all!

2. I allow something and disallow something
How to do

User-agent: *
Disallow: /
Allow: /blog

** Just means "Allow" to allow or disallow the home page.

3. Is it important to link down the sitemap file?

## Not at all I do not know why people are still giving it to Hudai. Although it was previously considered as Best SEO Practise but which has now been deprecated. There is no profit even if there is no rule to give. Please give it

4. How to edit robots.txt file?

## Any Text Editor, Notepad, Mobile Computer, Online Software; Whatever your happiness !!

5. Where is Robots.txt file located?

## Generally on the home folder of the website.

The advantages and disadvantages of the Robots.txt file



Convenience: **

1. Do not allow Google to access specific file folders.

2. The commands are very easy.

3. It is possible to edit when there is a text file.

Disadvantage: **

1. If you make a mistake, your site will not have any profit from SEO. Googlebot can not access your site. So understand it.

WordPress Tips: ***


Good news for those who have WordPress (WordPress) sites, there are various modern SEO plugins that Robots.txt does not have to think about. Noindex or Nofollow can be used to allow allow or disallow from the specific pages or post side options. Also with many plugins, backend will allow this robot to edit the commands of txt or add.