See: Joomla or WordPress? What to choose?
What are the limitations of the t file?
The file has three main limitations:
Different interpretation of page syntax by crawlers
Even though each bot knows Google's rules, they all understand them slightly differently. In order for individual commands to be recognized, the correct syntax defined by Google's web developers must be used.
Other guidelines can be
Problems handlingrules by some search engines
The instructions in the file are only guidelines that tell the crawlers how to behave. Whether the crawler will follow the instructions is entirely up to him . Therefore, if you want to be sure that particular data will mobile number list be hidden from crawlers, you should use other access blocking methods protect private files placed on the server with a strong password).
What is the ile for?
You can also easily remove selected content from Google. All you have to do is apply for the liquidation of these results. You can verify the details at developer
Indexing pages not allowed in
Some pages may still be indexed in even though they are not allowed. There is one condition - links from other websites must lead to it. This aspect is well described by Google web developers.