Undeniable Proof That You Need synthetic dataset
https://telegra.ph/9-Signs-You-Need-Help-With-data-analysis-04-17
This allows Goggle (user-agent title GoogleBot) to visit every web site and directory, whilst at the same time banning Check with Jeeves with the internet site totally