Should robots txt be visible?