"Search for xyz in all content" link only shows up when there's no results. Users cannot expand their search to include all content if they can't find what they're looking for. The only workaround is to search for something that will return no results so the users can search all content. Users complain the search experience in SPO isn't as useful as earlier versions.