On MOSS 2007 / Search server 2008 , when you do a search on the SharePoint site with the "All Site" scope, the first result is displayed as expected and the subsequent search on the search result page is getting delayed. But this search works absolutely perfect when you do a search with "This Site" scope.
The Federated Locations option that is provided with Infrastructure update in the search administration page is the cause if the SharePoint server do not have access to the internet as it tries to fetch results from the net also for the keyword in the federated webpart.
You have two options:
1. Disable all the federated search webparts on the search result page. This needs to be done on all the web application and sites that uses the search center page.
2. You can select the following option under:
a. Click open ‘Central Administration’ and open the ‘Shared Service Provider’
b. Click open ‘Search Administration’
c. Now click on ‘Federated Location’ on the left hand paned. You will come across the ‘Manage Federated Locations’ and we need to select the ‘Internet Search Results’ and the ‘Internet Search Suggestions’ and make sure that they don’t use OpenSearch.
e. Edit ‘Internet Search’ results and the ‘Internet Search’ and scroll below and expand the ‘Location Information’
f. Change the radio button to use ‘Search Index on this Server’ from the default ‘OpenSearch’
This will resolve your issue.