The spider function actually works like a champ! At least on the server side of things. The problem I am having is that my !@#*%! browser times out before the spider can finish crawling a URL. The spidering function on the server side keeps on running until finished (thanks to setting the php time limit).

It may help to have some sort of progress bar output to the browser to prevent timeout.

I have tried to force some output during the spider function but had no luck. All normal output is held until the script completes execution.

One thing this would really be useful for is that site owners could just set the spider running and then let it run until all URL's have been crawled and not have to constantly monitor the progress. Just call me lazy!

Al

Have you tried changing your web browser settings, or a different web browser? I use Opera 9.00b without any problems.
Also, try Admin/Config/Admin/set_time_limit option.

I have used both IE 6 and Firefox 1.5 and 2.0 without any problems...

I don't think the time limit is a problem but that my version of IE is. I am using an "SBCDSL" modified version of IE. Gonna try things with regular IE for now and see what happens.

I'll let ya know! BTW, the "SBCDSL" version won't allow changes to many of the advanced options that IE normally makes available! What a bunch of fecal matter that is!

Al

Try Opera, its by far more advanced than MSIE.

your problem is probably the SBC dsl... sbc sucks in my experiences with them... never did get my 3.0 .... now i have CenturyTel and i have 3.0 and i actually reach a 3.0 sometimes... mostly 2.8 though... with 512 upload speed when i actually get 515kbps upload...

If you are using a router that will cause that problem . It happens whe i use the router BUT when I plug directly into the dsl it works fine


I was using another script that checks for backlinks and I can not use it do to that problem

I'm using a Linksys WRT54-G wireless/wired router and i have absolutely no problem.... in fact i am also behind a hub that is attached to it! so there are in fact 2 hops between my computer and the outside internet...

I should have posted earlier. I did some investigation and found that the "set_time_limit() function doesn't change a thing! Yahoo is so paranoid about customers fooling around that they don't allow anything other than their default phpini settings.

So, it looks like I'll have to live with it for now. I will figure a workaround for it but it is gonna take some time.

All someone has to do is make a what i call a loading script so there is something moving on the screen and it will stop that

I have a new script i am using now and it has that and it will not time out no mater how long the time takes

also if a page times out... you can always restart from where it left off by refreshing the page... also you can make it so that it does fewer things per page... (would make the page move more often)...