On Mon, Apr 19, 2004 at 03:37:13PM -0000, quinlan@apache.org wrote:
> I think this method is still going to miss encoded redirects, though.
> + if (m{^https?://.+?(https?://.+)$}) {
> + push(@uris, $1);
> + }
It shouldn't. The code above it deals with encoding, then that if
statement strips out the top level redirect and puts the remaining URL
back in the queue to be passed through the loop again.
However, your modification to the code stripped out the "$nuri =~"
which kinda breaks things. :( (r10104 committed to fix it)
--
Randomly Generated Tagline:
EACH year, as they pay their taxes, many Americans conduct a tiny
mental debate. "Why should I have to turn over such a huge fraction of my
hard-earned money to the government?" And then, a moment later: "Oh, yeah:
schools, roads, national security - blah, blah, blah. Sign the check."
- http://www.nytimes.com/2003/07/31/technology/circuits/31stat.html
> I think this method is still going to miss encoded redirects, though.
> + if (m{^https?://.+?(https?://.+)$}) {
> + push(@uris, $1);
> + }
It shouldn't. The code above it deals with encoding, then that if
statement strips out the top level redirect and puts the remaining URL
back in the queue to be passed through the loop again.
However, your modification to the code stripped out the "$nuri =~"
which kinda breaks things. :( (r10104 committed to fix it)
--
Randomly Generated Tagline:
EACH year, as they pay their taxes, many Americans conduct a tiny
mental debate. "Why should I have to turn over such a huge fraction of my
hard-earned money to the government?" And then, a moment later: "Oh, yeah:
schools, roads, national security - blah, blah, blah. Sign the check."
- http://www.nytimes.com/2003/07/31/technology/circuits/31stat.html