[aklug] Re: recursive HTTP file downloading...

Thanks all. I learned something new today...

Arthur Corliss wrote:
> On Thu, 10 Jun 2010, Leif Sawyer wrote:
>
>
>> Supposedly, wget supports the robots =3D off line in .wgetrc which
>> will ignore the robots.txt file restrictions.
>>
>> or
>>
>> wget -e robots=3Doff
>>
>> So, no need to hacks it.
>>
>
> Thanks for the heads up! The man page didn't mention that specifically.
> And not being a bit wget user I didn't bother to check all the available
> wgetrc options...
>
> --Arthur Corliss
> Live Free or Die
> ---------
> To unsubscribe, send email to <aklug-request@aklug.org>
> with 'unsubscribe' in the message body.
>
>
>
---------
To unsubscribe, send email to <aklug-request@aklug.org>
with 'unsubscribe' in the message body.
Received on Thu Jun 10 12:16:28 2010