|
|
Posted by Erwin Moller on 06/29/05 14:53
studio@stoxfx.com wrote:
> I have a simple crawler as part of a website. It uses file() to copy
> HTML content from a web page on another website and reformat it into a
> new HTML page using a template. Is there a simple way of having the
> crawler supply a custom HTTP user agent header to identify itself to
> the website being crawled? I don't want to alter the php.ini file, I
> need to set the user agent value from PHP if possible.
>
> Thanks
Hi,
AFAIK: headers are added to the actual HTML page by the software that is
sending the HTML page.
For example: The webserver will add a few headers.
So I do not know how you can 'tag' your pages on the second server, so the
webserver will know it should send some extra headers.
You can however always add META-tags into the document itself, but I don't
know if that is what you need.
just my 2 cents..
Regards,
Erwin Moller
Navigation:
[Reply to this message]
|