|
|
Posted by Benjamin Niemann on 11/14/06 16:55
Hello,
CptDondo wrote:
> OK, this is OT for this group, but I really have no idea where to post
> this.
>
> I am working on a project where a 'client' periodically queries a number
> of 'servers'. The exchanges are done using XML.
>
> There is one client and an awful lot of servers (hundreds), and
> bandwidth is limited. It can take hours for the client to query all of
> the servers in round-robin fashion. (We can't use exception reporting
> or have the servers report for technical reasons.)
>
> My solution is to develop intermediate proxy-cache boxes, which would
> query servers in their subnet and cache the results. The client then
> would only need to query the proxies.
>
> This seems like a pretty simple idea, and there solutions out there for
> html proxies doing this sort of thing.
>
> Is anyone aware of anything out there for xml queries?
Proxies like squid work on the protocol level (HTTP) - they do not care what
kind of data is being transferred.
If you are using HTTP to fetch the XML data, then you should be able to use
any generic HTTP proxy including squid.
Just make sure that the data is cachable at all: proper HTTP headers, data
is fetched using GET, not POST...
You could install cronjobs on or near the proxy servers, which pull the data
(via the proxy) and just drop it - to make sure the data is in the cache,
when your client comes around. A simple bash script with lots
of 'wget -O /dev/null http://...' might be sufficient.
HTH
--
Benjamin Niemann
Email: pink at odahoda dot de
WWW: http://pink.odahoda.de/
Navigation:
[Reply to this message]
|