|
|
Posted by Steve on 08/18/05 09:58
On Wed, 17 Aug 2005 08:12:09 -0700, Nimit wrote:
> Hi, I wasn't sure which forum this post belongs to, so I've posted it
> to a couple forums that I thought may be appropriate.
>
> In giving me advice, please consider me a beginner. Below is a synopsis
> of my problem/question:
>
> SOME BACKGROUND:
> - I am writing a php based web application.
> - There is a very data intensive task I need to do that requires
> reading and lookup of a lot of data.
> - This data is all stored in a database. If I did the computation
> directly from php, then the load on the database is too intensive, and
> takes a unacceptable amount of time (over 20 secs) to calculate (I've
> already tried this).
> - So I thought what I need to do is load all this data into memory,
> and then do this operation from there, and this should be a lot faster
> than doing lookups on a database.
>
I think you need to look into how a proper rdbms manages its data. You'll
find that regularly used data *will* automatically be stored in memory[1].
Try transferring a data set into postgresql ( it's available for windows
if you must ), and see whether the performance becomes acceptable.
Failing that, use Oracle (:
Steve
[1] Assuming you've got enough spare!
Navigation:
[Reply to this message]
|