Network World
Saturday, November 22, 2008
DNSstuff.com
Get information about your IP
IP Information
50+ On-demand DNS and network tools

Community: Security

Navigation

What about distributed data?

But Dave, in response to your comment:

"Well, no. While I didn't state it expressly, all SQL database data is left in the SQL database, with the power of it's join engine at our beck and call to select only that data which is needed for our particular problem."

I agree that the power of the SQL database engine is at our disposal. However, that power is limited when it comes to distributed queries, particular where the data exists in heteroegenous database engines. This is likely given that identity-related data is dispersed across multiple applications. Reliance on a virtual directory system, unless it has sophisticated distributed query optimisation techniques to determine the best way to move and join data, could result in significant overhead in comparison to synchronising the data into a single engine specifically designed for the purpose.
"n compute-intensive environments it might be necessary to devote a computer to servicing these join requests in tandem with the virtual directory server, but that's a time-honored (well, 10-15 years, perhaps) method of solving compute problems. The various services could even be linked through a separate backbone, or mesh, network to improve throughput both for those services as well as for all of the clients."

Of course this is true but again doesn't resolve the distributed query issues. The next logical step in your argument could be to move the data to that computer devoted to join processing - a metadirectory.

Click to read the article this is in response to.

distributed data

0

gathering all the data that you might potentially need into one place, and keeping it in-sync and accurate at all times carries an immense price in terms of network overhead.

A good analogy can be made to Just In Time (JIT) manufacturing practice - it's cheaper and more efficient to bring in the raw materials (the data bits) when they are needed rather than having them all stockpiled, perhaps needlessly.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <i> <b> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <blockquote> <br /> <br> <p>
  • Lines and paragraphs break automatically.
  • You can use BBCode tags in the text.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.

Advertisement: