Databases already adapt to the "size" of the data they store.
And adapting to the "shape" of the data they store is what I was warning against above.

Ok but it's the scalability of the database that is the point of focus here. And the database would have to adapt to the data

One of us is still missing the point.
Databases already scale to the size of the data (if they're properly designed).
Databases can't adapt to the "shape" of the data without sacrificing many of the important features of databases (relational integrity, domains, constraints).

ok im aware of the typical relational databases used today however which large amounts of data being produced everyday it would be more resourceful to give this data the ability to behave in such a manner that the data would be retrieved directly from a search without the user being directed to multiple web pages that may hold the same data. in addition the data would be able to store it self in any database according to the size. this would result in a one size fits all database similar to what certain nosql systems are doing

Sounds like you want to create a data virus that morphs into a physical shape depending on size.

if u take a look at tim berners-lee (the guy usually accredited for inventing the web) and just look up his concept of linked data and the semantic web i think you may understand the concept i have put forward better as i am not great at explaining this yet.

I'm pretty sure that HADOOP is exactly what you want, and that map / reduce is the key to making sense of the data in its pure (non-semantically enhanced) form.

Big Data | Microsoft SQL Server already delivers the ability to do what I think that you want... Allowing you to add semantic meaning via relational data merged with the HADOOP.

Is this what you're driving toward? If not, please try to explain what I'm missing.

-PatP

yh i believe this may be exactly what im looking for as ive been told to work with java aswell. i currently have a server setup using the amazon ec2 web service.

does anyone know how i can install hadoop on ubuntu?