Results 1 to 5 of 5

Thread: Data Sets

  1. #1
    Join Date
    Jan 2011
    Posts
    5

    Data Sets

    Is there any type of data sets that would best be used in a format other than a database?

  2. #2
    Join Date
    Feb 2004
    Location
    In front of the computer
    Posts
    15,579
    Yes, definitely. Please explain your question so I can give a better answer.

    -PatP
    In theory, theory and practice are identical. In practice, theory and practice are unrelated.

  3. #3
    Join Date
    Jan 2011
    Posts
    5
    Well I was just thinking about the subject due to an article I read for class. I've searched the internet posing that question and the only thing I've found is arguments about whether images or "binary" data should be stored in a database. I found nothing about data sets. Maybe I'm approaching the question wrong but I can't think of a "data set" that should not be stored in a database where a different format should be used.
    Thanks for helping.

  4. #4
    Join Date
    Feb 2004
    Location
    In front of the computer
    Posts
    15,579
    For small databases (under 250 Gb), the difference isn't crucial in most cases. When the application reaches a certain size, you have to look at "scale out" versus "scale up" and start spreading the load across more servers. Some types of data such a pictures, audio, video, and complex multimedia will perform much better if you allow easy parallel access by storing them in a file system.

    An application that I worked on a few years ago is a great example. There was a fair bit of conventional database activity which was hit directly by the application servers. There was a fair bit of multimedia that was served directly to the web servers by the file servers. By picking the right persistance (storage of data) for the task at hand we were able to both increase performance and decrease the cost of the solution at the same time.

    Databases are my preference for storing true "data" that can be edited by the user or that is used for making decisions about processing. File systems are still much better for static information such as application help and video tutorials.

    -PatP
    In theory, theory and practice are identical. In practice, theory and practice are unrelated.

  5. #5
    Join Date
    Jan 2011
    Posts
    5
    Thanks for replying Pat. You answered my question and more. I have some terminology to study now. Application servers, file servers and web servers will be some interesting research. I've only been aware of the use of the word server. Cheers!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •