Results 1 to 1 of 1
  1. #1
    Join Date
    Aug 2016

    Question What database should I use?


    I'm going to crawl websites and rate them, so I just need to store domain (like or and integer value (0-750k).
    Everyday crawler will add about 100k rated websites to database.
    Each day I'm going to select top 100 websites (those with the lowest rate) about 10 times.
    What technology/database/... should I use to minimize costs?
    I'm running Linux and have some basic knowledge of relational databases but manuals are my friends so whatever is ok

    Thanks in advance

    Edit: I need to rate exactly 10,000,000 websites.
    Last edited by RIck90; 08-17-16 at 15:01.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts