Thread: What database should I use?
08-17-16, 13:53 #1Registered User
- Join Date
- Aug 2016
What database should I use?
I'm going to crawl websites and rate them, so I just need to store domain (like facebook.com or bbc.co.uk) and integer value (0-750k).
Everyday crawler will add about 100k rated websites to database.
Each day I'm going to select top 100 websites (those with the lowest rate) about 10 times.
What technology/database/... should I use to minimize costs?
I'm running Linux and have some basic knowledge of relational databases but manuals are my friends so whatever is ok
Thanks in advance
Edit: I need to rate exactly 10,000,000 websites.
Last edited by RIck90; 08-17-16 at 14:01.