I am currently building an application which updates a database at the rate of 1000 rows per second.. I am finding that unless I use bulk insert with SQL Server I cannot insert the data as single rows (CPU Flies off the handle on the server)...
The only problem with this is that I need to rationalise the data without hammering the server (I have yet to find a method using SQL Server which doesn't mash up the server)..
Also because this software needs to be distributable I was thinking SQL Server is not the best way to go..
Does anyone have any experience with Flat file databases ?? Which one would be the best ?? for this kind of mass record environment ?