Do the following:
- Load the input data into a feed table
- Put a date on these records and copy them to a raw data table that holds all the raw data for each day.
- Process the feed data as you need to.
- Put the processed data with the date into a processed data table.
- Delete any ancient data you no longer need.
You will do your reporting etc on the processed data table. It's not difficult but I'd suggest that you get someone who knows what they're doing to write this for you - it will save you a lot of time.
Mike