Is there an application / tool that can scan through tons of flatfile ( individual .html pages) pages, strip the html and put the data into an access table or other database? The 2 gig of individual html files are searchable by index server -- maybe there's a way to extract some data from index server?

You can write one yourself

Check out the FileSystemObject in Visual Basic (and it's siblings, VBA, VBS).