There is a difference, Numbers set up in the text format will be treated as text whereas in the general format numbers are numbers(unless specified as text with ' ) and text is text, Excel tends to be leaniant with data types so you should be ok with leaving everything as general,
I only change the format if i want to force the data i have into a specific type i.e. 2 decimal places etc.
HTH
Dave