Git + a large data set?

We're often working on a project where we've been handed a large data set (say, a handful of files that are 1GB each), and are writing code to analyze it.

All of the analysis code is in Git, so everybody can check changes in and out of our central repository. But what to do with the data sets that the code is working with?

I want the data in the repository:

• When users first clone the repository, the data should come with.
• The data isn't 100% read-only; now and then a data point is corrected, or a minor formatting change happens. If minor changes happen to the data, users should be notified at the next checkout.

However, I don't want the data in the git repository:

• git cloning a spare copy (so I have two versions in my home directory) will pull a few GB of data I already have. I'd rather either have it in a fixed location [set a rule that data must be in ~/data] or add links as needed.
• With data in the repository, copying to a thumb drive may be impossible, which is annoying when I'm just working on a hundred lines of code.
• If an erroneous data point is fixed, I'm never going to look at the erroneous version again. Changes to the data set can be tracked in a plain text file or by the person who provided the data (or just not at all).

It seems that I need a setup with a main repository for code and an auxiliary repository for data. Any suggestions or tricks for gracefully implementing this, either within git or in POSIX at large? Everything I've thought of is in one way or another a kludge.