bundler Rails require different gem in development

I'm trying to set up a develoment environment for developing a Rails gem. I would like to load the gem from a local source in development mode and via rubygems in production. I would like to do something like the following:

Gemfile

group :production do
  gem 'my_gem', '1.0.0'
end

group :development do
  gem 'my_gem', :path => '~/apps/my_gem'
end

When I run the bundle command, bundler complains that you can't load the same gem twice. Is there a way to require different versions of a gem depending on the Rails environment?