Custom Ruby Gem in Gemfile on Heroku

I've modified a Gem that I use in my Rails app, and need to use it on Heroku. Is there a way to upload the modified Gem to Heroku within my app and specify a custom path in my Gemfile?