Disable rubocop for folder, but re-enable for specific files in folder

I'm trying to disable a cop for an entire folder, but then re-enable the cop for specific files inside the folder. I've tried the following, but it doesn't work.

Lint/AmbiguousBlockAssociation:
  Exclude:
    - 'spec/**/*'
  Include:
    - 'spec/support/**/*'
    - 'spec/factories/**/*'
    - 'spec/rails_helper.rb'
    - 'spec/spec_helper.rb'

Is this possible with rubocop?