The distinction you're seeing is called "emoji presentation" vs "text presentation." Some characters have both, and may have one or the other be the default.
The file you want is emoji-data. When you say "these don't have a full-colour emoji counterpart," that's not correct for most of them. They just have default text representation. I'll walk through a few of these to see how to understand them. One of my favorite exploration tools for this is the Unicode Utilities. You'll want UTS#51 as well.
(Note that in Unicode, WHITE means "not filled in" and BLACK means "filled in" in many cases for historical reasons, going back to Japanese flip phones. They are not actually colors. Similarly, HEAVY means "bold" or "wide.")
- ID: 263A
- Emoji: yes
- Extended_Pictographic: yes
- Emoji_Presentation: no
So there is an emoji form of this, but it's not the default. We have to ask for it by adding U+FE0F (VARIATION SELECTOR-16). With that, this character displays as ☺️.
For comparison, see this character, which is a more "traditional" emoji.
- ID: 1F60A
- Emoji: yes
- Extended_Pictograph: yes
- Emoji_Presentation: yes
- ID: 263B
- Emoji: no
- Extended_Pictographic: yes
- Emoji_Presentation: no (necessarily, since not Emoji)
So, this is not an emoji at all which means it has no "emoji presentation." It is merely "similar in kind to characters with the Emoji property" (i.e. extended pictographic).
Another example of an Emoji without Emoji_Presentation. The emoji form is ↕️.
And just for a little completeness:
- ID: 0031
- Emoji:yes
- Extended_Pictographic: no
- Emoji_Presentation: no
Digits are also emoji, and can take VS-16 modifier:
- default: 123
- as emoji: 1️2️3️
If you want a browsable list of characters with different properties, see the Character Property Index.