TL;DR
Don't use symlinks in repos that are meant to be used on both Windows and Linux/Mac.
The problem with symlinks
Based on the comments under the question, it turns out the repo did not have two copies of the big file, but rather one copy, and a Linux-style symlink pointing to it.
Git fully supports symlinks - you can add them, modify them, check them in, check them back out. As long as you're staying in Linux, everything will work fine.
But Windows* does not (always) support Linux-style symlinks, so what you get is broken, as you describe in the comments under the question.
The solution: get rid of symlinks in cross-platform repos
It might not seem like a nice solution, but if your repo is meant to be used on Windows and *nix OSs, avoid symlinks.
You will still save some space, at least on the Git server, and in Git LFS storage too, because Git is smart enough to reuse the same blob when there are two identical files in a repo. In fact, it's unable to do anything else, because the sha1 hash of the blob is what is used to store and retrieve the blob! You'll just have two copies of it in each sandbox that uses that repo.
The asterisk: Windows does support symlinks, just not by default...
Kudos to @GianMarco for this blog post link: Symlinks in Windows 10
Windows can now support symlinks, but it's not enabled by default: you have to be an admin or have the developer mode enabled.
Here's essential reading if you want to use symlinks with Git on Windows: Git-for-Windows's Symbolic Links documentation.
TL;DR: if you configure Git-for-Windows to try to create symlinks (with git config core.symlinks true) and you have permission to create them, you should be able to checkout a repo with symlinks and see them work correctly on Windows too.
I personally remain averse to using symlinks in cross-platform repos, because I want my repos to always just work as intended, but I'm happy to see the option now exists on Windows!