Snowflake network user-level policy

I'd like to create network policies in snowflake with this design

1. A user called loader can access with some unique 5 IPs
2. A user called transformer can access with some other unique 5 IPs
3. All other users can access on any IP - i.e. no network policy

From the docs on snowflake and the approach, it seems I can only add an account-level policy, which is then used inside for users specifically as needed

Can I create directly user-level network policies only for 1, 2 and leave out 3 in some way?