Syntax for template friend declaration

I have template <int N> class A; and template <typename T> class B;. How do I declare B<A<N>> to be a friend for all N? template <int N> friend B<A<N>>; does not work.