How to make log4j2 log itself into a file?

I have a file appender:

<Appender type="File" name="main" fileName="logs/all.log">
        <Layout type="PatternLayout">
            <Pattern>%d [%p] %C %m%n</Pattern>
        </Layout>
</Appender>

And root logger, configured to it:

    <Root level="ALL">
        <AppenderRef ref="main"/>
    </Root>

But log4j itself are logging into console. Is there any way to setup log4j itself logging iunto a file?