How to tell if a file handle is a socket?

I need to log socket usage, and I wrote a LD_PRELOAD library.

The problem is when I override read() and write() than ordinary file operations are get logged too (of course).

So how can I tell ordinary file descriptors and socket descriptors apart?