ListView - Fast scroll bar not visible for first time in 4.4 Kitkat

I have one list view with fast scrolling enabled. For first time, the fast scroll bar is not visible. But if I navigate to another screen and comes back to this, then it's getting visible. This issue is observed with latest Android OS version. i.e., on 4.4 - Kitkat

First vist

Second visit

Any idea on why it's happening like this?