I've been playing around with lightfm for quite some time and found it really useful to generate recommendations. However, there are two main questions that I would like to know.
to evaluate the LightFM model in case where the rank of the recommendations matter, should I rely more on
precision@kor other provided evaluation metrics such asAUC score? in what cases should I focus on improving myprecision@kcompared to other metrics? or maybe are they highly correlated? which means if I manage to improve myprecision@kscore, the other metrics would follow, am I correct?how would you interpret if a model that trained using
WARPloss function has a score 0.089 forprecision@5? AFAIK, Precision at 5 tells me what proportion of the top 5 results are positives/relevant. which means I would get 0precision@5if my predictions could not make it to top 5 or I will get 0.2 if I got only one predictions correct in the top 5. But I cannot interpret what 0.0xx means forprecision@n
Thanks