Hi there! In the function corresponding to NDCG calculation I noticed that `ignore_rank_of_non_annotated_urls` flag is present. https://github.com/github/CodeSearchNet/blob/76a006fda591591f196fd0aef1d6282af3135f71/src/relevanceeval.py#L76 The question is: are your results in the paper calculated with `ignore_rank_of_non_annotated_urls=True`?
Hi there! In the function corresponding to NDCG calculation I noticed that
ignore_rank_of_non_annotated_urlsflag is present.CodeSearchNet/src/relevanceeval.py
Line 76 in 76a006f
The question is: are your results in the paper calculated with
ignore_rank_of_non_annotated_urls=True?