Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

指标问题?? #40

Open
BLUE811420 opened this issue Mar 26, 2024 · 3 comments
Open

指标问题?? #40

BLUE811420 opened this issue Mar 26, 2024 · 3 comments

Comments

@BLUE811420
Copy link

为什么SASrec和BERTrec在ml-1m数据集上的指标在各自论文中相差很大?评估方法我看论文中说的是一致的,请答复,谢谢

@pmixer
Copy link
Owner

pmixer commented Apr 12, 2024

建议把两边代码都跑一遍实际测出来 ml-1m 的结果贴回来看看,请务必这样做,谢谢。

@goodmanpzh
Copy link

这种以自己测试的为准吗

@pmixer
Copy link
Owner

pmixer commented Sep 26, 2024

这种以自己测试的为准吗

嗯,是的。细读每篇论文的话会发现各类设定(比如最后是给一个正样本配一百个负样本打分还是直接给所有物品打分)都不见得一样。论文里面通常是设定好自己的 baseline 条件(序列最大长度、负采样方法、负采样比例、评估指标),然后把所有模型放一起在这些条件下对比。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants