Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

a little problem about results #9

Open
chenbofeng123 opened this issue Dec 10, 2020 · 3 comments
Open

a little problem about results #9

chenbofeng123 opened this issue Dec 10, 2020 · 3 comments

Comments

@chenbofeng123
Copy link

hi,sorry to interrupt you again~
we can see you get a so big improvement on amazon dataset !
i run your code on amazon dataset , and search parameters as your paper said "α; β; from 0:0001; 0:001; 0:01; 0:1".
but i am sad i can not get a comparable result as your paper. some details is below:
nmi: my best result is 0.2858 | 0.2954 for DMGI-att and DMGI. your paper is 0.412 and 0.425
macro | micro : my best result is 0.7426 | 0.7462| 0.7380| 0.7414 for DMGI-att and DMGI. your paper is
0.758 | 0.758 | 0.746 | 0.748. We can see my result is very close to you .
sim: my best result is 0.820 and 0.809 for DMGI-att and DMGI. , your paper is 0.825 and 0.816 . we can see my result is also very close to you .

so i am very confused about the performance about the metric nmi. do you meet the same problem or can you give me some suggestions?

@chenbofeng123
Copy link
Author

can you get a comparable result (nmi on amazon dataset)on your computer ?

@Mrxiahelong
Copy link

I also meet a same problem, the acm's nmi is 0.5806 which is much lower than the result in papers

@yoiscarlet
Copy link

I also meet a same problem, the acm's nmi is 0.5806 which is much lower than the result in papers

me too, the best acm's nmi of mine is 0.5886

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants