Inference: Sampling result

[xinhaoc]

Description of changes:

Related Issues:

Linked Issues:

• Issue #

Issues closed by this PR:

• Closes #

Before merging:

• Did you update the flexflow-third-party repo, if modifying any of the Cmake files, the build configs, or the submodules?

[xinhaoc]

before:

I believe the meaning of life is to live it to the fullest and to enjoy every moment of it.
I believe that the meaning of life is to live it to the fullest and to enjoy every moment of it.
I believe that the meaning of life is to live it to the fullest and to enjoy every moment of it. I believe that the meaning of life is to live it to the fullest and to enjoy every moment of it. I believe that the meaning of life is to live it to the fullest and to enjoy every moment of it. I believe that the meaning of life is to live it

after

 I believe the meaning of life is to live life to the fullest and not waste it. I believe everyone is born with a purpose and that is to find that purpose and live it out to the fullest. I believe everyone has a gift that God has given them and that gift is meant to be shared with the world. I believe the meaning of life is to live a full life. 2019- B H Hy S: T Spring Su B Ford:-/ N R H Toy Bu A Che I Maz W MA- is Vol Se B was International is Toy Maz F N- April is

it will avoid the repeat sentence, but also generate some meaningless tokens at the end. need to find a way to address this problem.
this is due to the gneration config params, like top_p value, temperature value.

[xinhaoc]

I think we can merge this PR.