Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[EPIC] Data mixing #95

Closed
2 tasks
aakankshaduggal opened this issue Jul 8, 2024 · 3 comments
Closed
2 tasks

[EPIC] Data mixing #95

aakankshaduggal opened this issue Jul 8, 2024 · 3 comments
Assignees
@aakankshaduggal @khaledsulayman

Comments

@aakankshaduggal
Copy link
Member

  • Include data mixing that mixes the newly generated data with the pre-computed dataset. Add this functionality to the utils
  • After the generation is completed, call the data mixing method and create a new dataset that comprises of the pre-computed + new generated data(messages format) and this new data is passed over to training.
@shivchander shivchander mentioned this issue Jul 8, 2024
Closed
4 tasks
@russellb
Copy link
Member

russellb commented Jul 8, 2024

It would also be great if someone could draft a proposed CLI UX for this functionality. What info is needed from a user? How and where would they provide it?

@markmc
Copy link
Contributor

markmc commented Jul 15, 2024

See also aakankshaduggal#4

@markmc markmc added this to the 0.1.3 milestone Jul 15, 2024
@bbrowning bbrowning mentioned this issue Jul 18, 2024
Closed
19 tasks
@markmc markmc modified the milestones: 0.1.3, 0.2.0, 0.2.1 Jul 19, 2024
@markmc
Copy link
Contributor

markmc commented Jul 25, 2024

Replaced by #162

@markmc markmc closed this as completed Jul 25, 2024
@markmc markmc removed this from the 0.2.1 milestone Jul 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aakankshaduggal aakankshaduggal

@khaledsulayman khaledsulayman

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@markmc @russellb @aakankshaduggal @khaledsulayman