Skip to content

Commit

Permalink
update link
Browse files Browse the repository at this point in the history
  • Loading branch information
skeydan committed Jun 16, 2023
1 parent c43afd2 commit 7eea42d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/2023-06-20-gpt2-torch/gpt2.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ preview: images/preview.jpg
knitr::opts_chunk$set(echo = TRUE, eval = FALSE, fig.width = 6, fig.height = 6)
```

Whatever your take on Large Language Models (LLMs) -- are they beneficial? dangerous? a short-lived fashion, like crypto? -- they are *here*, *now*. And that means, it is a good thing to know (at a level one needs to decide for oneself) how they work. Two days ago, I published [TBD](file:///home/key/code/rstudio/ai-blog/_posts/2023-06-20-llm-intro), intended for a more general audience, not necessarily too familiar with deep learning. Today, I'd like to address deep learning practitioners, walking through a `torch` implementation of GPT-2 [@Radford2019LanguageMA], the second in OpenAI's succession of ever-larger models trained on ever-more-vast text corpora. You'll see that a complete model implementation fits in fewer than 250 lines of R code.
Whatever your take on Large Language Models (LLMs) -- are they beneficial? dangerous? a short-lived fashion, like crypto? -- they are *here*, *now*. And that means, it is a good thing to know (at a level one needs to decide for oneself) how they work. On this same day, I am publishing [What are Large Language Models? What are they not?](https://blogs.rstudio.com/ai/posts/2023-06-20-llm-intro), intended for a more general audience. In this post, I'd like to address deep learning practitioners, walking through a `torch` implementation of GPT-2 [@Radford2019LanguageMA], the second in OpenAI's succession of ever-larger models trained on ever-more-vast text corpora. You'll see that a complete model implementation fits in fewer than 250 lines of R code.

## Sources, resources

Expand Down

1 comment on commit 7eea42d

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please sign in to comment.