this post was submitted on 23 Jul 2023
3 points (80.0% liked)
Code Monkeys
8 readers
1 users here now
Code Monkeys
A place for people to post code and other techy stuff
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Training data:
OpenWebText2 is an enhanced version of the original OpenWebTextCorpus covering all Reddit submissions from 2005 up until April 2020, with further months becoming available after the corresponding PushShift dump files are released.
https://openwebtext2.readthedocs.io/en/latest/