Skip to main navigation Skip to search Skip to main content

Raw Python Code Corpus

  • Rafael - Michael Karampatsis (Creator)
  • Hlib Babii (Creator)
  • Romain Robbes (Creator)
  • Charles Sutton (Creator)
  • Andrea Janes (Creator)

Dataset

Description

A raw code corpus for the Python programming language i.e., includes only the Python source files of each repository without any preprocessing. The corpus was used to generate the Python training, validation, testing, and BPE encoding sets for the experiments performed in the paper: Big Code != Big Vocabulary: Open-Vocabulary Models for Source Code.

Data Citation

Rafael - Michael Karampatsis, Hlib Babii, Romain Robbes, Charles Sutton, & Andrea Janes. (2020). Raw Python Code Corpus [Data set]. 42nd International Conference on Software Engineering (ICSE 2020), Seoul, South Korea. Zenodo. https://doi.org/10.5281/zenodo.3628784
Date made available27 Jan 2020
PublisherZenodo

Cite this