This dataset contains code and data for our paper "Better by default: Strong pre-tuned MLPs and boosted trees on tabular data". The main code is provided in pytabkit_code.zip and contains further documentation in README.md and the docs folder. The main code is also provided on GitHub. Here, we additionally provide the data that is generated by the code as well as the plots. See the documentation in docs/source/bench/download_results.md in the main code for instructions on how/when to download which data. The code for the Grinsztajn et al. (2022) benchmark is provided in grinsztajn_benchmarking_code.zip and on GitHub.