Replication Data for: On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data


Non-Parametric Estimation in Information Theory 1. Introduction This is a repository for our paper on: "On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data". The projects is organizes as follows: ├── analysis_results\ │ ├── plots\ ├── data_evaluation\ │ ├── data\ │ ├── notebooks\ │ ├── results\ │ ├── utils\ │ ├── (...) scripts ├── data_generation\ ├── └── .gitignore 2. Installation Code was written in Python 3.11.5 but should be compatible with later and earlier versions of Python down to Python 3.6. Check the requirements.txt file for any dependency issues. Usage is recommended by cloning the repository to a local directory and setting up the required environment using venv and pip: python -m venv .venv source .venv/Scripts/activate pip install -r requirements.txt

  1. Generating Data Initially data is generated and stored in the data_evaluation/data directory using the script in the data_generation/ directory. The data for the experiments is stored as an HDF5 database. From the root directory: python data_generation/

Note: as the data.hdf5 file is ~123 GB, it is recommended to be locally generated. This process takes about ~12 hrs in an Intel Xeon E5-26280 v2 but shouldn't vary too much in any modern CPU. 4. Conducting an Evaluation The scripts in the directory data_evaluation/ are used to read the data and perform the experiments. Results are stored in the results/ directory. Again, from the root directory: python data_evaluation/

All of the names of the scripts have the format eval_{estimator}_{quantity}.py. In total, 12 scripts must be run, tree for each estimator: binning, KDE, numerical integration of KDE and k-NN. The notebooks/ directory serves as an archive of the development of the workflow to test each estimator. The contents of each notebook are generally the same as the code in the scripts. Log files describe the history of the project. 5. Visualizing Results The analysis_results directory contains a notebook to create the plots used in the paper, as well as a script to read the log files and calculate the time per iteration of the different experiments. The plots are generated using the results from the data_evaluation/results directory. Results are read from .hdf5 files.

All results produced using the UNITE Toolbox.

Related Identifier IsCitedBy
Metadata Access
Creator Alvarez Chaves, Manuel ORCID logo; Gupta, Hoshin ORCID logo; Ehret, Uwe ORCID logo; Guthke, Anneli ORCID logo
Publisher DaRUS
Contributor Alvarez Chaves, Manuel; Guthke, Anneli
Publication Year 2024
Funding Reference DFG EXC 2075 - 390740016 ; DFG 507884992
Rights MIT License; info:eu-repo/semantics/openAccess;
OpenAccess true
Contact Alvarez Chaves, Manuel (Universität Stuttgart); Guthke, Anneli (Universität Stuttgart)
Resource Type Dataset
Format text/x-python; text/plain; text/x-hdf5; application/x-hdf5; application/x-ipynb+json; application/pdf
Size 4305; 326875; 5195; 1839520; 370476; 113940; 1786; 3827; 12947; 132865550256; 56154; 6770; 8728; 4453; 6214; 7674; 3909; 7543; 9979; 5232; 7524; 9899; 5164; 179113; 185802; 188251; 190104; 187757; 182292; 182223; 182238; 7456; 203873; 549600; 9162; 341492; 5208; 96929; 0; 260995; 3361; 1857392; 1458014; 148644; 12954; 239395; 3003; 3296976; 16067; 534489; 8884; 31543; 741; 3675; 101; 2138; 2140
Version 1.1
Discipline Construction Engineering and Architecture; Engineering; Engineering Sciences