22 Reproducibility

All examples presented in this book are reproducible. Parts of the source codes are available in the book. Over time, some of the functionality of the described packages may change. The online version is updated. Fully reproducible code is available at https://pbiecek.github.io/ema/.

Possible differences may be caused by other versions of the installed packages. Results in this version of the book are obtained with the following versions of the packages.

22.1 Package versions for R

The current versions of packages in R can be checked with sessionInfo().

sessionInfo()
## R version 4.0.2 (2020-06-22)
## Platform: x86_64-apple-darwin17.0 (64-bit)
## Running under: macOS Catalina 10.15.7
## 
## Matrix products: default
## BLAS:   /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRblas.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRlapack.dylib
## 
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
## 
## attached base packages:
## [1] grid      stats     graphics  grDevices utils     datasets 
## [7] methods   base     
## 
## other attached packages:
##  [1] ranger_0.12.1         GGally_2.0.0          tidyr_1.1.2          
##  [4] scales_1.1.1          tree_1.0-40           gridExtra_2.3        
##  [7] dplyr_1.0.2           caret_6.0-86          ingredients_2.0      
## [10] gower_0.2.2           glmnet_4.0-2          Matrix_1.2-18        
## [13] iml_0.10.1            localModel_0.5        lime_0.5.1           
## [16] DALEXtra_2.0          iBreakDown_1.3.1.9000 e1071_1.7-4          
## [19] gbm_2.1.8             randomForest_4.6-14   rms_6.0-1            
## [22] SparseM_1.78          Hmisc_4.4-1           Formula_1.2-4        
## [25] survival_3.2-7        lattice_0.20-41       forcats_0.5.0        
## [28] patchwork_1.0.1       ggmosaic_0.3.0        kableExtra_1.2.1     
## [31] knitr_1.30            DALEX_2.0.1           ggplot2_3.3.2        
## 
## loaded via a namespace (and not attached):
##   [1] backports_1.1.10     workflows_0.2.1      plyr_1.8.6          
##   [4] lazyeval_0.2.2       splines_4.0.2        listenv_0.8.0       
##   [7] TH.data_1.0-10       digest_0.6.27        foreach_1.5.1       
##  [10] htmltools_0.5.0      parsnip_0.1.3        fansi_0.4.1         
##  [13] productplots_0.1.1   memoise_1.1.0        magrittr_2.0.1      
##  [16] checkmate_2.0.0      cluster_2.1.0        Metrics_0.1.4       
##  [19] recipes_0.1.14       globals_0.13.1       matrixStats_0.57.0  
##  [22] sandwich_3.0-0       dials_0.0.9          jpeg_0.1-8.1        
##  [25] colorspace_2.0-0     blob_1.2.1           rvest_0.3.6         
##  [28] xfun_0.18            RCurl_1.98-1.2       crayon_1.3.4        
##  [31] jsonlite_1.7.1       libcoin_1.0-6        flock_0.7           
##  [34] zoo_1.8-8            iterators_1.0.13     glue_1.4.2          
##  [37] gtable_0.3.0         ipred_0.9-9          webshot_0.5.2       
##  [40] MatrixModels_0.4-1   shape_1.4.5          mvtnorm_1.1-1       
##  [43] DBI_1.1.0            Rcpp_1.0.5           archivist_2.3.4     
##  [46] viridisLite_0.3.0    xtable_1.8-4         htmlTable_2.1.0     
##  [49] reticulate_1.16      bit_4.0.4            GPfit_1.0-8         
##  [52] foreign_0.8-80       stats4_4.0.2         prediction_0.3.14   
##  [55] lava_1.6.8           prodlim_2019.11.13   htmlwidgets_1.5.2   
##  [58] httr_1.4.2           RColorBrewer_1.1-2   ellipsis_0.3.1      
##  [61] reshape_0.8.8        pkgconfig_2.0.3      farver_2.0.3        
##  [64] nnet_7.3-14          reshape2_1.4.4       DiceDesign_1.8-1    
##  [67] tidyselect_1.1.0     labeling_0.4.2       rlang_0.4.8         
##  [70] later_1.1.0.1        munsell_0.5.0        tools_4.0.2         
##  [73] cli_2.2.0            RSQLite_2.2.1        generics_0.1.0      
##  [76] evaluate_0.14        stringr_1.4.0        fastmap_1.0.1       
##  [79] yaml_2.2.1           bit64_4.0.5          ModelMetrics_1.2.2.2
##  [82] purrr_0.3.4          future_1.19.1        nlme_3.1-149        
##  [85] mime_0.9             quantreg_5.73        xml2_1.3.2          
##  [88] compiler_4.0.2       shinythemes_1.1.2    rstudioapi_0.13     
##  [91] plotly_4.9.2.1       png_0.1-7            tibble_3.0.4        
##  [94] lhs_1.1.1            stringi_1.5.3        highr_0.8           
##  [97] vctrs_0.3.5          pillar_1.4.7         lifecycle_0.2.0     
## [100] bitops_1.0-6         data.table_1.13.2    conquer_1.0.2       
## [103] httpuv_1.5.4         R6_2.5.0             latticeExtra_0.6-29 
## [106] bookdown_0.21        promises_1.1.1       codetools_0.2-16    
## [109] polspline_1.1.19     MASS_7.3-53          assertthat_0.2.1    
## [112] withr_2.3.0          multcomp_1.4-14      mgcv_1.8-33         
## [115] parallel_4.0.2       rpart_4.1-15         timeDate_3043.102   
## [118] class_7.3-17         rmarkdown_2.4        inum_1.0-1          
## [121] pROC_1.16.2          partykit_1.2-10      shiny_1.5.0         
## [124] lubridate_1.7.9      base64enc_0.1-3

22.2 Package versions for Python

The current versions of packages in Python can be checked with pip.

pip freeze 
 absl-py==0.6.1             appnope==0.1.0            
 astor==0.7.1               atomicwrites==1.2.1       
 attrs==18.2.0              backcall==0.1.0           
 bleach==3.1.1              cycler==0.10.0            
 dalex==0.3.0               dbexplorer==1.21          
 decorator==4.4.2           defusedxml==0.6.0         
 entrypoints==0.3           future==0.17.1            
 gast==0.2.0                grpcio==1.16.1            
 h5py==2.8.0                imageio==2.9.0            
 importlib-metadata==1.5.0  innvestigate==1.0.4       
 ipykernel==5.1.4           ipython==7.13.0           
 ipython-genutils==0.2.0    jedi==0.16.0              
 Jinja2==2.11.1             joblib==0.14.1            
 json5==0.9.2               jsonschema==3.2.0         
 jupyter-client==6.0.0      jupyter-core==4.6.3       
 jupyterlab==2.0.1          jupyterlab-server==1.0.7  
 Keras==2.2.2               Keras-Applications==1.0.6 
 Keras-Preprocessing==1.0.5 kiwisolver==1.0.1         
 lightgbm==2.3.1            lime==0.2.0.1             
 Markdown==3.0.1            MarkupSafe==1.1.1         
 matplotlib==2.2.2          mistune==0.8.4            
 more-itertools==4.3.0      nbconvert==5.6.1          
 nbformat==5.0.4            networkx==2.4             
 notebook==6.0.3            numpy==1.19.0             
 pandas==1.1.1              pandocfilters==1.4.2      
 parso==0.6.2               patsy==0.5.1              
 pd==0.0.1                  pexpect==4.8.0            
 pickleshare==0.7.5         Pillow==5.3.0             
 plotly==4.9.0              pluggy==0.8.0             
 prometheus-client==0.7.1   prompt-toolkit==3.0.3     
 protobuf==3.6.1            psycopg2==2.7.4           
 ptyprocess==0.6.0          py==1.7.0                 
 Pygments==2.5.2            PyMySQL==0.8.0            
 pyodbc==4.0.23             pyparsing==2.2.0          
 pyrsistent==0.15.7         pytest==4.0.0             
 python-dateutil==2.7.3     pytz==2018.4              
 PyWavelets==1.1.1          PyYAML==3.13              
 pyzmq==19.0.0              retrying==1.3.3           
 scikit-image==0.17.2       scikit-learn==0.22.2.post1
 scipy==1.1.0               Send2Trash==1.5.0         
 simplejson==3.14.0         six==1.11.0               
 sklearn==0.0               sphinx-rtd-theme==0.4.0   
 statsmodels==0.11.1        tabulate==0.8.7           
 tensorboard==1.12.0        tensorflow==1.12.0        
 termcolor==1.1.0           terminado==0.8.3          
 testpath==0.4.4            tifffile==2020.7.17       
 torch==1.0.1.post2         torchvision==0.2.1        
 tornado==6.0.4             tqdm==4.43.0              
 traitlets==4.3.3           typing==3.6.4             
 virtualenv==16.2.0         wcwidth==0.1.8            
 webencodings==0.5.1        Werkzeug==0.14.1          
 xgboost==0.72              zipp==3.1.0