Last updated on 2025-12-24 01:48:50 CET.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.4.0 | 16.19 | 308.03 | 324.22 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.4.0 | 9.91 | 211.33 | 221.24 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.4.0 | 23.00 | 432.52 | 455.52 | ERROR | |
| r-devel-linux-x86_64-fedora-gcc | 0.4.0 | 26.00 | 441.26 | 467.26 | ERROR | |
| r-devel-windows-x86_64 | 0.4.0 | 18.00 | 293.00 | 311.00 | OK | |
| r-patched-linux-x86_64 | 0.4.0 | 15.65 | 318.37 | 334.02 | OK | |
| r-release-linux-x86_64 | 0.4.0 | 13.22 | 320.29 | 333.51 | OK | |
| r-release-macos-arm64 | 0.4.0 | OK | ||||
| r-release-macos-x86_64 | 0.4.0 | 9.00 | 267.00 | 276.00 | OK | |
| r-release-windows-x86_64 | 0.4.0 | 17.00 | 291.00 | 308.00 | OK | |
| r-oldrel-macos-arm64 | 0.4.0 | OK | ||||
| r-oldrel-macos-x86_64 | 0.4.0 | 9.00 | 252.00 | 261.00 | OK | |
| r-oldrel-windows-x86_64 | 0.4.0 | 21.00 | 422.00 | 443.00 | OK |
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [04:34:46.064] [mlr3] Running benchmark with 4 resampling iterations
INFO [04:34:46.317] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [04:34:46.386] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [04:34:46.433] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [04:34:46.490] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [04:34:46.587] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [31s/25s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [04:35:24.643] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:24.948] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:25.246] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:25.447] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:25.660] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:26.278] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:27.113] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:27.479] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [04:35:38.207] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:38.426] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:36:07.322] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:36:47.201] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:37:24.222] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:37:24.676] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:37:24.992] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:37:25.490] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [04:37:32.502] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [04:37:32.730] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [04:37:32.834] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [04:37:32.918] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [04:37:32.965] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [04:37:33.009] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [04:37:42.694] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:37:43.197] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:37:45.019] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:37:47.160] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:37:49.117] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:37:49.223] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:37:49.298] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:37:49.435] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:16:19.441] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:16:19.596] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:16:19.707] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:16:19.760] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:16:19.803] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:16:19.852] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [21s/24s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:16:54.162] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:16:54.282] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:16:54.577] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:16:54.879] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:16:55.268] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:16:55.798] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:16:56.170] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:16:57.189] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:17:06.885] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:17:07.014] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:17:39.586] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:18:08.327] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:18:36.356] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:18:36.867] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:18:37.567] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:18:38.155] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:18:44.457] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:18:44.666] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:18:44.746] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:18:44.776] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:18:44.807] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:18:44.832] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:18:53.989] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:18:55.005] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:18:56.896] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:18:58.940] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:19:01.211] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:19:01.415] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:19:01.575] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:19:01.632] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:47:23.935] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:47:24.373] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:47:24.547] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:47:24.706] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:47:24.916] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:47:25.144] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [39s/60s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:48:54.201] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:48:54.633] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:48:55.104] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:48:55.361] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:48:55.763] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:48:56.823] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:48:58.203] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:48:59.155] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:49:18.130] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:49:18.501] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:50:24.321] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:51:30.411] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:52:27.909] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:52:28.654] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:52:29.615] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:52:30.401] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:52:44.843] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:52:45.753] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:52:46.283] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:52:46.425] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:52:46.569] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:52:46.704] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:53:14.324] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:53:15.141] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:53:19.623] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:53:23.466] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:53:27.593] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:53:27.809] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:53:27.965] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:53:28.585] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [00:07:02.690] [mlr3] Running benchmark with 4 resampling iterations
INFO [00:07:03.055] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [00:07:03.203] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [00:07:03.286] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [00:07:03.378] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [00:07:03.472] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [33s/59s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [00:08:36.232] [mlr3] Running benchmark with 6 resampling iterations
INFO [00:08:36.671] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [00:08:37.146] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [00:08:37.455] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [00:08:37.887] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [00:08:38.992] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [00:08:40.384] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [00:08:41.585] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [00:09:00.698] [mlr3] Running benchmark with 6 resampling iterations
INFO [00:09:01.051] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [00:09:44.579] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [00:10:39.862] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [00:11:24.566] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [00:11:25.885] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [00:11:26.493] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [00:11:27.232] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [00:11:36.905] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [00:11:37.311] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [00:11:37.545] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [00:11:37.606] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [00:11:37.664] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [00:11:37.727] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [00:11:53.745] [mlr3] Running benchmark with 6 resampling iterations
INFO [00:11:54.584] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [00:11:57.354] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [00:11:59.927] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [00:12:02.465] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [00:12:02.703] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [00:12:02.842] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [00:12:03.045] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc