Object .data[[some_string]] is not translated correctly when used with dpyr::across in dplyr::mutate #1520
Description
Object .data[[some_string]] Is not translated correctly when used with dpyr::across in dplyr::mutate. Find below two examples: one without the use of dpyr::across that correctly translates .data[[some_string]]; and one with the use of dpyr::across that fails to correctly translate .data[[some_string]].
library(magrittr)
mtcars_db <- dbplyr::memdb_frame(mtcars)
my_col <- 'carb'
# Trivial mutating: when gear >= 4, assign NA, otherwise assign values from carb #
# Attempt 1: without dplyr::across
x1 <- mtcars_db %>%
dplyr::mutate(
x = dplyr::case_when(
gear >= 4 ~ NA,
TRUE ~ .data[[my_col]]
)
)
# Attempt 2: with dplyr::across
x2 <- mtcars_db %>%
dplyr::mutate(
dplyr::across(
dplyr::all_of(
'gear'
),
~
dplyr::case_when(
. >= 4 ~ NA,
TRUE ~ .data[[my_col]]
),
.names = 'x'
)
)
x1
# # Source: SQL [?? x 12]
# # Database: sqlite 3.46.0 [:memory:]
# mpg cyl disp hp drat wt qsec vs am gear carb x
# <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
# 1 21 6 160 110 3.9 2.62 16.5 0 1 4 4 NA
# 2 21 6 160 110 3.9 2.88 17.0 0 1 4 4 NA
# 3 22.8 4 108 93 3.85 2.32 18.6 1 1 4 1 NA
# 4 21.4 6 258 110 3.08 3.22 19.4 1 0 3 1 1
# 5 18.7 8 360 175 3.15 3.44 17.0 0 0 3 2 2
# 6 18.1 6 225 105 2.76 3.46 20.2 1 0 3 1 1
# 7 14.3 8 360 245 3.21 3.57 15.8 0 0 3 4 4
# 8 24.4 4 147. 62 3.69 3.19 20 1 0 4 2 NA
# 9 22.8 4 141. 95 3.92 3.15 22.9 1 0 4 2 NA
# 10 19.2 6 168. 123 3.92 3.44 18.3 1 0 4 4 NA
# # ℹ more rows
# # ℹ Use `print(n = ...)` to see more rows
x2
# Error in `collect()`:
# ! Failed to collect lazy table.
# Caused by error:
# ! no such column: .data.carb
# Run `rlang::last_trace()` to see where the error occurred.
In x1, .data[[my_col]] is correctly translated:
dbplyr::sql_render(x1)
# <SQL> SELECT
# `dbplyr_MemBTBwTpc`.*,
# CASE WHEN (`gear` >= 4.0) THEN NULL ELSE `carb` END AS `x`
In x2, .data[[my_col]] isn't correctly translated (see .data.carb in the SQL code):
dbplyr::sql_render(x2)
# <SQL> SELECT
# `dbplyr_MemBTBwTpc`.*,
# CASE WHEN (`gear` >= 4.0) THEN NULL ELSE (`.data`.`carb`) END AS `x`
# FROM `dbplyr_MemBTBwTpc`
Details
Session info:
R version 4.4.1 (2024-06-14)
Platform: x86_64-pc-linux-gnu
Running under: Ubuntu 22.04.4 LTS
Matrix products: default
BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3
LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so; LAPACK version 3.10.0
locale:
[1] LC_CTYPE=en_GB.UTF-8 LC_NUMERIC=C LC_TIME=en_GB.UTF-8
[4] LC_COLLATE=en_GB.UTF-8 LC_MONETARY=en_GB.UTF-8 LC_MESSAGES=en_GB.UTF-8
[7] LC_PAPER=en_GB.UTF-8 LC_NAME=C LC_ADDRESS=C
[10] LC_TELEPHONE=C LC_MEASUREMENT=en_GB.UTF-8 LC_IDENTIFICATION=C
time zone: Etc/UTC
tzcode source: system (glibc)
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] magrittr_2.0.3 offendeR_1.2.2 Rdbtools_0.5.2 testthat_3.2.1.1
loaded via a namespace (and not attached):
[1] tidyselect_1.2.1 dplyr_1.1.4 blob_1.2.4
[4] fastmap_1.2.0 promises_1.3.0 digest_0.6.35
[7] mime_0.12 lifecycle_1.0.4 ellipsis_0.3.2
[10] RSQLite_2.3.7 paws.storage_0.6.0 compiler_4.4.1
[13] rlang_1.1.4 config_0.3.2 tools_4.4.1
[16] utf8_1.2.4 yaml_2.3.8 data.table_1.15.4
[19] knitr_1.47 htmlwidgets_1.6.4 bit_4.0.5
[22] pkgbuild_1.4.4 curl_5.2.1 xml2_1.3.6
[25] pkgload_1.3.4 miniUI_0.1.1.1 withr_3.0.0
[28] purrr_1.0.2 paws_0.6.0 desc_1.4.3
[31] fansi_1.0.6 urlchecker_1.0.1 profvis_0.3.8
[34] xtable_1.8-4 cli_3.6.2 rmarkdown_2.27
[37] crayon_1.5.2 generics_0.1.3 remotes_2.5.0
[40] rstudioapi_0.16.0 httr_1.4.7 tzdb_0.4.0
[43] sessioninfo_1.2.2 DBI_1.2.3 cachem_1.1.0
[46] stringr_1.5.1 assertthat_0.2.1 vctrs_0.6.5
[49] devtools_2.4.5 jsonlite_1.8.8 hms_1.1.3
[52] bit64_4.0.5 noctua_2.6.2 glue_1.7.0
[55] stringi_1.8.4 later_1.3.2 tibble_3.2.1
[58] pillar_1.9.0 htmltools_0.5.8.1 brio_1.1.5
[61] paws.security.identity_0.6.1 R6_2.5.1 dbplyr_2.5.0
[64] paws.analytics_0.6.0 rprojroot_2.0.4 evaluate_0.24.0
[67] shiny_1.8.1.1 readr_2.1.5 memoise_2.0.1
[70] renv_0.15.4 httpuv_1.6.15 paws.common_0.7.3
[73] Rcpp_1.0.12 uuid_1.2-0 xfun_0.45
[76] fs_1.6.4 usethis_2.2.3 pkgconfig_2.0.3