Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dunnett test is more stringent than pairwise test #276

Open
LLansing opened this issue Jul 24, 2024 · 1 comment
Open

Dunnett test is more stringent than pairwise test #276

LLansing opened this issue Jul 24, 2024 · 1 comment
Labels
invalid This doesn't seem right

Comments

@LLansing
Copy link

I've ran the same ancombc2 analysis as both Dunnett and pairwise, but the Dunnett results have fewer significantly differential taxa. My understanding was that the Dunnett test employs fewer comparisons and thus p-value adjustment would make a smaller impact compared to the pairwise results. However, it appears I may be mistaken.

Is my understanding incorrect?

Here are my function calls:

da_sp <- ancombc2(data = species_pseq,
                fix_formula = "trt.foster+rep",
                p_adj_method = "BH",
                n_cl = 4,
                pseudo_sens = TRUE,
                group = "trt.foster",
                pairwise = TRUE)
 
 da_sp_dun <- ancombc2(data = species_pseq,
                   fix_formula = "trt.foster+rep",
                   p_adj_method = "BH",
                   n_cl = 4,
                   pseudo_sens = TRUE,
                   group = "trt.foster",
                   dunnet = TRUE)

to which I then compare the number of values that are TRUE in da_sp$res_pair$diff<comparison> columns to da_sp_dun$res_dunn$diff<comparison> columns.

@Maggie8888
Copy link
Collaborator

Dunnett test controls multiple comparisons, you may find helpful information form the website https://en.wikipedia.org/wiki/Dunnett%27s_test

@Maggie8888 Maggie8888 added the invalid This doesn't seem right label Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants