Questions tagged [differences]
The process of taking the difference between two values to achieve desirable statistical properties. e.g. paired differences t-test, differences between time points in an AR(1) model, and difference-in-differences causal impact analysis.
169 questions
2
votes
1
answer
71
views
Determining the significant difference between one ratings and the average of 7 others within the same person
I have a large data set of participants, each participant has had 8 identical heat stimuli delivered to the right forearm. Pain ratings are provided for each of the 8 stimuli (on an 11 point ...
- 21
1
vote
1
answer
40
views
Testing equality of coefficients of different attributes in a multinomial logit
I trying to estimate the willingness to pay for a specific product. To do so, I am running a multinomial logit in willingness to pay space.
I am doing something like this using the ...
- 151
0
votes
1
answer
79
views
How to determine if 2 Pearson correlation coefficients are significantly different? (using Bonett's SE approximation)
I came across these solutions, but @Firebug's one doesn't seem to be using Bonett's approximation for the SE. Would it be possible to do something like this? Why is he converting r to z space, when we ...
- 475
1
vote
0
answers
48
views
Constructing transition matrix $B'$ for differential sequence in non-uniform RLL-constrained DNA channel to match spectral radius of $A'$
I’m computing the capacity of a run-length-limited (RLL) DNA channel with alphabet $\{ \texttt{A}, \texttt{T}, \texttt{C}, \texttt{G} \}$ (encoded as $\{0, 1, 2, 3\}$) and a non-uniform input ...
- 61
0
votes
0
answers
56
views
Compute difference in repeated-measures values, while controlling for another variable
In our experiments, we measured two types of metabolic rates - Baseline metabolic rate (BMR) and Summit metabolic rate (Mcold) on birds, such that each individual bird will have both BMR and Mcold ...
- 1
0
votes
1
answer
84
views
Hypothesis test where the null hypothesis states that the difference between two proportions equals a constant
I am looking for a statistical test to compare two proportions, but instead of testing whether their difference is zero, I need to test whether their difference equals a specific constant (d ≠ 0). ...
- 3
0
votes
0
answers
123
views
Using classifier prediction as independent variable with within-subjects data?
In my work I've stumbled upon an interesting result when a classifier is applied to within-subjects data. My question is whether this is a known result, and if so, does it have a name? I can't find ...
- 2,087
0
votes
0
answers
91
views
Statistical test to show differences between two categorical datasets
I have two categorical datasets that I would like to compare against each other, but I'm not exactly sure which test to choose and how to go about it. Both datasets show the number of cases for 8 ...
- 1
1
vote
1
answer
135
views
How to compare cases and controls after adjusting for age differences?
I have a dataset in which I have different measures (a, b, c) and two independent variables: D which is an independent binary variable representing cases (1) and controls (0), and age is another ...
- 11
0
votes
1
answer
113
views
What is the difference between a one sample t test of the difference between two groups versus a two sample t test comparing the two groups?
Let us say that we currently have two independent groups $G_1, G_2$ with equal sample numbers $n_{G_1} = n_{G_2}$ and may not have equal variances $ {\sigma_1}^2 \neq {\sigma_2}^2$. If the statistical ...
- 115
1
vote
1
answer
408
views
Getting relative measure of difference between two numbers - Reference (close to) zero
I'll be writing a program that compares two numbers and based on how different they are, perform, or not perfom an action. It would make sense to have one formula to get a standardized measure that I ...
1
vote
0
answers
41
views
Measuring treatment effect when only half the the treatment group appear affected
I have data for a set of customers divided into treatment and control, where the objective is to check the impact of treatment on customer’s bank balance. To this purpose, I computed the percentage ...
- 35
1
vote
1
answer
58
views
What is the distribution of similarites between 2 iterations of a binomial variable?
Suppose I have a binary vector $v$ of dimension $n$ with $np$ entries set to $1$ and $n(1-p)$ entries set to $0$ (where $0 \leq p \leq 1$, and $q:=1-p$).
Suppose I then generate a random vector $w$ by ...
- 121
0
votes
0
answers
76
views
Which test do I need for testing differences in two populations?
I would like to compare the different variables in a life table of two populations and check if the differences are significant. However, I am totally unsure which test is appropriate.
For example, I ...
- 1
0
votes
1
answer
129
views
How to calculate reliability of difference scores?
I am trying to calculate the reliability of a difference score. Specifically, the data have, for each participant, scores for 10 items in Condition X (1s and 0s), as well as 10 different items in ...
- 61
3
votes
1
answer
161
views
Is there a formula for the 95% confidence interval for the Skellam distribution or difference of two Poisson r.v.'s?
I have two independent Poisson random variables and want to assess the confidence bounds for X - Y. I know there is a closed form solution for Poisson confidence bounds, but need the difference. Can I ...
- 131
0
votes
0
answers
48
views
How to compare if multi-class outputs are different?
I am testing different multi-class (16 classes) classification models (ANN, DNN, DL, and so on) and the overall accuracy varies from 0.75 to 0.92. Despite that 0.92 is greater than 0.75, is there a ...
- 125
2
votes
1
answer
170
views
How to calculate mean difference for effect size calculation?
For a two-sample effect size calculation on paired data (or a one-sample test on differences), does it make sense for an effect size to be negative for a hypothetical % increase of a mean? I’m doing a ...
- 2,537
0
votes
0
answers
52
views
Statistical difference between very small distributions
I am evaluating machine learning classifiers with 4-cross validation due to very small dataset. Is there a way to determine if a classifier is better (other than F1 averages) from only 4 performance ...
- 1
1
vote
0
answers
55
views
How to model a difference score for cross-sectional, hierarchical survey data
What is the best way to model a difference score that is based on cross-sectional survey data, while also taking into account the hierarchical structure of the survey data?
I have the following survey ...
- 11
6
votes
1
answer
216
views
A time-series where the average of the difference depends only on the interval
Consider a time-series: $\{X_1,X_2,\ldots,X_T\}$.
Then, we can think of the difference like $X_{t+r}-X_{t}$, where $r$ is an integer.
Here, I am wondering whether there is any time-series process that ...
- 441
1
vote
0
answers
90
views
Error between average of averages and true average [closed]
It is known that the average of averages can yield an incorrect result as compared to the true average.
The classroom example comes to mind: if the test results of class A is [50, 60, 100], class B is ...
- 111
0
votes
0
answers
70
views
Can I test for a significant difference within one variable?
I collected microplastics falling on an island in a year. The types of microplastics are fiber (F) and miscellaneous (M) particles. I want to know if the number of each that fell are significantly ...
- 1
0
votes
0
answers
35
views
Improving an ARIMA model by eliminating AR/ME terms
I've come over the following two statements to manually improve the fit of an ARIMA model by changing its parameters $p,q$.
If the AR coefficients sum to nearly 1 and suggest a unit root in the
AR ...
- 103
1
vote
1
answer
848
views
Independent Variable vs. Dependent Variable in Statistics
Following are the definitions of independent variable and dependent variable I found on the internet:
<1> In statistical modelling, the dependent variable is studied to see if and how much it ...
- 113
4
votes
1
answer
213
views
Inverting diff() and BoxCox() in R
i'm doing a project with a non-stationary time series. i used BoxCox trasformation and differences to make it stationary
...
- 41
3
votes
1
answer
3k
views
One-way Table vs Two-way Table. What’s the difference?
The following is the definition representative of the definitions if you google the difference between the one-way and two-way table:
Sometimes we talk about data tables in terms of independent and ...
- 113
1
vote
0
answers
105
views
Transform Second Difference Predictions from VAR model back to levels
I am currently working with a VAR model in R using the second difference of some variables (it only becomes stationary after differencing twice). So far I'm trying to see if the model fits one of the ...
- 11
0
votes
1
answer
86
views
Train Test leakage
Imagine the following dataset. 1 --> Person buys this product sometimes 0 --> Person never buys this product:
...
- 101
1
vote
2
answers
1k
views
How does the Bayesian Information Criterion work for model selection? [closed]
I am aware that we can use the BIC values from different models in order to determine which model predicts the data best. However, I'm a little confused about the criteria used to determine which ...
- 113
2
votes
1
answer
232
views
Joint posterior distribution of differences
I have data $x_1,...,x_n$, $y_1,...,y_m$ and $z_1,...,z_p$ where
$$x_1,...,x_n\sim N(\mu_x,\sigma^2_x)$$
and
$$y_1,...,y_m\sim N(\mu_y,\sigma^2_y)$$
and
$$z_1,...,z_p\sim N(\mu_z,\sigma^2_z)$$
Now let'...
- 39
0
votes
0
answers
39
views
Relationship between std dev of difference of 2 random samples of a distribution and the std dev of the distribution
I am studying the analytical variance of a clinical test. In published work I observed two things: 1) when looking at a particular patient, the std dev of repeated replicates was 11.5 points. 2) when ...
- 101
2
votes
1
answer
88
views
Bootstrapped difference test with smaller subsamples
Question
How do I perform a bootstrapped difference test when my bootstrapped sample sizes are smaller than the original sample sizes?
Typically I would do this by taking $p = \frac{\sum_{i=1}^{B} t_{...
- 275
4
votes
3
answers
742
views
How to properly explain a delta between 0.10 to 0.05 in proportions
Assuming I have proportions for clicks to impressions of 0.10 for p1 and 0.05 for p2. This is equivalent to 10% and 5% click through rate.
One way is to say that p1 is 5% higher but can we even say ...
- 211
0
votes
0
answers
172
views
Can the chi-square statistic in Kruskal-Wallis test be compared to determine the most appropriate to distinguish the groups?
I have a dataframe in R which format is similar as follows:
v1 v2 v3 group
1 3.5 100 a
3 5 200 a
10 5.5 150 b
8 7.5 210 b
4 4.5 300 c
9 2.5 200 c
...
My ...
- 1
0
votes
0
answers
75
views
Difference or similarity in latent variables or SEM models
There are five latent variables (three independent and two dependent) which constitute a PLS-SEM model.
A single survey was conducted; however, the questions were asked twice to the same participants. ...
- 1
2
votes
1
answer
224
views
Wilcoxon Signed Ranks Test for relative differences
Is it correct to use the Wilcoxon signed ranks test for relative differences $\frac{Wx-Wy}{Wy}$, instead of absolute differences $Wx-Wy$? In some cases the relative difference is more relevant, for ...
- 35
2
votes
1
answer
217
views
The distribution of the difference between two correlated non-central t distribution
Suppose a binormal population $\{X, Y\}$ with means $\mathbf{\mu} = \{\mu_1,\mu_2\} \ne \{0,0\}$ and covariance $\Sigma= \sigma^2\begin{bmatrix}1 & \rho\\ \rho &1 \end{bmatrix}$. Let $S^2$ be ...
- 381
0
votes
0
answers
534
views
How to test for difference between two GLMs (generalized linear model) in R?
What are appropriate tests for determining whether two GLMs are statistically significantly different? AIC and BIC is not an option because I am not trying to determine parsimony.
If it were regular ...
- 139
0
votes
0
answers
148
views
How to determine if a relative difference is "big"?
I have two columns with the percentage of a certain variable, each column represents a different year. I calculate the relative difference in each category and I want to determine if this change is ...
- 1
0
votes
0
answers
207
views
Is it possible to use descriptive statistics to make conclusion about "differences"?
Here is the question that bothers me for a long time. I used an example to describe my question.
For example, if I asked the same participants to answer the two questions:
Q1) do you think that other ...
1
vote
0
answers
53
views
Crude difference vs effect size
Let's assume I have two groups of animals with the following weights and the average difference of 8 kilograms:
Could you explain in layman's language, how the calculate difference differs from the ...
- 2,327
3
votes
1
answer
599
views
Percentage change of interval data
My understanding is that the percentage/relative change is applicable/meaningful only with ratio data, and not with interval data. Can you confirm it is right, or correct me if it's wrong?
- 183
4
votes
1
answer
130
views
Sample size calculation in a clinical trial
I'm doing a clinical trial and I'm comparing a certain number before treatment and after treatment. I recorded the numbers for each patient before treatment and after treatment and take the difference(...
- 521
2
votes
1
answer
661
views
Which statistical method can be used to compare the values of the same variables measured from different views?
I got a biological data set, where I need to run a statistical analysis on.
The data was created on a mass spectrometer and contains the intensity values for around one hundred lipids.
The analysis ...
0
votes
0
answers
140
views
Test which time series is closer to zero
I have two time series, A and B, which represent reactions of subject A and B to a certain medication measured at different point in times. I want to formally test that the reaction of patient A is ...
- 220
1
vote
2
answers
2k
views
Taking percentage difference b/w average of values vs taking average of individual percentage differences
I have two sets of data points: List A [x1, x2, x3...xn] and List B [y1, y2, y3...yn]. If I were to calculate percentage difference between the two sets, what would be more accurate:
a. Taking ...
- 621
1
vote
0
answers
64
views
R or Excel: Calculate difference between dates [closed]
I have a list of course completion dates (person, start, end) in the following format (exemplary):
Person X || Sept 21, 2021 06:30 PM || Sept 21, 2021 06:50 PM
Now I'd like to calculate the overall ...
- 129
0
votes
0
answers
1k
views
Time-Series Analysis versus ODE parameter estimation -- why does one use first differences (stationarity) and the other does not?
This is kinda a tricky question, because it crosses disciplines. But I looking at the difference between time-series analysis in statistics, versus fitting parameters to ordinary differential ...
- 1,782
1
vote
1
answer
2k
views
How is standard error affected by multiplication?
If I have some measure, suppose the difference of two means, and then I multiply it by 100; how will the standard errors be affected? Will they be multiplied too? or will they be completely different?
- 357