Questions tagged [measurement]
Measurement is the assignment of a value (numeric or otherwise) to an observation.
365 questions
2
votes
1
answer
101
views
Validating a new metric using two-period panel data
Suppose I have two metrics, x and y. I have measures for a few dozen units on both metrics, at time 1 and at time 2.
I want to validate metric y, so that future users can use it as a substitute for ...
9
votes
3
answers
391
views
What makes a metric representative and reliable when comparing different processes?
I’d like to ask a general question about metrics.
Recently, while working as an intern, I was asked to evaluate the success of different marketing journeys (in a CRM/Marketing Cloud context). The data ...
3
votes
1
answer
117
views
Ordinal item should be regressed as such using ordered regression. But how can ordinal scales be treated using ordered regression?
Many fields use questionnaires that ask questions with ordered answer options. For instance, a question might be I have a good self-esteem, with response options ranging from Fully disagree; Disagree; ...
2
votes
2
answers
200
views
Statistical analysis for 2 measures in intervention group and 1 measure in control group?
I have to analyse the results of an intervention research where 3 dependent variables were measured with questionnaires. Participiants were randomly assigned to intervention and control groups. In the ...
15
votes
6
answers
3k
views
Is there any problem with too much (or false) precision?
For example, I often work with ages, for adults and infants. For adults, 0.001 years is less than a day. Rarely do we need to know adults' ages down to the hour. But, often databases store ages down ...
1
vote
1
answer
76
views
What is this measure of diversification called?
Suppose that a population is comprehensively divided into mutually exclusive categories $1,...,n$. The proportion of the population in category $k$ is $p_k$, so that $p_1+\cdots+p_n=1$. The proposed ...
9
votes
3
answers
1k
views
Is "categorical data" a synonym of "nominal data"?
So far, it's always been my understanding that nominal data was a type of categorical data, not a synonym of it. For me, categorical data included ordinal data, not just nominal data.
As of November ...
2
votes
0
answers
54
views
What are the mathematical structures of nominal, ordinal, interval and ratio data? [duplicate]
In Michael Eysenck's fundamentals of psychology, it says
Another factor to consider when deciding which statistical test to use
is the type of data you have obtained. There are four types of data of
...
2
votes
1
answer
110
views
Estimates from low resolution measurements: The weight of a single almond
Christmas will be here before we know it, so we've started honing our christmas cookie baking skills. Today it was a madeleine variety, so almonds were involved. While weighing up the almonds the ...
0
votes
0
answers
46
views
Measure gaps in support of histogram/probability distributions
I have a distribution of a Groundtruth (green graph) that I would like to learn using xgboost. The red graph in the figure below shows the distribution of xgboost's learned predictions. By the way, ...
0
votes
0
answers
82
views
Ratios when 0 denominator is possible
I've seen a few threads discussing something similar but I feel like my use case is a little different and doesn't fit the answers given.
I have records for digital usage where a user can use the web ...
4
votes
1
answer
204
views
Logic of scales of measurement (Nominal, ordinal, etc.) when transforming variables
Scales of measurement often discussed as:
Nominal: Qualitative category with no order
Ordinal: Order but no meaningful distance between values
Interval: Order and meaningful distance between values
...
8
votes
1
answer
465
views
Why does Item Response Theory not depend on a representative sample, or why is it "sample-independent"?
Multiple resources describing Item Response Theory (IRT) and comparing it to Classical Test Theory (CTT) note that CTT depends on a representative sample whereas IRT does not.
Sample-independence of ...
9
votes
1
answer
173
views
Show that "dichotomizing" a continuous outcome variable reduces the standardized effect size
We have been teaching sample size calculation for the comparison of two groups A and B. I was asked to provide a mathematical explanation of why it reduces power to "dichotomize" a ...
1
vote
2
answers
283
views
Confusion about Standard Error of Measurement (SEM)
The problem is this: I want to "estimate the error made when attempting to predict the true score from the observed score when I am using an unreliable measurement" (Theory of Mental Tests, ...
1
vote
1
answer
74
views
Minimum number of samples to effectively measure an effect
An interesting question came across my desk. With some hypothesized success rate, $p$, what is the minimum number of binomial trials needed to effectively measure this effect?
Given an infinite number ...
2
votes
1
answer
71
views
Combined reliability for statistically independent tests/measurements
I'm perplexed by this statement in Wikipedia article, 'Consilience':
"Statistically, if three different tests are each 90% reliable when they give a positive result, a positive result from all ...
0
votes
1
answer
85
views
Measurement invariance across groups and time
I want to run a multi-group longitudinal model. Based on prior invariance testing, I can assume scalar invariance across groups and time. So is it appropriate to have both the same intercepts across ...
3
votes
1
answer
174
views
How to improve testing method B, if Bland-Altman analysis show a near-perfect correlation between the difference and the mean between method A and B?
I have two sets of measurements (two different methods), A and B.
Correlation between the measurements is only modest.
Therefore, I wondered whether there is some inherent bias in (one or both) of ...
3
votes
1
answer
107
views
Why is reliability a ratio of true score variance to total score variance, instead of the ratio of true score to total score?
Reliability is given by:
$r_{xx} = \frac{Var(T)}{Var(X)}$
where $T$ is the true score and $X$ is the total score.
Why isn't reliability simply:
$r_{xx} = \frac{T}{X}$
where $T$ would be a sum of all ...
3
votes
0
answers
69
views
Dry skull vs live skull measurement adjustments
I am working on a dataset that has dry skull measurements from a museum's collection (twice as many samples) or a live specimen (less common). As you can imagine, the live specimen are on average a ...
5
votes
2
answers
629
views
How to detect a plateau at the end of a short time series?
In exercise testing (spiroergometry), participants' oxygen uptake is measured continuously while they engange in physical exercise that progressively intensifies. The measurements are taken at regular ...
1
vote
0
answers
146
views
CFA Measurement Invariance - can weak invariance be significant with the configural but not strong invariance? [closed]
I am a newbie here. I searched through the forum but did not find similar questions, so I hope someone who is proficient with SEM / lavaan can help out.
I am using R lavaan and semTools to perform ...
2
votes
2
answers
110
views
How to compare distributions if some data maxed out instrument/measurement?
I am comparing the distributions for the strength of two part designs.
The test equipment maxes out at 300 units. The 300 units is an arbitrary limit of the equipment and does not represent a ...
1
vote
1
answer
118
views
Does measurement invariance analysis assume equal latent scores across groups?
I have completed a measurement invariance analysis comparing high-school aged boys to high-school aged girls on a measure of depression. The results suggest that scores are not (scalar) invariant; ...
0
votes
1
answer
86
views
What is F1 Score for this diagram?
I have this Venn chart that represent a dataset prediction of Identifying if our products are classified as "A41" standard or not
The Blue Circle represents a Machine Learning Model ...
4
votes
2
answers
422
views
Is there multi-variate generalized MAPE(Mean Absolute Percentage Error)
The MAPE could be employed in the context of regression problem and is defined by
$$
MAPE := \frac{1}{n} \sum_{t=1}^{n} \left| \frac{y_{t} - \hat{y}_{t}}{y_{t}} \right|
$$
where $y_{t}$ is target ...
3
votes
1
answer
112
views
Response style as an alternative explanation for latent mean differences under scalar invariance?
I established scalar measurement invariance for a two-group CFA. The output from my final model showed that the latent mean in group 1 is lower than the latent mean in group 2. Can this difference in ...
3
votes
3
answers
237
views
What is the (logical) relationship between an measurement instrument's validity and responsiveness?
The three major criteria for the quality of a measurement instrument are validity, reliability, and responsiveness. I understand validity and reliability, but I have trouble understanding the need to ...
4
votes
2
answers
124
views
Is there a standard measurement of 2-dimensional precision?
Suppose a gun is fired at the bullseye of a target a specific number of times.
Ignoring the accuracy (e.g. all the shots are well to the left and above the bullseye), is there a standard way of ...
7
votes
3
answers
2k
views
"Decade" variable ranging over 130 years - Can I treat this as continuous? I've seen it done with 8pt scales...but it doesn't past the smell test
My dataset includes "decade founded" but not "year founded" for organizations. I need to include some "maturity" variable in the model. Decade is the best I have. The ...
6
votes
1
answer
642
views
How can I calculate a relative measure of change for data series that can include zero?
I have a series of data points representing the number of OKs for a test. For each data point, I want to calculate by how much its value changed compared to the preceding value, and I need this ...
2
votes
2
answers
196
views
Is it valid to take the midpoint of discrete outcome variables that express a range e.g. (1-20%, 21-40%) then calculate the mean of those midpoints?
I work in a health service and have a PhD student who was told by my boss (her primary supervisor) to measure clinicians' responses concerning what proportion of their clients had a certain condition ...
0
votes
1
answer
60
views
Normalised versus true racing times as DV for a learning experiment?
I have a question about using ratios as variables in alpine ski racing research. We want to compare skiers' performance on different days, but snow conditions affect the results. To address this, we ...
2
votes
0
answers
63
views
Best way of determining how unique an inspector's ratings are compared to the average inspector
Noob question.
I have a full population of every inspector rating for all items being rated. Each inspector has inspected a subset of the items and given them a rating, but different inspectors have ...
0
votes
0
answers
55
views
Adding a confidence interval to deal with noisy measurements
I have a formula and I am not sure how the author of this paper got to that formula. Im working on an algorithm that can filter out ground points from a Point cloud. The author describes the following ...
7
votes
1
answer
456
views
How valid is the use of bootstrapping in my case?
I am currently working on the analysis of measurement data and have the problem of obvious non-normal data. Since most methods I want to use require normality (especially statistical process control ...
0
votes
1
answer
244
views
Is ceiling effect mitigated by standardisation, renorming or combining with other indicators?
I have a psychological test that consist of a set of binary items. It has a noticeable ceiling effect in the sum scores (essentially, a majority of participants get most items correct).
I also see ...
3
votes
1
answer
184
views
BMI is calculated from two other measurements, so does it need adjusting for multiple comparisons?
If BMI is calculated from measures of patient height as well has weight, do statistical tests and resulting p values around BMI changes need adjusting for multiple comparisons? I.e. Two tests were ...
0
votes
0
answers
309
views
Very Basic Question - Propagation of Error and Fold Changes in Medicine
Say you have measured three conditions (x, y, and z) together and at three separate times (three replicates). These raw values are normally distributed and in a linear space.
You use those three ...
13
votes
1
answer
686
views
Exposition of "levels of measurement" for mathematicians
Is there a good expository account that explains and justifies Stevens's classification of "levels of measurement" into nominal, ordinal, interval, and ratio, that is comprehensible to all ...
5
votes
1
answer
146
views
What's the standard deviation of the difference between randomly paired data?
Assume that we want to compare the agreement of two methods of measuring blood pressure (e.g. a machine and a sphygmomanometer). In their paper, Preiss & Fisher (2008) discuss the standard ...
0
votes
0
answers
34
views
Just passing through: Estimating the probability that a changing quantity will pass through some value within a time interval?
Suppose I have a quantity that is measured periodically, that is continuous in the following sense: In order for the quantity x to move from x=a to x=b, x must pass through all the values between a ...
0
votes
0
answers
84
views
Development of an adaptive scale
I need your help with a problem that I noticed and I don't know the solution (I am not from statistics). In sum, I would like to create a measurement instrument that is adaptive in that respondents ...
0
votes
0
answers
51
views
Using items with different numbers of response categories across time points in longitudinal modeling
I'm doing a cross-lagged panel modeling for three time points. For one specific construct of interest, I have three items that were used for across three time points, but the number of items used for ...
3
votes
2
answers
689
views
In measurement invariance testing, how can one differentiate between differences in response styles and differences in latent means?
I am trying to establish measurement invariance between two groups on a depression measure: high-school aged boys and high-school aged girls. Though my entire sample reports elevated depression ...
1
vote
0
answers
77
views
How to estimate variance when measuring fluctuating variable that never settles?
I am supposed the investigate viscosity related phenomena in water flow through a horizontal pipe, connected to a water tank at one end, and with clear opening on the other. Mounted in the middle is ...
1
vote
0
answers
55
views
Detection limit for a drop in speed, due to stopping between measurements
Assume that a device is traveling at a constant expected speed $\mu$, subject to random variation with standard deviation $\sigma$, for a measurement period of duration $t$. Then the expected travel ...
1
vote
1
answer
1k
views
How to determine sample size for non-normal distributed data with continuous variables?
TLDR: I need to determine the minimum sample size for measuring the energy consumption of code.
Hello, I'm trying to determine how many samples (N) I need in an experiment to be confident that my ...
1
vote
0
answers
39
views
How to treat data of one parameter measured with two same devices that show slight differences in averge [closed]
I have measured one parameter with two identical devices. Unfortunately one device shows higher values on average. Also maximum and minimum of the values differ by exactly the same value like the ...