Questions tagged [autocorrelation]
Autocorrelation (serial correlation) is the correlation of a series of data with itself at some lag. This is an important topic in time series analysis.
1,776 questions
1
vote
0
answers
25
views
R: Is it correct to use vcovSCC with pcce (plm library)
I am working on my undergraduate thesis. I'm working with a balanced macro-panel of N = 17 (countries of the same region) and T = 32 (years).
Considering that my panel shows a certain level of ...
0
votes
0
answers
44
views
GAMM model with corCAR1() run-time?
I am running a GAMM model to look at the effect of temperature on the daily patterns (in radians) of an animal's movement (step length). The data is hourly, however there are individuals with hours, ...
3
votes
1
answer
41
views
How to define a correlation structure for relational data in glmmTMB?
I have relational data, i.e. observations for pairs of objects. More specifically these are migration rates between plant populations, which I would like to explain by a predictor. The migration rates ...
0
votes
0
answers
31
views
Direct comparison of correlation coefficient R
I am a CS undergrad with some basic stats courses under my belt. I am now taking a time series course, which thus far seems to just apply the same statistical concepts to time-related data, which ...
4
votes
1
answer
173
views
Can I include latitude and longitude as fixed effects along with a Matern spatial correlation term in spaMM?
I’m modeling body mass in relation to differente variables, but I also need to account for spatial autocorrelation. My current approach uses spaMM with a Matérn correlation term based on coordinates.
<...
0
votes
0
answers
18
views
Temporal autocorrelation when my observations are pairwise comparisons between timesteps?
I have a timeseries of species abundances (continuous variable). I calculated the dissimilarity (Bray Curtis coefficient) between all time steps, and now I want to model this dissimilarities against ...
1
vote
0
answers
25
views
Spatial and temporal variance partitioning with missing values
I have a gridded dataset indexed by time and space, represented as a $m \times n$ array. I'm following along with Eq. 10 in this paper to partition the variance in this data over space and time. ...
0
votes
0
answers
43
views
Interpretation of ACF and PACF for my data
I have a data vector for which I calculated ACF and PACF estimates using R's base acf() and <...
0
votes
0
answers
42
views
Unaccounted for residual dependence in hierarchical GAM
I'm in need of some advice on how to account for residual dependence in a fitted GAM that doesn't appear to be driven by temporal structure in the data.
In summary, I am working with a long-term ...
0
votes
0
answers
26
views
Spatial Autocorrelation of Residuals
I am running SDM model with time and spatial fixed effects. When I apply, Moran's I test on the residuals of the model, I get the significant spatial autocorrelation. Why is it the case that I get so ...
0
votes
0
answers
50
views
Sampling counterfactual posterior to mitigate error autocorrelation in event studies
I have question regarding event studies (pre-event data is observed, an event occurs at $t=e$, then following the treatment is assumed to be in-effect.)
There are multiple approaches to event study ...
1
vote
0
answers
46
views
Autocorrelation between shocks in ARCH(1) model
I'm deep diving into the ARCH model and i had a doubt. While in AR or ARDL model the autocorrelation is a huge problem and the models themselves are shaped for fixing it, I've been reading that, in ...
0
votes
0
answers
93
views
Meaning of zero autocorrelation when performing linear regression on unstructured data
I have a seemingly very simple question that I cannot find the answer to.
When performing linear regression, we are assuming that the correlations between residuals is zero. This makes sense to me ...
2
votes
0
answers
42
views
Problem in gamm QQplot with gam.check() after adjusting for autocorrelation of residuals
I am following Wieling (2018) to fit a gam model. After checking for the autocorrelation of residuals, I added the autocorrelation corrections suggested by Wieling. Although the autocorrelation is ...
0
votes
0
answers
70
views
Modelling residual autocorrelation and heteroskedasticity in a small sample
I have monthly time series $\{y_t\}$ and $\{x_t\}$ (continuous variables) with just over 200 observations. I model $y_t$ conditional on $x_t$ them as follows:
$$
y_t = \alpha_1Jan_t + \dots + \alpha_{...
5
votes
1
answer
140
views
Can I cluster data based on their location and use it to account for spatial autocorrelation in my GLMM model?
I am trying to understand species presence (1/0) within protected areas in Africa using a set of predictor variables. My data is not nested and contains no hierarchies within it.
My question pertains ...
3
votes
1
answer
385
views
How is it that a time series can autocorrelate with first lag but not the second? And conequence on linear regression
When I have a time series that I want to model as an autoregressive series, I express my value at time t as a linear combination of previous values:
$$y_t=\sum_{i=1}^p\theta_iy_{t-i}+e_t$$
Right, but ...
8
votes
1
answer
188
views
Can Ljung-Box and ACF Be Used to Assess XGBoost Residuals?
I am using XGBoost to forecast electricity prices.
In classical time series models such as ARIMA, it is common to evaluate the model by analyzing the residuals using tools like the Ljung-Box test and ...
1
vote
1
answer
146
views
R: How to interpret my temporal variogram?
This is a follow-up question to my last one (larger dataset found here). I was able to code a variogram (gstat::variogram()), but the resultant plot is a bit ...
6
votes
1
answer
173
views
R: How to test for, or visualize, autocorrelation in irregularly spaced count data?
I'm not sure if this question is unique to count data, but I'm having trouble finding a means of detecting temporal autocorrelation between fish count observations recorded close in time. Although I ...
0
votes
0
answers
61
views
Optimal lag based on function VARselect from R package should be used on non-stationary data in levels or on stationary first differences?
I would like to ask regarding my research. I am going to use the cointegration tests Trace and Eigen, but I need optimal lags for them. Then I want to use VAR or VECM model, but it will be based on ...
1
vote
1
answer
76
views
How to only adjust for certain autocorrelation structures within specific levels of a by factor GAM model?
My model:
gam(response ~ s(days, k=9) + s(days, by=subject, k=9, m=1) + covariates.
I used this approach https://stackoverflow.com/questions/78182559/...
3
votes
2
answers
229
views
Do robust standard errors correct autocorrelation?
Autocorrelation exists and this was tested through Wooldridge test, to account for this I included lags of FDI and HC which corrected this.
Is lagging the right way to correct autocorrelation, or is ...
1
vote
0
answers
57
views
Failure to comply with Model Diagnostics test in Panel VECM estimation
I have an unbalanced panel (N = 39, T = 14). I aim to investigate the long- and short-run causal relationships between firm-specific variables and firm risk. Based on the findings of non-stationarity ...
0
votes
0
answers
35
views
Should you test for autocorrelation given geographical cross sectional data?
I was looking at my introductory course in econometrics, and found that cross sectional data is generally non autocorrelated. I started to wonder when the 'generally' would not hold. I was thinking ...
3
votes
1
answer
86
views
Is the autocorrelation of two measurements just the correlation between measurement 1 and 2?
I have over 100 sites where forest carbon was measured once in 2010 and again in 2020. I want to see if the second measurement is significantly dependent on the first one. I think this might also be ...
1
vote
0
answers
72
views
Is there any way to calculate or account for auto-correlation of many samples that each only have 2 observations?
Forest carbon has been measured for over 100 independent sites, and each site has been measured at two time points 10 years apart. At observation 1, each site has an amount of carbon that is ...
0
votes
0
answers
36
views
Quantification of departure from gaussianity in residuals of inhomogeneous time series model
Setup:
I applied a Gaussian process regression on several inhomogeneous time series. The GP kernels were motivated by a physical understanding of the phenomenon; the posteriors are well-sampled and ...
1
vote
0
answers
57
views
In time-series data with autocorrelation, how should I filter observations?
I'm looking at the simulation accuracy of a model that predicts forest carbon. I'm comparing these simulated values against measurements of forest carbon at specific sites. Each site has had forest ...
1
vote
1
answer
122
views
Autocorrelation and loss of information
When we want to train an ML model on a sample, it's better to have an i.i.d training sample. If the sample is autocorrelated we need much more data to actually train the model.
Intuitively this makes ...
0
votes
0
answers
57
views
Dealing with serially correlated errors (AR3) in two-way Fixed effects model
I have a problem that has been plaguing me over the past three days. I have an unbalanced panel. T=52, N=39, obs. = 1565. I am using a fixed effects model with time and country level fixed effects. ...
1
vote
1
answer
118
views
Calculating ICC and IAC for clustered binary longitudinal data in R
I have clustered binary data collected at three time points, with the following variables:
uid: Unit ID (individual unit)
cid: ...
0
votes
1
answer
312
views
temporal autocorrelation and seasonality in GAMs
I want to check/ better understand how to model seasonality and autocorrealtion in GAMs.
Here's an example of my data.
It is count data collected monthly, but I only want the trend at the yearly ...
1
vote
0
answers
60
views
AR process skew and other moments
I was reading this post: Analyse ACF and PACF plots, and in the comment it's noted that the data has a left skew which is a problem for AR process.
I am wondering why this is a problem and what are ...
1
vote
0
answers
43
views
Will group the series overestimate or underestimate the standard deviation?
Suppose I have a series $a_1, a_2, a_3, \cdots, a_{qN}$; its standard deviation is called $\sigma_a$.
Then define $b_j = \frac{1}{q}\sum_{i=1}^q a_{q(j-1)+i}$ as another series $b_1, b_2, \cdots, b_N$;...
0
votes
0
answers
64
views
How to account for temporal auto-correlation in 2 time covariates?
I've constructed a model in mgcv, but it seems there are still patterns in the residuals indicating some strong temporal auto-correlation. The data are irregularly spaced, so I think I need to use the ...
5
votes
2
answers
932
views
Why is "white noise" generated from uniform distribution sometimes autocorrelated?
I am trying to understand properties of different time series models. In order to be a white noise $w_t$ must follow three conditions:
$E(w_t) = 0$,
$Var(w_t) = \sigma^2$, and
$cov(w_t, w_s) = 0$, ...
0
votes
0
answers
47
views
Is autocorrelation in GARCH standardized residuals bad for creation of news impact curves?
I have made a GJR-GARCH(1,1) estimate for various MSCI indices and time periods. There is no autocorrelation (AC) in the squared standardised residuals, but there is some in standardised residuals. I ...
3
votes
1
answer
170
views
Is Copula Modeling Suitable for Accounting for Temporal Dynamics in Olive Plantation Data?
I am working on a project analyzing olive plantation data, where I aim to simulate the relationship between investment costs (Costs), revenues (...
4
votes
2
answers
142
views
Accounting for non-independence and autocorrelation in HGAM
I am currently trying to fit a HGAM to model differences in daily activity patterns of fish in two treatments. Data were collected with high-resolution telemetry, and I currently have estimates of ...
0
votes
0
answers
53
views
ACF Diagnostic for Shifted Distribution Univariate Time Series Data
I have these 1920 observations with shifted distribution. For some reasons I want to use all of observations for time series modeling but I have difficulty in reading the ACF plot. I need detail ...
3
votes
1
answer
335
views
How to calculate autocorrelation manually
I was taught the autocorrelation in a time-series at lag $k$ is the correlation between all pairs of values separated by this lag.
Suppose I want to give it a go and calculate it manually for lag 1.
...
1
vote
0
answers
72
views
Is there a spurious correlation between slope and intercept of a simple linear regression under constrained x and y? [closed]
I am trying to determine if I can use the y-intercept of a simple linear regression to predict the slope but I want to confirm whether the y-intercept is spuriously correlated with the slope. Would ...
1
vote
0
answers
65
views
Dealing with non-stationary time series in Granger Causality
I am working on determining the Granger Causality of two time series.
One thing to note is that for my specific project, I have around 100k time series across two different dimensions, say Product ...
1
vote
1
answer
64
views
Understanding the error covariance of pooled regression model
I am reading Econometric Analysis by Greene (7th edition, 2011). On page 350, he discusses the random effects regression model:
$$
\begin{aligned}
y_{it} &= x'_{it} \beta + E[z'_i \alpha] + \left[ ...
2
votes
2
answers
161
views
Posterior simulation of residuals and ACF for GAMs
I am using R to smooth time series using Generalised Additive Models (GAMs).
A preceding question concerned uncertain serial autocorrelation in the residuals. I was impressed by the diagnostic plots ...
1
vote
1
answer
68
views
Why do the BG test results seem contradictory
I conducted a Breusch-Godfrey (BG) test after performing a regression, and the results showed that the p-value was 0.12, indicating that there is no serial correlation. However, the two-time lagged ...
5
votes
1
answer
167
views
Uncertain serial autocorrelation in GAM count model residuals
I wish to use Generalised Additive Models (GAMs) to smooth count time series and estimate first derivatives, i.e. to identify periods where the counts are increasing, stable or decreasing.
I'm using R ...
1
vote
0
answers
47
views
Degrees of freedom for Ljung-Box test
I have two questions regarding the degrees of freedom for the Ljung-Box test on residuals in case of different AR(p) models:
In case of a model with non-consecutive lags: As I understand it, one has ...
1
vote
0
answers
85
views
How do you specify a regression model when both the response and explanatory variables are autocorrelated?
I have two sets of data points:
Each data point (y_t) in the first set represents the annualized return for the next ten years of monthly return data, i.e., this is forward-looking data, so my last ...