Questions tagged [cross-correlation]
A measure of correlation between different time series, at the same or different times.
400 questions
0
votes
0
answers
56
views
Generating correlated random numbers with non-identically-distributed random variables
I have a semi-Markov process in which the time between states is log-normally distributed, but with parameters that depend on $n$ (the mean and variance are state-dependent). In other words I have the ...
0
votes
0
answers
55
views
Finding subset of least correlated time series from a set of time series
I have got a set $T = \{t_1, t_2, t_3, ...\}$ that contains some stock prices time series. I am trying to find a way to construct a new set $S \subset T$ that satisfies the following characteristics:
...
0
votes
0
answers
95
views
Cross-correlation (dot product) vs residual sum squares (L2 norm)
Context
I have a roughly periodic signal $x_n$, and was going to do a cross correlation of a small segment $s_n = \{x_n\}_{n=n_0}^{n_0+N-1}$ with the rest of the signal
$$(x \star s)_k = \sum_{n=n_0}^...
1
vote
1
answer
90
views
Similarity between time series using GARCH residuals
I would like to have a reliable measure of similarity between several time series. These represents swap rates of different currencies.
I would like to start simple but also make sure I am not missing ...
0
votes
1
answer
279
views
Using cross-correlation to find signal delay
Let's say I have two signals $A$ (blue) and $B$ (red), of length $M$ and $N$ respectively, and $N<M$, like this (I've constructed this example to be a worst-case representation of the problem I'm ...
1
vote
1
answer
111
views
Analyzing epidemiological variables across years, countries and diseases
I have a large dataset including the following variables:
year (discrete from 2000 to 2020)
country (~100 countries)
...
2
votes
1
answer
83
views
Asymptotic Theory in Cross-Sectional Dependence
I've recently started studying cross-sectional dependence in panels from Pesaran's (2015) book, and I’d appreciate your help in developing an intuitive understanding of the concepts. Here’s a summary ...
0
votes
0
answers
67
views
The cross spectrum calculation: spec.pgram function in R
I have to do the calculation of a crosss-spectrum between two signals. I read the post "Spectral Analysis in R - the periodogram" and I understand why the periododram is symmetric. In the ...
0
votes
0
answers
78
views
Measure of correlation between binary sequences that were generated using a gaussian process
To perform an experiment, I need to construct a collection of $n$ binary sequences of length $T.$
Example consisting of $n=3$ and $T=20$:
$
\begin{bmatrix}
0&1&1&0&0&1&0&1&...
4
votes
1
answer
276
views
Creating correlated Gaussian processes
I want to create a set of Gaussian processes that are correlated.
Presently I understand how to generate a Gaussian process using which I am able to generate a sequence of length T. I do this by ...
1
vote
0
answers
85
views
Cross-correlation function using Spearman's correlation
Is it "kosher" to use Spearman's correlation in place of Pearson's in the cross-correlation function?
Basically, I have used the cross-correlation function to determine correlation over a ...
1
vote
0
answers
85
views
Causality analysis in time series
I'm trying to do a time series analysis, but I'm new to this topic and I need help. I have a multivariable time series and I would like to do an analysis of the relationship between them. I have done ...
1
vote
0
answers
54
views
Cross correlation between time series
I have to measure the cross-correlation between different time series in my dataset.
The dataset contains 9358 instances of hourly averaged responses from an array of 5 metal oxide chemical sensors, ...
1
vote
0
answers
45
views
Standard Error of a Mean of Standard Errors
I'm looking at a panel of observations where, for each column (15 sets of Y) in time series, I'm running individual OLS's to estimate each slope against a common (1) X variable. I now have the 15 ...
1
vote
1
answer
182
views
Looking for an efficient way to calculate the correlation of different time series
I have 6 temperature sensors (columns) located at different places. Each one offers a measurement each hour. I have $168$ measurements (rows).
I am working on python and I have already used the ...
2
votes
0
answers
118
views
GLS when error covariance matrix depends on regression coefficient
My data is a pair of points (x1, y1) & (x2, y2) [Just in case it's relevant, I explain how the data is created at the end]. I know how the data points are correlated. For a GLS (generalized ...
0
votes
0
answers
94
views
Can I do Pearson cross-correlation between two time series of Twitter data without violating the assumptions?
I have a dataset of Tweets regarding a given topic (extracted by predefined keywords and hashtags). I aggregated the Tweets in bins of time (e.g. every ten minutes) to generate a time series of the ...
4
votes
2
answers
268
views
Measuring level of uncorrelation from correlation matrix?
This question might not be completely well defined mathematically, but if so I am hoping that people can help point me in the right direction, since this is not a part of mathematics I have ever had ...
0
votes
0
answers
109
views
How do I choose parameters for WINDOW SIZE and POLYNOMIAL ORDER to calculate the detrended cross-correlation coefficient rho?
In my project I generate synthetic energy demand data using a neural network. I want to check the cross-correlation of those two time-series: the original and the synthetic one. I found, that the ...
14
votes
3
answers
3k
views
What does it mean for a time series to be autocorrelated?
I am trying to become more familiar with time series analysis. I am reading through Dangers and uses of cross-correlation in analyzing time series
in perception, performance, movement, and ...
1
vote
0
answers
387
views
Generalizing Inverse Variance Weighting?
Consider a generalization of inverse-variance weighting, where we choose normalized weights
$w_i = \dfrac{\sigma_i^{-p}}{W_p}$ for some $p\geq 1$, where $W_p \equiv \sum\sigma_i^{-p}$.
Then $p=2$ ...
0
votes
1
answer
100
views
Cross Correlation Function: How to handle an Auto-correlated response variable
I am attempting to perform a CCF analysis between a predictor time series(P_a_cm) and a response time series (delta_total_cm) which represent annual precipitation and annual water table elevation ...
1
vote
0
answers
43
views
Step type correlation plot: Need to understand correlation between 2 variables
I am struggling analyzing the correlation between two variables in my experiments. It turns out that I now that when the SNR of the signal (the definition of the signal with respect to the noise) is ...
2
votes
1
answer
478
views
Initial guess of a GARCH-DCC model?
I’m trying to fit an ECM-GARCH-DCC model for 2 time series, the whole 3 in the same time using log-likelihood estimation. It has 14 parameters to estimate:
ECM has 2 gammas and 1 lambda per time ...
0
votes
0
answers
57
views
How to generalise the results of cross correlation?
Data: I have 1000 independent time series. Each of these 1000 contains two variables A & B.
Goal: My goal is to find out whether there is a statistically significant correlation between A & B ...
1
vote
0
answers
289
views
Using JMP or R to find the correlation between two different time series?
Suppose I'm measuring concentrations of gas over time as well as relative humidity. How can I find the correlation between time series? The author suggests Pearson's correlation and the Cross ...
1
vote
0
answers
68
views
Check correlation between labels in two set of non-binary categorical labels?
I have a dataset with ~6k data points. Each data point has two labels, both categorical (unlike measuring temperature from cold, warm, to hot, my labels in the same category is totally non-continuous)....
0
votes
0
answers
38
views
Understanding Peaks and Valleys in CCF Results
I am new to cross-correlation and I'm running an analysis where I'm trying to see if Mentions_t can predict Calls_t at a later date (lags are in days). I got the following results and I am having ...
1
vote
0
answers
109
views
Time-lagged cross correlation between two measurements across multiple people
I have collected time-series data from a few hundred people. For each person, I have two measurements that I am interested in correlating.
Specifically, I want to identify the time point at which ...
1
vote
1
answer
220
views
Cross-lagged Pearson correlation in R
I have a dataset where I have two recordings (sessions) of two different variables.
...
0
votes
0
answers
103
views
Correlation by group and test for significant
My data has the following form:
...
1
vote
0
answers
92
views
Question on the 2002 Engle paper regarding GARCH-DCC model
Paper here, please open using Incognito tab: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=236998 press "Download this paper" button
Let me sum up the core of that paper in simple ...
1
vote
0
answers
45
views
Estimation of time-varying velocity
Objective:
Estimate the mechanical tension of a cable using the velocity of the waves travelling along it.
Experimental setup:
I have a cable in tension equipped with accelerometers. I measure a ...
1
vote
0
answers
245
views
Cross-correlation of cumulative sum of cross-correlated random variables
Let's say we have two random variables a and b, which are correlated. Will their cumulative sums (A and B) be correlated too? I find it logical that corr(A,B) = corr(a,b). I am bit rusty in my ...
1
vote
0
answers
49
views
Given a real matrix $M$, find the closest cross-correlation matrix
Say we have an arbitrary real matrix $M$. I am wondering if we can find a cross-correlation matrix that has the least square distance to $M$.
In other words,
$$\min_{A,B} \|M-A^TB \|^2_F $$
s.t.
$$...
1
vote
0
answers
38
views
Name of this "cross-correlation type" quantity?
Suppose I have I have vectors $x_1,\ldots,x_m$ in $\mathbb{R}^d$, with $\|x_i\|=1$ for all $i$
Is there a name or statistical/geometric interpretation of the following quantity?
$$\sum_{ij} \langle ...
1
vote
0
answers
171
views
Kendall correlation is significant but cross correlation is not significant
I have time series data and I am confused about the output of correlation and cross correlation.
This is my data:
...
3
votes
1
answer
450
views
Centering in normalized cross correlation for template matching
Context
I'm following Lewis (1995) exposition on normalized cross correlation for template matching (Section 2).
The cross-correlation of the image and the feature at $u,v$ is denoted by $c(u,v)$ and ...
1
vote
0
answers
48
views
What kind of statistical test might be used to if two datasets contain a non-zero lag or lead hierarchically?
I am aware of Granger causality, cross correlation, and simple methods of computing correlation at each lag/lead timestep. However, I have a dataset with 1000s of users each with a potential lag/lead ...
0
votes
0
answers
164
views
Correlation within groups
I have a dataset with 200 variables. Each row of my data represents the quarter results of a company. I want to know if variable X is linearly related to variable Y.
I computed the correlation matrix ...
0
votes
0
answers
77
views
Finding the vectors/modes "maximally responsible" for the fluctutation of a quantity?
I have a question which I fear might be simple but i am completely unable to figure out.
Lets say we have a time-series of a vector of coordinates which define a molecule ( column vector of x,y,z) ...
1
vote
1
answer
99
views
Is vector-autoregression applicable to two series with Granger causality and cross-correlation that has multiple modes, both negative and positive?
Is the vector-autoregression applicable to two series with Granger causality or stationary series where the cross-correlation plot is negative at some parts and also positive in others?
If that's the ...
2
votes
1
answer
160
views
Should one examine the cross-correlation plot to rule out performing Granger causality test?
Should one look at cross-correlation plot before performing Granger causality test to avoid type I errors?
If we can't find any dependence between two series from the cross-correlation plot, then ...
0
votes
0
answers
51
views
How does the Cross-Correlation Function of these two series suggest "bove average value of SOI is likely to lead to a below average value of..."?
library(astsa)
soi= scan("soi.dat")
rec = scan("recruit.dat")
soi=ts (soi)
rec = ts(rec)
ccfvalues =ccf (soi, rec)
ccfvalues
Reproduce these ...
1
vote
1
answer
2k
views
Cross-correlation of multidimensional time-series and Python function for computing it
So far I know, the cross-correlation of two time-series $a(t)$ and $b(t)$ for which $N$ observations are available is given by $r^N(\tau)=\frac{1}{N} \sum_{t=\tau+1}^Na(t-\tau)b(t)$, where $\tau$ ...
1
vote
0
answers
87
views
Temperature Lag calculation
I am working on a data science project on an industrial machine. This machine has two heating infrastructures. (fuel and electricity). It uses these two heatings at the same time, and I am trying ...
1
vote
1
answer
3k
views
Doubts with cross correlation in Python's statsmodels
I have been trying to understand statsmodels.tsa.stattools.ccf, the cross correlation between two random vectors and I tried
...
1
vote
0
answers
42
views
Cross Correlation Techniques for Time Series Data [closed]
I am working with time series data and am currently using cross correlation on my data. I can use different techniques like spearman, pearson, and kendall.
I was wondering if beyond that, there are ...
2
votes
1
answer
108
views
Cross-correlation seems defined backwards
Suppose $f$ and $g$ are real. Why
$$
C(\tau)=(f\star g)(\tau) = \int_{-\infty}^{\infty} f(t) g(t + \tau)dt \tag{1}
$$
and not
$$
C(\tau)=(f\star g)(\tau) = \int_{-\infty}^{\infty} f(t) g(t - \tau)dt\...
0
votes
0
answers
53
views
Cross-covariance in context of Andrews plot
As shown in this Cross-Validated post
Close curves on an Andrews plot
I don't understand how, in the accepted answer, the cross-covariance can be defined as,
$$\int_{-\pi}^{\pi}f_xf_ydt$$
Considering ...