CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > General Forums > Main CFD Forum

autocorrelation and Power Spectrum

Register Blogs Community New Posts Updated Threads Search

Like Tree9Likes

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   April 22, 2021, 07:22
Default autocorrelation and Power Spectrum
  #1
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
Hi all,
usually in a lot of books of signal processing the autocorrelation of a signal x(t) is defined as:

\rho(\tau)=\int_{-\infty}^{+\infty}x(t)x(t+\tau)dt

Usually the signals we work with, such as the time history of the velocity component u(t), are finite signals. The autocorrelation in Tennekes and Lumley book is defined as:

\rho(\tau)=\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)dt

where u(t) is the history of the velocity component.

If I want to find the power spectral density, doing the Fourier Transform of \rho(\tau), which should be the integral of the extremes of the Fourier Transform? the same of the integral of \rho(\tau)(0 and T)?

Last edited by lucamirtanini; April 22, 2021 at 10:18.
lucamirtanini is offline   Reply With Quote

Old   April 22, 2021, 09:19
Default
  #2
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
The discrete FFT has a number of components up to the limit defined by the Nyquist frequency. Given the samplig step dt, given the period T, you have T/(2*dt) the maximum resolved wavenumber.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 09:28
Default
  #3
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
If we suppose that our signal is continuous but finite which should be the extremes of the FT integral? I am trying to demonstrate the autocorrelation theorem for finite signal.
lucamirtanini is offline   Reply With Quote

Old   April 22, 2021, 12:06
Default
  #4
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
Quote:
Originally Posted by lucamirtanini View Post
If we suppose that our signal is continuous but finite which should be the extremes of the FT integral? I am trying to demonstrate the autocorrelation theorem for finite signal.

A continuous function means you have dt->0 while a finite period T means you have a limit in the maximum wavelength.


The relation between power spectrum and correlation is described by Pope in his textbook.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 12:25
Default
  #5
Senior Member
 
Lucky
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 5,754
Rep Power: 66
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
When you do a Fourier transform of a finite signal, you're actually not doing it on a finite signal but a periodic extension of the signal (the same signal but repeated with a period equal to the length of the signal). Even if your actual signal in your databook is finite, the function you are transforming is infinite. There are quite a bit of nuances of Fourier stuff due to finite vs infinite signal length and discrete vs continuous.

That's why, both definitions are equivalent even though one is integrated from 0 to T and the other, minus to plus infinity. It takes some time getting used to, but they are the same...

To put it another way... If my velocity data is [1,2,3] with a length of 3. Instead of considering it as a finite signal, I instead consider the infinite data series [1,2,3,1,2,3,1,2,3,1,2,3,...] and then take the Fourier transform of that. If I do it properly, the finite Fourier transform of my original data should have the same representation as the infinite Fourier transform of my made up data series.
lucamirtanini likes this.
LuckyTran is offline   Reply With Quote

Old   April 22, 2021, 12:37
Default
  #6
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
I already know the relation between Power spectrum and autocorrelation.
I need to know the extremes of the fourier transform of the Power Spectrum if the signal is finite and continuous:

PSD=\int_{?}^{?}\rho(\tau)e^{-i\omega\tau}d\tau

In the book of Pope the definition is given for an infinite signals and the extremes of the integrals are always [-\infty,+\infty]
lucamirtanini is offline   Reply With Quote

Old   April 22, 2021, 12:49
Default
  #7
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
Quote:
Originally Posted by lucamirtanini View Post
I already know the relation between Power spectrum and autocorrelation.
I need to know the extremes of the fourier transform of the Power Spectrum if the signal is finite and continuous:

PSD=\int_{?}^{?}\rho(\tau)e^{-i\omega\tau}d\tau

In the book of Pope the definition is given for an infinite signals and the extremes of the integrals are always [-\infty,+\infty]



Have a look to page 685
lucamirtanini likes this.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 12:58
Default
  #8
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
A "hidden" issue is about the stationary process vs. non stationary process. Clearly, the period T, repeated infinitely times is somehow a constraint
lucamirtanini likes this.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 13:07
Default
  #9
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
Ok @LuckyTran your explanation is very clear! I'd never caught this nuance! Then why is the autocorrelation for a finite signal:
\rho(\tau)=\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)dt
while for the inifinite one:
\rho(\tau)=\int_{-\infty}^{+\infty}u(t)u(t+\tau)dt

Why \frac{1}{T} is omitted in the infinite one?

When I apply the Fourier transform to a signal, should the signal in the period T have some requirements to be considered representative of the infinite? I had just made sure that the time average of u(t) (which are fluctuations) is 0.
lucamirtanini is offline   Reply With Quote

Old   April 22, 2021, 14:57
Default
  #10
Senior Member
 
Lucky
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 5,754
Rep Power: 66
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
Quote:
Originally Posted by lucamirtanini View Post
Ok @LuckyTran your explanation is very clear! I'd never caught this nuance! Then why is the autocorrelation for a finite signal:
\rho(\tau)=\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)dt
while for the inifinite one:
\rho(\tau)=\int_{-\infty}^{+\infty}u(t)u(t+\tau)dt

Why \frac{1}{T} is omitted in the infinite one?
There are always two definitions for autocorrelation and these are the correct two. Which one depends on context of whether your signal is finite or infinite.

If you apply the first formula to my example...

Take the autocorrelation of a signal [1,2,3] versus [1,2,3,1,2,3] versus [1,2,3,1,2,3,1,2,3,...]. You will see that the 1/T is needed to make all three yield the same result. It might not be so readily apparent where the 1/T goes when the signal becomes infinite but keep in mind you are integrating an infinitely long signal. The integrand gets bigger in addition to 1/T driving it smaller. Or try applying this to the sine function. Integrate over 1 wavelength, 2 wavelengths, and infinite wavelengths... It looks funny but it really is just algebra.

If the function is periodic with period T then any integral of length T [t,t+T] will be the same for any t. So instead of integrating from minus infinity to plus infinity, I can divide my infinite length signal (into segments of length T) that each have an finite length integral. The number of such integrals I have will go like 1/T. It's just summation rules.

The requirements of what the signal needs to look like over the period T falls under measurement theory. You measure something and pray that the sample statistics represents the population statistics. You checked the fluctuations, but the more obvious check is that the mean velocity matches the flow characteristics.
lucamirtanini likes this.
LuckyTran is offline   Reply With Quote

Old   April 22, 2021, 15:20
Default
  #11
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
I have doubt about the definition of autocorrelation as Int[-Inf,+Inf] () dt.
A general definition involves the averaging operator, for example see 13.7 in Kundu- Cohen.
On the other hand, without the division by a time the dimensions of the two definitions are not coincident.
lucamirtanini likes this.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 16:16
Default
  #12
Senior Member
 
Lucky
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 5,754
Rep Power: 66
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
Quote:
Originally Posted by FMDenaro View Post
I have doubt about the definition of autocorrelation as Int[-Inf,+Inf] () dt.
A general definition involves the averaging operator, for example see 13.7 in Kundu- Cohen.
On the other hand, without the division by a time the dimensions of the two definitions are not coincident.

The u in Int[-Inf,+Inf] () dt must already be normalized with mean subtracted and scaled by variance. It's actually the autocorrelation coefficient in statistics. Maybe that's what is missing?
LuckyTran is offline   Reply With Quote

Old   April 22, 2021, 16:25
Default
  #13
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
Quote:
Originally Posted by LuckyTran View Post
The u in Int[-Inf,+Inf] () dt must already be normalized with mean subtracted and scaled by variance. It's actually the autocorrelation coefficient in statistics. Maybe that's what is missing?



I don't remember if this equation is from Lumley, it should be addressed that... However, I would use the expression as clearly stated by Kundu.
lucamirtanini likes this.
FMDenaro is online now   Reply With Quote

Old   April 22, 2021, 17:31
Default
  #14
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
@FMDenaro in the Tennekes and Lumley it is defined\overline{u(t)u(t+\tau)} and the overbar is defined as the time average in an other section of the book. I don't have the Kindu, is there defined as a time average?

@LuckyTran So the two definitions are both correct, but the results cannot be compared between them two, isn't it?
Considering to use the second definition, should the Fourier transform of \rho(\tau) be multiplied by \frac{1}{T} as well? Reading other books I found also this kind of definition:
\rho(\tau)=lim_{T->+\infty}\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)d\tau
Is it a version of the first definition that considers an infinitely long signal?
lucamirtanini is offline   Reply With Quote

Old   April 22, 2021, 17:44
Default
  #15
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
Quote:
Originally Posted by lucamirtanini View Post
@FMDenaro in the Tennekes and Lumley it is defined\overline{u(t)u(t+\tau)} and the overbar is defined as the time average in an other section of the book. I don't have the Kindu, is there defined as a time average?

@LuckyTran So the two definitions are both correct, but the results cannot be compared between them two, isn't it?
Considering to use the second definition, should the Fourier transform of \rho(\tau) be multiplied by \frac{1}{T} as well?



Reading other books I found also this kind of definition:
\rho(\tau)=lim_{T->+\infty}\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)d\tau

Is it a version of the first definition that considers an infinitely long signal?



This is exactly the definition adopted by Kundu
FMDenaro is online now   Reply With Quote

Old   April 23, 2021, 07:17
Default
  #16
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
@FMDenaro So based on pag 685 of the Pope, as you suggest. Also the FT is multiplied by \frac{1}{T}, isnt' it?

I have checked the Tennekes and Lumley and I was wrong, the definition has before the lim_{T->+\infty}. What concerns me of this definition is th fact that the signal we work with are not T->\infty. Which assumption should I do in order to fit my signal to this definition? Regardless the presence of lim_{T->+\infty}, we practically calculate it using the formula:
\rho(\tau)=\frac{1}{T}\int_{0}^{T}u(t)u(t+\tau)dt
lucamirtanini is offline   Reply With Quote

Old   April 23, 2021, 07:54
Default
  #17
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
The general assumption is that the period T is sufficiently large to describe the maximum wavelenght of the flow you are studying.
FMDenaro is online now   Reply With Quote

Old   April 23, 2021, 08:08
Default
  #18
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
@FMDenaro So based on pag 685 of the Pope, as you suggest. Also the FT is multiplied by \frac{1}{T}, isnt' it?
lucamirtanini is offline   Reply With Quote

Old   April 23, 2021, 08:18
Default
  #19
Senior Member
 
Filippo Maria Denaro
Join Date: Jul 2010
Posts: 6,882
Rep Power: 73
FMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura aboutFMDenaro has a spectacular aura about
Quote:
Originally Posted by lucamirtanini View Post
@FMDenaro So based on pag 685 of the Pope, as you suggest. Also the FT is multiplied by \frac{1}{T}, isnt' it?



Have a look at Appendix G, Eq.(G1-3) will show that the autocorrelation is defined by the time averaging and the spectra takes into account 1/T from the definition.
FMDenaro is online now   Reply With Quote

Old   April 23, 2021, 09:04
Default
  #20
Senior Member
 
luca mirtanini
Join Date: Apr 2018
Posts: 165
Rep Power: 8
lucamirtanini is on a distinguished road
In my version of the book I have not G1-3. Is The Appendix G dedicated to the "Power Low Spectra"? Which is the name of yours appendix G?
lucamirtanini is offline   Reply With Quote

Reply

Tags
autocorrelation, power spectrum


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Power Spectral Density - Energy Spectrum lucamirtanini Main CFD Forum 34 April 8, 2022 20:40
Power spectrum. Jake. Main CFD Forum 1 October 9, 2004 16:18


All times are GMT -4. The time now is 05:16.