Spatial-spectral concentration on the ball

Post by Jason McEwen

In cosmology, observations are made over the celestial sphere, giving rise to observations defined on the two-dimensional sphere, i.e. a spherical surface.  If depth information is also available (i.e. redshift), then observations are defined on the three-dimensional ball, i.e. on a spherical volume.  For example, observations of the cosmic microwave background (CMB) are made on the sphere, while observations of the galaxy distribution that traces the large-scale structure (LSS) are made on the ball.

Often, however, observations cannot be made over the full sky.  For example, we must look through our galaxy, which contaminates observations. Foreground contamination can sometimes be modelled and reduced, however regions of significant contamination must be removed altogether. In addition, telescopes often simply cannot see the entire sky.

Dealing with partial-sky coverage can be difficult.  Wavelets are a powerful method to do this due to their dual spatial and spectral localisation properties.  Alternatively, one can build a basis concentrated in the observed region.  This is a well-studied problem in signal processing and is known as the Slepian spatial-spectral concentration problem.  Although this problem has been solved in the Euclidean setting, and also on the sphere, it has not been solved on the ball.  We recently submitted a paper solving the Slepian spatial-spectral concentration problem on the ball.

The abstract of our submission is reproduced below and you can find the full paper on the arXiv.

“We formulate and solve the Slepian spatial-spectral concentration problem on the three-dimensional ball. Both the standard Fourier-Bessel and also the Fourier-Laguerre spectral domains are considered since the latter exhibits a number of practical advantages (spectral decoupling and exact computation). The Slepian spatial and spectral concentration problems are formulated as eigenvalue problems, the eigenfunctions of which form an orthogonal family of concentrated functions. Equivalence between the spatial and spectral problems is shown. The spherical Shannon number on the ball is derived, which acts as the analog of the space-bandwidth product in the Euclidean setting, giving an estimate of the number of concentrated eigenfunctions and thus the dimension of the space of functions that can be concentrated in both the spatial and spectral domains simultaneously. Various symmetries of the spatial region are considered that reduce considerably the computational burden of recovering eigenfunctions, either by decoupling the problem into smaller subproblems or by affording analytic calculations. The family of concentrated eigenfunctions forms a Slepian basis that can be used be represent concentrated signals efficiently. We illustrate our results with numerical examples and show that the Slepian basis indeeds permits a sparse representation of concentrated signals.”

In additional to considering the standard Fourier-Bessel basis on the ball, we also consider the Fourier-Laguerre basis, which exhibits a number of practical advantages.  The first few Slepian functions concentrated within an example region are shown in the following plots for each basis on the ball.


Fourier-Bessel spatially concentrated Slepian functions


Fourier-Laguerre spatially concentrated Slepian functions


Cosmological image processing

Post by Jason McEwen

Modern science is becoming increasingly interdisciplinary, and cosmology is no exception. The analysis of observational data in order to constrain cosmological theories is drawing more and more heavily on methods from other fields, such as statistics and applied mathematics. These interdisciplinary approaches often go far beyond the level of straightforward application of techniques from other fields, often uncovering fundamental connections or new results in disparate fields. In fact, such interdisciplinary research has given rise to new terminologies: astrostatistics and astroinformatics.

I recently had the pleasure of attending IVCNZ 2013, an Image and Vision Computing conference in New Zeland, where I spoke about cosmological image processing.  While the general focus of the meeting covered image processing and computer vision and graphics, a diverse range of applications of these techniques were discussed, from vehicle classification, to crystallography, to medial and biological imaging, to cosmology… and many others.  I particularly enjoyed many interesting discussions over coffee, often contemplating the application of methods from one field to another.

One of the highlights was certainly the opportunity to test-drive Google Glass (kindly provided by Mark Billinghurst)!

Mark Billinghurst test-driving Google Glass.

Mark Billinghurst test-driving Google Glass.

Wavelets for studying the large-scale structure (LSS) of the Universe

Post by Jason McEwen

Why wavelets?

It can be insightful to analyse data, or “signals”, in different domains. For example, the frequency spectrum of music is often studied, where contributions to the base and treble are more clearly visible.


Music in time (lower panel) and frequency (upper panel).  These representations can be computed on your iPhone.

In the Fourier domain, we can probe the frequency content of signals but lose information about the time localisation of signal structure. In the time domain, the reverse is true: we can probe the time content of signals but lose information about the frequency localisation of signal structure.  Wavelets overcome this problem by looking at signal content in time and frequency (scale) simultaneously.  

Often, we may be interested in signals that are defined on domains other than time.  For example, a standard image is a two-dimensional signal defined on a spatial domain.  Nevertheless, for such signals it can also be insightful to view the signal content in the frequency domain, rather than the spatial domain, or in the wavelet domain.

Many physical processes are manifest on particular physical scales, while also spatially localised.  Wavelets are therefore a powerful analysis tool for extracting the fingerprint of a physical process of interest when it is embedded in some background signal.

Wavelet analysis of the CMB

Wavelets have now become a standard analysis technique for studying the anisotropies of the cosmic microwave background (CMB).

In this setting, the signal of interest (the CMB) is defined on the celestial sphere.  We therefore need wavelet transforms defined on the sphere.


Temperature anisotropies of the CMB defined on the celestial sphere. [Credit: WMAP]

A number of wavelet transforms have been defined on the sphere.  The construction of many of these analysis methods has been motivated directly by the desire to study the CMB but these techniques are of general use for studying signals on the sphere, such as observations made in geophysics and computer graphics.  

Wavelets defined on the sphere are now a prevalent analysis technique for studying the CMB.  In fact, many of the cosmological studies performed in the 2013 analysis and release of Planck data used wavelet methods .

Exact wavelet on the ball for studying LSS

The large-scale structure (LSS) of the Universe, as traced by the distribution of galaxies, is another powerful cosmological probe.  Observations tracing the LSS are made in three-dimensions, with the radial dimension measuring redshift.  These observations therefore also live in spherical space and are made on the ball, i.e. on the sphere augmented with depth information.


Observations tracing the LSS defined on the ball. [Credit: SDSS]

Recently, we have developed wavelet methods defined on the ball for the purpose of extracting cosmological information from observations tracing the LSS.   More technical details on wavelets on the ball will appear in a future post.

We hope that these types of methods can prove as useful for studying the LSS as they have for studying the CMB.

We’re now busy applying them for various cosmological analyses and will keep you posted!

Related reading

B. Leistedt, J. D. McEwen, Exact Wavelets on the Ball

J. D. McEwen, B. Leistedt, Fourier-Laguerre transform, convolution and wavelets on the ball

F. Lanusse, A. Rassat, J.-L. Starck, Spherical 3D isotropic wavelets

B. Leistedt, H. V. Peiris, J. D. McEwen, Flaglets for studying the large-scale structure of the Universe

Y. Wiaux, J. D. McEwen, P. Vandergheynst, O. Blanc, Exact reconstruction with directional wavelets on the sphere

B. Leistedt, J. D. McEwen, P. Vandergheynst, Y. Wiaux, S2LET: A code to perform fast wavelet analysis on the sphere,

D. Marinucci, D. Pietrobon, A. Balbi, P. Baldi, P. Cabella, G. Kerkyacharian, P. Natoli, D. Picard, N. Vittorio, Spherical needlets for CMB data analysis

J.-L. Starck, Y. Moudden, P. Abrial, M. Nguyen, Wavelets, ridgelets and curvelets on the sphere

The power of three

Post by Tom Kitching

Today a paper of mine that I have been working on for the last few years was posted to the arXiv.

The subject of the paper is a method called “3D cosmic shear”. It’s a particularly important subject because there are several new telescopes, and surveys that have been designed, or are being built, that intend to use such methods to measure the properties of dark energy. What we found in this paper is that some of the assumptions that have been made about how dark matter and ordinary matter interact in the cosmic web could be incorrect, which means the interpretation of the data from the new experiments will be a bit more complicated than cosmologists previously thought…

What is 3D cosmic shear?

Let’s start with the 3D part of the name. The Universe is filled with galaxies, which are sprinkled throughout the cosmic web of dark matter (one may say sprinkled like raisins in the infinite hot-cross-bun that is the Universe, but let’s not push the analogy too far).

Plot credit: S. Columbi and Y. Mellier. Matter is distributed as a cosmic web (orange) and galaxies are sprinkled within this web (blue dots). Light from the galaxies (yellow lines) is distorted by the gravitational field of the web and causes a small change in the ellipticity of the galaxy images.

Plot credit: S. Columbi and Y. Mellier. Matter is distributed as a cosmic web (orange) and galaxies are sprinkled within this web (blue dots). Light from the galaxies (yellow lines) is distorted by the gravitational field of the web and causes a small change in the ellipticity of the galaxy images.

We live in one of those galaxies, the Milky Way, so as we observe the Universe what we see are galaxies scattered across the sky (2-dimensions, north-south and east-west, or “right ascension” and declination). We also see galaxies in a 3rd dimension of redshift. This 3rd dimension is a little more complicated to understand: because the speed of light is finite the galaxies we see that are a long way away in the 3rd dimension are not only distant in a space but also distant in time. The 3D distribution of galaxies we see is consists of galaxies that are scattered across space and time.


But what else happens to light as it propagates towards us? Well, all of the matter from which the cosmic web is made, like all matter everywhere, has a gravitational field, and gravity is a force that pulls things together. You are being pulled by Earths gravity to the ground, the Earth (and you) are being pulled by the Suns gravity, the Sun (and you, and the Earth) are being pulled by all of the other stars in the Milky Way… and so on and so forth. Light doesn’t escape the universal attraction of gravity, and it is also pulled towards objects that have mass. The effect of gravity on a light ray is known as gravitational lensing, what happens (when the gravitational field is weak) is that an additional ellipticity (or “oval-ness”, technically this is the third flattening or third eccentricity of the galaxies observed shape) is imprinted on the image of a distant galaxy. We call this extra ellipticity “shear”.

Plot credit: T. Tyson. The light from distant galaxies is gravitationally lensed by the cosmic web of dark matter, inducing a small change in the ellipticity of the images of galaxies called cosmic shear.

Plot credit: T. Tyson. The light from distant galaxies is gravitationally lensed by the cosmic web of dark matter, inducing a small change in the ellipticity of the images of galaxies called cosmic shear.

The additional ellipticity caused by the cosmic web is known cosmic shear.

3D cosmic shear combines both information from the distances and spatial distribution of galaxies and the gravitational lensing effect of cosmic shear into a single analysis, and in the paper this was applied to a large survey for the first time. Because 3D cosmic shear maps the cosmic web and how it grows with time we can potentially learn about how the Universe evolved, and what its ultimate fate will be.

What did we find?

The paper used the method of 3D cosmic shear to analyse the largest/deepest optical wavelength survey of the sky to date CFHTLenS.

What we found is that matter in the Universe is clumped together less tightly than it should be if dark matter alone was responsible for the structure of the cosmic web.

Previously it has been assumed that the cosmic web of dark matter is not affected by the sprinkling of galaxies on top of it. However what we found is that there is evidence that the cosmic web of dark matter may actually be affected by the galaxies after all, in particular by the supermassive black holes that reside in the centres of the most massive galaxies, so-called Active Galactic Nuclei (AGN).

AGN may be impacting the distribution of dark matter in the Universe. Hubble Space Telescope image of a 5000-light-year-long (1.5-kiloparsec-long) jet being ejected from the active nucleus of the active galaxy M87, a radio galaxy. The blue synchrotron radiation of the jet contrasts with the yellow starlight from the host galaxy.

Alternatively things may be even weirder, another possibility is that what we are seeing the effect of massive neutrinos, or even a combination of effects. But a new mystery, and challenge for cosmologists, now exists. The normal matter and the dark matter seem to have an effect on each other: we may live in a more complicated Universe than we previously imagined. To resolve this mystery more data is now required, and more work to make the data analysis using 3D cosmic shear even more sensitive to the structure of the cosmic web within which we reside.

Materia Incognita

Post by Tom Kitching, MSSL


Occasionally people ask me what I work on, and at some point in the conversation the words “dark matter” inevitably arise. Normally one would say that dark matter “is named because it does not emit or absorb light, unlike ordinary matter that does…”. However in every day usage an object is “dark” because either i) it is absorbing light, or ii) there simply is no detectable light present (its dark at night because your eyes can’t detect the very low level of optical photons around).

So if everyday things are dark because they do absorb light, why does dark matter not absorb light?

Dark matter is a material that constitutes the majority of the mass in the Universe, it doesn’t interact with other particles with light but it does with gravity. Light in fact passes straight through it, as does the atoms that make up the Earth and you and all the stars and galaxies we can see.

Where did the phrase “dark matter” come from? Wikipedia tells us the familiar story told to generations of new physics students that:

Astrophysicists hypothesized dark matter due to discrepancies between the mass of large astronomical objects determined from their gravitational effects and the mass calculated from the “luminous matter” they contain: stars, gas, and dust. It was first postulated by Jan Oort in 1932 to account for the orbital velocities of stars in the Milky Way and by Fritz Zwicky in 1933 to account for evidence of “missing mass” in the orbital velocities of galaxies in clusters.

In fact Zwicky referred to the matter as dunkle Materie that has a  German-to-English translation of dark matter. It is interesting to note that dark matter did not enter the common scientific canon, or popular culture for another 50 years after Zwicky’s discovery. A search for the term “dark matter” in books produces the figure below, where it can be seen that it was not until the 1980’s that the dark was popularised. This was due in a large part to the work of Vera Rubin in the 1970’s on galaxy rotation curves, that lead to the publication of an influential paper in 1980.

Search on for "dark matter". The percentage of books that contain this term.

Search on for “dark matter”. The percentage of books that contain this term.

Astronomers are used to seeing matter that is emitting light, primarily stars, so it is only natural to label everything else (that is not actively emitting or absorbing light) as being “dark”. So, we do have an excuse.. But the problem is that the word “dark” whilst, arguably, is descriptive of our ignorance, is not physically an accurate description when “dark” is used in its everyday form. So, when trying to describe the physics of dark matter the word “dark” can cause confusion. In fact as a noun the Oxford English Dictionary has 5 definitions for the word dark:

  • 1 a. Absence of light; dark state or condition; darkness, esp. that of night,  b. The dark time; night; nightfall., c. A dark place: a place of darkness.,
  • 2. fig. (a leap in the dark)
  • 3. a. Dark colour or shade; spec. in Art. a part of a picture in shadow, as opposed to alight.,  b. fig. A dark spot, a blot.
  • 4. a. The condition of being hidden from view, obscure, or unknown; obscurity. in the dark: in concealment or secrecy. b. Obscurity of meaning
  • 5. in the dark: in a state of ignorance; without knowledge as regards some particular fact.
So on the face of it “dark matter” satisfies several of these definitions, except that  it doesn’t quite fit any of them. Dark matter is not an “absence of light”, since light can pass straight through it: dark matter can in fact be permeated with light. Dark matter is not a “leap in the dark” since it is not a wild or speculative conjecture (although some may argue on this point). Perhaps the most appropriate is definition 4, but in fact dark matter is not hidden from view, since with gravitational lensing we can directly observe its effect.  And with definition 5, the usage is not quite correct, which should be “we are in the dark, about this matter”.  Furthermore the name is somewhat depressing, one of the OED adjectival definitions is “Devoid of that which brightens or cheers; gloomy, cheerless, dismal, sad.” (and of course no one wants to turn to “dark side”).

Direct imaging of dark matter in the “bullet cluster”, blue is dark matter density and red is X-ray gas. From . Composite Credit: X-ray: NASA/CXC/CfA/ M.Markevitch et al.; Lensing Map: NASA/STScI; ESO WFI; Magellan/U.Arizona/ D.Clowe et al. Optical: NASA/STScI; Magellan/U.Arizona/D.Clowe et al.;

So perhaps we should look for alternative word to describe the matter with which the Universe is suffused, through which light can travel unhindered, and that acts as the cosmic scaffolding around which ordinary matter clusters. My humble proposals are either:
  • Transparent Matter : This has a nice descriptive word that actually has physical interpretation that is accurate. Clear matter would be along similar lines. If you are cosmologist would you prefer to be talking about transparent matter every day, or dark matter?
  • Materia Incognita : The unknown material. Maps used to be labelled with “terra incognita“, in a similar way we could be explicit about ignorance of its nature (caveat: my latin is possibly entirely incorrect). Maps also, according to legend, used to use the term “here be dragons”, so I am tempted to propose that dark matter should be called “Dragonite“, “Dragonium” or perhaps even “Smaugite“, but I won’t.
  • The Cosmic Scaffolding : This would explain an aspect of the role this matter plays in the growth of large-scale structure, but normal scaffolding can be seen, so perhaps “the transparent cosmic scaffolding”, but this is admittedly not as catchy as dark matter.

However the name dark matter is probably here to stay for the near future. But don’t worry because this will hopefully be a brief period as new direct detection experiments, and new cosmic sky surveys come online we will learn the true nature of this mysterious component of our Universe and give it its true name.

Weak Lensing in the Alps!

Post by Tom Kitching, MSSL


This month I was very fortunate to be a lecturer at the TRR33 winter school in Passo del Tonale in the Italian Alps. The aim of the school was “Theory for Observers & Observations for Theorists”.


My task for to educate the PhD students in weak lensing, which is a method that can be used to map dark matter and infer cosmology.

Over the course of the lecture we went through what a lens actually is, and I used some inspiration from Richard Feyman in his book QED. As light propagates from point A to point B it can take any possible path, with a particular probability.


In his book Feynman then poses the thought experiment and asks what would happen if we “fooled the light” so that every path took the same amount of time. What we end up with is a lens!


So in a certain sense you can think of a lens as a device for equalising the probability of paths between two points; or down-weighting the most likely paths. Of course, reality is much more complicated than that, but I was struck that this was a very nice way to explain why lenses work the way they do. These explanations, from a mathematical perspective are using the principle of least action, which is a powerful general technique used in physics. The amount of lensing caused by large scale structures in the Universe can be derived in a similar way.

It strikes me an elegant historical path that astronomy itself has taken: it was founded on the technological development of optical lenses, and that now as we are planning on surveying almost the entire sky over a significant fraction of the age of the Universe it is the motivation of observing the lensing caused by the Universe itself that is driving these ambitions (see for example Sami’s Euclid post).

The meetings organisers were amazingly good at arranging fun and engaging activities for the participants (as Peter Coles over at Telescoper eloquently remarked last year), who found themselves skiing, hiking through the night in snow shows, getting guided tours of the night sky (for some students it was the first time the Milky Way had been observed), and having 4 course meals every day for lunch and dinner!

One of the joys of being an astronomer is sharing your knowledge, exploring new places and meeting amazing people.

How does the mass-to-light ratio of galaxies change over time?

Post by Tom Kitching, MSSL


In a recent paper, led by collaborator Dr Mike Hudson the CFHTLenS survey was used to investigate how the relationship between the total amount of matter surrounding galaxies, compared to the amount of luminous (stellar) matter changes as a the Universe ages.

There is a vast and growing amount of evidence that the stars we see in galaxies are just the tip of the ice-berg when it comes to the total amount of matter. In this recent paper the gravitational lensing signal around individual galaxies was used to measure the amount of total matter present; which would include any unseen or dark matter. It was confirmed that there is much more dark matter than star-matter, and that in fact there is roughly 30 times more dark matter than star-matter!

There is much more than meets the eye. The stars present in galaxies account for approximately 3% of the total matter present in most galaxies. From

What this study found for the first time was that this ratio of dark matter to star-matter is not a constant as the Universe ages but is actually changing. It was found that the peak ratio falls as a function of cosmic time from 3.8±0.3 percent when the Universe was 7.4 billion years old to only 3.0±0.2 percent at when the Universe was 10.3 billion years old. This is a very precise measurement, measuring a change of only 1 percent over a timescale of nearly 3 billion years!

Why is this change happening? The paper shows that the change is actually dominated by changes in galaxies that are “red”, these are large and old galaxies where the production-rate of stars is slowing down as they run out of available gas, as the Universe ages. Interestingly if this change is dominated by the red galaxies then it implies that in the other galaxies, so-called “blue” galaxies, that are young and star-forming, the amount of stars that are made is balanced by the amount of dark matter attracted to those galaxies.

  • The full article can be found at this link :
  • The CFHTLenS data can be accessed here :