GAN is Meditation

Since its advent, the GANs, or the Generative Adversarial Networks are managing to garner increasingly high attention and interest. We use them to enhance the quality of sample data. This enables us to fit more accurate model.

There’s a generator G, whose objective is to fool a discriminator D. Whereas, the objective of the discriminator is not to be fooled by the generator. The GAN is said to have converged when the generator is able to generate real samples, or in other words, when the discriminator fails to differentiate between a real and a fake sample, that is, after really ending D’s discriminating faculty! I would not like to be in favor of this kind of wording. I would like to rephrase the objective as, the GAN is said to have converged when the generator merges with Reality, so that D always classifies every example as coming from Reality. However, the meaning of ending D’s discriminative faculty also means to end my ego, or to end my mind. This is the state of no mind.

Let’s now see the algorithm of GAN:

The images above are from the thesis, ‘Tabular data synthesis using Generative Adversarial Networks : an application to table
augmentation
‘.

Let me now try to build the metaphysical correspondence. Here, G is Maya, ego or a particular mind (using J. Krishnamurti‘s words) and D is a Universal Mind. These are my views by the way! G will continue to generate (or weave) this illusionary world around me, as long as my D is not optimal (or realized). The ultimate objective, that is, my GAN will be said to have converged, when it stops generating any fake example. What do we mean by fake example here? It’s my beliefs about the world. These fake examples x~d come from a domain X~d which is non-empty. In fact it is full of bias, prejudice, predispositions, all parts of Ignorance. If we look carefully, the domain of xd, the real example, is essentially Empty (Xd)!

In other words the Real distribution has only 1 mode and no variance. This mode is what many call Brahman, the Ground, the Emptiness or the Rope! It is, probably like a Dirac delta function, or it could be the Singularity, that is, it is undefined!

If we look at the algorithm, we see that first for k steps, the discriminator is updated. What is meant by examples here? And where do they come from? The examples come from generator G and from the Reality. For instance, I am writing this blog. What I write is words which are fake, to the core, of course! However, what I do not write, need not write or cannot write is what is there everywhere, and all the time. The space. The space between the words. But I fail to read the space. I read only words. Space comes from Xd and words come from X~d.

Now to update the D, I need to focus more on the space between the words. Eckhart Tolle puts it very nicely in this post. This takes a lot of practice. And that’s why updating D is a part of meditation.

After this crucial step, I need to update G. What are the signs to recognise that G is updated? Well, first I don’t do anything to achieve anything. I become content, feel fulfilled, have no desire. I am in a state of no lack. I have no biases, predispositions, misunderstandings, desires. And this then, will push my G closer to The Reality. Keep doing this exercise of updating D and G till G is merged.

My G then starts manifesting Reality. This indeed to me is what we call a Conscious Manifestation.

When this happens, my GAN is converged. The purpose of my life fulfilled. I am merged into the unimodal single pointed Reality, called Brahman!