Bert Olivier
Bert Olivier

What ordinary people don’t know about the deep web

The November 11 edition of TIME magazine features a cover article on “The Secret (or Deep) Web” (pp20-27), which most regular users of the internet are not even aware of — I, for one, did not know that what I had always regarded as that most splendid of inventions, the internet as “horizontal”, democratising axis of globalisation, had anything “deeper” than precisely its “horizontality” (except in so far as the “oligopolistic” axis of sustained attempts at internet control intersected it at 90 degrees). It is mind-boggling to learn that this Deep Web comprises 7500 Terabytes, compared to the 19 Terabytes of the web people know. A veritable virtual iceberg.

At any rate, it was quite an eye-opener to learn that there are vast “underground” levels of the web that even Google cannot reach, and access to which depends on special software. As might be expected, the “deep” web is, like its shallow, horizontal counterpart, a genuine “pharmakon” — a remedy and poison at the same time: it is the comparatively out-of-sight, anonymity-guaranteed medium of choice for both law-enforcement agencies (as well as snooping agencies that are on the right side of the law), AND for criminals and criminal organisations in whose interest it is to stay out of reach of ordinary search engines like Google and Yahoo.

If Google is the most frequently used search instrument for the “visible” web, then Tor (The Onion Router, in light of its layers) is its open-source counterpart for searching the “invisible” web. Here I should quote Lev Grossman and Jay Newton-Small from the TIME article (p22): “If the Deep Web is a masked ball, Tor provides the costumes. It was a highly elegant and effective creation, so much so that even the people who built it didn’t know how to break it.”

The reason for its effectiveness is the mechanism(s) it employs to safeguard anonymity, which has become ever-more difficult to maintain since the advent of social media sites like Facebook. What Tor enables one to do when you enter the Deep Web, is to wrap your usually traceable information — name, email address, search history — in layers of encryption. Moreover, it disguises your location by sending all the information you are providing through a web of relays (of which it has 4 000, although only three are randomly used in each communication), each of which peels a layer of encryption away before forwarding it to the next relay. It also changes the relay path regularly. Only after passing through the third relay, does Tor connect you to the website you’re after.

The TIME article focuses on one of several illegal or criminal-activity websites (including sites for purchasing forged passports and “high quality” counterfeit US dollars) located on the Secret Web — what is known as Silk Road, where one could shop for virtually all known drugs, from cannabis through crystal meth, mescaline, ecstasy and cocaine to “good quality” heroin.

I said “could” because the FBI recently arrested a man called Ross Ulbricht, whom they believe to be the Dread Pirate Roberts, owner and administrator of Silk Road. Ulbricht had evaded them for a long time, partly because clients always placed their orders through Tor, and partly because they paid in Bitcoin, the “purely” digital, completely unregulated currency, which is practically anonymous. This means that Silk Road transactions did not leave any tracks, financial or otherwise, in the real world, even if its narcotics “products” were sent by ordinary mail, like any parcel (which explains why it was unlikely for anyone to suspect anything).

While I was reading this article on the “secret web”, it crossed my mind that the crime novel that I read recently (Leif Persson’s Between Summer’s Longing and Winter’s End; see my post on Mirror wars) also left me with the distinct impression that the everyday social world that one encounters at street level — in schools, shopping centres, theatres, and so on (and even in newspapers and on the “ordinary” internet) — is but a façade which hides another world. One of secret, behind-the-scenes wheeling and dealing, of strings being pulled in one country and repercussions occurring across the globe, of colleagues seeing and talking to each other in broad daylight, and not knowing or ever suspecting what others might be doing with themselves in the evening, or over weekends.

Among other things, Persson’s novel delves into the activities of the Swedish secret police, or “SePo”, which is entrusted with many interrelated tasks, including that of providing on-going information to the minister of justice regarding the activities of right-wing elements. The latter include plans to overthrow the Social Democratic government, as well as to assassinate its prime minister (who is widely suspected, among conservatives, of spying for the Russians).

Persson writes with undeniable authority on these matters, albeit in fictional vein, because he is all of Scandinavia’s most famous criminologist and psychological profiler (like our own Micki Pistorius), as well as being professor at the national Swedish police board. Not surprisingly, he is frequently consulted by the Swedish media as the country’s leading authority on crime. Reading his novel drives home an awareness that he is fully conversant with unacknowledged events that occur in the interstices of justice.

But his novel does not only parallel the TIME article on the tomfoolery that happens on the hidden, “secret web” in its uncovering of widespread covert activities by members of the secret police, who move among other citizens without them knowing that they are always on the radar of these people; it also reminds one that the private activities of “familiar” colleagues may not really fall within the domain of what is misleadingly called “normal”.

One of the characters in the narrative, for instance, who happens to be a chief superintendent in the secret police — and who is notable among his peers for his suave appearance and sartorial prowess — just happens to be a well-disguised psychopath who neatly got rid of his hypochondriac mother by nudging her into the path of an oncoming train. He also gets off on women acting the role (under the guidance of his expert hand) of little girls who serve him drinks, dressed in nothing but a pair of skimpy panties, and routinely fastens them to the bedposts to give them a sound lashing with his belt. He is the kind of psycho who gets a hard-on just thinking back to the sadistic sex he had with the nymphomaniac wife of a colleague. There are some chilling moments when one realises that one of the female characters one has come to like, has been taken in by the superintendent’s charm, fake “sensitivity” and fashionable appearance, blissfully unaware of what’s waiting for her.

Hence, it is not only on the web that things are not what they seem at first sight. In his short article, “Spy vs Spy” (TIME, November 11, 2013, p12), referring to the hullabaloo over American spying on German Chancellor Angela Merkel, Michael Crowley observes: “The latest NSA flap may be less a story about a spy agency run amok than a peek into a world where for political leaders, the walls (and phones, tablets and laptops) always have ears.” If one puts the revelations on the “deep web” together with Persson’s insights into the shadowy world of secret policing, it seems safe to say that, at any given time, there are shenanigans within shenanigans going on around us, and the world is not as straightforward a place as one would sometimes like to believe.

Tags: , , , , , , , , , , ,

  • ‘In Bruges': Film-making at its best
  • Our troubled world
  • The cyber-war(s) being fought right under our noses
  • The early 21st century: Taking stock
    • Stephen Browne

      I’m not sure Terabyte is the size you’re looking for (it’s only 1024 Gigabytes, making the internet). Possibly Petabyte?

      A fascinating topic otherwise. On the whole I think of it in positive terms, as the ‘normal’ internet is fast becoming another tool for the ruling elite to track and control their ‘slaves.’

      Just be warned, the filth of humanity manifests itself here as well – the modern day Wild West, where the best of mankind struggles against the worst!

      Who said Space was the final frontier? We’ve created a whole new one here.

    • Comrade Koos

      Very interesting article Bert. Its a little creepy until you realize the tug-of-war between good and evil in the material world is nothing more than a direct reflection of the tug-of-war between good and evil in the spiritual world. For “good and evil” you could substitute “positive forces and negative forces”. My two cents worth. :-)

    • Rene

      It’s as if we have duplicated the space where good and evil can clash, just like in real life. We have complicated things even more.

    • Bert

      Stephen – It seemed a bit of an understatement to me, too, but you can check in TIME magazine; it actually says 19 Terabytes (the web we know) as opposed to 7500 Terabytes that’s hidden. It depends on how wide you want to draw the ‘web we know’. I suppose many websites that a good many people do know, but others not, would be part of the 7500 Terabytes. TIME has unlimited resources when it comes to research, so I suppose the figures are correct. I like your metaphor of the new (virtual) Wild West.

      Comrade Koos – Creepy indeed, especially if one recalls that (as I’ve argued before) WW 3 could be fought on the web. This intangible, virtual thing has immense power. Read Gibson’s Neuromancer to understand just how much power we’re talking about.

    • Aragorn Eloff

      Calculating the size of the internet (and dark web) with any amount of accuracy is probably almost impossible. However, it’s safe to say that it’s a couple of orders of magnitude larger than 19Tb:

      – The Internet Archive ( alone currently stores around 10 petabytes (10 000Tb).

      – Facebook is apparently 100 petabytes in size (100 000Tb).

      – I can’t even begin to imagine how large the combined data from all the Google projects (e.g., Gmail, Maps) is O_o

      – Some estimates from several years back put the storage of the visible web at around 2 exabytes (2 000 petabytes / 2 000 000 Tb).

      – The dark / deep web is estimated to contain anywhere up to several hundred times as much as the visible web depending on how you measure it (e.g. do you include dynamically generated pages), so we’re probably talking anywhere up to a zettabyte (a billion Tb). Much of this content is garbage and endless iterations of the same algorithmically generated stuff though, so it’s best not to think of it as primarily a subterranean treasure trove of useful / interesting stuff.

      – Total global Internet traffic is measured in exabytes but might be measured in zettabytes within a couple of years (a zettabye is a billion terabyte).

      Me, I’m waiting for geopbytes …

    • Sheldon Jennings

      interesting view on ‘weblationships’.