The Skeptical Methodologist

Software, Rants and Philosophy

This Lifehacker Diet Article is a Wolf in Sheep’s Clothing

“Hey there, did you know everyone else is lying to you about diet? It’s all due to their corrupt corporate interests! I have no agenda, and will explain to you why everyone else is lying. Also, avoid processed food, as everyone knows that’s bad for you.”

Before we get started, there are a lot of great gems in the article. It does go into why diet is so confusing. But unfortunately, it breaks its own rule. It fails to cite evidence for its claims, and even misuses the word ‘natural’ in the middle of an article dismissing the word as meaningless.

Let’s dive into a few assumptions here. First, they are right in stating that there’s a lot of mixed messages out in diet. I’d come away saying that we actually know little beyond people who eat a lot of fruits and vegetables seem to be healthier. But we don’t necessarily even know why since there’s so many confounding variables there.

But this ‘corporate interest’ bullshit that should be the first sign that it’s not one person selling you truth and another falsehood, its just two bullshit vendors providing different varieties. Corporations are not evil. Repeat that with me. Corporations are almost completely amoral, in fact. They, for the most part, exist to maximize profits assuming human management with bounded rationality is making the day to day decisions. What does that mean? Does it mean Corporations are trying to get you fat, to die early, to lie to you? No, it means that established corporations biggest motivator is to protect the status quo. The status quo makes them money.

Let’s think about that for a bit. Does that mean that General Mills might try to convince you Fruity Pebbles is completely healthy for you? Yes, it does. They currently sell Fruity Pebbles, its in their interest to try and convince you to keep buying it. But what if they sold Grandpa John’s brand dried vegetable slaw (now with more wholesome!)? Well then they’d try to convince you that vegetables are healthy for you too! They aren’t trying to sell you packaged shit, they just happen to already sell packaged shit, so they want you to keep buying.

This same logic works for so-called ‘natural’ foods, which appears to just be foods closer to their original state. Organic farmers can charge nice hefty margins because they’ve convinced you that organic is healthier, even though there’s little evidence for that. Basically, everyone who sells something is motivated to keep you buying. It’s really not that hard to figure out, and it doesn’t make them evil. If science finds the best diet, just wait twenty years and these same evil corporate interests will have built up supply chains, warehouses, and marketing campaigns to make sure you buy that best diet, whatever it is. But until then, expect them to come kicking and screaming. That’s just their nature.

The second assumption they cite without evidence is this ‘processed food is bad for you’ clap trap. First of all, what the hell is processed food? Apparently Chetoes. They really seem to hate Chetoes. But beer, cheese, bread, pickles, deli meats, milk and yogurt are all processed too. Fermentation, cooking, pickling, and the like. Those are all processes. Canned vegetables, frozen berries, these are processed too. Are all these things bad for you? Not at all. You can tell the author’s motivations when they compare so called ‘processing’ to cooking at home, which is just another process. Apparently, processing is okay if you do it yourself. Do you see the motivations and assumptions too?

I’ll spell it out: eat food rich people eat, and avoid food poor people eat. Cooking at home is a luxury someone who isn’t working two jobs can do, it must be healthier for you. This sort of unprocessed push is just more upper class privilege asking why the poor colored masses aren’t living as long. Clue: it’s because they are poor, not because they aren’t eating what you eat. Just like the obesity epidemic was more or less invented so we can continue to hate blacks and latinos, the rampage against processed food is another way we can all feel better about making fun of that lower class family picking up some more hamburgers from McDonalds and blame them for their own misfortune.

Does this mean Fruity Pebbles is healthy? I have no idea. Fortified cereals have been shown to lower a nationwide deficiency of folic acid, so they’ve got that going for them. But the more important thing to point out is that there are many processed foods that are bonafied healthy – tomato paste being my favorite example as having a more bioavailable form of lycopene than whole tomatoes. Using simple rules like “unprocessed” is a great way to eliminate more than half the population from your recommendation since they can’t afford to eat that way anyway and eliminate a whole lot of good pathways to nutrition.

I’d say this unprocessed fad is no better than all the others, and it really gets to me that someone would go through such trouble to point out why everyone else is lying to you while blatantly doing the same to you themselves. It’s the kind of moral superiority that upper class, out of touch, privilege gets them, I suppose.

May 7, 2014 Posted by | Uncategorized | Leave a comment

Theory is Dead: Long Live Theory

In this recent article, Bob Cringely argues that Big Data and the resultant progress in what has traditionally been called AI will inevitably automate everything – include science itself.

This “death of theory” has been argued before, and periodically comes up from various empiricist leaning circles arguing that all you really need is data. The problem is that, as Kant showed when he reconciled rationalism with empricism, theory and data are intractably linked. Contrary to what some die hard empiricists might argue, we do not believe “1 + 1 = 2″ simply because we’ve seen it enough. We invent notions and concepts to think symbolically, and in that realm, we set up definitions which we use to prove “1 + 1 = 2″ inside the system we’re discussing. We then tie our theories to fact on the ground to make predictions.

Indeed, I’d say the reason AI originally failed in the 1980’s is due to its over-reliance on theory to the diminishment of actual data. Purely symbolic systems can only go so far, and only go so fast, especially in discerning very noisy rules like those of spoken language. And now it appears we’re swinging too far the other way – we’ll never have need of symbolic or formal reasoning systems again, it may be argued. We’ll just throw enough data at it. This obviously rubs many of those actually in the machine learning field the wrong way, as its precisely those formal methods that allow them to code (type checking, compilers) and prove (mathematics, theorem provers) their models work within certain parameters.

The argument Cringely seems to be implying is that theory has just been a crutch for we mere humans, and that if we only had enough data, we wouldn’t need it. However, theory does many things, and even in the era of big data, it will continue to do these things:

1. It is our only path to actual truth.

One can prove theorems based on assumptions. All empiricism ultimately falls to Hume’s problem of induction.

2. Theory can succinctly describe in a single equation many terrabytes of data.

Big data means lots of data – but the above fact is still true no matter how cheap data gets. We can always do more when data is married with theory, each unit of processing power will always be more useful when mixing the two rather than simply trying to neural network the whole problem.

3. Theory can communicate ideas.

Linked to the above in terms of compression of data into a single equation, our symbolic language also makes it easy to communicate ideas to one another. This will be true of big data as well – moving around simple equations will always be cheaper and faster than moving around the entirety of data sets on which they are based.

4. Theory can make predictions out of sample.

Big data’s predictions out of sample are always, at best, guesses. Educated guesses, but guesses. And they are, in turn, guesses based on a few fundamental theoretical assumptions of attempting to minimize error. If we ever run into inputs that are not in our data set, or alternatively, if we want to backsolve for our inputs given required outputs, this is always easier when we have theories to supplement our data. Regression analysis, for instance, allows for a lot more theoretical interpretation of results than a cackle of random forests. When we have regression coefficients, we can make many more predictions about our data set using far fewer facts.

Big data is already changing things, and many of Cringely’s predictions are true. But to say that Big data is going to ‘automate science’ away is a large misunderstanding of what the theoretical side of science does, and how theory serves us.


April 29, 2014 Posted by | Uncategorized | Leave a comment

Pecking at Prometheus’ Abdomen

I was recently intrigued by the this video. It walks you through some hand wavy steps on how we can actually assign a number, in this case, -1/12th, to the series 1 + 2 + 3 + 4…. It makes a few appeals to intuition on why this may be correct. It got me really interested in how it worked, sending me off to Wikipedia to learn about the Riemann Zeta function, extensions to calculus, and so on. I think it is a great example of making mathematics fascinating to larger numbers of people, a great thing in our world where so many mathematics educators seem to think it is their duty to pass as few kids as possible.

Little did I know about the shit storm of engineering undergrads who apparently knew more than Euler when it came to this form of analysis. With fingers waving wildly, they tore the video apart, explaining just how wrong it was, some going so far as to talk about the damage it could do to we mere unwashed masses.

The lesson they’d rather teach? Math is boring, hard to understand, and we like it that way. STAY OUT.

I could go into a deconstruction of these types of personalities – how they identify with their ability to excel at increasingly difficult arithmatic with genuine mathematical ability throughout high school. How they most likely chose to pursue an engineering degree (no small feat, mind you) rather than a pure mathematical degree plan because of the unease they met finding out that math is actually quite different than mindlessly following rules. This video is just a reminder that they didn’t really ‘get’ how math could be equally invention, art and science.

When geniuses like Euler invent new rules and terminology to solve the problems that vex them, that shows just how freeing mathematics can be. But its precisely that freedom that scares a lot of arithmaticians shitless because it violates their precious black and white rules.

Truly, these folks are little more than crows pecking at Prometheus’ abdomen – the punishment any good educator receives when they have sufficiently ‘dumbed things down’ enough to convert the unengaged into the engaged from those who were quite happy being the few who understood before. In a way, you can’t blame them – their knowledge is being inflated away, as more and more people grasp the basics. What they saw as precious and theirs is shared with everyone else – not diminished in any way, but certainly no longer an attribute that makes them unique.

So they can but caw and cackle as they point at technicalities, sad that no matter how much liver they tear away, the fire has been lit.

January 21, 2014 Posted by | Uncategorized | Leave a comment

Software Development: Applied Metaphysics?

I’ve been playing around with a thought. What if the metaphor of software development as engineering isn’t wrong insofar as software development could never be made as rigorous as engineering, but rather, perhaps its wrong because of the assumptions loaded with engineering? After all, when we say engineering, we generally are talking about applied science and technology of physics.

Perhaps its the case that software developers are engineers, but of a different sort. Perhaps they are practitioners of applied science and technology of metaphysics? This definition itself is a little hairy, since one could argue that the sheer concepts of science and technology are metaphysical ones. Perhaps it would be better said if we simply said software developers were applied meta-physicists?

After all, the debates over immutability of data versus mutation harken all the way back to to the presocratics and the famous quotation attributed to Heraclitus that one never steps into the same river twice. Arguments over substance  sound eerily familiar to that over object oriented programming. Finally, the introduction of process philosophy by Whitehead can be tied very easily with the ideas embodied by event driven programming.

The tie of software design to metaphysics seems obvious upon reflection. It is our job to listen to loose descriptions of our clients worlds and try and encode them into a rigorous system of objects, relationships, processes and data – so rigorous, in fact, a computer can follow through with them. One of the hardest problems in computer science, it is said, is naming things, which is very much a hard problem in philosophy. The corollary to metaphysics also explains one reason why software design is so amorphous and hard to nail down, while software itself is ironically very rigorous once written. Meta-physicists do not yet have the tools of science, mathematics or empiricism. It is in fact the very same philosophers who invent those tools. Much like C style object orientation, they have to use tools that their language doesn’t necessarily give them, thus rely on convention over configuration, to a degree.

Software engineering as a psychological pursuit surely will come under the knife of science in time – we can measure whether or not teams that pair program, test-drive design and object orientate their work are more or less productive than others. But the source of those ideas and processes itself will always, it seems, live in the realm of metaphysics which can only loosely be attacked through rational debate (notwithstanding the assumptions one must make to even get to the point where you’re allowed rationality).

December 8, 2013 Posted by | Uncategorized | Leave a comment

Where Innovation Comes From

Innovation is not a well understood concept. This is sad because our economy is driven by it. Businesses seek it out for profit. Whoever can crack the innovation puzzle drastically increases their chances of success. We know it when we see it – three guys in a garage, tinkering away. But we can’t seem to recreate it at the office.

This leads to a second source of melancholy – the very methods many enterprises use to spur innovation end up back firing. This is because innovation ends up being the very opposite of what a large organization usually seeks, and what largess provides. Organizations seek to be efficient, specialized and focused. TLDR: don’t be those things.

Breadth, not Depth

One important facet of innovation is that innovative people and teams invariably are … varied. A group of five software engineers may be only marginally more innovative than any single software engineer. But a group consisting of multiple types of engineers, as well as marketing and finance specialties is many orders of magnitude more innovative.

This occurs for two reasons – one, the obvious one, is that the team can supplement any particular individuals weaknesses with another’s strengths. Since innovation always consists of unknowns and discoveries, there are no efficiencies to be reaped by simply adding more of the same specialization to the team. Adding another electrical guy may do no good whatsoever if the team eventually decides to go after a problem that doesn’t benefit from that sort of engineering talent.

The other more subtle reason is that innovation is 95% realizing a problem and 5% realizing a solution. Many people just are not familiar with problems they can solve. This, too, results from specialization. Any particular analyst or associate could give you a list of open problems in their field. They don’t even attempt to solve these as usually such things happen in university labs. But they have no idea what the problems are in other people’s fields – some of which may be easily solved using techniques native to their own field. This opening up of the problem space to easy exploration allows a multifaceted team quick access to low hanging fruit in the innovation space – the things that seem ‘obvious’ in retrospect, but no one really goes after because it’s thought to be unsolvable or not important.


Slack not only in time, but money. Of course, most successful businesses do not optimize for slack – slack looks bad on ROI calculations as simply wasted resources. But we need to change our views of slack to something more positive.

The fact is, if you hire creative and passionate people, and give them free time, they won’t stop producing. They’ll very much continue to produce things because they enjoy it. Key example here would be the open source software movement.  Open source software represents many collective man millennia of work, all done for free. Wikipedia is another good example. When you give creative people free time, they continue to work.

Moreover, slack gives people time to relax. To open their minds and work on something where the company isn’t at stake. Ideas that formerly seemed too risky or out there suddenly become costless in terms of experimentation.

You might have heard of the term ‘cognitive surplus’. These are simply extra brain cycles not dedicated to anything due to built in slack. Brain cycles will compute something – they won’t be wasted.

So let’s summarize so far – we need broad teams given lots of slack. If I were to lock a team of brilliant and diverse people in a hotel  room and give them limitless food, drinks and any tools they required, would I get ideas out? Not necessarily. A final ingredient is in order.

Dogmas at the Door

An interesting question comes to mind when thinking about slack and the cognitive surplus it provides. During the middle ages, due to taxes and tithing, the Church had a great deal of surplus. And, as expected, we did get a great deal of innovation from that period in architecture, art, and music. But oddly these innovations seemed to miss obvious points. Moreover, what about technological or scientific innovation?

The problem then was that all the surplus was too centralized. Hence, centralized dogmas could take over and direct where and when that surplus was to be used. Arbitrary decisions and politics ended up creating roadblocks along many scientific and cultural paths, despite the surplus.

The same thing is happening in China, which struggles with innovation. Until potentially dangerous ideas have a chance to be nurtured and grown, no real innovation will happen. Guided innovation in certain sectors may continue, but no revolutions will spring up.

Enterprises tend to jealously guard what little slack they are willing to give away. Perhaps an hour here or hour there, but damnit, we better get our moneys worth and see some results! Ironically, they are willing to pour thousands of man hours and millions of dollars into inefficient processes and never complain of a lack of results, yet the minute someone asks for slack, they suddenly care about ROI.

Alternatively, enterprises attempt to ‘guide’ innovation, setting up certain committees, shutting down projects early to ensure no precious slack is wasted on bad ideas. The problem is, we don’t know what’s a bad idea at first. More importantly though, from an ROI perspective, these mechanisms to ensure no slack is wasted often end up costing far more than the wasted slack they save in terms of opportunities lost by innovation not taking root in a bureaucracy.

Innovation is an artificial Ecosystem

We are attempting to grow a small ecosystem, to take advantage of mutation and natural selection and produce an entirely new species of product, process or other work. Ecosystems need diversity, they need spare resources to allow innovation to thrive unabated and not allow efficiency concerns to crush ideas too early, and they need protection from outside stewards to ensure special interests and politics don’t clear cut certain ‘worthless’ endeavors.

Like growing any thing else, the best thing for businesses worried about the risks of innovation to do is to embrace it whole heartedly – don’t just innovate once, innovate dozens of times. Don’t simply put one cross functional team in a hotel room with limitless supplies and a promise to not interfere – lock many teams in various rooms. The fact is even with the above three environmental conditions in place, we can be assured innovation will take hold but we can not be assured it’s fruits will be useful. Don’t be quick to attempt to ‘prune’ innovation: leave your dogmas at the door and let it grow. But, to ensure a good crop, batch process. If you have even one stellar idea, it will fund many dozens of teams with bad ideas.



March 7, 2013 Posted by | Uncategorized | 1 Comment


Get every new post delivered to your Inbox.