The plural of anecdote is data.An anecdote to ignorance or absence is not.
Many of us are familiar with the misquote attributed to Wolfinger, stating that “The plural of anecdote is not data.” However, this commonly repeated trope of social skepticism is actually incorrect. In reality, there are certain types of anecdotes that can be considered as data, information, or even intelligence.1 There are six circumstances in which a single anecdote holds valid inferential significance – yes, even if it involves personal testimony. It is important to recognize that skeptics who dismiss all forms of anecdotal evidence, except for one particular invalid application cited in strikethrough below, are using a deceptive tactic. This deceptive tactic is akin to a magician’s trick – the anecdotal appeal to ignorance or absence.2
Six Types of Valid Anecdote (and Two Invalid but Popular Types)
1. White Crow
In a laboratory, it is assumed that a specific material state is either non-existent or unachievable. Instead of accepting this null hypothesis, the laboratory engages in a seemingly impractical process of systematically testing every possible combination of experimental conditions in order to bring about this desired material state. After six weeks of exhaustive testing, they finally discover a particular set of control conditions that successfully produces the sought-after material state. As a result, the null hypothesis has been proven false.
2. Negation of a Claim to Scarcity
A wildlife team receives information suggesting that the population of a specific horse breed in a particular island nation is extremely scarce. Tasked with the job of assessing that horse population, they embark on an expedition with the intention of counting these horses. Surprisingly, within mere minutes of commencing their first random sampling run, they come across the first herd of the target horse breed. One looks for a needle in a large haystack, and finds a needle upon first glance. Intelligent life on Earth.
3. When Testing Policy or Constraint
After being a loyal customer for ten years with no claims, your insurance company unexpectedly raises the rates on your homeowner’s insurance by a significant 20+% for the third consecutive year. Perplexed by this substantial rate increase, you decide to call and inquire about the reason behind it. During the conversation, the agent attributes the steep rise in costs to “roof replacement fraud” plaguing the insurance industry. In order to validate this claim, you request the insurer to assess the extensive hail damage affecting your aging roof. Following their longstanding policy, the insurer sends their own evaluation team to examine your roof. Their evaluation results in a credit of $1,600 for the hail damage, which falls below your deductible. As a result, you are left with the burden of covering the entire cost of the roof replacement, amounting to $16,000. It becomes evident that the insurer has misrepresented the reasons for their cost increases, as their policy prevents them from assuming such liabilities.
4. Small Relevant Domain
You observe a person drinking in a bar, and make the claim that you are more likely to find a buzzed or drunk person in a bar, as compared to other public venues.
5. Case Study During Discovery/Profiling
A person suffering long-term infection by Epstein-Barr virus is found to have Hodgkin’s lymphoma later in life. The diagnosing physician suspects a connection, and wishes to document it in a case study. A suspect in a robbery has his background checked, whereupon his criminal history is found to contain two convictions for petty theft.
6. As a Datum to the Presence (the plural of which is data)
Personal testimony that a popular brand of dimmable light switches installed in a house caught fire through overheating. Your new phone suffers a hardware malfunction right after you purchase it. You observe a thylacine crossing your farmyard to chase after your barn cat.
7. As a Datum to the Absence (anecdotal appeal to ignorance)
Your friend’s house with dimmable light switches installed did not burn down. Your grandfather lived to age 92 after smoking his entire life. You had the Covid vaccine and are fine.
8. As a Data Set to the Absence (utile absentia – appeal to failure in detection/collection)
You conduct a study on house fires, in order to see if houses with dimmable light switches suffer a higher proportion of fires. However, newer house fire incidents have yet to be entered in many district fire department databases. As well, newer houses tend to have a greater number of dimmable light switches installed. Amazingly, houses with dimmable light switches are found to rarely have fire incidents. Most house fires collected into your database therefore occur in houses with conventional flip switches. Your report concludes that dimmable light switches do not cause more house fires as compared to conventional ones. Moreover, although not acknowledged inside your conclusions, the data shows that dimmable light switches actually prevent all unrelated forms of house fire as well (inversion effect indicative of a utile absentia exclusion error).
Be cautious of individuals who clumsily twist Wolfinger’s misquote or assert that your personal experience holds no value as “evidence.” They might be spreading misleading philosophy. If they habitually commit appeal to absence errors, numbers 7 and 8 above in particular, it is certainly wise to avoid seeking their advice regarding skepticism or science.
Why those who boast of holding the ‘data’ and ‘facts’ are also those likely to be the most clueless.
Years ago I was asked to develop and lead a plan targeting acquisition of a marine and boating consumer products company. During the discovery process I flew to Manhattan in order to interview the senior executives about the overall business state and direction. Being an avid sloop sailor, I was rather excited about the chance to speak with the developers of some of the key equipment I employed on my boat.
When I arrived at the intended conference room and began to speak with the C-level executives prior to the meeting start, it became clear that none of them bore experience in boating, nor afloat work or recreation at all. Upon asking if any of them were boaters, the CEO replied, “I think Earl in Product Development owns a boat.” To which the rest of the team acknowledged, “Yes, Earl owns one, I’ve been on it with him.” or responses of such nature. These were all Harvard Finance MBA trained suit and tie wearers – nothing but undertakers there to embalm and prepare the body for value-extraction and burial. They were perdocent, taught to be more-than-eager to follow the instructions exactly as prescribed and without question. They were quickly-promoted operatives whose mission was to funnel formerly productive asset value to predatory offshore elite stockholders – a whole set of clowns of whom none bore an interest in, nor knew anything about boating. Portraits of fashion models, celebrities, and dead Presidents debarked in various vessels, adorned their conference room walls – mocking them for the betrayal of trust in their name.
The single most toxic thing you can do to a business is appoint its own accountants or information technologists to run it. The perdocent mistakenly conflates a state of holding the data and facts, and following the instructions, with competence in the art of its delivery. Very often, the opposite is true.
The worst thing a university can do is teach confidence interval and p-value skills to candidates who have no idea what inference is, nor how to prosecute an argument. This is like handing binoculars to the driver of a car, so that they can ‘see better’.
The most clueless person in a business is typically the controller or Vice President of Finance. Ironically, despite the fact that this is also the person who holds and knows the most facts and data about the business itself. When I conduct a strategy, the team is required to work very closely with such entities early on, simply because they possess all the data the team initially needs. We will often get along well, because I hold an MBA in Finance from a tier I B-school as well. This reality forces a business’ accountants to also be represented on the strategy team.
But once the data is collected and accounts have been defined, the process of strategy is exposed to devolving into teaching those representatives why Enterprise Resource Planning financial profit & loss pro forma are not sufficient tools to determine the state of a market nor the viable direction of a business. I have found myself at times pointing out that the scope of the project did not include teaching accountants how to be strategists and business leaders. As well, I have had to often find ways to insulate the strategy team from being forced to use their methods – techniques which will merely serve to show that driving in-context sales, capturing low-hanging fruit, and cost-cutting are the appropriate next steps.
Why Those Who Boast of Holding the ‘Data’ and ‘Facts’ are Also Likely to Be the Most Clueless
Among my Folleagues I have been known from time to time, to issue the following apothegm.
Data must be denatured into information. Information must be transmuted into intelligence. Intelligence is the first sound basis from which to plan or take action.
In order to comprehend what these tenets mean let’s then delve more into the philosophies behind this, shall we?
I. Data must be denatured into information.
Taking data to 3rd normal and relative-to-context form is taught in database development courses no doubt.1 However, denaturation of data requires expertise in the dynamics of the data structures themselves. A faithfulness in observing them over time, a knowledge of human nature, or having observed such structures under similar business dynamics. Denaturation is the process of removing the natural background noise, influences, and confounding factors from the raw data itself.
Example: In the below example, the graph publisher has depicted the flow of death records through a medical death classification category called R00-R99 ‘Symptoms, Signs, and Abnormal Clinical and Laboratory Findings, Not Elsewhere Classified’. What the graph creator failed to do however, is take the data to a normal form, or to ‘denature’ it. Denaturation (biochemistry, not alcohol) is the process of removing invalid primary, secondary, or tertiary structure so that data may be parsed into its native state.2 This is also often called a process of ‘normalization’. However, since normalization relates to the elemental structure of a relational database as well, I use the term ‘denature’, in order to distinguish that this step constitutes more than simple assembly of a 3rd Normal Form (3NF) database table structure.3
A ‘graph’ is a visual depiction of raw data. A ‘chart’ communicates a concept for comprehension, which transcends or belies the mere ‘data’ behind it.
The example Exhibit 1 graph below is compromised by two dynamic secondary structures: First, the dynamic lag in the rate of its arrival (the dip in each sub-line at the right end), and second the dynamic rate of clearing of the data to other underlying cause of death codes (the relative gaps between the sub-lines). These two secondary structures must be removed from the data (denatured) in order to make it usable for model development or inference.
Denature – to remove the secondary, tertiary, agency-driven, confounding, or misleading concatenation structures from extracted data, no matter its purported ‘reliability’, in order to derive its base state – a state which is then more likely to inform.
As such, while the table below indeed portrays fact, it does not therefore also constitute information. It is disinformation technically, sans intent. It is equivalent to an accountant’s ledger entry and nothing more. The ‘accountant’ here (the CDC) is missing (most of) an alarming rise in this category of deaths, because they are deluding themselves through a conflation of the data and its secondary dynamic structures. An inability to see the forest for the ‘facts’. The fact that the data is reliable, has nothing to do with whether or not it is also therefore useful. It must be denatured before it can become informative.
Exhibit 1 – US Centers for Disease Control data which looks normal and informative – however, whose dynamic secondary structures obfuscate an underlying critical trend in deaths.
II. Information must be transmuted into intelligence.
Transmutating information into intelligence typically involves two steps:
a. Assembly of the denatured elemental data structures produced in Step I above, into a model outlining a chain of mechanism and feedback (a dynamic or ‘neural’ model) which represents the system in question (most all things involve systems), and
b. Filtering out imbalances and dis-economies of scale. That is to say – modeling the true value, magnitude, risk ,or cost of each element or node in a system, and not its fiat or nominal estimate of same.
The holding of a reasonably accurate model, which can describe contribution points, contributors, current or future activity, is called holding ‘intelligence’. Counter-intelligence is the process of obfuscating these elements so that the enemy or competitor is not able to produce an accurate model. This failure to develop dynamic or neural systems, along with modeling by means of nominal (not normalized) node costs (values), almost always lead to the conclusion that the current approach or understanding is the correct answer. Sound familiar? For readers of The Ethical Skeptic, this should.
The techniques which serve to break these habits are typically taught in systems and value chain engineering curricula, but not in most of academic science.
Example: At one fashion designer for whom I did strategy, the question was raised as to whether or not a shift in sourcing out of South Korea was in order. South Korea had been where the main competitor was conducting its sourcing – a sourcing strength which proved to be a disadvantage to my client in terms of both factory clout and landed cost. I proposed that we take an opposite approach and develop sourcing out of Jordan, Mexico, and Pakistan instead. The finance team retorted that per-unit first costs out of those nations were prohibitively high, product was slow to arrive, and costly to ship.
My team responded that those figures cited by accounting constituted ‘nominal loaded figures’ – in other words, they did not reflect economies of scale, maturation, and clout. They were simply output data from an ERP report, and not the result of a dynamic and normalized node structure. I contended that, once those resources were fully loaded and managed, not only would their per-unit costs then fall in line, but the speed by which they could swiftly outpace South Korean factories, would enable a speed-to-margin strategy win which would surpass the client’s major competitor in terms of fashion-based push sell-through.
The CEO comprehended what I was saying and elected to implement our strategy. Three years later, I was invited to speak before executives at this major competitor (a prominent national brand) – and without divulging proprietary information, present how this client had beaten them over the last three years through smart strategic changes. Although my team contributed a minor role at the very beginning of its process, this business case constituted one of the most monumental ‘David and Goliath’ upsets in US business history.
III. Intelligence is the first sound basis from which to plan or take action.
Intelligence is a process of eliminating the irrelevant, as much as it is a process of identifying the truth. Often, it is not a lack of truth which prevents the making of a sound decision, but rather a lack of clarity – a distraction with the chronically ill-defined, trivial, and menial. Humanity labors as if an unfortunate animal, trapped in a tar pit of irrelevancy, regarding that its desperate bellows will somehow serve to bring it to the salvation of truth.
Assembly and testing of conjecture scenarios through a systemic model, the measure of soundness, logical calculus, deduction, critical path, and inferential strength I have only found (to sufficiency – and not even complete given that) on my website. I am sure all of this is comprised through a number of separate publications – however, there exist few individuals if any, who can match my experiential depth in data analysis, business operations, military intelligence, philosophy, science, decades of applied systems and value chain engineering projects, knowledge of the nature of deception, along with hundreds of successful business and national strategies to boot.
This leveraging of intelligence into sound planning, is roughly outlined in the chart below. It involves the process of extracting thinking from the mire of irrelevance and into the ‘shining pathway of success’. The critical path.
There are many people who write books about this topic, but very few who have actually done it. You will note that these Type II or Semantic Experts employ intimidating-in-appearance heuristic and second-hand accounts, as a substitute for actual personal experience and competence. So I consider this, fortunately or unfortunately, to constitute my horizon of expertise.
The Ethical Skeptic, “Inflection Point Theory and the Dynamic of The Cheat”; The Ethical Skeptic, WordPress, 20 Oct 2019; Web, https://wp.me/p17q0e-atd
The Ethical Skeptic, “The Map of Inference”; The Ethical Skeptic, WordPress, 4 Mar 2019; Web, https://wp.me/p17q0e-9r6
Intelligence after all, constitutes far more than the mere holding of facts and data. Those who boast of such, only serve to discredit themselves in the eyes of an ethical skeptic. Just smile and quietly move on when you encounter these types. Refuse to join them as they wallow, blissful and intoxicated inside the warm yellowing pool of fact-fueled ignorance.
The Ethical Skeptic, “Mere Facts & Data Do Not Constitute Knowledge”; The Ethical Skeptic, WordPress, 9 Apr 2022; Web, https://theethicalskeptic.com/?p=64843
A single observation does not necessarily constitute an instance of the pejorative descriptive ‘anecdote’. Not only do anecdotes constitute data, but one anecdote can serve to falsify the null hypothesis and settle a scientific question in short order. Such is the power of a single observation. Such is the power of wielding skillfully, scientific inference. Fake skeptics seek to emasculate the power of the falsifying observation, at all costs.
It is incumbent upon the ethical skeptic, those of us who are researchers if you will – those who venerate science both as an objective set of methods as well as their underlying philosophy – incumbent that we understand the nature of anecdote and how the tool is correctly applied inside scientific inference. Anecdotes are not ‘Woo’, as most fake skeptics will imply through a couple of notorious memorized one-liners. Never mind what they say, nor might claim as straw man of their intent, and watch instead how they apply their supposed wisdom. You will observe such abuse of the concept to be most often the case. We must insist upon the theist and nihilist religious community of deniers, that inside the context of falsification/deduction in particular, a single observation does not constitute an instance of ‘anecdote’ (in the pejorative). Not only do anecdotes constitute data, but one anecdote can serve to falsify the Null (or even null hypothesis) and settle the question in short order. Such is the power of a single observation.
To an ethical skeptic, inductive anecdotes may prove to be informative in nature if one gives structure to and catalogs them over time. Anecdotes which are falsifying/deductive in nature are not only immediately informative, but moreover they are even more importantly, probative. Probative with respect to the null. I call the inferential modemodus absens the ‘null’ because usually in non-Bayesian styled deliberation, the null hypothesis, the notion that something is absent, is not actually a hypothesis at all. Rather, this species of idea constitutes simply a placeholder – the idea that something is not, until proved to be. And while this is a good common sense structure for the resolution of a casual argument, it does not mean that one should therefore believe or accept the null, as merely outcome of this artifice in common sense. In a way, deflecting observations by calling them ‘anecdote’ is a method of believing the null, and not in actuality conducting science nor critical thinking. However, this is the reality we face with unethical skeptics today. The tyranny of the religious default Null.
The least scientific thing a person can do, is to believe the null hypothesis.
Wolfinger’s Misquote
/philosophy : skepticism : pseudoscience : apothegm/ : you may have heard the phrase ‘the plural of anecdote is not data’. It turns out that this is a misquote. The original aphorism, by the political scientist Ray Wolfinger, was just the opposite: ‘The plural of anecdote is data’. The only thing worse than the surrendered value (as opposed to collected value, in science) of an anecdote is the incurred bias of ignoring anecdotes altogether. This is a method of pseudoscience.
Our opponents elevate the scientific status of a typical placeholder Null (such-and-such does not exist) and pretend that the idea, 1. actually possesses a scientific definition and 2. bears consensus acceptance among scientists. These constitute their first of many magician’s tricks, that those who do not understand the context of inference fall-for, over and over. Even scientists will fall for this ole’ one-two, so it is understandable as to why journalists and science communicators will as well. But anecdotes are science, when gathered under the disciplined structure of Observation (the first step of the scientific method). Below we differentiate four contexts of the single observation, in the sense of both two inductive and two deductive inference contexts, only one of which fits the semantics regarding ‘anecdote’ which is exploited by fake skeptics.
Inductive Anecdote
Inductive inference is the context wherein a supporting case or story can be purely anecdotal (The plural of anecdote is not data). This apothegm is not a logical truth, as it could apply to certain cases of induction, however does not apply universally.
Null: Dimmer switches do not cause house fires to any greater degree than do normal On/Off flip switches.
Inference Context 1 – Inductive Data Anecdote: My neighbor had dimmer switched lights and they caused a fire in his house.
Inference Context 2 – Mere Anecdote (Appeal to Ignorance): My neighbor had dimmer switched lights and they never had a fire in their house.
Hence we have Wolfinger’s Inductive Paradox.
Wolfinger’s Inductive Paradox
/philosophy : science : data collection : agency/ : an ‘anecdote’ to the modus praesens (observation or case which supports an objective presence of a state or object) constitutes data, while an anecdote to the modus absens (observation supporting an appeal to ignorance claim that a state or object does not exist) is merely an anecdote. One’s refusal to collect or document the former, does not constitute skepticism. Relates to Hempel’s Paradox.
Finally, we have the instance wherein we step out of inductive inference, and into the stronger probative nature of deduction and falsification. In this context an anecdote is almost always probative. As in the case of Wolfinger’s Inductive Paradox above, one’s refusal to collect or document such data, does not constitute skepticism.
Deductive or Falsifying Anecdote
Deductive inference leading to also, falsification (The plural of anecdote is data). Even the singular of anecdote is data under the right condition of inference.
Null: There is no such thing as a dimmer switch.
Inference Context 3 – Deductive Anecdote: I saw a dimmer switch in the hardware store and took a picture of it.
Inference Context 4 – Falsifying Anecdote: An electrician came and installed a dimmer switch into my house.
For example, what is occurring when one accepts materialism as an a priori truth pertains to those who insert that religious agency between steps 2 and 3 above. They contend that dimmer switches do not exist, so therefore any photo of one necessarily has to be false. And of course, at any given time, there is only one photo of one at all (all previous photos were dismissed earlier in similar exercises). Furthermore they then forbid any professional electrician from installing any dimmer switches (or they will be subject to losing their license). In this way – dimmer switches can never ‘exist’ and deniers endlessly can proclaim to non-electricians ‘you bear the burden of proof’ (see Proof Gaming). From then on, deeming all occurrences of step 2 to constitute lone cases of ‘anecdote’, while failing to distinguish between inductive and deductive contexts therein.
Our allies and co-observers as ethical skeptics need bear the knowledge of philosophy of science (skepticism) sufficient to stand up and and say, “No – this is wrong. What you are doing is pseudoscience”.