Last updated on: 8/25/2015 5:58:57 PM PST

Theoretical Expertise Rankings

Evaluating the credibility of one person’s statements is difficult if not impossible, especially without knowing, for example, each person’s background, training, affiliations, education, or experience. However, we feel that a guide to a person’s theoretical expertise can be helpful, so we have built theoretical expertise ranking charts for each ProCon.org website to help differentiate the theoretical expertise of the various sources on our sites.

  1. Our Rankings for Sources at Minimum Wage ProCon.org
  2. Our Methodology
  3. Pros and Cons of Our Theoretical Expertise Ranking System
  4. Some Flaws in Our Theoretical Expertise Ranking
  1. Our Rankings for Sources at Minimum Wage ProCon.org:

    Government Reports and Peer-Reviewed Studies
    Official vetted reports from international government bodies (such as the United Nations and the European Union), foreign governments (federal level agencies such as France's Ministry of Justice, South Africa's Ministry of Health, or Japan's office of the Prime Minister), and US government agencies (state, federal, and quasi-government agencies including the Smithsonian Institution, the National Academy of Sciences, and Legal Services Corporation) and peer-reviewed studies from academic journals (such as Science, Nature, New England Journal of Medicine, etc.) tend to have multiple editorial and ideological filters, and they normally receive rigorous review from experts before being formally issued.
    Key Experts
    We do not believe that this issue has a Key Experts category. [Note: Key Experts definition varies by sites that have this designation.]
    Experts
    Individuals with PhDs, JDs, or equivalent advanced degrees in fields relevant to the minimum wage. Also top-level government officials (such as foreign leaders, US presidents, Founding Fathers, Supreme Court Justices, members of legislative bodies, cabinet members, military leaders, etc.) with positions relevant to the minimum wage.
    Media and Academic Journals
    Mainstream print, broadcast, radio, and internet media entities such as the New York Times, CNN, ABC News, National Public Radio, Slate.com, Seattlepi.com, etc., as well as influential academic journals such as the Journal of the American Medical Association, Quarterly Journal of Economics, Foreign Policy, etc.
    Organizations/VIPS/Others
    Individuals and organizations that do not fit into the other star categories.
  2. Our Methodology:

    Our theoretical expertise rankings are based upon the following premises:

    • The courts and many people equate a level of education and knowledge with a person’s theoretical expertise.
    • Although ProCon.org doesn’t have the resources to make complex evaluations of the expertise of each contributor to our website and such an evaluation would still contain a fair amount of subjectivity, we believe our theoretical ranking is more desirable than no ranking at all, and that it should be accurate at least 80% of the time.

    We have therefore assigned a one through five star rating based on the theoretical expertise each of our sources should possess.

    Additionally, we have customized the star categories to each of our sites’ specific content because of their different subject matter.

  3. Pros and Cons of Our Theoretical Expertise Ranking System:

    Some people have praised our ranking system as a tool for differentiating the theoretical expertise of our sources. Others believe our star system should be eliminated because it is too subjective. The following chart sets out the main Pros and Cons about our theoretical expertise system:

    Pro Theoretical Expertise SystemCon Theoretical Expertise System
    Provides a quick guide to theoretical source qualitySuggesting that one source is more theoretically expert than another reflects bias
    Our star system is based on a person’s education and knowledge – a concept used in the court system to try and distinguish reliable informationThe number of stars prejudges sources for readers rather than allowing readers to judge the sources’ expertise for themselves
    Stars add a simple and clean visual aid for a source’s theoretical expertiseSome 1 star individuals can be more expert than 3 or 4 starred sources. All organizations receive 1 or 2 stars regardless of their actual expertise
    We estimate our star system is accurate roughly 80% of the timeWe estimate our star system is inaccurate roughly 20% of the time
  4. Some Flaws in Our Theoretical Expertise Ranking:

    The following are examples of flaws or problems with our theoretical expertise rankings:

    ol li p {margin-top: 13px; padding-top: 0;}

    1. Government Reports – Some have questioned why we have chosen to give government reports our highest rating of five stars.

      Our thinking is that government facts and statistics are generally reliable. However, what is less reliable, hence our lower rating, is when government personnel attempt to quote from such facts out of context, or worse when they misuse those facts on purpose or by accident.

      For example, we generally would give our highest rating–five stars, to a government report saying that there have been 52,850 killed in auto accidents in a given time period, but we would consider a government employee who said in a speech “Fifty-thousand people died last year in auto accidents” to have less expertise. The government employee would probably receive one, three, or in some cases four stars, depending on the person’s education and position.

    2. Star Ranking Challenges at Organizations – We rank most organizations as 1-star because they are often dynamic and subject to myriad influences, thereby making a ranking difficult if not impossible.

    3. Expertise Leap Between One-Star Organizations and Their Five-Star Reports – A government organization would be categorized as a one-star source, but a report issued by that organization would probably receive our five-star ranking.

    4. No Background Verifications – We do not verify the professional or educational background of our sources. For instance, if someone reports that they hold a PhD, MD, or JD degree, then we presume that they hold that degree. We recognize that people may lie on their resumes, but we don’t check resumes for accuracy.

    5. Each Site Has a Different Scale – Election officials are 3-star “Experts” on the Voting Machines website, but probably wouldn’t be on the Euthanasia website.

    6. Some Expertise Categories Do Not Exist on Other Sites – The Born Gay website lists people with PhD’s in Psychology as 4-star “Key Experts” while other sites may not even have a 4-star “Key Expert” category.