Because a literature review is a summary and analysis of the relevant publications on a topic, we first have to understand what is meant by “the literature.” In this case, “the literature” is a collection of all of the relevant written sources on a topic.

Disciplines of knowledge

When drawing boundaries around an idea, topic, or subject area, it helps to think about how and where the information for the field is produced. For this, you need to identify the disciplines of knowledge production in a subject area.

Information does not exist in the environment like some kind of raw material. It is produced by individuals working within a particular field of knowledge who use specific methods for generating new information. Disciplines consume, produce, and disseminate knowledge. Looking through a university’s course catalog gives clues to disciplinary structure. Fields such as political science, biology, history, and mathematics are unique disciplines, as is social work, with its own logic for how and where new knowledge is introduced and made accessible.

You will need to become comfortable with identifying the disciplines that might contribute information to any search. When you do this, you will also learn how to decode the way how people talk about a topic within a discipline. This will be useful to you when you begin a review of the literature in your area of study.

For example, think about the disciplines that might contribute information to a topic such as the role of sports in society. Try to anticipate the type of perspective each discipline might have on the topic. Consider the following types of questions as you examine what different disciplines might contribute:

• What is important about the topic to the people in that discipline?
• What is most likely to be the focus of their study about the topic?
• What perspective would they be likely to have on the topic?

In this example, we identify two disciplines that have something to say about the role of sports in society: the human service professions of nursing and social work. What would each of these disciplines raise as key questions or issues related to that topic? A nursing researcher might study how sports affect individuals’ health and well-being, how to assess and treat sports injuries, or the physical conditioning required for athletics. A social work researcher might study how schools privilege or punish student athletes, how athletics impact social relationships and hierarchies, or the differences between boys’ and girls’ participation in organized sports. In this example, we see that a single topic can be approached from many different perspectives depending on how the disciplinary boundaries are drawn and how the topic is framed. Nevertheless, it is useful for a social worker to be aware of the nursing literature, as they could better appreciate the physical toll that sports take on athletes’ bodies and how that may interact with other issues. An interdisciplinary perspective is usually a more comprehensive perspective.

Types of sources

“The literature” consists of the published works that document a scholarly conversation on a specific topic within and between disciplines. You will find in “the literature” documents that explain the background of your topic. You will also find controversies and unresolved questions that can inspire your own project. By now in your social work academic career, you’ve probably heard that you need to get “peer-reviewed journal articles.” But what are those exactly? How do they differ from news articles or encyclopedias? That is the focus of this section of the text—the different types of literature.

First, let’s discuss periodicals. Periodicals include journals, trade publications, magazines, and newspapers. While they may appear similar, particularly online, each of these periodicals has unique features designed for a specific purpose. Magazine and newspaper articles are usually written by journalists, are intended to be short and understandable for the average adult, contain color images and advertisements, and are designed as commodities sold to an audience. Magazines may contain primary or secondary literature depending on the article in question. The New Social Worker is an excellent magazine for social workers. An article that is a primary source would gather information as an event happened, like an interview with a victim of a local fire, or relate original research done by the journalists, like the Guardian newspaper’s The Counted webpage which tracks how many people were killed by police officers in the United States. ^[1]

Is it okay to use a magazine or newspaper as a source in your research methods class? If you were in my class, the answer is “probably not.” There are some exceptions like the Guardian page mentioned above or breaking news about a policy or community, but most of what newspapers and magazines publish is secondary literature. Secondary sources interpret, discuss, and summarize primary sources. Often, news articles will summarize a study done in an academic journal. Your job in this course is to read the original source of the information, in this case, the academic journal article itself. Journalists are not scientists. If you have seen articles about how chocolate cures cancer or how drinking whiskey can extend your life, you should understand how journalists can exaggerate or misinterpret results. Careful scholars will critically examine the primary source, rather than relying on someone else’s summary. Many newspapers and magazines also contain opinion articles, which are even less reputable as the author will choose facts to support their viewpoint and exclude facts that contract their viewpoint. Nevertheless, newspaper and magazine articles are excellent places to start your journey into the literature, as they do not require specialized knowledge to understand and may inspire deeper inquiry.

Unlike magazines and newspapers, trade publications may take some specialized knowledge to understand. Trade publications or trade journals are periodicals directed to members of a specific profession. They often have information about industry trends and practical information for people working in the field. Because of this trade publications are somewhat more reputable than newspapers or magazines, as the authors are specialists on their field. NASW News is a good example a trade publication in social work, published by the National Association of Social Workers. Its intended audience is social work practitioners who want to know about important practice issues. They report news and trends in a field but not scholarly research. They may also provide product or service reviews, job listings, and advertisements.

So, can you use trade publications in a formal research proposal? Again, if you’re in my class, the answer would be “probably not.” A main shortcoming trade publication is the lack of peer review. Peer review refers to a formal process in which other esteemed researchers and experts ensure your work meets the standards and expectations of the professional field. While trade publications do contain a staff of editors, the level of review is not as stringent as academic journal articles. On the other hand, if you are doing a study about practitioners, then trade publications may be quite relevant sources for your proposal. Peer review is part of the cycle of publication illustrated below and acts as a gatekeeper, ensuring that only top-quality articles are published. While peer review is far from perfect, the process provides for stricter scrutiny of scientific publications.

In summary, newspapers and other popular press publications are useful for getting general topic ideas. Trade publications are useful for practical application in a profession and may also be a good source of keywords for future searching. Scholarly journals are the conversation of the scholars who are doing research in a specific discipline and publishing their research findings.

Types of journal articles

As you’ve probably heard by now, academic journal articles are considered to be the most reputable sources of information, particularly in research methods courses. Journal articles are written by scholars with the intended audience of other scholars (like you!) interested in the subject matter. The articles are often long and contain extensive references for the arguments made by the author. The journals themselves are often dedicated to a single topic, like violence or child welfare, and include articles that seek to advance the body of knowledge about their chosen topic.

Most journals are peer-reviewed or refereed, which means a panel of scholars reviews articles to decide if they should be accepted into a specific publication. Scholarly journals provide articles of interest to experts or researchers in a discipline. An editorial board of respected scholars (peers) reviews all articles submitted to a journal. Editors and volunteer reviewers decide if the article provides a noteworthy contribution to the field and should be published. For this reason, journal articles are the main source of information for researchers and for literature reviews. You can tell whether a journal is peer reviewed by going to its website. Usually, under the “About Us” section, the website will list the editorial board or otherwise note its procedures for peer review. If a journal does not provide such information, you may have found a “predatory journal.” These journals will publish any article—no matter how bad it is—as long as the author pays them. Not all journals are created equal!

A kind of peer review also occurs after publication. Scientists regularly read articles and use them to inform their research. A seminal article is “a classic work of research literature that is more than 5 years old and is marked by its uniqueness and contribution to professional knowledge” (Houser, 2018, p. 112). ^[2] Basically, it is a really important article. Seminal articles are cited a lot in the literature. You can see how many authors have cited an article using Google Scholar’s citation count feature when you search for the article. Generally speaking, articles that have been cited more often are considered more reputable. There is nothing wrong with citing an article with a low citation count, but it is an indication that not many other scholars have found the source to be useful or important.

Journal articles fall into a few different categories. Empirical articles apply theory to a behavior and reports the results of a quantitative or qualitative data analysis conducted by the author. Just because an article includes quantitative or qualitative results does not mean it is an empirical journal article. Since most articles contain a literature review with empirical findings, you need to make sure the finds reported in the study are from the author’s own analysis. Fortunately, empirical articles follow a similar structure—introduction, method, results, and discussion sections appear in that order. While the exact headings may differ slightly from publication to publication and other sections like conclusions, implications, or limitations may appear, this general structure applies to nearly all empirical journal articles.

Theoretical articles, by contrast, do not follow a set structure. They follow whatever format the author finds most useful to organize their information. Theoretical articles discuss a theory, conceptual model, or framework for understanding a problem. They may delve into philosophy or values, as well. Theoretical articles help you understand how to think about a topic and may help you make sense of the results of empirical studies. Practical articles describe “how things are done” (Wallace & Wray, 2016, p. 20). ^[3] They are usually shorter than other types of articles and are intended to inform practitioners of a discipline on current issues. They may also provide a reflection on a “hot topic” in the practice domain, a complex client situation, or an issue that may affect the profession as a whole.

No one type of article is better than the other, as each serves a different purpose. Seminal articles relevant to your topic area are important to read because of their influence on the field. Theoretical articles will help you understand the social theory behind your topic. Empirical articles should test those theories quantitatively or create those theories qualitatively, a process we will discuss in greater detail later in this book.  Practical articles will help you understand a practitioner’s perspective, though these are less useful when writing a literature review as they only present a single person’s opinions on a topic.

Other sources of information

As I mentioned previously, newspaper and magazine articles are good places to start your search (though they should not be the end of your search!). Another source students go to almost immediately is Wikipedia. Wikipedia is a marvel of human knowledge. It is a digital encyclopedia to which anyone can contribute. The entries for each Wikipedia article are overseen by skilled and specialized editors who volunteer their time and knowledge to making sure their articles are correct and up to date. Wikipedia is an example of a tertiary source. We reviewed primary and secondary sources in the previous section. Tertiary sources synthesize or distill primary and secondary sources. Examples of tertiary sources include encyclopedias, directories, dictionaries, and textbooks like this one. Tertiary sources are an excellent place to start (but are not a good place to end your search). A student might consult Wikipedia or the Encyclopedia of Social Work (available at http://socialwork.oxfordre.com/) to get a general idea of the topic.

The difference between secondary and tertiary sources is not exact, and as we’ve discussed, using one or both at the beginning of a project is a good idea. As your study of the topic progresses, you will naturally have to transition away from secondary and tertiary sources and towards primary sources. We’ve already talked about one particular kind of primary source—the academic journal article. We will spend more time on this primary source than any other in this textbook. However, it is important to understand how other types of sources can be used as well.

Books contain important scholarly information. They are particularly helpful for theoretical, philosophical, and historical inquiry. For example, in my research on self-determination for individuals with intellectual and developmental disabilities, I needed to define and explore the concept of self-determination. I learned how to define it from the philosophical literature on self-determination and the advocacy literature contained in books. You can use books to learn definitions, key concepts, and keywords you can use to find additional sources. They will help you understand the scope and foundations of a topic and how it has changed over time. Some books contain chapters that look like academic journal articles. These are called edited volumes, and they contain articles that may not have made it into academic journals or seminal articles that are republished in the book. Edited volumes are considered less reputable than journal articles, as they do not have as strong of a peer review process. However, papers in social science journals will often include references to books and edited volumes.

Conferences are a great source of information. At conferences such as the Council on Social Work Education’s Annual Program Meeting or your state’s NASW conference, researchers present papers on their most recent research and obtain feedback from the audience. The papers presented at conferences are sometimes published in a volume called a conference proceeding. Conference proceedings highlight current discussion in a discipline and can lead you to scholars who are interested in specific research areas. A word about conference papers: several factors contribute to making these documents difficult to find. It is not unusual that papers delivered at professional conferences are not published in print or electronic form, although an abstract may be available. In these cases, the full paper may only be available from the author or authors. The most important thing to remember is that if you have any difficulty finding a conference proceeding or paper, ask a librarian for assistance.

Another source of information is the gray literature, which is research and information released by non-commercial publishers, such as government agencies, policy organizations, and think-tanks. If you have already taken a policy class, perhaps you’ve come across the Center on Budget and Policy Priorities (https://www.cbpp.org/). CBPP is a think tank or a group of scholars that conduct research and perform advocacy on social issues. Similarly, students often find the Centers for Disease Control website helpful for understanding the prevalence of social problems like mental illness and child abuse.  Think tanks and policy organizations often have a specific viewpoint they support. There are conservative, liberal, and libertarian think tanks, for example. Policy organizations may be funded by private businesses to push a given message to the public. Government agencies are generally more objective, though they may be less critical of government programs than other sources might be. The main shortcoming of gray literature is the lack of peer review that is found in academic journal articles, though many gray literature sources are of good quality.

Dissertations and theses can be rich sources of information and have extensive reference lists to scan for resources. They are considered gray literature because they are not peer reviewed. The accuracy and validity of the paper itself may depend on the school that awarded the doctoral or master’s degree to the author. Having completed a dissertation, they take a long time to write and a long time to read. If you come across a dissertation that is relevant, it is a good idea to read the literature review and plumb the sources the author uses in your literature search. However, the data analysis from these sources is considered less reputable as it has not passed through peer review yet. Consider searching for journal articles by the author to see if any of the results passed peer review. You will also be thankful that journal articles are much shorter than dissertations and theses!

The final source of information we must talk about is webpages. My graduate research focused on substance abuse and drugs, and I was fond of reading Drug War Rant (http://www.drugwarrant.com/), a blog about drug policy. It provided me with breaking news about drug policy and editorial opinion about the drug war. I would never cite the blog in a research proposal, but it was an excellent source of information that warranted further investigation. Webpages will also help you locate professional organizations and human service agencies that address your problem. Looking at their social media feeds, reports, publications, or “news” sections on an organization’s webpage can clue you into important topics to study. Because anyone can begin their own webpage, they are usually not considered scholarly sources to use in formal writing, but they are still useful when you are first learning about a topic. Additionally, many advocacy webpages will provide references for the facts they site, providing you with the primary source of the information.

As you think about each source, remember:

All information sources are not created equal. Sources can vary greatly in terms of how carefully they are researched, written, edited, and reviewed for accuracy. Common sense will help you identify obviously questionable sources, such as tabloids that feature tales of alien abductions, or personal websites with glaring typos. Sometimes, however, a source’s reliability—or lack of it—is not so obvious…You will consider criteria such as the type of source, its intended purpose and audience, the author’s (or authors’) qualifications, the publication’s reputation, any indications of bias or hidden agendas, how current the source is, and the overall quality of the writing, thinking, and design. (Writing for Success, 2015, p. 448). ^[4]

While each of these sources is an important part of how we learn about a topic, your research should focus on finding academic journal articles about your topic. These are the primary sources of the research world. While it may be acceptable and necessary to use other primary sources—like books, government reports, or an investigative article by a newspaper or magazine—academic journal articles are preferred. Finding these journal articles is the topic of the next section.