
Contributed by Beverly Vicker
By definition individuals with an autism spectrum disorder have difficulty with what is called the pragmatic aspect of language. Parents and speech language pathologists often ask, “What test will demonstrate that my child (or student) has difficulties with pragmatics?” This question reflects the assumption that there is such an instrument. There isn’t one AND there may never be a singular effective standardized test of pragmatic ability. While this response may come as a shock, it may be more understandable if one knows more about the nature of pragmatics and knows how one can assess pragmatic function.
If one has good pragmatic skills, he or she is able to communicate an appropriate message in an effective manner within a reasonable time frame in a real life situation. Pragmatics is like a cake. The cake is the whole or gestalt that represents the combination of many ingredients. No one ingredient is representative of the edible item, that we call a “cake.” In a somewhat related fashion, as one continues the cake analogy, no singular standardized test of ingredients can effectively capture the essence of the whole or gestalt called “pragmatics.” In order to communicate an appropriate message in a given situation, many ingredients have to mesh in an instantaneous fashion. Within a few seconds or less, the typical communicator must:
This sounds like quite a task, but typical speakers do it all the time with little effort. For the person with an autism spectrum disorder, such situations often represent a serious challenge.
The potential for difficulty or lack of effectiveness in any given situation is ample. A person may have difficulty because of one or more of the following reasons. He or she may have:
When one considers the complexity of the process listed above, it is understandable why a singular formal test would not accurately identify something as complex and context based as pragmatic problems. Pragmatics represents the whole act of communication and is not simply a sum of the parts.
One might, however, initially identify that an individual has a problem with pragmatics (the whole) and particular situations that present problems by:
For an elementary school age student, this might translate into an observation in the classroom during group instruction and small group sessions, at recess, and in the lunchroom. Parents, teachers, aides and peers might contribute useful information during an interview or through a checklist. The student him or herself also might be able to identify situations that represent a challenge by completing a checklist. Challenging situations could be embedded within the daily routine so that the student might demonstrate how he manages situations such as being overlooked as papers are passed out, someone teasing him, or needing to ask for assistance with a difficult task. This type of data is called qualitative data. This data collection method is used to analyze complex behaviors such as social interaction. Qualitative data can be as legitimate as quantitative data (test scores) for decision-making about programming needs if it has been collected in an appropriate manner.
The Test of Pragmatic Language, for example, attempts to look at the application of social knowledge. The test involves pictured situations and requires responding to static, non-emotional, decontextualized situations. The examiner provides information about the situation and asks what the person might say in that situation. The test can provide some information about social knowledge but one has to understand the limitations. If one has been taught about certain social situations and has good associational recall, one might be able to pass the test. This same person may have significant problems with natural pragmatic situations, however, when he or she is in a real life situation. He or she may have great difficulty coping with emotions and/or may be in sensory overload. He or she might be clueless about the subtleties of the situation. He or she may be unable to manage the demand for a rapid processing of information. And, he or she may be unable to deal with the rapid need for formulation and delivery of an appropriate response. In other words, the test produces false negative data for some children because it cannot capture enough of the holistic demands of real life situations. Emotional state, not measured by the test, can play an important role in how well one can use what he or she knows. The degree of challenge emanating from the demands will differ by individual and by specific situation.
Other types of formal testing might be used if the purpose is clearly defined and the results reviewed within the holistic context that pragmatics represent. For example, if it is suspected that the student has trouble with understanding complex grammar, this could be probed. Intervention focused on only this one underpinning element, however, may or may not improve pragmatic abilities unless coupled with increasing social knowledge. The reverse is also true. If one learns more about social knowledge, one may still be ineffective in real situations because other significant components collectively also impact performance. It may be very important to screen or evaluate selective contributing elements such as vocabulary, word retrieval, event representation skills, and so forth and consider these as one attempts to improve pragmatic skills for a specific individual.
By definition, individuals with an autism spectrum disorder will have difficulty with social pragmatic function. It does not take formal testing to identify that a social pragmatic problem exists. No singular test can evaluate the complexity of situational pragmatic skills. Passing a test such as the Test of Pragmatic Language can represent a false negative and exclude someone from needed support and intervention. Sometimes information from selective tests or subtests that probe specific elements that contribute to pragmatic competency, however, might be helpful for program design. Scoring within normal limits, however, on any of these tests does not mean that there is no pragmatic disorder but rather that one of the components, under specific conditions, does not seem to be a major problem.
Qualitative data is legitimate and can be gathered through various means. Individuals will differ in terms of how effective they are in specific situations, with specific partners, and as the mental and emotional demands of situations change. The complexity of pragmatics must be considered as intervention programs are designed.
Brinton, B. & Fujiki. (2003). Blending quantitative and qualitative methods in language research and intervention. American Journal of Speech-Language Pathology, 12(2), 165-171.
Duchan, J. F. (1994). Pragmatics: From theory to practice. Englewood Cliffs: Prentice Hall.
Gallagher, T. (1991). (Ed.). Pragmatics of language: Clinical practice issues. San Diego, CA: Singular Publishing Group.
Phelps-Terasaki, D. & Phelps-Gunn, T. (1992). Test of Pragmatic Language. Austin: Pro-ED.
Tetnowski, J. A. & Franklin, T. C. (2003). Qualitative research: Implications for description and assessment. American Journal of Speech-Language Pathology. 12(2), 155-164.
Twachtman-Cullen, D. (2003). The effect of theory of mind deficits on communication and social behavior in individuals with ASD: An introduction. Autism-Asperger Digest. January-February, 16-19.
A special thanks is extended to Diane Twachtman-Cullen for her feedback during the preparation of this article.
Vicker, B. (2003). Can social pragmatic skills be tested? The Reporter, 8(3), 12-15.