doc.gif (2921 bytes)

HUMANIZING DECISION SUPPORT SYSTEMS*



Jean Campbell, Ph.D., Director
Research, Quality Assurance and Information Systems
Maine Department of Mental Health and Mental Retardation


Elizabeth Doore Frey, Systems Analyst
Maine MHSIP Project Director
Research, Quality Assurance and Information Systems
Maine Department of Mental Health & Mental Retardation




*Thanks to Victoria Burwell and Cecilia Leland, Social Service Specialists employed by the Maine State DMHMR Office of Research, Quality Assurance and Information Systems, Mike DeSisto, Ph.D. of Medical Care Development, Inc., and the members of the Consumer/Survivor Mental Health Research and Policy Work Group for their contributions to this text.

October 1993



TABLE OF CONTENTS


INTRODUCTION

The mental health service delivery system is facing unprecedented challenges in this current period of fiscal crisis and system change. The Chinese ideogram for crisis suggests this situation presents the twin possibilities of opportunity and catastrophe. Unlike the Chinese ideogram, efforts to humanize this system offer the twin positive possibilities of opportunity and collaboration. These possibilities can only be realized through a commitment to all stakeholders involved in the management of mental health information systems to dialogue about values and goals and to bring this collaborative knowledge and skill into all areas where quality in mental health services is ensured and policy decisions are made. Most critical to the success would be the dedication of all stakeholders to make the mental health system responsive, effective and egalitarian. Fluid and continuing system reform can only be guaranteed when all stakeholders work together as equals and consumer participation is fully supported as the primary value.

A review of the MHSIP Current Status and Directions for the Future (May, 1992) provides the opportunity to critically examine MHSIP's vision of a decision support system. Some of the questions raised by a review of this document are:

1) What are the political factors that influence data collection, standards and uses?

2) What is the responsibility to ensure confidentiality, informed consent and prevent collection burden?

3) How can we obtain data that reflects the role of self-help, support and advocacy groups?

4) What can be learned from people who don't use mental health services?

5) How can the process of healing and recovery be captured in the bits and pieces of information electronically strung out across the mental health system?

6) And most importantly, how can a decision support system that is truly responsive to the information needs of all citizens be created?

The thrust of these questions leads to an exploration of the nature of a truly voluntary information system that embraces human subjects protection for data collection and its uses.

The following concept paper, prepared for the Center for Mental Health Services, provides some background on and insight into the growing consumer/survivor movement, and offers the vision of an architecture of decision support that is person-driven. It promises to challenge thinking about what decision support really means and advances the argument that health care reform ought to and can enhance individual choice, power and knowledge.

IN PURSUIT OF WELLNESS

There is increasing evidence that persons who experience mental illness and the people who try to help them often see the world from very different perspectives. Ridgeway (1988) has provided a recent review. Wide differences between consumers and professionals have been found for the relative importance of various treatment goals (Dimsdale et al., 1979), problems (Mitchell et al., 1983), barriers to service (Lynch and Kruzich, 1986), and residential needs (Ridgway and Caning, 1987; Goldberg, et al., 1988). In an unpublished study of community support needs in Maine, Harvey et al., (1984) found that over half of the clients wanted to live in their own home or apartment, while only 12% of the clinicians would recommend this for the same clients.

Even though self-determination is a basic tenet of rehabilitation and social work practice (Anthony et a., 1983; Meenaghan and Mascare, 1971), consumer perspectives are often ignored in the development of programs, service systems, and individual service plans. Many basic attitudes, processes, and prejudices contribute to this situation. For example. mentally ill persons are stigmatized not only by society, but sometimes also through labeling by the very system that is trying to help them (Goffman, 1961). This serves to dehumanize the person; to make a presumption of incompetence that invalidates sense of self. Mental Health professionals believe that they are the keepers of special knowledge or frame problems in their own conceptual scheme or treatment approach, sometimes ignoring the perception or framework of the person they are trying to help (Kopolow, 1979). System planners and managers may also assume that they know what is best, or respond to their own constituencies instead of listening to consumers.

Historically, changes in and "improvements"" to health services in general have been based on the opinions and studies of professionals in the field. While opinions may have been influenced by research that examined clients, they are, nonetheless, the professionals' own opinions. John McKnight writes in "Regenerating Community" that "Each of us has a map of the social world in our mind, and the way we act, our plans and opinions are the result of that map." (1987). Health professionals share common assumptions that "the expert knows best" about the operating principles of the service delivery system: (1) they know the scientifically correct way to deliver services: (2) they know the values and preferences of their clients: (3) they are disinterested and objective without preferences and biases of their own; (4) they choose for their clients what the client would choose for themselves if they had the same knowledge (Silberman, 1993).

From the perspective of the professional. diagnosis refers to pathology, a process abstracted from the person and his/her suffering. To an individual, the diagnosis of mental illness becomes an assault on identity and sense of self with concomitant erosion of autonomy and control. It is an existential process. People judge the quality of and appropriateness of services by their impact on the quality of their lives (Campbell and Schraiber, 1989; Trochim, Dumont, and Campbell, 1993) while professionals monitor functionality, recidivism, and symptom control. This fundamental difference in cognitive maps compromises the process of communication between individuals. Kay Toombs reports, "this inability to communicate does not result from inattentiveness or insensitivity but from a fundamental disagreement about the nature of illness. Rather than representing a shared reality between us, illness represents two quite different realities, the meaning of one being significantly...different from the meaning of the other" (1987).

Since information about what a person thinks and feels has been considered soft or subjective science, objective data has lead the development of knowledge and practice in mental health. By making this distinction, professionals have ignored the personhood or humanity of individuals and all the factors that differentiate them from symptoms, brains, or molecules.

Personhood: A Humanistic Philosophy for Decision Support

"I prefer not to be labeled. Labels make me feel like I will never get well, like I'm not a human being, like I'm not a person. But I don't hold with that in my thoughts. I just feel I'm a well-being person and I'm going to speak up and say that I'm a human being and I'm to be treated like a human being. Like everybody else, I'm a person like everybody else."

testimony of Barbara F. Mickens

(Campbell and Schraiber, 1989, p.48)

Validation of one's personhood is essential for well-being. The recognition of common humanity and acceptance of individual difference enables people to survive the stress and uncertainty of modern life with dignity and joy. Nowhere is the importance of personhood as a philosophical and operational principle of social organization more appropriate than in the field of mental health. Mental health is essentially the formation of an acceptable identity-acceptable to oneself and others. It is therefore ironic that the extent to which a sense of self is derived from social context is seldom recognized in the planning, delivery, and evaluation of mental health services.

Traditional mental health systems are based on a medical model, emphasizing illness rather than wellness, patienthood rather than personhood. It is common practice to call people by their diagnosis or simply label them as "mentally ill". However, a diagnosis of mental illness permeates all aspects of a person's life. It captures the ideological, material, and emotional resources people have to give meaning and to act in everyday and political life by stripping away the objective power and will to power of people as they encounter the social world and participate in the reproduction of daily life. Personhood is subsumed by a global sentence of illness and disability even though people are never constantly, nor in all aspects, and not for all time "out of their minds". It is presumed that people with a psychiatric diagnosis do not know what is in their own best interests. Feelings of anger and joy are scrutinized for signs of pathology and violence. Needs and desires are imputed as if consumers were mute. They are routinely consigned to everyday lives emptied of quality, vitality, and dignity. Many ex-patients are angry at treatment they have received or witnessed in the mental health system (Chamberlin, 1988).

Significantly, in a survey of mental health consumers in California to determine what factors promote or deter well-being, the Well-Being Project found that invalidation of insight, failure to provide treatment information, and lack of respect by mental health professionals and agency personnel towards the people who received mental health services had the greatest effect on their well-being when compared with other variables such as poverty, loneliness, employment, health and safety. Conversely, consumers reported that the quality of their lives improved when they were treated as people first and provided with the necessary information to make knowledgeable judgements about their lives (Campbell and Schaiber, 1989). The tendency to discount and ignore consumer's dissatisfaction with the mental health system is particularly salient in research and data collection. For example, researchers have lacked the insight to ask questions that capture detrimental or iatrogenic effects of services and institutionalization. Further, in a review of quality of life instruments no measures of coercion or personal freedom were found, even though liberty represents a deep-seated cultural value (Campbell, 1993).

From TQM to Person-Driven Decision Support

Structural changes are presently occurring in the development, organization, and management of information Systems in health care to accommodate a person-driven perspective. These changes appear to be a response to a broader humanistic societal trend related to the definition and production of knowledge and the democratization of decision-support. As identified by Susan Buckley in. her paper "Moving MHSIP Toward a Person-driven Paradigm" (1993), indicators of this emerging humanistic paradigm include:

"a broadened concept of public accountability (Ziglin, 1991); widespread popularity of "customer-driven" approaches to management, in general (Osborne and Gaebler, 1992). and in mental health (Rago and Reid, 1991); and recognition of the legitimacy and value of having persons actively participate in making decisions related to their well-being, demonstrated in general health care settings (Emanuel and Emanuel, 1992; Davies and Ware, 1988); and, particularly, by the blossoming of a vibrant mental health consumer empowerment movement (Bevilacqua, 1993; Scott. 1993; Consumer/Survivor Mental Health Research and Policy Work Group. 1992)."

Further, the Picker-Commonwealth survey found that Americans are eager to use survey data to help them decide where to seek medical and hospital care (Cleary et al., 1991) and to play an active role in decisions about the health care delivery system in general, and in their own treatment choices.

In the confluence of forces creating the climate for a paradigm shift to person-driven information systems, one important development has been leadership from business, human service systems and state legislatures to implement Total Quality Management (TQM) procedures to capture customer focus and customer satisfaction through answering such questions as who are the customers, what do customers prefer, what do customers need, are customers satisfied with processes, and what are customer outcomes?.

Faced with the need to regain the ability to compete in world-wide service and manufacturing markets, American business is in the process of reframing its conceptualization of how to achieve quality. Lead by such thinkers as Deming (1982; 1986). Crosby (1984; 1989), and Juran (1988; 1989), traditional thinking about quality has been transformed to a focus on customer satisfaction. The table below contrasts some principles of traditional Quality Assurance (QA) with principles from TQM.

TQM QA
1. Consumer/customer centered Management centered
2. Quality definition Quality intangible
3. Process focus Product focus
4.Preventive Reactive
5. Error-free attitude Acceptable quality level
6. Management by fact Management by intuition
7. Consumer and employee empowerment Consumer and employee control
8. Total organization Quality department
9. Continuous improvement Status quo
10. Supplier/provider partnerships We-they relationships
11. Team Individual
12. Flexible/flat Rigid/hierarchical
13. Sampling, customer and community surveys, focus groups concept mapping, longitudinal follow-up Client identification, client tracking, vertically integrated information, mass inspection
14. Consumers define quality:
determines if measures developed to determine if consumer requirements are met
Management defines quality; quality is provided


The basic essence of TQM involves empowering the entire system to improve the quality of goods and services continuously in order to satisfy the customer. In business, high performance organizations seek not only to meet customer expectations, they go the extra mile to try to delight their customers. They develop a strategic plan to find out what customers want by involving and asking them. Only customers know, and their expectations and needs are likely to change over time. Therefore, the organization's information gathering needs and activities involve a wide range of methodologically conservative methods for acquiring customer feedback so that the product can be redesigned. These include customer surveys, focus groups. consumer councils, complaint tracking systems, and test marketing (Osborne and Graebler, 1992). The organization adopts a service orientation as the primary means of achieving their mission. There is no effort to develop vertically-integrated information Systems to identify individuals. This would be too expensive and is oriented toward management versus consumer needs. It is like using mass inspection rather than sampling to monitor quality in manufacturing.

There are significant differences between service and manufacturing organizations (Deming, 1986). An important difference is that the worker in manufacturing not only has a job, he or she can point to an end product and has an immediate sense of quality. The worker providing services may not be aware that the product IS both the service and the process of providing it. Another difference is that in most service industries, especially those that are government-sponsored, there is a captive market with very little consumer choice. Despite these differences, the principles and methods for quality improvement are the same for human services as for manufacturing. These principles and practices are being applied in a wide variety of health care and government organizations (Berwick et al., 1991; JCAH, 1991). The principles can be summarized as follows:

1) top leadership must 'walk and talk' the principles and work to create a quality culture,

2) strategic planning must occur for both short and long-term goals,

3) the focus must be on consumer needs and expectations,

4) processes, rather than people, must be improved.

5) adequate training resources must be provided,

6) data and statistical sampling tools must be used, as opposed to mass inspection, and

7) teamwork must be actively fostered.


Coming to Voice

The rapid development of the mental health consumer/survivor movement in the past ten years has enabled people to speak for themselves about their needs, the damages of involuntary treatments, the vital importance of making informed choices, and the empowering process of taking responsibility for their own treatment. A growing number of professionals and policymakers have responded to demands for change and reform in the mental health system by redesigning professional roles and creating opportunities for people who receive services to provide input and perspective (Blanch et. al, 1993).

In 1969 the National Association of State Mental Health Program Directors (NASMHPD) approved a position paper that "recognizes that former mental patients/mental health consumers have a unique contribution to make to the improvement of the quality of mental services in many areas of the service delivery system" The paper goes on to recommend that consumer contribution should be valued and sought in areas of program development, policy formation, program evaluation, quality assurance, systems designs, education of mental health service providers, and the provision of direct services. The growth and acceptance of mental health professional and consumer partnerships in research, services, and public policy shows clearly the potential for change when people work together in relationships of mutuality and respect.

Research has accepted the practical value of including consumers when evaluating psychiatric services (Davies and Ware, 1988; Distefano et. a, 1981; Feddolino, Fleishman, and Moxley, 1987; Giordano, 1977; Justice and McBee, 1978; Landsberg, 1973; Lebow, 1982; Prager and Tanaka, 1980; Windle and Paschall. 1981). However, these efforts are not comprehensive and do not provide for comprehensive participation of persons diagnosed with mental illness at all key stages of the research and data collection process.

In its 1992 amendments reauthorizing the Rehabilitation Act of 1973, Congress indicated a strong desire for the beneficiaries and constituencies of the National Institute on Disability and Rehabilitation Research (NIDRR) to participate meaningfully in the research and implementation process. An initiative entitled Constituency-Oriented Research and Dissemination (CORD) was undertaken to draft a policy statement for the agency that would insure that constituencies would actively participate in identifying research needs. setting priorities, RFP development, the application preparation process, peer review, making awards, conducting projects, dissemination and utilization of results, and conducting evaluations. This is a blueprint for generating research inputs in a person-driven information system. It promotes the opportunity for each individual to share and utilize his/her unique skills and background so that common objectives could be defined and achieved in partnership with people with disabilities (Fenton, 1993).

Out of personal anger and the struggle to heal, individuals have fought to redress perceived injustices in the delivery of mental health services by organizing advocacy groups, building a self-help movement and participating in research and evaluation of traditional mental health services. The growth of the mental health consumer movement is perhaps the most important factor in the drive from service-driven to a person-driven information system. Offices of Consumer Affairs in state mental health agencies, model consumer case-management programs, state~wide consumer conferences, consumer-directed social centers across the nation, and the proliferation of consumer research efforts indicate the momentum of consumer/survivor movement. More consumers are now speaking for themselves about their needs, are making more informed choices, and are more empowered to take responsibility for their own treatment and care. Consumers now are gaining access to all levels of the system in the areas of program development, policy formation, service provision, training, research, and public policy. They have lead the effort to determine consumer housing preferences (Tanzman, 1988), to define outcome measures (Campbell & Schriber, 1989, Trochim, Dumont and Campbell, 1993) and to develop professional/consumer research partnerships (C/S Research and Policy Work Group, 1993).

The tension in civilization between the necessity for systems of government to control, monitor and rationalize efficiency and the necessity for human communities to nurture freedom, democratize information exchange and empower individuals is played out through the medium of communication. The profound issues of power and knowledge are oftentimes translated or conceived of in terms of knowledge exchange and decision support.

Therefore, it is of great importance that "the public should have a voice that matches or even surpasses all others, (in) how the structure of the proposed network will shape its content, its character, and its influence on society" (Chapman and Rotenberg, 1993), because it is at the level of people communicating with each other that human values have the greatest potential for becoming incorporated into and humanizing the institutions of society.

The principles, characteristics, and implications of a person-driven mental health service system are yet to be clearly articulated. It is clear, however, that the potential of humanism to propel system change goes beyond attitudinal and behavioral changes of people within the mental health system to a refashioning of the very foundations of how mental health services are conceptualized and delivered. This marks the fundamental difference between a person-centered approach and a person-driven approach. A person-centered approach is only an expansion of the existing service driven-model (Fig. 1) which, though it adds substantial information about persons, continues to reserve knowledge and decision-making power within the system. A person-driven approach, on the other hand, seeks to turn the model on its head by giving the person who is subject of the system control of knowledge and decision-making.

A person-driven information system would eliminate the tendency in data collection and analysis to pathologize undesired human behaviors, to label consumer choices from the perspective of system goals or values (e.g., when a consumer chooses to reduce or stop a traditional mental health treatment it is usually seen as noncompliance or lack of insight), to ignore socio-economic factors as significant in both positive and negative outcomes, and to attempt to establish correlations or causal connections between a person's personality, abilities, needs, preferences and aspirations on the basis of a psychiatric label. Further, the analysis and labeling of sub-populations based on diagnosis, service use, and demographic variables such as "the young, adult chronic" would be rigorously examined as artifacts of the system or the analysis.

The formal elements of the system would also resist psychiatric labeling by being responsive to the information needs of citizens who prefer to avoid seeking mental health services. A citizen would not have to risk psychiatric labeling by entering the mental health system in order to have access to information on psychiatric treatment outcomes such as self-help, personal coping strategies, hospitalization or types of psychotropic medications. Such information could be provided through access to public computer terminals or some other form of public information technology. Information provision and use by citizens could be self-initiated and be assisted by persons outside the mental health system instead of exclusively locating such services in a clinical environment.


THE NEXUS OF CHANGE

Knowledge is a social construction: partial, colluded and inscribed with power relationships. In the social world the dominant epistemologies of science and techniques of data collection and analysis take material and ideological form. This has "profound impact on what we study, how we study it, and how we relate to people or 'subjects' and what actions may be taken on the basis of findings" (Chesler, 1991). Therefore, the meaning of the word "paradigm" lies at the nexus of the forces of knowledge and power.

According to Thomas Kuhn in The Structure of Scientific Revolutions (1962), a paradigm is the world view of the community of scholars. It circumscribes the known world and defines the activities of scientists. In this sense, the production of knowledge is more accurately described as problem solving rather than exploratory. Still, anomalous phenomena inextricably emerge in the data which eventually subvert the paradigm. Anomaly intrudes through unexpected consequences, the social resistance to domination of disempowered people, and autonomous moments of experience and consciousness. A shift in world view occurs as the processes of interpreting what is known must accommodate these forces. Such a sea change reorganizes the production and reproduction of society and gives meaning to the construction of identity of self and community. Thus, in the history of civilization humans have created not only complex social cultures, but in a very real sense, have created themselves.

Most profoundly, a paradigm shift places the individual's heart and mind within an intimate relationship between the knower and the known and demands that one look with new eyes. The point of departure is visionary. It lies in the hopes and dreams of people and comes into existence through what they know, do, and value.

EMERGING PARADIGM IN INFORMATION SYSTEMS

It is time to break away from the obsolete images of the world of the 1960's. the 1970's, and the 1980's. That world no longer exists. Now is a rare moment, a clearing horizon of historic opportunity, for all nations to promote peace, liberty, and global prosperity through partnerships. It is a unique time for creativity, comparable to the era immediately after World War II. Concepts, laws and institutions must change. The stakes are high. So are the chances for success.

(Carnegie Commission, 1992)

As people witness the closing years of the twentieth century, they see the world changing all around them. Many of these changes are beyond their control, impelled by an inexorable process which is fast moving the world towards an integrated global society. They have lived through a period in history which has seen an astonishing, ever-increasing rate of change in all areas of human endeavor. The results of these changes are seen in every aspect of human society and have caused widespread speculation and interest as to where they will lead in the next century.

One of the fastest-moving areas of change is that of electronic technology and information systems. Among these changes is the widespread proliferation of network technology throughout the computer world. There is a growing perception that lack of networking ability is a disability in our increasingly technological, information-based society. We are "rapidly approaching the point where lack of network will become our competitive disadvantage" (Keyworth and AbelI, 1990). In response to this perception, the Clinton administration has proposed a new technology policy which centers around the concept of an "information highway." According to Vice-President Gore, "Digitized information is now the lingua franca of the entire world. Those companies, those universities, and those nations best able to deal with information in that form turn out to be most successful." (Chapman and Rotenberg, 1993).

The emphasis on civilian technology development by the new administration is a strong indicator that the United States will soon have a national information infrastructure. The emergence of such an infrastructure, linking into the global Internet which presently connects over 11,000 networks in 102 countries (Chapman and Rotenberg, 1993, pg. 5), could well mark a point in the development of society that future historians would come to see as rivaling the industrial revolution in its impact upon all our institutions of commerce, education and government. Indeed. every aspect of society and of the development as individuals within that society will be revolutionized by the removal of barriers to communication on a world-wide scale. More than merely a revolution in information. it will be a revolution in communication. James Carey, in "A Cultural Approach to Communication," asserts that "Communication is a symbolic process, whereby reality is produced, maintained, repaired and transformed."

This concept has vast implications for fostering distribution of resources and knowledge. for development of common cultural reference points, and for every aspect of the development necessary to bring coherence and peace to a struggling, fragmented global society. Communication can be seen not merely as a mechanical or electronic process serving the needs of individuals and groups within society, but as the basic fabric underlying every aspect of societal interaction and development.

Over time, the institution of a national information infrastructure will become the foundation of enhanced capabilities for delivery of all types of services. including those for mental health. If it is well designed, it will strengthen individual participation in community development, encourage noncommercial sharing of resources, provide flexibility in design and technology so it can continue to evolve in new directions, and support informed public access at a reasonable cost. New and undreamt of possibilities for social development will emerge from the use of it.

In contrast to the fast-moving pace of technology, one of the slowest-moving areas of change is governmental policy and bureaucracy. What happens when the policies and institutions of government refuse to adapt to the forces of societal change has been demonstrated in other countries in recent years . The government can choose, if it wills, to embrace the vision of the future and employ the tools provided by the process of change to enable the inevitable transformation to progress more smoothly. Or, it can resist. It can try to preserve the vision of how life was in some earlier time. But change will come perforce. Mankind can neither retard these changes nor prevent them. The challenge facing the mental health system, which is largely government funded, regulated and managed, is whether it will adapt to the changes necessary to meet the demands of an evolving society or whether it will break apart in attempting to resist the tumultuous forces propelling society into the twenty-first century.

As the world nears the beginning of the 21st century and the advent of a new millennium, there is a widespread feeling that we are witnessing the emergence of a new era, one that will upend many of the most salient features of the current century.

(Chapman and Yudken, 1993)

BUILDING AN ARCHITECTURE OF DECISION SUPPORT

The Clinton administration has announced support for the development of a new "national information infrastructure" (Nil) based on high speed computers and high speed, high band width communication links, such as fiber optic cables. Building on the present worldwide computer network called the Internet, the Nil will eventually allow the near instantaneous communication of voice, still and moving images, data, and high quality sound simultaneously. The Nil has the potential to revolutionize communications. It also has the potential to increase the gap between the 'haves' and 'have nots' within the United States and between nations.

(Chapman and Yudken, 1993)

In order to create a decision support system that can effectively meet the demands of the person-driven model, the establishment of a formal information infrastructure is necessary. The complex issues of access, connectivity, universality and privacy which are involved in developing a real-world implementation of the person-driven model must be addressed on a public policy level as well as at the technology level.

"Public interest values such as equity, enhanced access to public sources of information, privacy, and freedom of expression should be built into the National Information Infrastructure's design and implementation process from the very start."

(Chapman and Yudken, 1993)

The concept of a person-driven information system is made possible by electronic networking technologies which open the way for development of information systems based on the human model of communication, i.e., interactive dialogue. The ability to interact, not only with other stakeholders, but with the mental health information system itself would empower people who receive mental health services by removing barriers to access to information, services, and both peer and professional support. This could provide the foundation for a "shift from the person as object to a person choosing services based on information about providers. their effectiveness and costs of services" (Guidera, 1992).

If the values of personhood become part of an architecture of decision support rather than just the embodiment of a humanistic philosophy within social relations, the interactive person-driven system will replace the hierarchical service-driven model currently used throughout mental health systems and persons will no longer be acted upon as the objects or units of data collection, nor will they be merely the passive recipients of information.

In a person-driven model, the mental health system would not expand in response to the demands of its information and decision support system, but would find ways to reintegrate and meet such demands within the community and/or through non-specialty human and community services. For example, the role of case-managers in helping to determine a consumer's unmet needs and in providing assistance in meeting those needs through researching resource directories and boundary-spanning is not a clinical function.

Such services could be provided through access to public computer terminals with resource directories and interactive needs assessment programs. Also, evaluations, performance indicators and satisfaction surveys of particular institutions and service providers could be made available to the public, as well as unit costs of services.

A person-driven information system would respect and be responsive to the data concerns of all stakeholders and seek acceptable solutions. Greater attention would be paid to the presentation of data. The usefulness of data would be evaluated by all stakeholders on the basis of its user-friendliness and relevancy. Many concerns could be resolved by providing incentives and additional benefits to outweigh perceived liabilities. For example, many providers see data reporting as a burden and resist any attempts to change or introduce new data elements. In data integration efforts this has been particularly problematic. Usually, providers are told that ultimately their reporting efforts will be reduced, but that is rarely the case. A person-driven approach might be to make special efforts to develop and distribute information to them that would be useful in meeting their needs

In a person-driven model (Fig. 2), the individual citizen determines the level of his/her involvement with service providers, if any, in their healing and recovery processes: they may access universally available information resources, do independent self-assessments, combine self-assessment with traditional service provision, or rely entirely on providers for whatever services they receive. All citizens would be empowered to choose among available information and services, and, if desired, have the ability to track their own history in a secure and confidential environment, and to disengage from the system at their own discretion.

Underlying the concept of the person-driven model is the notion of participatory design as paraphrased from the principles of participatory research put forth by the International Council on Adult Education (Toronto, 1977):

Participatory (design) is an approach to (system design) by which the full participation of the community is sought in analyzing its own reality for the purpose of promoting social transformations for the benefit of the participants in the (system).

Such an approach implies full collaboration between all stakeholders in the design of the system itself including purpose, structure, content, access, security, timing, and relevance with particular emphasis being placed on the value of insight from the persons the system is intended to benefit. Without this approach, the movement towards a person-driven decision support system would be undermined by a poverty of vision in systems design and a resistance to implementation.


The Electronic Gateway Model

There is a growing recognition that people from all walks, in all phases of life; may at sometime in their lives have a need for mental health services to cope with events and transitions of life. The need for such support services is beginning to be widely recognized and, with that recognition, the lines between those considered "mentally ill" and those considered "normal" are beginning to blur.

The concept of an electronic getaway to mental health information and services (Fig. 3) sees the citizen/consumer as both user and subject of an open architecture information network designed to aid the individual in managing his/her own mental health care and life development, as well as providing information and access to the community at large. The electronic technologies necessary to implement a person-driven information system are presently being developed and examples of some early attempts are described below.

A dramatic effort at the transformation of a provider-driven state job training infrastructure to a person-driven information and resource allocation system was attempted in Michigan in the 1980's. Kiosks with automatic teller machines were planned that would enable customers to electronically browse through training and educational options, and a "smart" credit card was designed that would credit funding for training to the account and debited as the person utilized services. However, the state government administration changed and funding for the project was lost. (Osborne and Gaebler, 1993).

In 1988 the legislature in Hawaii passed an act to develop a state electronic information system in response to media criticism that geography prevented citizens from having the opportunity to voice their concerns and participate in the legislative decision-making process. To date, Hawaii is providing general information services to more than 4.000 users on the existing gateway (Gamble-Risley and James, 1989).

The York County Parent Awareness, Inc. in Maine recently established an electronic network for disabilities issues accessible to anyone with a terminal and modem through a state-wide 800 number. It provides the opportunity for networking among individuals with disabilities and their family members as well as access to many varieties of information on assistive technology, consumer education, and supported employment, among other topics. This person-driven model promises to be cost-effective as well as an effective way to inform and empower the disabilities community regardless of age, location, or disability. (York County Parent Awareness "The Maine Meeting Place" Proposal, January, 1993).

Finally, John Wennberg, M.D. established the Foundation for Informed Medical Decision-Making in 1989, a medical education and research organization that furnishes physicians with interactive videos to be used in everyday clinical practice to inform patients who are facing a treatment decision about the likely outcomes of various choices. Patients enter personal data about their age, symptoms, and test results and then receive information tailored specifically to them so they can assess their own likelihood of and preference for experiencing the various outcomes. These outcomes are discussed through interviews with other patients who have chosen the different treatments--some with good outcomes and some with bad (Cassidy, 1992).


Protecting Privacy and Confidentiality

There are affordable and free-access networks now emerging in communities around the nation which will enable the person-driven model to come into widespread use and be of practical value to real people. However, implementation of a networked information system which does not adequately protect privacy and confidentiality would be a significant barrier to service delivery for mental health clients. This is due to the natural reluctance of all people, not just mental health consumers, to be tracked and monitored in the most personal aspects of their lives.

Furthermore, for those who have already been labeled as mental health consumers, the practical consequences of stigma associated with psychiatric labeling can be profound. Loss of or denial of employment, inability to obtain housing and a cascading host of other problems which are not related to diagnosis or disability but to inaccurate assumptions regarding persons who have received mental health services are among the threats presented by breach of confidentiality. For this reason, the issues of personal privacy and confidentiality loom very large in the minds of mental health consumers. The right of confidentiality must include the right to informed consent, to have controlled access to one's own health history, and to correct inaccuracies, as well as the right to withdraw from the system.

But there are many complex issues which must be faced and resolved in order to obtain the desired results rather than ones which are unanticipated and undesired. An improperly thought out and implemented system could result in invasion of privacy, personal surveillance, abridgement of constitutional rights. inappropriate monitoring and control of individuals, access to personal data for private profit or criminal use, and other problems. No segment of the population is potentially more vulnerable to this than those who have received mental health services It is imperative to move forward with the implementation of privacy and confidentiality standards while national policy is favorable towards institution and enforcement of such standards.

The FN-10 Data Standards for Mental Health Decision Support Systems (Legenski et al., 1989) calls for the use of the social security number as a patient/consumer identifier, and assumes that it is both possible and legitimate to convince consumers that the use of unique client identifiers would pose no risk or minimal risk to the privacy of an individual. However, consumer privacy under such systems cannot be totally safeguarded (Rotenberg, 1992; Ziglin, 1993).

For decades, corporate and government bodies have utilized the social security number as a unique identifier for tracking information about individuals. Originally intended only to identify workers to the Social Security Administration for tax purposes, its use has expanded to provide every form of individual record keeping identification. It has become ubiquitous. One must supply it even to obtain a supermarket check cashing card. The widespread use of this single, unique identifier has seriously eroded personal privacy.

The growing amounts of information that different organizations collect about a person can be linked because all of them use the same key--In the U.S. the social security number--to identify the individual in question. This identifier-based approach perforce trades off security against individual liberties. The more information that organizations have, the less privacy and control people retain.

(Chaum. 1992)

Not only has privacy been eroded, but personal security has been endangered through this practice.

Thieves routinely use a stolen credit card number to trade on their victims' good payment records; murderers have tracked down their targets by consulting government-maintained address records. On another level, the U.S. Internal Revenue Service has attempted to single out taxpayers for audits based on estimates of household income compiled by mailing-list companies.

(Chaum, 1992)

In a person-driven information system, these concerns would be acknowledged and validated. Any use of an identifier would be fully waivered with complete disclosure of use of information. Further, only minimal information would be anchored to a unique identifier. If expanded information for longitudinal studies were determined to be necessary by participating stakeholders, sampling technologies that require the fewest number of respondents would be employed with scheduled destruction of identifiers at the completion of the study. If a person still refused to have a unique client identifier, services would not be withdrawn or denied. Given the stigma associated with mental health labeling, not only are the risks of using the social security number, or any universal identifier, substantial, but the use of it constitutes a barrier to access for those unwilling to take the risk.

However, there are alternatives. One of the most promising appears to be that of the "digital signature." International cryptography expert David Chaum, has been in the forefront of developing and implementing a model for digital signatures, employing the use of sophisticated "smartcard" technology. The prototype is a "smart credit-card-size computer containing memory and a microprocessor. It also incorporates its own keypad and display so that its owner can control the data that are stored and exchanged". (Chaum, 1992). According to Chaum, it would also be possible to incorporate fingerprint identification technology within the card itself to prevent anyone other than the owner from using it. Such a device could be an effective means for empowering individuals to gain and control access to their own personal records while excluding unauthorized persons from similar access. The use of encryption to ensure privacy of data and communications is a subject of widespread interest and debate in the computer community (Chapman and Rotenberg, 1993)



CHARACTERISTIC PERSON-DRIVEN MODEL
Purpose  
Values Equity of knowledge and power; reciprocity between persons in the system and other stakeholders; respect freedom/empowerment; and democratic and participatory processes; person-first language to ensure freedom from stigmatizing terminology (labeling);
Focus On the whole individual rather than personality, behaviors or problems. Provision of educational and decision support resources to citizens in the community.
Goals Improve cost, quality and access for all citizens. Use education and prevention to enable people to heal and recover, to provide supports to enable people to control and self-monitor, to empower people through knowledge to facilitate reaching self-defined goals. To promote well-being and quality of life of all citizens.
System Principles 1) System exceeds minimum legal requirements allowing access to data in favor of empowering persons to exercise choice.

2) Person in the system has ultimate control over the data.

3) Person in the system and citizens have access to information at his/her convenience.

4) Person in the system is able to withdraw from the system at any time.

5) Person in the system is able to dictate limitation of access.

6) Person in the system has immediate recourse in the event of errors.

7) Evaluation of the system includes determination of benefits offered to the person and the weaknesses in the system, e.g. errors and iatrogenic effects.





CHARACTERISTIC PERSON-DRIVEN MODEL
System Principles

(continued)

8) Evaluation of the system includes a cost-benefit analysis from the perspective of service

9) Data elements collected are developed, approved, and re-evaluated regularly by a representative sample of people about whom data is/will be collected.

10) Participation of persons in the system is based on informed consent, e.g., knowledge of the universe of individuals, and access protocols including who has access to the information, confidentiality and privacy protections.

11) Citizens have immediate access to information regarding outcomes and evaluations of providers and treatments, directory of services, costs, and other relevant information to facilitate the choice of provider/services.

12) People in the system evaluate the system's strengths and weaknesses, and provide citizens with the results of such evaluations. A representative sample of people in the community about whom data is being/will be offered continuously plan for the implement improvements.

13) Problems, suggestions and comments are communicated democratically between the individual, the community and the system. Forms of communication such as dialogue are supported through the information system.

14) System to user interface is easy to understand.

15) Transactions with system are courteous, respectful, and assumes the competency of all participants.

16) Participation in the system is voluntary for all citizens.

Structure

 
Distribution Universal distribution from/to: individuals through modem communications; community through access ports in Laundromats, schools, mails, libraries, etc.; service system stakeholders through integrated MIS.









CHARACTERISTIC PERSON-DRIVEN MODEL
Integration Multiple levels of integration: The service recipient as human being; individual as member of community (public health model); services integration (human services), target populations, unit function such as research, quality assurance, information services; stakeholders in decision-making; Vertical integration between individual(s), state and federal systems, balanced with horizontal integration at the community level.
Flexibility Highly flexible and interactive with built-in feedback loops; responsive; able to accommodate unique differences in system participants (adaptation); allows for alternatives in input and processing and distribution.

Content

 
Purpose of Information Expansion of human knowledge and potential; liberatory.
Domains of Concern Proactive: Health (rather than illness); education; quality of private life/well-being; public health; healing and recovery; empowerment, autonomy/personal sovereignty, self-actualization/identity; citizenship; system change; legal issues.
Source of Information All stakeholders
Information Inputs Consumer surveys, community surveys, consumer councils, focus groups, electronic mail, test marketing, consumer inspection, complaint tracking system, 800 numbers, community bulletin boards
Types of Information Subjective/objective, self-reporting, satisfaction, evaluative (based on human values), collaborative, non-hierarchical. Needs are defined based on use, desire and interest, not by stakeholder category (providers, customers, family members, government agencies and policy makers, researchers, etc.).









CHARACTERISTIC PERSON-DRIVEN MODEL
Quality of Information Rethinking validity, reliability, replicability. Focus on honesty, usefulness, and relevancy of findings. Constant re-evaluation of assumptions of the system and of the participants (reflexivity, self-criticism).
Analysis Strategies Longitudinal studies, qualitative methods, concept mapping, sampling, survival analysis, citizen-defined system and individual outcomes. System Outputs information is available in increasing levels of complexity and detail in formats accessible to all citizens. Content defined by citizen feedback.
Control of Information High security, privacy and confidentiality, egalitarian ownership; provisions that allow individuals to inspect information about themselves and to add information that they consider important or remove inaccurate information; that it be known in general what information is stored in the system and what use will be made of that information (informed consent); notice and consent for data merging; no secret data banks.









DIRECTIONS FOR THE FUTURE

It is prudent to only commit resources to a person-driven model after a literal "researching of what constitutes essential components of care. In this process, the cost to individuals and systems by ignoring consumers would be enormous. Individuals would lose self-confidence, feel devalued, and lose their ability to make informed decisions. Systems would lose the ability to provide effective programs. services, and processes, which may delay or retard recovery and people's ability to leave the formal mental health system. Though active participation of system stakeholders to articulate services that are "done with, rather then done to" citizens, outcomes of services become congruent with the values, needs, and goals of individuals and communities. It is only when people are no longer acted upon as objects or units of data collection, nor are they seen as the passive recipients of information that they can function as independently as possible in living and working environments of their choice, with the level of support and services they need and prefer.

In order for MHSIP to be partners in the production of an information age system focused on servicing communities and individual citizens, its agenda must be broadened to include collaboration, analysis and distribution as significant areas of support and interest. Without this integration, the model proposed in this paper could not be operationalized through MHSIP leadership.

The "best practices" leadership of MHSIP in developing data collection standards has provided valuable and. essential objectives for mental health delivery systems that are supportive of sound decision-support- structures and management of information. These standards reflect the values behind the support and service system. They articulate the manner that services and supports are to be organized and provided. Until now, the FN-10 has functioned as an ideal for practices and performance to guide state mental health agencies in their data collection efforts.

The review of data collection protocols in terms of an ideal has not been regulatory. but MHSIP has imposed incentives through grants and has provided technical assistance, feedback and encouragement designed to move mental health data collection systems towards best practices. Such standards also emphasize preferred decision support models. In this way, MHSIP has become part of a leadership process providing feedback and support to mental health delivery systems as attempts are implemented to improve upon services.

On another level, however, MHSIP has failed to provide leadership by embracing its own best practices approach. The FN-l0 really reflects back to the "field" standards which articulate a consensus regarding what constitutes best practices. Until recently this consensus has been consistently reinforced by exclusively utilizing peers rather than consumers, family members or others who may have quite different points of view regarding the overall direction and quality of services provided. In a way, MHSIP's professionalism has been the principle obstacle to its own stated purposes by excluding the perspective of a diversity of stakeholders.

Ironically, MHSIP's leadership is compromised by focusing on the standards rather than embracing a dynamic, inclusive process towards excellence. With the growing inclusion of a multii-stakeholder perspective and the participation of consumers in crafting the architecture of a person-driven decision support system, MHSIP has the means to move beyond reinforcing the status quo and the illusions of success and of quality.

if the prime purpose of best practices standards is to drive decision-support systems forward, then inclusionary means must be incorporated to provide direction. guidance, and supports in the struggle towards improving human services and promoting well-being in the lives of citizenry. Risk taking, innovation and even failing must be reinforced and encouraged to achieve these goals. The paradox is that while the intent of MHSIP's best practices approach has survived the test of time and has remained relevant through multiple system changes, the mechanics for addtessing the intent have become institutionalized in the FN-10 and, therefore, are a potential barrier to implementing system change.



RECOMMENDATIONS:

We have tried to be as objective as possible in our analysis. but objectivity is not synonymous with lack of perspective. Our analysis makes no pretense at being 'value-free.' Our operating bias may be made explicit: t'e are partial to the values of equality. participation. and legality-in short, to those values we think of as the values of constitutional democracy. We believe in due process of law and look forward toward a society in which order is achieved through consent, not coercion.

(Skolnick, 1969, p. IX)

In order to move MHSIP to a person-driven decision support system. both incremental and comprehensive steps must be taken within the service systefri at the personal and system levels to embrace, in both theory and practice, the humanistic philosophy underlying the person-driven model. To reach those goals:

Promote person-driven values through:

Provide protection by:

Ensure accessibility through:

Promote collaboration with:

Collect and distribute information and data on:

Recognize the uneven development of existing state mental health infrastructures and budget federal funds for:

DECISION SUPPORT AND DIALOGUE: THE NEXT STEP

At the point of encounter there are neither utter ignoramuses nor perfect sages; there are only men who are attempting, together. to learn more than they know now. Dialogue further requires an intense faith in man, faith in his power to make and remake, to create and re-create, faith in his vocation to be more fully human . . . .the dialogical man believes in other men even before he meets them face to face.

(Freire, 1973, pp.79-SO)

MHSIP should take incremental steps that allow for dialogue, experimentation, failure, and personal and system growth. Further, people should be invited to provide their own thoughts to deepen the depth of diverse responses and facilitate dialogue. Collecting various insights concerning the nature of problems. benefits, consequence and critical factors is the means of identifying potential obstacles to success and pinpointing areas which may require policy decisions or outside support. There is also a need to do a problem analysis, to separate facts from inaccurate assumptions, differentiate between problems, symptoms of problems, and solutions masquerading as problems.

A second step would be to look at the development of mental health information systems in the concrete, to work from where people are currently by studying specific interventions. Examining the experience of functioning systems could provide important information about particular problems and specific recommendations to MHSIP.

A third step would be to conduct a nationwide survey of various constituencies within the States regarding their experiences and interests in person-driven information systems. The results of such a survey would be useful only if the groundwork described above had been laid to assure common understanding of concepts involved.

Although no definitive answers can be offered based on the above steps, the obvious need for a more accepting and compassionate process is indisputable if mental health consumers are to share in the American Dream. In the final analysis, the experiences of everyday life are always relative and bound by an individual's private and social history. For this reason alone, all people should be afforded the right and respect to speak for themselves. This is both the critical and conciliatory edge offered by a person-driven decision support system. Within a humanized framework, the efforts of MHSIP could propel dialogue to begin to reach out and nurture personhood. Paulo Freire was convinced that every human being, no matter how "ignorant" or submerged in the "culture of silence", is capable of looking critically at the world he/she experiences and participating in a dialectical encounter with others.

BIBLIOGRAPHY

1991 Consumer Housing Preference Survey Results and Executive Summary. collaborative Support Programs of New Jersey. Freehold, flew Jersey.

Agency for Health Care Policy and Research, Office at Science and Data Development. April 1991. "The Feasibility of Linking Research-Related Data Bases to Federal and won-Federal Medical Administrative Data Bases: Report to Congress. AHCPR pub. No. 91-0003.

Anthes, Gary H. (September 13, 1993) The National Information Infrastructure Strategic Plan. Feds to downsize with IT; Computerworld.

Anthony, W.A. et at (1983). philosophy, treatment process, and principles of the psychiatric rehabilitation approach. In Bachrach, 1. (Ed.), New directions for mental health services: Deinstitutionalization San Francisco: Josdy-Bass.

Awad, A.G. (1992) Quality of Life of Schizophrenic Patients on Medications and Implications for New Drug Trials. Hospital and Community Psychiatry, Vol 43, No. 3, March.

Baker, F. Burns, T.F., Libby, N., Integliata, 4. (1985) The Impact of Life Events on Chronic Mental Patients. Hospital and Community Psychiatry. Vol.. 36, No. 3, March.

Beckwith, O., Schaffer, J. and Randall, R. (1991) Consumer Perceptions of the Lucas County Mental Health System. Urban Affairs Center, the University of Toledo.

Betts, Mitch (August, 1993). Computerized records: An open book? Computerworld, Vol.. 27, No. 32, pp. 12-13.

Bevilacqua, Joseph 4. (Spring, 1993) Consumerism is not a fad. Resources: Workforce Issues in Mental Health Systems 5(1): 1.

Blanch, Andrea, Daniel Fisher, William Tucker, Dale Walsh, and Janet Chessman. (1993) Consumer-Practitioners and Psychiatrists Share Insights About Recovery and Coping. Disability Studies Quarterly 13:2, pp. 17-20.

Bronson, David L., Alan S. Rubin, and Henry K. Tufo. December, 1978. Patient Education Through Record Sharing. Quality Review Bulletin 4(12); 2-4.

Buckley, Susan N. (August, 1993). Moving MHSIP Toward a Person-Centered Paradigm. MHSIP, Center for Mental Health Services, Washington, D.C. (Draft)

Campbell, Jean, Ph.D. (May, 1991). Research Designs in Housing and Support. Housing and Supports: Collaboration in the 90's, National Institute of Mental Health Community Support Program, pp. 22-24.

Campbell, Jean, Ph.D. (October, 1992). The Well-Being Project: Mental Health Clients Speak for Themselves. 3rd Annual Conference Proceedings, NASMHPD Research Institute, Inc.

Campbell, J. and Schraiber, R. (1989) The Well-Being Project; Mental Health Clients Speak for Themselves. The California Department of Mental Health, Sacramento, California.

Carey, James W. (1973) A Cultural Approach to Communication, Champaign-Oriana: Institute of Communication Research, University of Illinois (Momeograph). Published in Communication (1975): 1-22.

Carling, Paul J., Ph.D. (May, 1993). Housing and Supports for Persons with Mental Illness: Emerging Approaches to Research and Practice. Vol. 44, No. 5, Hospital and Community Psychiatry, pp. 439-449.

Carnegie Commission on Science, Technology, and Government, (1992) Partnerships for Global Development: Clearing Horizon. (New York: Carnegie Commission on Science, Technology, and Government, p. 19.

Cassidy, Judy. December, 1992. Outcomes Data: Rational Utilization, Better Doctor-Patient Relations. Health Progress, p. 36.

Chamberlin, Judi (1977). On our own: Patient-Controlled Alternatives to the Mental Health System.

Chapman, Gary & Rotenberg, Marc (Summer, 1993). The National Information Infrastructure: A Public Interest Opportunity CPSR Newsletter, Vol.. II, (2).

Chapman, Gary & Yudken, Joel (1993). The 21st Century Project: Setting a New Course for Science and Technology Policy, Executive Summary (Computer Professionals for Social Responsibilities).

Chaum, David (August, 1992). Achieving Electronic Privacy. Scientific American, pp. 96-101.

Chesler M.A. (1991) Participatory Action Research with Self-Help Groups: An Alternative Paradigm for Inquiry and Action. American Journal of Community Psychology. Vol. 19, No. 5.

Cleary, P.D., Edgman-Levitan, S., and Roberts, N. (1991). Patients evaluate their hospital care: A national survey. Health Affairs, 10(4). 254-267.

Coltin, Kathryn L., M.P.H. & Aronow, David B., M.D., M.P.H. Quality Assurance and Quality Improvement in Information Age. Putting Research to Work in Quality Improvement and Quality Assurance: Summary Report

Consumer/Survivor Mental Health Research and Policy Work Group. (1992) Reports 1, 2, and 3. Fort Lauderdale, Florida.

Cook, Judith A. February 1992. Outcome Assessment in Psychiatric Rehabilitation Services for Persons with Severe and Persistent Mental Illness. Prepared for the National Institute of Mental Health.

Cotter, Barbara, September, 1981. Planning and Implementing Social Service Information Systems: A Guide for management and users, Project SHARE Human Services Monograph Series, Number 25.

The CPSR Newsletter (Summer, 1993) Vol.. 11, No. 2.

Crosby, P.R. (1989) Let's talk quality.

Davies, Allyson Ross and John F. Ware, Jr. (1988) 'Involving Consumers in Quality of Care Assessment'. Health Affairs 7(1): 33-48.

Davies, A.R. and Ware, J.E.. Jr. (1988) Involving Consumers in Quality of Care Assessment. Health Affairs, Spring.

Deber, Raisa. The patient-physician partnership Part 1: Changing Roles, and the Desire for Information. Canadian Medical Association Journal, In press.

Deming, W.E. (1982) Out of the crisis. Cambridge: MIT Center for Advanced Engineering Study.

Dimsdale, J.E. et at (1979). Conflict in treatment goals between patients and staff. Social Psychiatry, 14, 1-4.

Distefano, Jr., M.K. (1981). Client's Satisfaction and Interpersonal Trust Among Hospitalized Psychiatric Patients. Psychological Reports 95:3, pp. 542-575.

Dumont, J. (1989) Validity of Multidimensional Scaling in the Context of Structured Conceptualization. Evaluation and Program Planning, 12 (1).

ElIwood, Paul N. June 9, 1981. A Technology of Patient Experience. Special Report, Shattuck Lecture on Outcomes Management. New England Journal of Medicine 318(23): 1549-56.

Emanuel, Ezekiel J. and Linda L. Emanuel. April 22/29, 1992. Four Models of the Physician-Patient Relationship. Journal of the American Medical Association 267(16): 2221-2226.

Estroff, S.E., Lachiocotte, W.S., Illingworth, L.C., and Johnston, A. (1991) Everybody's Got a Little Mental Illness: Accounts of Illness and Self among People with Severe, Persistent Mental Illness. Medical Anthropology Quarterly, Vol. 5, No. 4.

Fenton, J., Batavia, A., and Roody, 0. (1993) Suggested Policy Statement and Support Material for an NIDRR

Policy on Constituency-Oriented Research and Dissemination (CORD). NIDRR, Department of Education, Washington, D.C. (Draft)

Freddolino, Paul, John Fleishman and David Moxley. (1987) Assessing Client Support and Representation Services: A Progress Report. NIMH Grant #MH37051.

Gamble-Risley, Michelle and Fred James. (1989) Electronic Gateway to Paradise. Government Technology, p.1.

Giordano, Peggy C. (January, 1977) The Client's perspective in agency evaluation. Social Work, pp.34-39.

Goffman, E. (1961). Asylums: Essays on the social situation of Mental patients and other Inmates. Garden City, N.Y.: Doubleday.

Goldsmith, Harold F., Ph.D., Lin, Elizabeth, Ph.D., Jackson, David J., Ph.D., Manderscheid, Ronald W., Ph.D., Belt, Roger A., Ph.D., (1991) The Future of Mental Health Needs Assessment, Chapter 10. Needs Assessment: Its Future. Mental Health Service System Reports, Series BN, No. 8, pp. 79-93.

Grob, M.C., Eisen, S.V., and Berman, J.S. (1978) Three Years of Follow-up Monitoring: Perspectives of Formerly Hospitalized Patients and Their Families. Comprehensive Psychiatry. Vol.. 19, No. 6, Nov-Dec.

Hart, W.T., Bassett, L. (1975) Measuring Consumer Satisfaction in a Mental Health Center. Hospital and Community Psychiatry Vol. 6, No. 8.

Harvey, S. et at. (1984). The Aroostook Assessment Project: a survey of clients and clinicians of the community support program of the Aroostook Mental Health Center. Augusta: Maine Department of Mental Health.

Heath, B.H. Hultberg, R.A., Ramey, J.M., Ries, C.S. (Summer, 1984) Consumer Satisfaction: Some New Trists to a Not So Old Evaluation, Community Mental Health Journal. Vol.. 20, No. 2.

Hogan, Michael F. and Susan M. Essock. (Winter, 1991). Data and Decisions: Can Mental Health Management Be Knowledge-Based? The Journal of Mental Health Administration 15(1): 12-20.

Holliday, S.G. (1902) The Partnership Convergence Project: An International Project in the Development of Research Instruments and Protocols. Presentation at Schizophrenia 1992: Poised for Change, Vancouver, B.C.

International Council on Adult Education. (Toronto, 1977) As cited in Hein, John. (1988). Radio Baha'i Ecuador: A Baha'i development project. George Ronald: Oxford.

Juran, J.M. (1988) The quality control handbook.

Justice, Blair and George, McBee. (1978) A Client Satisfaction Survey as One Element in Evaluation. Community Mental Health Journal 14:3, pp. 248-252.

Kamis-Gould, Edna (1987). The New Jersey Performance Management System: A State System and Uses of Simple Measures. Evaluation and Program planning, Vol. 10, pp. 249-255.

Kasper, Joseph F., Albert G. Mulley, and John E. Wennberg. June, 1992. Developing Shared Decision-Making Program to Improve the Quality of Health Care. Quality Review Bulletin 18(6): 183-190.

Kline, F., Adrian, A. and Spevak, N. (1974) Patients Evaluate Therapists. Archives of General Psychiatry Vol 31, July.

Kopolow, L.E. (1979). Consumer demands in mental health care. International Journal of Law and Psychiatry. 2, 263-270.

La Fond, John Q. March, 1992. Toward a Working Model of Outcome Measures for the Public Welfare Domain. Prepared for the National Institute of Mental Health.

Landsberg, Gerald (1973) Consumers Appraise Storefront Mental Health Services. Evaluation 1:2, pp. 66-68.

Laws of 102nd Cong. - 1st Session (December, 1992). Sec. 102. National Research and Education Network.

Lebow, J. (1982) Consumer Satisfaction with Mental Health Treatment. Psychological Bulletin 91, pp. 244-259.

Leginski, Walter, Colette Craze, John Driggers, Shirley Dumpman, Dennis Geertsen, Edna Kamis-Gould, M. Jo Namerow, Robert Patton, Nancy WIlson, and Cecil Wurster, (1989) Data Standards for Mental Health Decision Support Systems. U.S. Department of Health and Human Services: Rockville, MD.

Lehman, Anthony F. (1992) "Measures of Humanistic Outcomes (Quality of Life) Among Persons with Severe and Persistent Mental Disorders." Prepared for the National Institute of Mental Health.

Lehmn, A.F., Ward, N.C., and Linn, L.S. (October, 1982) Chronic Mental Patients: The Quality of Life Issue. American Journal of Psychiatry, 139:10.

Lynch, N.M. & Kruzich, J.M. (1986) Needs assessment of the chronically mentally ill: practitioner and client perspectives. Administration in Mental Health. 4, 237-248.

Meenaghan, T.M. & Mascari, M. (1971). Consumer choice, consumer control in service delivery. Social Work. 16, 50-61.

Merton, R.K. et al (1962). The focused interview. New York: Free Press.

Mitchell, J.E. et al (1983). A comparative analysis of psychiatric problems listed by patients and physicians. Hospital and Community Psychiatry. 34 (9), 848-849.

Molony, T.W., and Paul, 5. (1991). The consumer movement takes hold for medical care. Health Affairs, 10(4), 269.

Maloy, Kathleen A. (July/August, 1992). effectiveness and Outcomes: Implications for Policymakers. Policy In Perspective, Mental Health Policy Resource Center, Washington, D.C.

Mark, Melvin M., R. Lance Shotland. October, 1985. Stakeholder-based Evaluation and Value Judgements. Evaluation Review 9(5): 605-626.

McGlynn Elizabeth A. March, 1992. A Review of Measures in the Clinical Domain for Research on Persons with Severe and Persistent Mental Disorders. Prepared for the National Institute of Mental Health.

Mental Health Consumer Concerns, Inc., (1989) The Residential Advocacy Project: Part I, A Survey project of Residents' Rights in Residential Care Facilities. Protection and Advocacy, Inc. Oakland, California.

Meyer, Diane (Spring, 1993). Jacqui Ennis speaks on IS and the quality focus. Interface (Premier Issue).

MHSIP Ad Hoc Advisory Group. May, 1992. Mental Health Statistics Improvement Program - Current Status and Directions for the Future (draft).

Minsky, Shula (with Phyllis Lloyd, Sally Anderson, Lawrence Stivers, Regis Parsons, Jacky Stencil). April, 1993. The Use of unique Client Identifiers in State Mental Health Services: National Survey Data. Unpublished manuscript sponsored by the Southeastern States MHSIP Users Group.

Mirin, Steven M., M.D., Namerow, M. Jo, Ph.D. (October, 1991), Why Study Treatment Outcome? Vol. 42, No. 10, Hospital and Community Psychiatry, pp. 1007-1013.

Morrell-Bellai, T.L. and Boydell, K.M. (1993) The Experience of Mental Health Consumers as Researchers. Canadian Journal of Community Mental Health. (In Press)

Morrison, J.K. (1978) The Client as Consumer and Evaluator of Community Mental Health Services. American Journal of Community Psychology. Vol. 6, No. 2.

Mowbray, Carol T. (1992) The Role of Evaluation in the Restructuring of the Public Mental Health System. Evaluation and Program planning 15: 403-415 (originally presented at APA convention, 8/89).

NASMHPD Research Institute, Inc. (1993). State Mental Health Agency Profiling System.

National Institute on Disability and Rehabilitation Research (NIDRR). (February, 1993) Constituency Oriented Research and Dissemination (CORD). The Network, Inc. (for NIDRR), 300 Brickstone Square, Suite 900, Andover, MA 01910. (DRAFT)

National Institute of Mental Health. (1991) Caring for People with Severe Mental Disorders: A National Plan of Research to Improve Services. OHMS Pub. No. (ADM)91-1762. Washington DC: supt of Docs., U.S. Govt. Print off.

National Institute of Mental Health. The Future of Mental Health Services Research. Taube, CA; Mechanic, D; and Hohmann, A, eds. DHHS Pub. No. (ADM)89-1600. Washington. DC: Supt. of Does., US Govt. Printing Office, 1989b.

Neubauer, Ruth, M.S.W. (May, 1993). Housing Preferences of Homeless Men and Women in a Shelter Population. Vol. 44, No. 5, Hospital and Community Psychiatry, pp. 492-494.

Newcomer, Kathryn E. and Sharon 1. Caudle. Sept/Oct 1991. Evaluating Public Sector Information Systems: More Than Meets the Eye. Public Administration Review 51(5):377-384.

0kin, R.L. and Pearsall, D. (March, 1993) Patient's Perceptions of Their Quality of Life 11 Years After Discharge from a State Hospital. Hospital and Community Psychiatry Vol.. 44, No. 3.

Osborne, David and Ted Gaebler (1993) Reinventing Government: How the Entrepreneurial Spirit is Transforming the Public Sector. Penguin Rooks, New York, New York.

Outcome Based performance Measures, Field Review Edition (1992). The Accreditation Council on Services for People with Disabilities.

Palmer, R. Heather, M.B., B.Ch., S.M. & Adam, Mary M.E., Ph.D. Quality Improvement/Quality Assurance Taxonomy: A Framework. Putting Research to Work in Quality Improvement and Quality Assurance: Summary Report.

Prager, E. and Tanaka, H. (1980) Self-Assessment: the Client's Perspective. Social Work. National Association of Social Workers, Inc. pp. 32-34.

Rago, William V. and William H. Reid. Fall, 1991. Total Quality Management Strategies in Mental Health Systems. Journal of Mental Health Administration 18(3): 253-263.

Reidy, D.E. (1993) Stigma is Social Death: Mental Health Consumers/Survivors Talk About Stigma in Their Lives. Education for Community Initiatives, Holyoke, Massachusetts.

Ridgeway, P. (1988) The Voice of Consumers in Mental Health Systems: A Call for Change. Center for Community Change through Housing and Support.

Ridgeway, P. & Carling, P.A. (1987) A user's guide to needs assessment in community residential rehabilitation. Monograph series on housing and rehabilitation in mental health. Boston: Center for Psychiatric Rehabilitation, Boston University.

Rogers, Anne, Pilgrim, David and Lacey, Ron (1993). Experiencing Psychiatry: Users' Views of Services. The Macmillan Press Ltd., London.

Rotenberg, Marc (February 28, 1992) Protecting the Privacy of Social Security Numbers and Records, testimony before the Subcommittee on Social Security and Family Policy, United States Senate.

Roth, D., Clark, J.A., Lauber. E.G., Hogan, M.F., (1993) Two Views of a Service System: Client Movement and Client Need. In Third Annual National Conference Proceedings. October 21-23. 1992, National Association of State Mental Health Program Directors Research Institute, Alexandria, Virginia.

Scheid-Cook, T.L. Hiday, V.A., Wooten, K. (1987) Mental Patients Eager and Willing to Help Sociological Research. Sociology and Social Research, Vol 72, No. 1, October.

Schuler, Douglas (February, 1993). A Community linked by an electronic network. The Seattle Times.

Schuler, Douglas and Namioka, Aki (Summer, 1993). Participatory Design: Principles and Practices. CPSR/Seattle.

Scott, A. (1993) Consumers/Survivors Reform the System, Bringing a 'Human Face' to Research. Resources. Workforce Issues in Mental Health Systems, pp. 3-6. Holyoke, Massachusetts.

Shepherd, L. (1988) Assessments in Five Southern California Counties. California Network of Mental Health Clients, Sacramento, California.

Sherbourne, Cathy Donald, Meredith, Lisa S. (1992). Quality of Self-Report Data: A Comparison of Older and Younger Chronically Ill Patients. Vol.-47, No. 4, Journal of Gerontology, pp. 204-211.

Shern, D.L., Coen, A.B., Wilson, W. (1991) The Colorado Treatment Outcome Study in McGuirk, F.D. (ed) Management Information Systems: Treatment Outcome Measurement. Western Interstate Commission for higher Education Mental Health Program, Boulder, Colorado.

Silberman, Charles E. Quality Improvement: A Patient's Perspective. Putting Research to Work in Quality Improvement and Quality Assurance: Summary Report.

Skolnick, Jerome (1960) The Politics of Protest. Ballantine Books: flew York, NY.

Sluyter, G.V.,Mukherjee, A.K. (1993) Total Quality Management. A Paradigm for the 90's. American Network of Community Options and Resources.

Smith, James N., Power, Kevin (April, 1993). Task force mulls health data sharing. Government Computer News.

Speed, Vickie (September, 1993). Gateway to Texas Government. Government Technology, Vol. 6, ho. 9, pp. 49-50.

Sterling, Theodore D. (1975). Humanizing Computerized Information Systems. Science, Vol.. No 4220. Stodolak, Frederick and Joseph Carr. June, 1992. Systems Must Be Compatible with Quality Efforts. Healthcare Financial Management, pp.72-fl.

Substance Abuse and Mental Health Services Administration. (March, 1993) SAMHSA Strategic Plan. Department of Health and Human Services Public Health Service.

Tanaka, H.T., Smith, M.K., Smith, J.G., Pittman, J.C., Enter the Consumer -- The Cope Experience, A Workshop on Mental Health Consumer Involvement in Program Evaluation. (1984) Office of Program Evaluation and Research. Ohio Department of Mental Health.

Tanzman, Beth, M.S.W. (May, 1993). An Overview of Surveys of Mental Health Consumers' Preferences for Housing and Support Services. Vol. 44, No. 5, Hospital and Community Psychiatry.

Tanzman, B. (1983) Researching the Preferences of People with Psychiatric Disabilities for housing and Supports. A Practical Guide. The Center for Community Change Through Housing and Support, Burlington, Vermont.

Task Force on Enhancing MHSIP to Meet the Needs of Children. October, 1992. Enhancing MHSIP to Meet the Needs of Children, Final Report. MHSIP, Center for Mental Health Services, Washington, D.C.

Toombs, S.K. (1937). The meaning of illness: A phenomenological approach to the physician-patient relationship. Journal of Medicine and Philosophy, 12, 219-240.

Toward a National Health care Survey: A data system for the 21st century. (1992) Gooloo S. Wunderlich, ed. Washington D.C.: National Academy Press.

Trochim, W. (1089). An Introduction to concept napping for planning and evaluation. Evaluation and Program Planning. 12, 1-16.

Trochim, W. (1989) Concept Napping: Soft science or hard art. Evaluation and Program Planning. 12, 87-110.

Trochim. W. Dumont, J. and Campbell, J. (1993) A Report for the State Mental Health Agency Profiling System.

Mapping Mental Health Outcomes from the Perspective of Consumers/survivors. National Association of Mental Health Program Directors. (Draft)

U.S. Department of Health and Human Services (July, 1903). Putting Research to Work in Quality Improvement and Quality Assurance, Summary Report.

Walker, Loran. March, 1992. Integrating Medical Records Systems Improves Care. Healthcare Informatics, pp.26-29.

Watson, L.C. (1978) The Study of Personality and the Study of Individuals: Two Approaches, Two Types of Explanation. Ethos Society for Psychological Anthropology.

Weissman, N.M., Bothwell, S. (September, 1976) Assessment of Social Adjustment by Patient Self-Report. Archives of General Psychiatry Vol 33.

Windle, L. C. and Paschall, N.C. (Spring, 1981) Client Participation in CMHC Program Evaluation: Increasing Incidence, Inadequate Involvement. Community Mental Health Journal Vol.. 17 (1), pp. 66-16

Work Group for Computer-Based Records of Behavioral Health and Human Services (April, 1903). Recommendations for the Clinton Health Care Reform Bill. Memo.

York County Parent Awareness. (January, 1993) "The Maine Meeting Place: Two Year Proposal." ME.

York County Parent Awareness (June, 1993). The Maine Meeting Place Project: Final Report, ME.

Ziglin, Alan L. February, 1993. The Importance of Unique Client Identifiers in the Public Sector Mental Health Service Delivery System. Unpublished draft presented to MHSIP Ad Hoc Advisory Group, Center for Mental Health Services, Washington D.C.

Ziglin, Alan 1. (August, 1901). Reporting Requirements and MHSIP: The Appropriate Relationship Between Accountability and Data Standards for decision Support Systems. Unpublished document prepared for the National Institute of Mental Health.