1. Review various versions of the Adult Survey utilized in outpatient settings (including psychometric properties and analyses as available). Usefulness of the various versions from the perspective of consumers, providers, family members, state and national level should also be addressed.

1. 40-item original survey, which includes negatively worded items.
2. 40-item version of the survey in which the negatively worded items have been reversed.
3. 21 item version based on a factor analysis by Jack Wackwitz (Colorado), Vijay Ganju and Tom Trabin). Testing by HSRI contractor for possible use by NCQA.
4. 23-, 25- and 29-item versions of the survey (currently being studied as part of the 16 State Performance Indicator Study) – Judy Hall.
5. Others, e.g., with similar items with variations on wording.

1. Illinois version – 52 items
2. NRI ORYX version
3. Others, e.g., NY

1. revised/adapted MHSIP adult consumer survey – Dorothy Webman
2. Modified Family Satisfaction and Youth Satisfaction Surveys, (Molly Brunk and workgroup from the 16-State Performance Indicator Project)
3. Others

1. Methodology for scoring and presenting data

1. Consumer administered vs. administration by others
2. In-person vs. telephone vs. mail vs. web-based
3. Timelines for administration: discharge, 6 months etc.
4. Population surveyed – adults with serious mental illnesses, other persons with mental illness, persons with alcohol and/or substance use problems
5. Training of persons who administer the survey
6. Sample selection

1. Recovery
2. Cultural competence
3. Others, e.g., dual diagnosis

1. What translations exist?
2. What was the methodology used?
3. Where are they being used?
4. Recommendations re: translation methodology and approval of translated copies

   IX.        Other issues

1. Public/Private Sectors issues, e.g. Performance Measurement Summit
2. Relationship between the CABHS (Consumer Assessment of Behavioral Health Services) and the MHSIP Consumer Survey
3. Copyright to ensure public domain status
4. Relation to HSRI-produced Toolkit

Recommendations to the MHSIP Policy Group regarding the following issues:

1. Which versions of the survey should be the "Official" versions recommended by the MHSIP Policy Group for Outpatient and Inpatient Settings and for Adult and Child and Adolescent Populations.
2. The appropriateness of the survey for various populations served by the mental health service delivery system.
3. Guidelines re: who should administer the survey and under what circumstances
4. Recommendations re: when the survey should be administered
5. Guidance regarding the translation process and official translation versions cataloged by language, persons (agencies) responsible for translation
6. Guidelines regarding scoring and presentation of data
7. Guidelines regarding involvement of consumers, family members and providers in interpreting and presenting data
8. Addition of items to the survey
9. Tracking of different versions and approval of future versions

10. Guidance for revision and completion of the draft MHSIP Consumer Survey policy paper

11. Guidance for Toolkit revision

¨ Vijay Ganju’s draft paper on the MHSIP website

¨ Information produced by Judy Hall summarizing work completed thus far on the 16 state pilot indicator project

¨ Information produced by Jack Wackwitz re: factor analysis

¨ NRI ORYX information re: use of consumer survey items

¨ Information from the HSRI toolkit

¨ Steve Davis’ proposal for tracking consumer survey use and development

¨ Any other information produced by invitees or others that can be reviewed prior to the meeting, e.g., NASMHPD State Profile System summary of states' use of surveys

• Eisen, et al., Development of a Consumer Survey for Behavioral Health Services. Psychiatric Services, June 1999, Vol 50, No 6, pp 793-798.
• Report by Carrie Kaufman on Survey of State Surveys