2010-23207. Agency Information Collection Activities: Proposed Collection; Comment Request

In compliance with Section 3506(c)(2)(A) of the Paperwork Reduction Act of 1995 concerning opportunity for public comment on proposed collections of information, the Substance Abuse and Mental Health Services Administration (SAMHSA) will publish periodic summaries of proposed projects. To request more information on the proposed projects or to obtain a copy of the information collection plans, call the SAMHSA Reports Clearance Officer on [phone].

Comments are invited on: (a) Whether the proposed collections of information are necessary for the proper performance of the functions of the agency, including whether the information shall have practical utility; (b) the accuracy of the agency's estimate of the burden of the proposed collection of information; (c) ways to enhance the quality, utility, and clarity of the information to be collected; and (d) ways to minimize the burden of the collection of information on respondents, including through the use of automated collection techniques or other forms of information technology.

Proposed Project: Strategic Prevention Framework State Incentive Grant (SPF SIG) Program (OMB No. 0930-0279)—Revision

SAMHSA's Center for Substance Abuse Prevention (CSAP) is responsible for the evaluation instruments of the Strategic Prevention Framework State Incentive Grant (SPF SIG) Program. The program is a major initiative designed to: (1) Prevent the onset and reduce the progression of substance abuse, including childhood and underage drinking; (2) reduce substance abuse related problems; and, (3) build prevention capacity and infrastructure at the State-, territorial-, tribal- and community-levels.

Five steps comprise the SPF:

Step 1: Profile population needs, resources, and readiness to address the problems and gaps in service delivery.

Step 2: Mobilize and/or build capacity to address needs.

Step 3: Develop a comprehensive strategic plan.

Step 4: Implement evidence-based prevention programs, policies, and practices and infrastructure development activities.

Step 5: Monitor process, evaluate effectiveness, sustain effective programs/activities, and improve or replace those that fail.

An evaluation team is currently implementing a multi-method, quasi-experimental evaluation of the first two Strategic Prevention Framework State Incentive Grant (SPF SIG) cohorts receiving grants in FY 2004 and FY 2005. This notice invites comments for revision to the protocol for the ongoing cross-site evaluation for the Strategic Prevention Framework State Incentive Grant (SPF SIG) (OMB No. 0930-0279) which expires on 11/30/12. This revision includes two parts:

(1) Continuation of the use of the previously approved two-part Community Level Instrument (CLI Parts I and II) for Cohorts I and II and the use of an instrument to assess the sustainability of grantee implementation and infrastructure accomplishments which is a modification of an instrument used in an earlier phase of the evaluation.

(2) The use of three additional instruments to support the SPF SIG Cohorts III and IV Cross-site Evaluation. All three instruments are modified versions of data collection protocols used by Cohorts I and II. The three instruments are:

a. A Grantee-Level SPF Implementation Instrument,

b. A Grantee-Level Infrastructure Instrument, and

c. A two-part Community-Level SPF Implementation Instrument.

An additional Cohort III and IV evaluation component (i.e., participant-level NOMs outcomes) is also included in this submission as part of the comprehensive evaluation, however, no associated burden from this evaluation activity is being imposed and therefore clearance to conduct the activities is not being requested. Specifically, Cohort III and IV SPF SIG grantees have been included in the currently OMB approved umbrella NOMs application (OMB No. 0930-0230) covering the collection of participant-level NOMs outcomes by all SAMHSA/CSAP grantees.

Every attempt has been made to make the evaluation for Cohorts III and IV comparable to Cohorts I and II. However, resource constraints for the Cohorts III and IV evaluation have necessitated some streamlining of the original evaluation design. Since the ultimate goal is to fund all eligible jurisdictions, there are no control groups at the grantee level for Cohorts III and IV. The primary evaluation objective is to determine the impact of SPF SIG on the reduction of substance abuse related problems, on building state prevention capacity and infrastructure, and preventing the onset and reducing the progression of substance abuse, as measured by the SAMHSA National Outcomes Measures (NOMs). Data collected at the grantee, community, and participant levels will provide information about process and system outcomes at the grantee and community levels as well as context for analyzing participant-level NOMS outcomes. The Grantee-Level Infrastructure and Implementation Instruments (Cohorts III and IV) and the Community-Level Part I and Part II (Cohorts I, II, III, and IV) Instruments are included in an OMB review package and are the main focus of this announcement.

Grantee-Level Data Collection

Cohort I and II Continuation

The Sustainability Interview will be conducted during Phase II of the evaluation in 2011 (Cohort I) and 2012 (Cohort II). The interview guide is adapted from the Phase I instruments (OMB No. 0930-0279) and focuses on state-level prevention capacity and infrastructure in relation to the five steps of the SPF process: Needs assessment, capacity building, strategic planning, implementation of evidence-based programs, policies, and practices (EBPPPs), and evaluation/monitoring. The interviews will be aimed at understanding the status of the prevention infrastructure at the time of the interview, whether the status has changed since the previous rounds of interviews (conducted in 2007 and 2009), and whether the SPF SIG had any influence on changes that might have occurred.

Cohort III and IV Revision

Two Grantee-level Instruments (GLI) were developed to gather information about the infrastructure of the grantee's overall prevention system and collect data regarding the grantee's efforts and progress in implementing the Strategic Prevention Framework 5-step process. Both instruments are modified versions of the grantee-level interview protocols used in the SPF SIG Cohort I and II Cross-Site Evaluation (OMB No. 0930-0279). The total burden imposed by the original interview protocols has been reduced by restructuring the format of the original protocol, deleting several questions and replacing the majority of open-ended questions with multiple-choice-response questions. The Infrastructure Instrument will capture data to assess infrastructure change and to test the relationship of this change to outcomes. The Strategic Prevention Framework Implementation Instrument will be used to assess the relationship between SPF implementation and change in the NOMs. Information for both surveys will be gathered by the grantees' evaluators twice over the life of the SPF SIG award.

Based on the current 16 grantees funded in Cohort III and an estimated 20 to be funded in Cohort IV the estimated annual burden for grantee-level data collection is displayed below in Table 1. The burden estimates for the GLIs are based on the experience in the Cohort I and II SPF SIG evaluation as reported in the original OMB submission (OMB No. 0930-0279), less the considerable reduction in length of these instruments implemented by the Cohort III and IV evaluation team.

Community-Level Data Collection (Continuation and Revision)

Cohort I and II Continuation

The Community-level Instrument (CLI) is a two part, web-based survey for capturing information about SPF SIG implementation at the community level (originally submitted as an addendum to OMB No. 0930-0279). Part I of this instrument was developed to assess the progress of communities as they implement the Strategic Prevention Framework (SPF), and Part II was developed to gather descriptive information about the specific interventions being implemented at the community level and the populations being served including the gender, age, race, ethnicity, and number of individuals in target populations. Each SPF SIG funded community will complete a separate Part II form for each intervention they implement.

The CLI (Parts I and II) was designed to be administered two times a year (every six months) over the course of the SPF SIG Cohort I and II initiative. Four rounds of data were collected under the current OMB approval period and the Cohorts I and II cross-site evaluation team plans to collect additional rounds once this request for a revision is approved. Data from this instrument will allow CSAP to assess the progress of the communities in their implementation of both the SPF and prevention-related interventions funded under the initiative. The data may also be used to assess obstacles to the implementation of the SPF and prevention-related interventions and facilitate mid-course corrections for communities experiencing implementation difficulties.

The estimated annual burden for community-level data collection is displayed below in Table 1. Note that the total burden reflects the 443 communities that have received SPF funds from their respective Cohort I and Cohort 2 States. Burden estimates are based on pilot respondents' feedback as well as the experience of the survey developers reported in the original OMB submission (OMB No. 0930-0279). Additionally, an individual community's burden may be lower than the burden displayed in Table 1 because all sections of the Community-level Instrument (parts I and II) may not apply for each reporting period as community partners work through the SPF steps and only report on the step-related activities addressed. Note also that some questions will be addressed only once and the responses will be used to pre-fill subsequent surveys.

Cohort III and IV (Revision)

The Community-Level Instrument to be completed by Cohort III and IV funded subrecipient communities is a modified version of the one in use in the SPF SIG Cohorts I and II Cross-Site Evaluation (OMB No. 0930-0279). The total burden imposed by the original instrument was reduced by reorganizing the format of the original instrument, optimizing the use of skip patterns, and replacing the majority of open-ended questions with multiple-choice-response questions.

Part I of the instrument will gather information on the communities' progress implementing the five SPF SIG steps and efforts taken to ensure cultural competency throughout the SPF SIG process. Subrecipient communities receiving SPF SIG awards will be required to complete Part I of the instrument annually. Part 2 will capture data on the specific prevention intervention(s) implemented at the community level. A single prevention intervention may be comprised of a single strategy or a set of multiple strategies. A Part II instrument will be completed for each prevention intervention strategy implemented during the specified reporting period. Specific questions will be tailored to match the type of prevention intervention strategy implemented (e.g., Prevention Education, Community-based Processes, and Environmental). Information collected on each strategy will include date of implementation, numbers of groups and participants served, frequency of activities, and gender, age, race, and ethnicity of population served/affected. Subrecipient communities' partners receiving SPF SIG awards will be required to update Part II of the instrument a minimum of every six months.

The estimated annual burden for specific segments of the community-level data collection is displayed in Table 1. The burden estimates for the CLIs are based on the experience in the Cohort I and II SPF SIG evaluation as reported in the original OMB submission (OMB No. 0930-0279), less the considerable reduction in length of these instruments implemented by the Cohort III and IV evaluation team. The total burden assumes an average of 15 community-level subrecipients per grantee (n=36 Grantees) for a total of 540 community respondents, annual completion of the CLI Part I, a minimum of two instrument updates per year for the CLI Part II, and an average of three distinct prevention intervention strategies implemented by each community during a 6-month period. Additionally, some questions will be addressed only once and the responses will be used to pre-fill subsequent updates.

Participant-Level Data Collection (Cohort III and IV—Continuation)

Participant-level change will be measured using the CSAP NOMs Adult and Youth Programs Survey Forms already approved by OMB (OMB No. 0930-0230). Subrecipient communities will have the opportunity to select relevant measures from the CSAP NOMs Adult and Youth Programs Survey Forms based on site-specific targeted program outcomes and may voluntarily select additional outcome measures that are relevant to their own initiatives. Cohort III and IV SPF SIG grantees have been included in the currently OMB approved umbrella NOMs application (OMB No. 0930-0230) covering all SAMHSA/CSAP grantees, therefore no additional burden for this evaluation activity is being imposed and clearance to conduct the activities is not being requested.

Total Estimates of Annualized Hour Burden

Estimates of total and annualized reporting burden for respondents by evaluation cohort are displayed below in Table 1. Overall summaries appear in Table 2. The estimated average annual burden of 5,642.9 hours is based on the completion of the Community Level-Instrument (CLI Parts I and II) and Sustainability Interview for Cohorts I and II, and the Grantee-level Instruments (GLI) and the Community-Level Instrument (CLI) for Cohorts III and IV.

Table 1—Estimates of Annualized Hour Burden to Respondents

Instrument	Respondent	Number of respondents	Number of responses per respondent (over four years)	Total number of responses (over four years)	Burden per response (hrs.)	Total burden (hrs.)
Cohorts 1 and 2—Grantee Level Burden
CLI grantee input	Grantee	26	2	52	1	52.0
Sustainability Interview	Grantee	26	1	26	1.5	39.0
Total Burden	Grantee	26	3	78	2.5	91.0
Average Annual Burden Over 4 Reporting years	Grantee	26				22.8
Cohorts 1 and 2—Community Level Burden
CLI Part 1	Community	443	2	886	2.17	1,922.6
CLI Part 2	Community	443	8	3,544	2.17	7,690.5
Review of Past Responses	Community	443	2	886	2.50	2,215.0
Total Burden	Community	443	12	5,316	6.84	11,828.1
Average Annual Burden Over 4 Reporting years	Community	443				2,957.0
Cohorts 3 and 4—Grantee Level Burden
GLI Infrastructure & Implementation Instruments (Reporting Years 1-4)	Grantee	36	2	72	4.75	342.0
CLI Part I, 1-20: Community Contact Information (Reporting Year 1)	Grantee	36	1	36	1.5	54.0
CLI Part I, 1-20: Community Contact Information (Reporting Years 2-4)	Grantee	36	3	108	0.25	27.0
Total Burden Over 4 Reporting Years	Grantee	36	6	216	6.5	423.0
Average Annual Burden	Grantee	9				105.8
Cohorts 3 and 4—Community Level Burden
CLI Part I, 21-172: Community SPF Activities (Reporting Year 1)	Community	540	1	540	3	1,620.0
CLI Part II (Reporting Year 1)	Community	540	6	3,240	0.75	2,430.0
CLI Part I, 21-172: Community SPF Activities (Reporting Years 2-4)	Community	540	3	1,620	0.75	1,215.0
CLI Part II (Reporting Years 2-4)	Community	540	18	9,270	0.5	4,860.0
Total Burden Over 4 Years	Community	540	28	15,120	5	10,125.0
Average Annual Burden	Community	540				2,531.3

Table 2—Annualized Summary Table

Respondents	Number of respondents	Responses/ respondent	Total responses	Total annualized hour burden
All Cohorts—Total Burden
Cohort 1 and 2:
Grantees	26	3	78	48.8
Community	443	12	5,316	2,957.0
Cohort 3 and 4:
Grantees	36	6	216	105.8
Community	540	28	15,120	2,531.3
Sub-total Grantees	62			128.6
Sub-total Community	983			5,488.3
Total	1045		20,730	5,616.9

Send comments to Summer King, SAMHSA Reports Clearance Officer, Room 7-1044, One Choke Cherry Road, Rockville, MD 20857 and e-mail a copy to [e-mail]. Written comments should be received within 60 days of this notice.

Dated: September 10, 2010.

Elaine Parry,

Director, Office of Management, Technology and Operations.