THE STATE EDUCATION DEPARTMENT / THE UNIVERSITY OF THE STATE OF NEW YORK / ALBANY, NY 12234

 

TO:

The Honorable the Members of the Board of Regents

FROM:

James A. Kadamus 

COMMITTEE:

Full Board

TITLE OF ITEM:

Schools Under Registration Review (SURR)

DATE OF SUBMISSION:

December 22, 2003

PROPOSED HANDLING:

Discussion

RATIONALE FOR ITEM:

Update on Policy Implementation

STRATEGIC GOAL:

Goal 2

AUTHORIZATION (S):

 

 

SUMMARY:

 

The attached report analyzes the performance of current and former SURR schools during the 2002-2003 school year, draws attention to some of the important trends in SURR schools, and highlights the strengths of the process and opportunities for improvement.

 

The report finds that, while the performance of SURR schools is generally low, most SURR schools showed improvement last year at rates substantially greater than other schools statewide.  Schools that were removed from registration review performed consistently higher than current SURR schools.  Overall, the SURR process has shown much greater success at the elementary school level compared to that at the middle school level or with high schools. The report also notes that, as we continue to transition to standards based on proficiency rather than minimum competency, some former SURR high schools are not showing adequate performance.  The report also predicts that, as more schools and districts are identified for improvement under No Child Left Behind, the Department and school districts will become more challenged to provide the intensive support and assistance necessary to improve performance in SURR schools.

 

These observations underscore that, while the registration review process has had a positive effect on student results in SURR schools, much more effort will be required to ensure that all students in these schools will be successfully prepared to meet the new State learning standards and higher graduation requirements.

 

Attachment



Report on Schools Under Registration Review (SURR)

 

I.          Introduction

 

            Since 1989, the registration review process has been a primary method by which the State Education Department works to strengthen teaching and learning in schools where student performance is below minimum standards.  The overwhelming majority of schools that have been identified by the process are located in urban communities with high levels of socioeconomic need.  Since the inception of the process through the 2002-03 school year, 251 schools have been identified for registration review.  Between 1989 and September 2003, 145 schools were removed from registration review because of improved student results.  An additional 39 schools have been closed pursuant to a plan developed by the local school district and approved by the Commissioner.  Seventy–seven (77) schools, including Kensington High School in Buffalo which has no students enrolled during the 2002-03 school year, are currently under registration review, of which 55 are located in New York City.

 

            This report is divided into three sections.  Following the Introduction, Section II of this report provides an analysis of the performance of current and former SURR schools during the 2002-2003 school year. Section III of the report summarizes those components of the SURR process that have contributed to improvements in the performance of SURR schools and identifies opportunities for further improvement in the process.

 

Among the trends observed during the 2002-03 school year were the following:

 

-          Over the last several years, there has been a significant decline in the average length of time that a school remains under registration review.  During this period, the goal of schools remaining under registration review for no more than three full academic years has been met for the majority of schools.

-       The percentage of elementary schools under registration review continues to decline and the percentage of upstate schools that are under registration review continues to increase.

-          At the elementary and middle school levels, SURR schools as a group made strong gains in English language arts and mathematics.  The large majority of schools showed improvement and the amount of improvement in SURR schools far exceeded the State averages on these four assessments.

-          The vast majority of former SURR schools perform at levels that place them above the cutpoint for being farthest from State standards but below the level necessary to meet State standards.  At the elementary and middle school levels, the longer ago a school was identified for registration review, the higher its performance was likely to be on the 2002-2003 school-year assessments.

-          The Department has over the past several years consistently raised the cutpoint which schools must achieve to avoid being potentially identified as SURR.  Nevertheless, the number of schools performing below the cutpoint has declined, particularly at the elementary school level, indicating there has been success at “raising the floor” in terms of school performance.

-          The number of former SURR elementary and middle schools that were farthest from State standards declined in 2002-03 compared to the prior two years.  However, the performance of schools in New York City that were opened to replace schools that were closed or phased out as part of the SURR process is a cause for concern.

-          Many former SURR high schools perform poorly in relation to State standards, particularly the math standard.

-          In addition to promoting school-by-school reform, the Regents and Department must be successful in its Closing the Gap strategy if SURR schools are to eventually reach levels of performance comparable to that of other schools in the State.

 

 

II.         Status of SURR Schools

           

Observation #1:  Number of Schools Identified for Registration Review

 

Finding: Between 1994-1995 and 2001-2002, the number of schools identified for registration review has been relatively stable and has averaged 22 per year.  In 2002-03, nine schools were identified, the smallest number of schools since 1993-94.

 

Observations:

 

-          After a large group of schools were identified in the first year of the program in 1989, the number of schools identified declined in each of the next several years. Between 1994 and 2001-2002, the number of schools identified for registration review remained relatively constant, ranging from a low of 19 in 1995-1996 to a high of 26 in 2000-2001. 

-          In 2002-03, the number of schools identified declined even though the cutpoint for identification on State assessments continued to rise at the elementary and middle school levels.  This reflects the fact that over time there has been improvement in the results of the lowest performing schools in the State, particularly at the elementary school level.

-          In December 2000, for the first time, schools that had been removed from registration review were re-identified SURR schools.  While nine schools were re-identified during the 2000-01 and 2001-02 school years, only one school was re-identified in 2002-03.

 


Table IA

Number of SURR Schools Identified By Year

1989-1990 to 2001-2002

 

School Year

Number Identified

Cumulative Number Identified

1989-1990

43

43

1990-1991

17

60

1991-1992

12

72

1992-1993

0

72

1993-1994

4

76

1994-1995

20

96

1995-1996

19

115

1996-1997

25

140

1997-1998

19

159

1998-1999

23

182

1999-2000

24

206

2000-2001

26

232

2001-2002

20

252

2002-2003

9

261

 

Notes: Because of a regulatory change in the timeline for identification of SURR schools, no schools were identified during the 1992-1993 school year. The five schools that were re-identified as SURR in 2000-2001, the four re-identified in 2001-2002, and one school re-identified in 2002-03 are counted both in their year of initial identification and their year of re-identification.   Thus, since 1989, 251 schools have been identified as SURR schools, including 10 schools that have been identified twice.

 

Table IB

Farthest From State Standards

Elementary and Middle Schools

1996-2001

 

Criteria

1996

1997

1998

1999

2000

2001

2002

2003

Grade 3 Reading

30% at or above SRP

40% at or above SRP

40% at or above SRP

NA

NA

NA

NA

NA

Grade 3 Math

65%

75%

75%

NA

NA

NA

NA

NA

Grade 6 Reading

35%

40%

40%

NA

NA

NA

NA

NA

Grade 6 Math

60%

65%

65%

NA

NA

NA

NA

NA

Grade 8 Reading

60%

65%

65%

NA

NA

NA

NA

NA

Grade 4 ELA

NA

NA

NA

60% at or Above Level II

75 SPI

78 SPI

80 SPI

82 SPI

Grade 4 Math

NA

NA

NA

60%

75

78

80

82

Grade 8 ELA

NA

NA

NA

60%

75

78

80

82

Grade 8 Math

NA

NA

NA

34%

40

45

50

55

 

Notes:  State Reference Point (SRP) is a standard of minimum competency.  Grades 4 and 8 ELA and math cutpoints are based upon the School Accountability Performance Index (SPI). 

 

Table IC

Farthest From State Standards

High Schools

1996-2001

 

Criteria

1996

1997

1998

1999

2000

2001

2002

2003

Reading

50%

passing

RCT or Regents

by end

of grade

 11 (NYC)

 

25% Failure Rate RCT (ROS)

60% passing RCT or Regents by end of grade 11

60% passing RCT or Regents by end of grade 11

60% passing RCT or Regents by end of grade 11

NA

NA

NA

NA

Writing

50%

passing

RCT or Regents

by end of

grade 11

 

25% Failure Rate RCT (ROS)

60% passing RCT or Regents by end of grade 11

60% passing RCT or Regents by end of grade 11

60% passing RCT or Regents by end of grade 11

NA

NA

NA

NA

ELA

NA

NA

NA

NA

50% of 1996 Cohort meeting assessment requirements

55% of 1997 Cohort meeting assessment requirements

58% of 1998 Cohort meeting assessment requirements

High School Performance Index of 82

Math

50%

passing

 RCT or Regents

by end

of Grade 10

 

40% Failure Rate RCT

(ROS)

60% passing RCT or Regents by end of Grade 11

60% passing RCT or Regents by end of grade 11

60% passing RCT or Regents by end of grade 11

50% of 1996 Cohort meeting assessment requirements

55% of 1997 Cohort meeting assessment requirements

58% of 1998 Cohort meeting assessment requirements

High School Performance Index of 82

Dropout

Less than 10%

Less than 9%

Less than 9%

Less than 9%

Less than 9%

Less than 9%

Less than 9%

NA

 

Notes: 1999-2000 cutpoints for High School ELA and math are based on the percentage of the annual high school cohort meeting graduation assessment requirements.  2000-2002 cutpoints for high school ELA and math are based on the percentage of the high school cohort meeting graduation assessment requirements.  The cutpoint for 2003 is based on the High School Performance Index.

 

 

 

 

 

 

Observation #2: Reasons For Low Performance Cited in Registration Review Reports

 

Finding:   Failure of schools to align instruction with State standards, ineffective instruction, and failure to use data to plan instruction were among the most frequently cited reasons cited by registration review teams in their reports on newly identified SURR schools.

 

Observations:

 

-          With the exception of faulty academic intervention services, all of the top 10 factors cited in last year’s registration reviews were also cited as among the top 10 factors in reports from either of the two prior years.  Year after year, low-performing schools are cited for a similar range of factors involving low student expectations, deficiencies in curriculum and instruction, and inexperienced and/or unqualified staff and leadership.

-          The failure to align instruction with State standards has emerged as a critical issue in schools identified for registration review.

-          Ineffective instructional methods is the one area that has been cited as among the top five factors in each of the past three years.

-          Compared to earlier years, low academic standards and many uncertified teachers were not among the top 10 factors cited in last year’s reports.

 

 

 



 


Observation #3:  Removal of Schools From Registration Review

 

Finding: Between the 1993-1994 and 1998-1999 school years, the number of schools removed from review increased dramatically.  Since then the number of schools removed from review has shown some variability and has averaged 23 per year.

 

-          In 1993-94, only one school was removed from registration review.  Over the next four years, the number removed each year increased and, in 1997-1998, 25 schools were removed from review.  In the last four years, the number of schools removed has ranged from 18 to 29 and has averaged 23 per year. 

-          In 2002-03, the 20 schools removed for academic performance was the largest number ever removed in a single year on that basis.

-          While the majority of schools are removed from review because of improved student results, the implementation of Commissioner’s Regulations that require schools to “perform or perish” has resulted in a significant number of school closings in the past several years. For the first time in 2002-03, school districts outside of New York City designated SURR schools for closure, with Buffalo and Newburgh closing SURR schools at the end of the 2002-2003 school year.

 

Table 3

Number of SURR Schools Removed from Registration Review

1989-1990 to 2002-2003

 

Year

Number of Schools Removed

Number Removed for Performance*

Number Removed for Closure

Cumulative Total Removed

1989-1990

0

0

0

0

1990-1991

7

7

0

7

1991-1992

3

3

0

10

1992-1993

5

5

0

15

1993-1994

0

0

0

15

1994-1995

1

1

0

16

1995-1996

11

11

0

27

1996-1997

13

13

0

40

1997-1998

21

18

3

61

1998-1999

25

19

6

86

1999-2000

18

15

3

104

2000-2001

29

14

15

133

2001-2002

27

19

8

160

2002-2003

24

20

4

184

Total

184

145

39

-

 

* Includes four schools that were removed prior to 1996 as a result of implementation of a school restructuring or redesign plan.

 

Notes:  Includes 10 schools that were subsequently re-identified, one of which subsequently closed.   Does not include Kensington High School in Buffalo, which has no enrollment in 2003-2004 and will be officially closed after this school year.

Observation #4:  Length of Time Under Registration Review of Current SURR Schools 

 

Finding: The vast majority of current SURR schools have been under registration review for less than three full academic years.

 

Eighty-three percent of current SURR schools have been under registration review for less than three full academic years.  Sixty-one percent of current SURR schools have been identified since January 2001.

 

 

 

Table 4

Length of Time Current SURR Schools Under Registration Review

 

Time Under Registration Review

Percentage of Schools

Cumulative Percentage of Schools

Less than one Year

12%

12%

One Year

23%

35%

Two Years

26%

61%

Three Years

21%

83%

More than Three Years

17%

100%

Total

100%

---


Observation #5:  Length of Time Schools Remain Under Registration Review

 

Finding:  The average length of time that schools spend under registration review has declined sharply in recent years.

 

-          Prior to the establishment in 1996 of timeframes by which SURR schools must meet performance targets, it was unusual for schools to be removed from registration review within three full academic years of their identification.  Of the schools identified for registration between 1989 and 1993, fewer than one in four (24 percent) were removed from registration review within three full academic years. By contrast, of the schools identified between 1995 and 1998, two-thirds (67 percent) were removed from registration review within three full academic years.

-          As of June 2003, of the 182 schools identified for registration review prior to 1999-2000, only 23 were under registration review, nine because of subsequent re-identification. This belies the notion that schools “languish” under review for many years.

 

 

 

 

Table 5

Time Under Registration Review

By Year of Initial SURR Identification

 

Year of Initial Identification

Number of Schools Identified

Number of Schools Removed from Registration Review

Percent of Schools Removed from Review

Number of Schools Removed Within Three Full Years of Identification

Percent of Schools Removed Within Three Full Academic

Years of Identification

Average Years Under Review

1989

43

43

100%

14

33%

6.5

1990

17

16

94%

2

12%

7.5

1991

0

0

-

0

-

-

1992

12

12

100%

2

17%

6.7

1993

4

4

100%

0

0%

6.5

1994

20

20

100%

10

50%

4.7

1995

18

18

100%

13

72%

3.3

1996

25

22

88%

17

68%

3.8

1997

20

16

75%

12

60%

4.0

1998

23

17

74%

16

70%

3.7

 

 

 

Observation #6:  Grade Configuration of Schools Identified for Registration Review

 

Finding: Since the administration of the new State assessments in 1999, a dispro-portionately large and increasing number of schools with middle-level grades have been identified for registration review.

 

-          Prior to the adoption of the new State assessments in 1999, elementary, middle, and high schools were identified for registration review in numbers that were generally proportionate to the percentage of elementary, middle, and high schools in the State.

-          Since 1999, schools administering middle-level examinations have been over- represented in terms of schools identified for registration review.  During the 1999-2000 school year, 50 percent of the schools identified as SURR were schools with either middle-level or K-8 configurations.  By the 2001-2002 school year, this number had grown to 70 percent.  This overrepresentation of middle schools for identification for registration review is another manifestation of the need for new strategies to address middle-level schooling in New York State.

-          In 2002-2003, two-thirds of the identified schools were high schools.  As the RCTs have been phased out as a means for meeting the graduation assessment standards in ELA and math, more high schools are being identified as farthest from State standards in terms of their ability to have students meet the graduation assessment requirements within four years of a student’s first entry into grade nine.

 

 

Table 6

Number and Percent of SURR Schools Administering

 Elementary, Middle and Regents Exams

By Year of Identification

 

School Year

Elementary

Middle

High School

Total Schools Identified

1999-2000

12 (50%)

12 (50%)

2 (8%)

24

2000-2001

10 (38%)

19 (69%)

4 (15%)

26

2001-2002

6 (30%)

14 (70%)

3 (13%)

20

2002-2003

2 (22%)

2 (22%)

6 (67%)

9

Total

30 (48%)

47 (59%)

15 (19%)

79

 

Note: In 1999-2000, two K-8 schools were identified; in 2000-2001, seven K-8 schools were identified; in 2001-2002, three K-8 schools were identified; and in 2002-2003, one K-8 school was identified. Percents, therefore, equal more than 100.

 

 

 

 

 

Observation #7:  Geographic Distribution of SURR Schools

 

Finding: Since the adoption of the new State assessments in 1999, the percentage of schools outside of New York City identified for registration review has been increasing.

 

-          Prior to 1999, the performance of New York City schools habitually lagged behind those of all other school districts in New York State.  Since the adoption of the new State assessments, however, New York City schools have reduced the gap in performance with the Rest of the State and have eliminated the gap between New York City performance and that of the other large cities on elementary and middle- level assessments.  As a result, the percentage of schools outside of New York City that have been identified for registration review has increased significantly, and at the end of 2002-2003 almost 30 percent of SURR schools were located outside of New York City.

-          Between 1989 and 1998, only 9 percent of schools identified for registration review were located outside of New York City. By 2001-2002, 50 percent of the schools that were identified as SURR schools for the first time were located outside of New York City.  As a result of this trend, the Department has been challenged to adapt the strategies that it has successfully implemented in New York City so that it can address the systemic problems in school districts such as Buffalo and Wyandanch, where the percentage of SURR schools now exceeds that of New York City.

 

 

Table 7

Identification of SURR Schools

NYC vs. ROS

 

Year Identified or Re-identified

NYC

Newly Identified

NYC

Re-identi-fied

ROS Newly Identified

Total

Percent-age of Newly- Identified Schools In NYC

1989-1998

166

0

16

182

91%

1999

19

0

5

24

79%

2000

13

5

8

26

50%

2001

8

4

8

20

40%

2002

5

1

3

9

56%

Total

211

10

40

261

81%

 

Note:  The 10 New York City re-identified SURR schools are also counted among the 166 New York City SURR schools identified between 1989 and 1998.


Observation #8: Performance of SURR Elementary and Middle Schools

 

Finding: As a group, SURR schools showed strong gains in grades 4 and 8 ELA and math between 2001-2002 and 2002-2003.

 

-          SURR schools showed significant improvement during the 2002-2003 school year in terms of their performance on the School Accountability Performance Index in grades 4 and 8 ELA and math.  Gains on the Index ranged from two index points in grade 8 ELA to 34 index points in grade 4 math.

-          The majority of SURR schools showed gains on the School Accountability Performance Index, ranging from 62 percent of schools showing gains in grade 8 ELA to 97 percent showing gains in grade 4 math. These results far exceeded those of the State as a whole.  Nevertheless, the performance of SURR schools as a group remains below standards.

 

 

Table 8A

Change In Performance of SURR Schools

on School Accountability Performance Index (SPI)

2003 vs. 2002 Test Administrations

Subject

# of Schools

2003 SPI

2002 SPI

Change SURR

Change STATE

Grade 4 ELA

29

110

93

+17

+6

Grade 4 Math

29

137

103

+34

+13

Grade 8 ELA

45

95

93

+2

-1

Grade 8 Math

45

76

61

+15

+6

 

Includes performance of all schools that were SURR schools at time of test administrations during the 2002-2003 school year.

 

Note:  The SPI ranges from 0 to 200.  If all students in a school perform at Level 1, the SPI will be 0.  If all students perform at or above Level 3, the SPI will be 200.  The State standard for the 2003 test administration was a SPI of 150.  The SPI will increase by one point for each one percent increase in the number of students performing at or above Level 3, or each one percent decrease in the number of students performing at Level 1.

 

Table 8B

Change In Performance of SURR Schools

Number and Percent Showing Gains

on School Accountability Performance Index (SPI)

2003 vs. 2002 Test Administrations

Subject

# of Schools

Number Showing Gains

Number Showing Loss

SURR

Percent Showing Gains

Statewide Percent Showing Gains

Grade 4 ELA

29

24

4

83%

62%

Grade 4 Math

29

28

1

97%

83%

Grade 8 ELA

45

28

17

62%

45%

Grade 8 Math

45

34

11

76%

66%

Includes performance of all schools that were SURR schools at time of test administrations during the 2002-2003 school year.

Observation #9:  Performance of Former SURR Elementary and Middle Schools

 

Finding: Former SURR schools as a group perform significantly better than current SURR schools, but lag beyond the performance of schools statewide.

 

-          Former SURR schools as a group perform significantly better than current SURR schools, but still generally do not achieve the State standards.  Former SURR schools also showed more improvement than did schools statewide, except in grade 8 ELA, where there was a comparable slight decline of one index point between 2001-02 and 2002-03.

-          In grade 4 ELA, former SURR schools as a group have closed 65 percent of the gap between the State standard and the cutpoint for farthest from State standards.  The gap reduction was 96 percent for grade 4 math, 32 percent for grade 8 ELA and 23 percent for grade 8 math.

-          The vast majority of former SURR elementary schools remain above the cutpoint for farthest from State standards and more than 49 percent have been able to achieve the State standard in grade 4 Math.

-          Grade 8 ELA is the only criterion on which any former SURR schools were below a State standard in 2002-03 and only two schools were below the standard. By contrast, nearly half of the former SURR schools now meet the State standard in grade 4 math.

 

Table 9A

Performance of Former SURR Schools

 

on School Accountability Performance Index (SPI)

2003 Test Administrations

 

Subject

# of Schools

Number Students Tested

SPI

2003

Gain/Loss from SPI 2002

Grade 4 ELA

102

10,528

126

+15

Grade 4 Math

102

10,509

147

+27

Grade 8 ELA

22

4,255

104

-1

Grade 8 Math

22

4,214

101

+15

 

Note:  Does not include performance of schools that were closed in June 2003.

 

 

 

 

 

 

 

 

 

 

 

 

Table 9B

Performance of Former SURR Schools

2002-2003 School Year Test Administrations

 

Subject

# of Schools

# of Schools Farthest From State Standards

# of Schools Meeting State Standards

Grade 4 ELA

102

0

7

Grade 4 Math

102

0

46

Grade 8 ELA

22

2

1

Grade 8 Math

22

0

2

 

Farthest from State Standards = 82 in grade 4 ELA and math and grade 8 ELA and 55 in grade 8 Math.  State standard = 150

 

Note:  Does not include performance of schools that were closed in June 2003.

 

 

 

Table 9C

Performance of Former SURR Schools

on School Accountability Performance Index (SPI)

2003 Test Administrations

 

Subject

State Standard

Farthest From State Standard

SPI

2003

Gap Reduction

Grade 4 ELA

150

82

126

65%

Grade 4 Math

150

82

147

96%

Grade 8 ELA

150

82

105

32%

Grade 8 Math

150

55

102

49%

 

Note:  Does not include performance of schools that were closed in June 2003.

 

 

 

 

 

 

 

 

 

 

 

 

 

 




Observation #10:  Performance of Current and Former SURR Elementary and Middle Schools Over Time

 

Finding: The longer ago a school was first identified for registration review, the better the school is likely to be performing today.

 

-          The longer ago a school was placed under registration review, the higher its performance was likely to be last year relative to other current and former Schools Under Registration Review identified more recently.

-          This trend was consistently observed on both the grade 4 and grade 8 ELA and math examinations.  This suggests that even though a few schools have been re-identified for registration review, overall SURR schools continue to improve after their removal from review.

 

Table 10

School Accountability Performance Index of Current and Former SURR Schools

By Year of Initial Identification

Year of Initial Identification

ELA 4

Math 4

ELA 8

Math 8

1989-1994

126

148

110

104

1995-1998

123

143

92

82

1999-2003

116

141

95

77

 

 


Observation #11: Performance of Schools Removed from Registration Review in 2003

 

Finding:  In the aggregate, schools removed from registration review showed gains on all criteria except grade 8 ELA, where there was a decline in performance.

 

Newly removed elementary schools continued to show gains that were stronger than that for other former SURR schools, but middle schools showed little gain in grade 8 math and a decline in grade 8 ELA after removal from SURR.

 

 

Table 11

Performance of Schools Removed from Registration Review January 2003

on School Accountability Performance Index (SPI)

2003 Test Administrations

Subject

# of Schools

SPI

2002

SPI

2003

Gain/Loss from SPI 2003

Grade 4 ELA

14

111

131

+20

Grade 4 Math

14

124

153

+29

Grade 8 ELA

6

104

91

-13

Grade 8 Math

6

91

92

+1


 

Observation #12:  Performance of Current and Former SURR Schools in Relation to Number of Students Tested

 

Finding:  In general, schools with enrollments of less than 50 performed better than did schools with larger enrollments.

 

In grades 4 and 8 ELA and math, as a group schools that tested fewer than 50 students had consistently stronger results than those that tested between 50 and 99 students. In turn, with the exception of grade 4 ELA, schools that tested between 50 and 99 students performed better than those with 100 or more students.  This is consistent with the thesis that it is easier to turn around small schools than large ones.  However, the data should be treated with some caution as a previous study in 2002 found that the group of schools that had between 50 and 99 students was generally the highest performing ones, suggesting that the data for small schools is variable from year to year. 

 

 

 

Table 12

Performance of Current and Former SURR Schools

on School Accountability Performance Index (SPI)

2003 Test Administration

By Size of Tested Population

 

Size of Tested Population

ELA 4

Math 4

ELA 8

Math 8

Less than 50

137

163

106

114

50-99

121

146

101

105

100+

123

143

98

82

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


Observation #13:  Performance of Current and Former SURR High Schools

 

Finding:  The new Regents graduation requirements present challenges to both current and former SURR schools.

-          From 1989 to 2002, high school accountability has moved from a system based on the passing or failing rate on RCTs, to the percentage of students that have passed RCTs by the end of grade 11, to a system based on the percentage of students who have met graduation assessment requirements within four years of entry into ninth grade.  In 2003, the system changed again to reflect a high school performance index which set as it goal students in a cohort achieving a score of 65 or higher on a Regents exam within four years of entry into grade 9.

-          As the graduation assessment requirement has changed to one based upon passage of Regents exams, many current and former SURR schools have struggled to meet standards.

-          As with elementary and middle schools, former SURR schools outperform current SURR schools but have results significantly below those of the average performance of schools statewide.

-          The math Regents graduation requirement has been a particular challenge for former SURR high schools.  One-third of former SURR high schools were farthest from State standards last year on this indicator.  Many former SURR schools, which had become successful at having students meet RCT standards, are finding it much more difficult to prepare students to meet the Regents math graduation requirements.

 

Table 13A

Performance of Current and Former SURR High Schools

1999 ELA and Math Cohorts

 

 

Number of Schools

Number of Students in Cohort

ELA Performance Index

Math Performance Index

Former SURR

18

5,373

111

97

Current SURR

17

3,217

88

74

Former SURR does not include schools closed June 2003.

 

Table 13B

Percent of Former SURR High Schools

Farthest from State Standards

1997 ELA and Math Cohorts

 

Number of Schools

ELA: Percent Farthest from State Standards

Math: Percent Farthest from State Standards

Former SURR

24

8%

33%

 

Former SURR does not include schools closed June 2003.

 

 

Observation #14:  Performance of Disaggregated Student Populations in Current and Former SURR Elementary and Middle Schools

 

Finding:  There are significant variations in the performance of disaggregated groups in current and former SURR schools.

-          In the aggregate, performance of students in current SURR schools exceeds the No Child Left Behind Annual Measurable Objective (AMO) for grade 4 math and almost meets the AMO for grade 8 math.  Limited English proficient (LEP) students and students with disabilities perform substantially less well than do other disaggregated groups.

-          In the aggregate, performance of students in former SURR schools exceeds the AMO on all elementary and middle-level criteria except grade 8 ELA.  In addition, White and Asian students as a group exceed the AMO on all four elementary and middle-level criteria, Black and low-income students exceed the criteria in all areas except grade 8 ELA, and Hispanic students exceed the grades 4 and 8 math AMOs. However, limited English proficient students and students with disabilities as a group exceed none of the AMOs.

 

 

 

Table 14A

Performance of Current SURR Schools

on School Accountability Performance Index (SPI)

2003 Test Administrations

By NCLB Disaggregated Group

 

Group

# Tested

ELA 4

Math 4

ELA 8

Math 8

Asian

210

127

156

102

105

Black

6,728

113

138

93

75

Hispanic

4,987

111

130

96

79

Native American

 

40

 

129

 

157

 

111

 

75

White

362

110

141

89

88

Low-Income

6,982

111

140

89

77

LEP

1,507

76

84

73

43

SWD*

2,214

62

85

48

39

Total

12,237

110

137

95

76

*Students with Disabilities


Table 14B

Performance of Former SURR Schools

on School Accountability Performance Index (SPI)

2003 Test Administration

By NCLB Disaggregated Group

 

Group

# Tested

ELA 4

Math 4

ELA 8

Math 8

Asian

296

134

163

134

145

Black

6,686

129

148

103

105

Hispanic

7,299

121

149

99

102

Native American

 

89

 

113

 

130

 

109

 

124

White

479

136

143

116

107

Low-Income

7,289

132

147

103

105

LEP

1,839

88

109

80

57

SWD*

2,127

74

102

46

38

Total

14,851

126

147

104

101

*Students with Disabilities

 

Note: The Annual Measurable Objectives for the 2002-03 school year are:

ELA 4:  123

Math 4: 136

ELA 8:  107

Math 8:  81

 

Under NCLB, schools are expected to have all disaggregated groups perform at or above these levels or to show at least 10 percent improvement between baseline performance and the goal of a performance index of 200.

 

 

III.        Successes and Challenges

 

            As the SURR process enters its 15th year, it is clear that thousands of students have been the beneficiaries of improvement in academic performance among schools in the State that had been among the lowest performing.  Factors that have contributed to these improvements include:

 

-          Registration review visits to newly identified schools by outside experts that result in a registration review report whose findings become the basis for school improvement and corrective action plans.

-          The assignment of an SED liaison to each SURR school to coordinate the provision of services to the school and to monitor implementation of improvement plans.

-          The linkage of SURR schools to a network of technical assistance providers through the Regional School Support Centers.

-          The direct provision of professional development to SURR schools through Department-sponsored Reading and Math Institutes, Leadership Institutes and the assignment of curriculum specialists to selected SURR schools.

-          The direction of grant funds to SURR schools to support efforts such as Universal Pre-k, early grade reduced class size, extended day and learning technology programs.

-          The adoption by SURR schools of researched-based models of excellence, particularly in the elementary schools.

-          The assignment of certified staff to schools that have been identified as SURR schools.

-          The development of a cadre of parent leaders who can actively participate in the improvement process in their schools and who can train other parents in how to help their children in school.

-          The pro-active steps taken by school districts to “pre-identify” low-performing schools and to take actions to close or restructure these schools before they can be identified as SURR schools.

-          The redirection of resources by school districts to support effective implementation of improvement plans in SURR schools.

 

An additional strength of the SURR process has been the willingness of the Department to constantly adjust and modify the process to reflect lessons learned and changes in the educational environment.  Areas where there appear to be opportunities for improvement in the process include:

 

-          Accelerating the process of identification of SURR schools.  Identification of SURR schools typically occurs at the beginning of the calendar year.  As the Department completes the process of establishing its No Child Left Behind (NCLB) accountability database for all schools and implementing the individual student data record system, the Department hopes that decisions about SURR schools can occur near the beginning of the school year.

-          Incorporating all public schools into the SURR process.  Schools that serve exclusively students with disabilities, small schools, and schools that do not participate in State assessments because of their grade configuration present special challenges in terms of making decisions regarding the effectiveness of the educational program at the school. As it has done with alternative high schools, the Department will continue its efforts to develop an appropriate mechanism to make determinations regarding which of these types of schools warrant designation as SURR schools.

-          Strengthening the process for redesigning and closing SURR middle and high schools.  While the SURR redesign process has been an overwhelming success at the elementary school level, too many SURR middle and high schools that have redesigned and too many new middle and high schools that have opened to replaced closed SURR schools are not showing adequate levels of student performance.

-          Expanding on-line professional development opportunities for teachers in SURR schools, a mechanism that has been successfully piloted under the State’s Reading Excellence Act grant.

-          Moving as appropriate from research-based models of excellence focused on whole school reform to the scientifically-based research curriculum models required by the No Child Left Behind.

-          Integrating further the SURR process with No Child Left Behind accountability requirements.  The Department had been successful in creating a nearly seamless integration of SURR into the accountability system required by the previous reauthorization of Title I, the Improving America’s School Act.  The accountability requirements of NCLB are more prescriptive and, therefore, require some adjustments in the SURR process to ensure that the programs continue to act in synergy, particularly in terms of performance targets, timelines and planning requirements.

-          Maintaining State and local commitment to the SURR process.  Under NCLB, it is highly likely that in the coming years there will be a large increase in the number of schools and districts identified for improvement.  This increase in the number of schools and districts will place new demands on those who have played key roles in supporting improvement efforts in SURR schools. It is critical that schools that are identified as SURR schools because they are the very lowest performing schools in the State continue to receive the high intensity support and assistance they need to turn around academic performance.

 

These observations underscore that, while the registration review process has had a positive effect on student results in SURR schools, much more effort will be required to ensure that all students in these schools will be successfully prepared to meet the new State learning standards and higher graduation requirements.  The SURR process does make most schools better, but, by itself, it generally cannot make such schools good.  For that reason, it is critical that as the Department pursues its School-by-School Support Plan for SURR schools, it must also aggressively implement its Closing the Gap Strategy so as move the entire educational enterprise in our districts with the lowest needs and capacities to a higher level.  It is only through this dual focus, both on reform at the individual school level and system-wide capacity building, that SURR schools will be able to give their students an equal opportunity to meet State standards.