Start Submission

Reading: Reply to comment on “Suburban watershed nitrogen retention: Estimating the effectiveness of ...


A- A+
Alt. Display

Comment and Reply

Reply to comment on “Suburban watershed nitrogen retention: Estimating the effectiveness of stormwater management structures” by Koch et al. (Elem Sci Anth 3:000063, July 2015)


Benjamin J. Koch ,

Center for Ecosystem Science and Society, Northern Arizona University, Flagstaff, Arizona, United States, US
X close

Solange Filoso,

Chesapeake Biological Laboratory, University of Maryland Center for Environmental Science, Solomons, Maryland, United States, US
X close

Roger M. Cooke,

Resources for the Future, Washington, District of Columbia, United States; Department of Management Science, University of Strathclyde, Glasgow, Scotland; Department of Mathematics, Delft University of Technology, Delft, Netherlands, NL
X close

Jacob D. Hosen,

School of Forestry & Environmental Studies, Yale University, New Haven, Connecticut, United States, US
X close

Abigail R. Colson,

Department of Management Science, University of Strathclyde, Glasgow, Scotland; Center for Disease Dynamics, Economics & Policy, Washington, District of Columbia, United States, US
X close

Catherine M. Febria,

School of Biological Sciences, University of Canterbury, Christchurch, New Zealand, NZ
X close

Margaret A. Palmer

Chesapeake Biological Laboratory, University of Maryland Center for Environmental Science, Solomons, Maryland, United States; Department of Entomology, University of Maryland, College Park, Maryland, United States; National Socio-Environmental Synthesis Center, University of Maryland, Annapolis, Maryland, United States, US
X close


We reply to a comment on our recent structured expert judgment analysis of stormwater nitrogen retention in suburban watersheds. Low relief, permeable soils, a dynamic stream channel, and subsurface flows characterize many lowland Coastal Plain watersheds. These features result in unique catchment hydrology, limit the precision of streamflow measurements, and challenge the assumptions for calculating runoff from rainfall and catchment area. We reiterate that the paucity of high-resolution nitrogen loading data for Chesapeake Bay watersheds warrants greater investment in long-term empirical studies of suburban watershed nutrient budgets for this region.
Knowledge Domain: Earth & Environmental Science Ecology
How to Cite: Koch, B.J., Filoso, S., Cooke, R.M., Hosen, J.D., Colson, A.R., Febria, C.M. and Palmer, M.A., 2015. Reply to comment on “Suburban watershed nitrogen retention: Estimating the effectiveness of stormwater management structures” by Koch et al. (Elem Sci Anth 3:000063, July 2015). Elem Sci Anth, 3, p.000079. DOI:
 Published on 02 Dec 2015
 Accepted on 09 Nov 2015            Submitted on 28 Oct 2015
Domain Editor-in-Chief: Donald R. Zak; School of Natural Resources & Environment, University of Michigan, Ann Arbor, Michigan, United States
Associate Editor: Julian D. Olden; School of Aquatic & Fishery Sciences, University of Washington, Seattle, Washington, United States

We thank Dr. Walsh for his interest in this research and for generously sharing his knowledge as one of the 10 experts participating in our structured expert judgment (SEJ) elicitation. Like all of the experts, he provided a thoughtful rationale for predicting nitrogen (N) loads in the focal watersheds. In his comment, Walsh (2015) restates a portion of his rationale and highlights differences in rainfall versus discharge measurements for the Coastal Plain scenario as presented in the SEJ protocol document (Koch et al., 2015; Appendix S3). He suggests the differences may be due to inaccurate measurements of stream discharge or, alternatively, may indicate unique catchment hydrology.

Discharge measurements are typically highly variable in small catchments (Harmel et al., 2006). This variation is further magnified within the Coastal Plain physiographic province, where low relief, dynamic channels, and subsurface flows combine to limit the precision of streamflow measurements.

In addition, several features unique to lowland Coastal Plain watersheds challenge common assumptions for calculating surface runoff from rainfall volume and drainage area (CSN, 2009). First, the Coastal Plain is especially flat, which complicates catchment delineation. For example, most slopes within the Magothy watershed, which contains the focal study catchment of North Cypress Creek, are less than 14% (MDE, 2013). The Cypress Creek subwatershed itself has extremely low elevation and little variation in topography (AACDPW, 2010). Consequently, it is possible that not all runoff within the delineated drainage flows into the Cypress Creek channel.

Second, Coastal Plain soils can be highly permeable (Markewich et al., 1990). Soils in the Magothy River watershed are predominantly sand (67%; MDE, 2013), and the majority (82%) of soils in the Cypress Creek subwatershed are classified as having low or moderately low runoff potential when thoroughly wet (AACDPW, 2010). The combination of flat terrain and highly permeable soils reduces runoff potential in this catchment.

Third, although the Cypress Creek subwatershed is substantially urbanized, an unexpectedly large proportion of the land cover is permeable. Low- to medium-density residential areas account for 57% of the developed area while commercial property accounts for 29%, and transportation corridors for 2% (MDP, 2010). Of the residential land cover, more than half is vegetated with grass and second-growth trees (MDP, 2010), where water infiltration can be quite high, especially because of the flat terrain and dominance of sandy soils. Walsh assumed that impervious runoff is predominantly routed to the stream channel, however much of the impervious runoff in the residential zones drains directly to those vegetated areas.

Finally, water infiltration in the Coastal Plain can vary greatly through time, depending on storm frequency and season (Harder et al., 2007). As a consequence, storm size may poorly predict the magnitude of runoff. Logs from groundwater monitoring wells located close to the Cypress Creek subwatershed reveal a thick (>30m) zone of permeable material extending below the surface which may act as a reservoir for infiltrating surface flows (MGS, 2015). Surface runoff varies with the level of saturation within this reservoir. Furthermore, this extensive zone of permeable sediments can promote the conveyance of stream water via subsurface flow paths.

The hydrologic data we provided the experts represented the best available, and indeed the paucity of high-resolution N loading data for Chesapeake Bay watersheds is what motivated our expert elicitation in the first place. The purpose of our SEJ was not to present comprehensive, empirical case studies of watershed hydrology. Rather, we sought to leverage what little existing data there are on N budgets in suburban Chesapeake Bay watersheds to derive expert-informed estimates of BMP N retention performance in those watersheds.

Walsh suggests a way of improving expert-informed estimates by calibrating each expert against a “known uncertainty”. This idea was explored in research leading up to the development of the “Classical Model” for structured expert judgment (Cooke, 1991); however it has not been implemented. The primary reason is that it is difficult to find such “known uncertainties” from experts’ domains, in this case, hydrology. A secondary problem is that testing the hypothesis that an expert is statistically accurate against a distribution of outcomes is mathematically complex and would require knowing the sample size on which the “known uncertainty” is based. Because of these challenges, the simpler statistical test is commonly employed in SEJ studies (Cooke and Goossens, 2008), though this has the disadvantage of a “binary assessment” that Walsh notes. The best practical antidote is to simply query more quantiles in the elicitation, but this increases the burden on experts. The current compromise adequately accomplishes the main goal of assessing the statistical accuracy of the resulting combination of experts; however another approach, when a few independent realizations are available for an elicited variable, was used in Slijkhuis et al. (1998).

Despite the tremendous economic and environmental importance of the nitrogen problem in the Chesapeake Bay region, there are scant data and funding to empirically characterize N dynamics of BMPs, especially within the Coastal Plain. Nonetheless, millions of dollars are invested annually in constructing stormwater BMPs (AACDPW, 2015; NRC, 2009; USEPA, 2006), the benefits of which are largely unknown. Although expert-derived uncertainty in BMP performance can inform management actions, long-term empirical studies of suburban watershed nutrient budgets are needed to quantify the extent to which alternative stormwater BMP designs retain excess nutrients under different environmental conditions.


© 2015 Koch et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Competing interests

The authors have no competing interests.


We thank Chris Walsh for his comments on our paper. We are also grateful to G. Isaacs for helpful discussions on the intricacies of Coastal Plain hydrology.


  1. AACDPW (Anne Arundel County Department of Public Works). 2010. Magothy River watershed assessment: Comprehensive study summary report. Annapolis, Maryland. Available at

  2. AACDPW (Anne Arundel County Department of Public Works). 2015. Anne Arundel County Watershed Protection and Restoration Program FY 2015 Report. Annapolis, Maryland. Available at

  3. Cooke RM. 1991. Experts in uncertainty: Opinion and subjective probability in science . New York, New York: Oxford University Press.

  4. Cooke RM, Goossens LLHJ. 2008. TU Delft expert judgment data base. Reliab Eng Syst Safe 93: 657–674. doi: 10.1016/j.ress.2007.03.005.

  5. CSN. 2009. CSN Technical Bulletin No. 2: Stormwater design in the Coastal Plain of the Chesapeake Bay watershed. Chesapeake Stormwater Network . Available at

  6. Harder SV, Amatya DM, Callahan TJ, Trettin CC, Hakkila J. 2007. Hydrology and water budget for a forested Atlantic Coastal Plain watershed, South Carolina. J Am Water Resour Assoc 43: 563–575.

  7. Harmel RD, Cooper RJ, Slade RM, Haney RL, Arnold JG. 2006. Cumulative uncertainty in measured streamflow and water quality data for small watersheds. Trans Am Soc Agric Biol Eng 49: 689–701.

  8. Koch BJ , Febria CM , Cooke RM , Hosen JD , Baker ME , et al. 2015. Suburban watershed nitrogen retention: Estimating the effectiveness of stormwater management structures. Elem Sci Anth 3: 000063. doi: 10.12952/journal.elementa.000063.

  9. Markewich HW, Pavich MJ, Buell GR. 1990. Contrasting soils and landscapes of the Piedmont and Coastal Plain, eastern United States. Geomorphology 3: 417–447. doi: 10.1016/0169-555X(90)90015-I.

  10. MDE (Maryland Department of the Environment). 2013. Watershed Report for Biological Impairment of the Magothy River Watershed in Anne Arundel County, Maryland Biological Stressor Identification Analysis Results and Interpretation, Final. Baltimore, Maryland. Available at

  11. MDP (Maryland Department of Planning). 2010. Land use land cover data. Available at Accessed 20 November 2013.

  12. MGS (Maryland Geological Survey). 2015. Coastal Plain Geophysical and Lithologic Logs. Available at Accessed 20 October 2015.

  13. NRC (National Research Council). 2009. Urban stormwater management in the United States . Washington, D.C.: National Academies Press.

  14. Slijkhuis KAH, Frijters MPC, Cooke RM, Vrouwenvelder ACWM. 1998. Probability of flooding: An uncertainty analysis, in LydersenS, HansenGK eds. , SandtorvHA eds., Safety and Reliability. Vol. 2 of Proceedings of the European Conference on Safety and Reliability . Rotterdam, Netherlands: A.A. Balkema: pp. 1419–1426.

  15. USEPA. 2006. Guidance for municipal stormwater funding. U.S. Environmental Protection Agency. Available at

  16. Walsh CJ. 2015. Comment on “Suburban watershed nitrogen retention: Estimating the effectiveness of stormwater management structures” by Koch et al. (Elem Sci Anth 3:000063, July 2015). Elem Sci Anth 3: 000077.

comments powered by Disqus