@article{Barros-2022-Empowering,
title = "Empowering ecological modellers with a {\textless}scp{\textgreater}PERFICT{\textless}/scp{\textgreater} workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation",
author = "Barros, Ceres and
Luo, Yong and
Chubaty, Alex M and
Eddy, Ian M. S. and
Micheletti, Tatiane and
Boisvenue, C{\'e}line and
Andison, David and
Cumming, Steven G. and
McIntire, Eliot J. B. and
Barros, Ceres and
Luo, Yong and
Chubaty, Alex M and
Eddy, Ian M. S. and
Micheletti, Tatiane and
Boisvenue, C{\'e}line and
Andison, David and
Cumming, Steven G. and
McIntire, Eliot J. B.",
journal = "Methods in Ecology and Evolution, Volume 14, Issue 1",
volume = "14",
number = "1",
year = "2022",
publisher = "Wiley",
url = "https://gwf-uwaterloo.github.io/gwf-publications/G22-79001",
doi = "10.1111/2041-210x.14034",
pages = "173--188",
abstract = "Abstract Modelling is widely used in ecology and its utility continues to increase as scientists, managers and policy‐makers face pressure to effectively manage ecosystems and meet conservation goals with limited resources. As the urgency to forecast ecosystem responses to global change grows, so do the number and complexity of predictive ecological models and the value of iterative prediction, both of which demand validation and cross‐model comparisons. This challenges ecologists to provide predictive models that are reusable, interoperable, transparent and able to accommodate updates to both data and algorithms. We propose a practical solution to this challenge based on the PERFICT principles (frequent Predictions and Evaluations of Reusable, Freely accessible, Interoperable models, built within Continuous workflows that are routinely Tested), using a modular and integrated framework. We present its general implementation across seven common components of ecological model applications{---}(i) the modelling toolkit; (ii) data acquisition and treatment; (iii) model parameterisation and calibration; (iv) obtaining predictions; (v) model validation; (vi) analysing and presenting model outputs; and (vii) testing model code{---}and apply it to two approaches used to predict species distributions: (1) a static statistical model, and (2) a complex spatiotemporally dynamic model. Adopting a continuous workflow enabled us to reuse our models in new study areas, update predictions with new data, and re‐parameterise with different interoperable modules using freely accessible data sources, all with minimal user input. This allowed repeating predictions and automatically evaluating their quality, while centralised inputs, parameters and outputs, facilitated ensemble forecasting and tracking uncertainty. Importantly, the integrated model validation promotes a continuous evaluation of the quality of more‐ or less‐parsimonious models, which is valuable in predictive ecological modelling. By linking all stages of an ecological modelling exercise, it is possible to overcome common challenges faced by ecological modellers, such as changing study areas, choosing between different modelling approaches, and evaluating the appropriateness of the model. This ultimately creates a more equitable and robust playing field for both modellers and end users (e.g. managers), and contributes to position predictive ecology as a central contributor to global change forecasting.",
}
<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="Barros-2022-Empowering">
<titleInfo>
<title>Empowering ecological modellers with a \textlessscp\textgreaterPERFICT\textless/scp\textgreater workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation</title>
</titleInfo>
<name type="personal">
<namePart type="given">Ceres</namePart>
<namePart type="family">Barros</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Yong</namePart>
<namePart type="family">Luo</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Alex</namePart>
<namePart type="given">M</namePart>
<namePart type="family">Chubaty</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Ian</namePart>
<namePart type="given">M</namePart>
<namePart type="given">S</namePart>
<namePart type="family">Eddy</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Tatiane</namePart>
<namePart type="family">Micheletti</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Céline</namePart>
<namePart type="family">Boisvenue</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">David</namePart>
<namePart type="family">Andison</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Steven</namePart>
<namePart type="given">G</namePart>
<namePart type="family">Cumming</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Eliot</namePart>
<namePart type="given">J</namePart>
<namePart type="given">B</namePart>
<namePart type="family">McIntire</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<originInfo>
<dateIssued>2022</dateIssued>
</originInfo>
<typeOfResource>text</typeOfResource>
<genre authority="bibutilsgt">journal article</genre>
<relatedItem type="host">
<titleInfo>
<title>Methods in Ecology and Evolution, Volume 14, Issue 1</title>
</titleInfo>
<originInfo>
<issuance>continuing</issuance>
<publisher>Wiley</publisher>
</originInfo>
<genre authority="marcgt">periodical</genre>
<genre authority="bibutilsgt">academic journal</genre>
</relatedItem>
<abstract>Abstract Modelling is widely used in ecology and its utility continues to increase as scientists, managers and policy‐makers face pressure to effectively manage ecosystems and meet conservation goals with limited resources. As the urgency to forecast ecosystem responses to global change grows, so do the number and complexity of predictive ecological models and the value of iterative prediction, both of which demand validation and cross‐model comparisons. This challenges ecologists to provide predictive models that are reusable, interoperable, transparent and able to accommodate updates to both data and algorithms. We propose a practical solution to this challenge based on the PERFICT principles (frequent Predictions and Evaluations of Reusable, Freely accessible, Interoperable models, built within Continuous workflows that are routinely Tested), using a modular and integrated framework. We present its general implementation across seven common components of ecological model applications—(i) the modelling toolkit; (ii) data acquisition and treatment; (iii) model parameterisation and calibration; (iv) obtaining predictions; (v) model validation; (vi) analysing and presenting model outputs; and (vii) testing model code—and apply it to two approaches used to predict species distributions: (1) a static statistical model, and (2) a complex spatiotemporally dynamic model. Adopting a continuous workflow enabled us to reuse our models in new study areas, update predictions with new data, and re‐parameterise with different interoperable modules using freely accessible data sources, all with minimal user input. This allowed repeating predictions and automatically evaluating their quality, while centralised inputs, parameters and outputs, facilitated ensemble forecasting and tracking uncertainty. Importantly, the integrated model validation promotes a continuous evaluation of the quality of more‐ or less‐parsimonious models, which is valuable in predictive ecological modelling. By linking all stages of an ecological modelling exercise, it is possible to overcome common challenges faced by ecological modellers, such as changing study areas, choosing between different modelling approaches, and evaluating the appropriateness of the model. This ultimately creates a more equitable and robust playing field for both modellers and end users (e.g. managers), and contributes to position predictive ecology as a central contributor to global change forecasting.</abstract>
<identifier type="citekey">Barros-2022-Empowering</identifier>
<identifier type="doi">10.1111/2041-210x.14034</identifier>
<location>
<url>https://gwf-uwaterloo.github.io/gwf-publications/G22-79001</url>
</location>
<part>
<date>2022</date>
<detail type="volume"><number>14</number></detail>
<detail type="issue"><number>1</number></detail>
<extent unit="page">
<start>173</start>
<end>188</end>
</extent>
</part>
</mods>
</modsCollection>
%0 Journal Article
%T Empowering ecological modellers with a \textlessscp\textgreaterPERFICT\textless/scp\textgreater workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation
%A Barros, Ceres
%A Luo, Yong
%A Chubaty, Alex M.
%A Eddy, Ian M. S.
%A Micheletti, Tatiane
%A Boisvenue, Céline
%A Andison, David
%A Cumming, Steven G.
%A McIntire, Eliot J. B.
%J Methods in Ecology and Evolution, Volume 14, Issue 1
%D 2022
%V 14
%N 1
%I Wiley
%F Barros-2022-Empowering
%X Abstract Modelling is widely used in ecology and its utility continues to increase as scientists, managers and policy‐makers face pressure to effectively manage ecosystems and meet conservation goals with limited resources. As the urgency to forecast ecosystem responses to global change grows, so do the number and complexity of predictive ecological models and the value of iterative prediction, both of which demand validation and cross‐model comparisons. This challenges ecologists to provide predictive models that are reusable, interoperable, transparent and able to accommodate updates to both data and algorithms. We propose a practical solution to this challenge based on the PERFICT principles (frequent Predictions and Evaluations of Reusable, Freely accessible, Interoperable models, built within Continuous workflows that are routinely Tested), using a modular and integrated framework. We present its general implementation across seven common components of ecological model applications—(i) the modelling toolkit; (ii) data acquisition and treatment; (iii) model parameterisation and calibration; (iv) obtaining predictions; (v) model validation; (vi) analysing and presenting model outputs; and (vii) testing model code—and apply it to two approaches used to predict species distributions: (1) a static statistical model, and (2) a complex spatiotemporally dynamic model. Adopting a continuous workflow enabled us to reuse our models in new study areas, update predictions with new data, and re‐parameterise with different interoperable modules using freely accessible data sources, all with minimal user input. This allowed repeating predictions and automatically evaluating their quality, while centralised inputs, parameters and outputs, facilitated ensemble forecasting and tracking uncertainty. Importantly, the integrated model validation promotes a continuous evaluation of the quality of more‐ or less‐parsimonious models, which is valuable in predictive ecological modelling. By linking all stages of an ecological modelling exercise, it is possible to overcome common challenges faced by ecological modellers, such as changing study areas, choosing between different modelling approaches, and evaluating the appropriateness of the model. This ultimately creates a more equitable and robust playing field for both modellers and end users (e.g. managers), and contributes to position predictive ecology as a central contributor to global change forecasting.
%R 10.1111/2041-210x.14034
%U https://gwf-uwaterloo.github.io/gwf-publications/G22-79001
%U https://doi.org/10.1111/2041-210x.14034
%P 173-188
Markdown (Informal)
[Empowering ecological modellers with a <scp>PERFICT</scp> workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation](https://gwf-uwaterloo.github.io/gwf-publications/G22-79001) (Barros et al., GWF 2022)
ACL
- Ceres Barros, Yong Luo, Alex M Chubaty, Ian M. S. Eddy, Tatiane Micheletti, Céline Boisvenue, David Andison, Steven G. Cumming, Eliot J. B. McIntire, Ceres Barros, Yong Luo, Alex M Chubaty, Ian M. S. Eddy, Tatiane Micheletti, Céline Boisvenue, David Andison, Steven G. Cumming, and Eliot J. B. McIntire. 2022. Empowering ecological modellers with a PERFICT workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation. Methods in Ecology and Evolution, Volume 14, Issue 1, 14(1):173–188.
