Climate-Science-Reranker

This is a Cross Encoder model finetuned from cross-encoder/ms-marco-MiniLM-L6-v2 using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

Model Type: Cross Encoder
Base model: cross-encoder/ms-marco-MiniLM-L6-v2
Maximum Sequence Length: 512 tokens
Number of Output Labels: 1 label
Language: en
License: apache-2.0

Model Sources

Documentation: Sentence Transformers Documentation
Documentation: Cross Encoder Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of texts
pairs = [
    ["The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.", 'Currently there is renewed interest in harnessing the vast tidal resource to combat the twin challenges of climate change and energy security. However, within the UK no tidal barrage proposals have passed the development stage, this is due to a combination of high cost and environmental concerns. This paper demonstrates how a framework, such as the North West Hydro Resource Model can be applied to tidal barrages, with the Mersey barrage as a case study. The model materialised in order to provide developers with a tool to successfully identify the capacity of hydropower schemes in a specific location. A key feature of the resource model is the understanding that there is no single barrier to the utilisation of small hydropower but several obstacles, which together impede development. Thus, this paper contributes in part to a fully holistic treatment of tidal barrages, recognising that apart from energy generation, other environmental, societal and economic opportunities arise and must be fully investigated for robust decision-making. This study demonstrates how considering the societal needs of the people and the necessity for compensatory habitats, for example, an organic architectural design has developed, which aims to enhance rather than detract from the Mersey.'],
    ["The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.", 'Rainbows contribute to human wellbeing by providing an inspiring connection to nature. Because the rainbow is an atmospheric optical phenomenon that results from the refraction of sunlight by rainwater droplets, changes in precipitation and cloud cover due to anthropogenic climate forcing will alter rainbow distribution. Yet, we lack a basic understanding of the current spatial distribution of rainbows and how climate change might alter this pattern. To assess how climate change might affect rainbow viewing opportunities, we developed a global database of crowd-sourced photographed rainbows, trained an empirical model of rainbow occurrence, and applied this model to present-day climate and three future climate scenarios. Results suggest that the average terrestrial location on Earth currently has 117 ± 71 days per year with conditions suitable for rainbows. By 2100, climate change is likely to generate a 4.0–4.9 % net increase in mean global annual rainbow-days (i.e., days with at least one rainbow), with the greatest change under the highest emission scenario. Around 21–34 % of land areas will lose rainbow-days and 66–79 % will gain rainbow-days, with rainbow gain hotspots mainly in high-latitude and high-elevation regions with smaller human populations. Our research demonstrates that alterations to non-tangible environmental attributes due to climate change could be significant and are worthy of consideration and mitigation.'],
    ["The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.", 'The ascendancy of dinosaurs to become dominant components of terrestrial ecosystems was a pivotal event in the history of life, yet the drivers of their early evolution and biodiversity are poorly understood.1Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. The first 50 Myr of dinosaur evolution: macroevolutionary pattern and morphological disparity.Biol. Lett. 2008; 4: 733-736https://doi.org/10.1098/rsbl.2008.0441Crossref PubMed Scopus (105) Google Scholar,2Irmis R.B. Evaluating hypotheses for the early diversification of dinosaurs.Earth Environ. Sci. Trans. R. Soc. Edinb. 2010; 101: 397-426https://doi.org/10.1017/S1755691011020068Crossref Scopus (94) Google Scholar,3Benton M.J. Forth J. Langer M.C. Models for the rise of the dinosaurs.Curr. Biol. 2014; 24: R87-R95https://doi.org/10.1016/j.cub.2013.11.063Abstract Full Text Full Text PDF PubMed Scopus (93) Google Scholar During their early diversification in the Late Triassic, dinosaurs were initially rare and geographically restricted, only attaining wider distributions and greater abundance following the end-Triassic mass extinction event.4Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. Superiority, competition, and opportunism in the evolutionary radiation of dinosaurs.Science. 2008; 321: 1485-1488https://doi.org/10.1126/science.1161833Crossref PubMed Scopus (334) Google Scholar,5Langer M.C. Ezcurra M.D. Bittencourt J.S. Novas F.E. The origin and early evolution of dinosaurs.Biol. Rev. Camb. Philos. Soc. 2010; 85: 55-110https://doi.org/10.1111/j.1469-185X.2009.00094.xCrossref PubMed Scopus (212) Google Scholar,6Langer M.C. Godoy P.L. So volcanoes created the dinosaurs? a quantitative characterization of the early evolution of terrestrial pan-aves.Front. Earth Sci. 2022; 10https://doi.org/10.3389/feart.2022.899562Crossref PubMed Scopus (3) Google Scholar This pattern is consistent with an opportunistic expansion model, initiated by the extinction of co-occurring groups such as aetosaurs, rauisuchians, and therapsids.4Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. Superiority, competition, and opportunism in the evolutionary radiation of dinosaurs.Science. 2008; 321: 1485-1488https://doi.org/10.1126/science.1161833Crossref PubMed Scopus (334) Google Scholar,7Tucker M.E. Benton M.J. Triassic environments, climates and reptile evolution.Palaeogeogr. Palaeoclimatol. Palaeoecol. 1982; 40: 361-379https://doi.org/10.1016/0031-0182(82)90034-7Crossref Scopus (89) Google Scholar,8Benton M.J. Dinosaur success in the triassic: a noncompetitive ecological model.Q. Rev. Biol. 1983; 58: 29-55Crossref Scopus (170) Google Scholar However, this pattern could instead be a response to changes in global climatic distributions through the Triassic to Jurassic transition, especially given the increasing evidence that climate played a key role in constraining Triassic dinosaur distributions.7Tucker M.E. Benton M.J. Triassic environments, climates and reptile evolution.Palaeogeogr. Palaeoclimatol. Palaeoecol. 1982; 40: 361-379https://doi.org/10.1016/0031-0182(82)90034-7Crossref Scopus (89) Google Scholar,9Whiteside J.H. Lindström S. Irmis R.B. Glasspool I.J. Schaller M.F. Dunlavey M. Nesbitt S.J. Smith N.D. Turner A.H. Extreme ecosystem instability suppressed tropical dinosaur dominance for 30 million years.Proc. Natl. Acad. Sci. USA. 2015; 112: 7909-7913https://doi.org/10.1073/pnas.1505252112Crossref PubMed Scopus (61) Google Scholar,10Bernardi M. Gianolla P. Petti F.M. Mietto P. Benton M.J. Dinosaur diversification linked with the Carnian pluvial episode.Nat. Commun. 2018; 9: 1499https://doi.org/10.1038/s41467-018-03996-1Crossref PubMed Scopus (87) Google Scholar,11Lovelace D.M. Hartman S.A. Mathewson P.D. Linzmeier B.J. Porter W.P. Modeling Dragons: using linked mechanistic physiological and microclimate models to explore environmental, physiological, and morphological constraints on the early evolution of dinosaurs.PLoS One. 2020; 15e0223872https://doi.org/10.1371/journal.pone.0223872Crossref Scopus (8) Google Scholar,12Mancuso A.C. Benavente C.A. Irmis R.B. Mundil R. Evidence for the Carnian pluvial episode in Gondwana: new multiproxy climate records and their bearing on early dinosaur diversification.Gondwana Res. 2020; 86: 104-125https://doi.org/10.1016/j.gr.2020.05.009Crossref Scopus (35) Google Scholar,13Mancuso A.C. Irmis R.B. Pedernera T.E. Gaetano L.C. Benavente C.A. Breeden III B.T. Paleoenvironmental and biotic changes in the late triassic of Argentina: testing hypotheses of abiotic forcing at the basin scale.Front. Earth Sci. 2022; 10https://doi.org/10.3389/feart.2022.883788Crossref PubMed Scopus (4) Google Scholar,14Kent D.V. Clemmensen L.B. Northward dispersal of dinosaurs from Gondwana to Greenland at the mid-Norian (215–212 Ma, Late Triassic) dip in atmospheric pCO2.Proc. Natl. Acad. Sci. USA. 2021; 118e2020778118https://doi.org/10.1073/pnas.2020778118Crossref Scopus (16) Google Scholar,15Griffin C.T. Wynd B.M. Munyikwa D. Broderick T.J. Zondo M. Tolan S. Langer M.C. Nesbitt S.J. Taruvinga H.R. Africa\'s oldest dinosaurs reveal early suppression of dinosaur distribution.Nature. 2022; 609: 313-319https://doi.org/10.1038/s41586-022-05133-xCrossref PubMed Scopus (4) Google Scholar,16Olsen P. Sha J. Fang Y. Chang C. Whiteside J.H. Kinney S. Sues H.-D. Kent D. Schaller M. Vajda V. Arctic ice and the ecological rise of the dinosaurs.Sci. Adv. 2022; 8eabo6342https://doi.org/10.1126/sciadv.abo6342Crossref Scopus (5) Google Scholar Here, we test this hypothesis and elucidate how climate influenced early dinosaur distribution by quantitatively examining changes in dinosaur and tetrapod "climatic niche space" across the Triassic-Jurassic boundary. Statistical analyses show that Late Triassic sauropodomorph dinosaurs occupied a more restricted climatic niche space than other tetrapods and dinosaurs, being excluded from the hottest, low-latitude climate zones. A subsequent, earliest Jurassic expansion of sauropodomorph geographic distribution is linked to the expansion of their preferred climatic conditions. Evolutionary model-fitting analyses provide evidence for an important evolutionary shift from cooler to warmer climatic niches during the origin of Sauropoda. These results are consistent with the hypothesis that global abundance of sauropodomorph dinosaurs was facilitated by climatic change and provide support for the key role of climate in the ascendancy of dinosaurs.'],
    ["The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.", 'The development of technologies to slow climate change has been identified as a global imperative. Nonetheless, such ‘green’ technologies can potentially have negative impacts on biodiversity. We explored how climate change and the mining of lithium for green technologies influence surface water availability, primary productivity and the abundance of three threatened and economically important flamingo species in the ‘Lithium Triangle’ of the Chilean Andes. We combined climate and primary productivity data with remotely sensed measures of surface water levels and a 30-year dataset on flamingo abundance using structural equation modelling. We found that, regionally, flamingo abundance fluctuated dramatically from year-to-year in response to variation in surface water levels and primary productivity but did not exhibit any temporal trends. Locally, in the Salar de Atacama—where lithium mining is focused—we found that mining was negatively correlated with the abundance of two of the three flamingo species. These results suggest continued increases in lithium mining and declines in surface water could soon have dramatic effects on flamingo abundance across their range. Efforts to slow the expansion of mining and the impacts of climate change are, therefore, urgently needed to benefit local biodiversity and the local human economy that depends on it.'],
    ["The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.", 'Rivers can abruptly shift pathways in rare events called avulsions, which cause devastating floods. The controls on avulsion locations are poorly understood as a result of sparse data on such features. We analyzed nearly 50 years of satellite imagery and documented 113 avulsions across the globe that indicate three distinct controls on avulsion location. Avulsions on fans coincide with valley-confinement change, whereas avulsions on deltas are primarily clustered within the backwater zone, indicating a control by spatial flow deceleration or acceleration during floods. However, 38% of avulsions on deltas occurred upstream of backwater effects. These events occurred in steep, sediment-rich rivers in tropical and desert environments. Our results indicate that avulsion location on deltas is set by the upstream extent of flood-driven erosion, which is typically limited to the backwater zone but can extend far upstream in steep, sediment-laden rivers. Our findings elucidate how avulsion hazards might respond to land use and climate change.'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    "The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.",
    [
        'Currently there is renewed interest in harnessing the vast tidal resource to combat the twin challenges of climate change and energy security. However, within the UK no tidal barrage proposals have passed the development stage, this is due to a combination of high cost and environmental concerns. This paper demonstrates how a framework, such as the North West Hydro Resource Model can be applied to tidal barrages, with the Mersey barrage as a case study. The model materialised in order to provide developers with a tool to successfully identify the capacity of hydropower schemes in a specific location. A key feature of the resource model is the understanding that there is no single barrier to the utilisation of small hydropower but several obstacles, which together impede development. Thus, this paper contributes in part to a fully holistic treatment of tidal barrages, recognising that apart from energy generation, other environmental, societal and economic opportunities arise and must be fully investigated for robust decision-making. This study demonstrates how considering the societal needs of the people and the necessity for compensatory habitats, for example, an organic architectural design has developed, which aims to enhance rather than detract from the Mersey.',
        'Rainbows contribute to human wellbeing by providing an inspiring connection to nature. Because the rainbow is an atmospheric optical phenomenon that results from the refraction of sunlight by rainwater droplets, changes in precipitation and cloud cover due to anthropogenic climate forcing will alter rainbow distribution. Yet, we lack a basic understanding of the current spatial distribution of rainbows and how climate change might alter this pattern. To assess how climate change might affect rainbow viewing opportunities, we developed a global database of crowd-sourced photographed rainbows, trained an empirical model of rainbow occurrence, and applied this model to present-day climate and three future climate scenarios. Results suggest that the average terrestrial location on Earth currently has 117 ± 71 days per year with conditions suitable for rainbows. By 2100, climate change is likely to generate a 4.0–4.9 % net increase in mean global annual rainbow-days (i.e., days with at least one rainbow), with the greatest change under the highest emission scenario. Around 21–34 % of land areas will lose rainbow-days and 66–79 % will gain rainbow-days, with rainbow gain hotspots mainly in high-latitude and high-elevation regions with smaller human populations. Our research demonstrates that alterations to non-tangible environmental attributes due to climate change could be significant and are worthy of consideration and mitigation.',
        'The ascendancy of dinosaurs to become dominant components of terrestrial ecosystems was a pivotal event in the history of life, yet the drivers of their early evolution and biodiversity are poorly understood.1Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. The first 50 Myr of dinosaur evolution: macroevolutionary pattern and morphological disparity.Biol. Lett. 2008; 4: 733-736https://doi.org/10.1098/rsbl.2008.0441Crossref PubMed Scopus (105) Google Scholar,2Irmis R.B. Evaluating hypotheses for the early diversification of dinosaurs.Earth Environ. Sci. Trans. R. Soc. Edinb. 2010; 101: 397-426https://doi.org/10.1017/S1755691011020068Crossref Scopus (94) Google Scholar,3Benton M.J. Forth J. Langer M.C. Models for the rise of the dinosaurs.Curr. Biol. 2014; 24: R87-R95https://doi.org/10.1016/j.cub.2013.11.063Abstract Full Text Full Text PDF PubMed Scopus (93) Google Scholar During their early diversification in the Late Triassic, dinosaurs were initially rare and geographically restricted, only attaining wider distributions and greater abundance following the end-Triassic mass extinction event.4Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. Superiority, competition, and opportunism in the evolutionary radiation of dinosaurs.Science. 2008; 321: 1485-1488https://doi.org/10.1126/science.1161833Crossref PubMed Scopus (334) Google Scholar,5Langer M.C. Ezcurra M.D. Bittencourt J.S. Novas F.E. The origin and early evolution of dinosaurs.Biol. Rev. Camb. Philos. Soc. 2010; 85: 55-110https://doi.org/10.1111/j.1469-185X.2009.00094.xCrossref PubMed Scopus (212) Google Scholar,6Langer M.C. Godoy P.L. So volcanoes created the dinosaurs? a quantitative characterization of the early evolution of terrestrial pan-aves.Front. Earth Sci. 2022; 10https://doi.org/10.3389/feart.2022.899562Crossref PubMed Scopus (3) Google Scholar This pattern is consistent with an opportunistic expansion model, initiated by the extinction of co-occurring groups such as aetosaurs, rauisuchians, and therapsids.4Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. Superiority, competition, and opportunism in the evolutionary radiation of dinosaurs.Science. 2008; 321: 1485-1488https://doi.org/10.1126/science.1161833Crossref PubMed Scopus (334) Google Scholar,7Tucker M.E. Benton M.J. Triassic environments, climates and reptile evolution.Palaeogeogr. Palaeoclimatol. Palaeoecol. 1982; 40: 361-379https://doi.org/10.1016/0031-0182(82)90034-7Crossref Scopus (89) Google Scholar,8Benton M.J. Dinosaur success in the triassic: a noncompetitive ecological model.Q. Rev. Biol. 1983; 58: 29-55Crossref Scopus (170) Google Scholar However, this pattern could instead be a response to changes in global climatic distributions through the Triassic to Jurassic transition, especially given the increasing evidence that climate played a key role in constraining Triassic dinosaur distributions.7Tucker M.E. Benton M.J. Triassic environments, climates and reptile evolution.Palaeogeogr. Palaeoclimatol. Palaeoecol. 1982; 40: 361-379https://doi.org/10.1016/0031-0182(82)90034-7Crossref Scopus (89) Google Scholar,9Whiteside J.H. Lindström S. Irmis R.B. Glasspool I.J. Schaller M.F. Dunlavey M. Nesbitt S.J. Smith N.D. Turner A.H. Extreme ecosystem instability suppressed tropical dinosaur dominance for 30 million years.Proc. Natl. Acad. Sci. USA. 2015; 112: 7909-7913https://doi.org/10.1073/pnas.1505252112Crossref PubMed Scopus (61) Google Scholar,10Bernardi M. Gianolla P. Petti F.M. Mietto P. Benton M.J. Dinosaur diversification linked with the Carnian pluvial episode.Nat. Commun. 2018; 9: 1499https://doi.org/10.1038/s41467-018-03996-1Crossref PubMed Scopus (87) Google Scholar,11Lovelace D.M. Hartman S.A. Mathewson P.D. Linzmeier B.J. Porter W.P. Modeling Dragons: using linked mechanistic physiological and microclimate models to explore environmental, physiological, and morphological constraints on the early evolution of dinosaurs.PLoS One. 2020; 15e0223872https://doi.org/10.1371/journal.pone.0223872Crossref Scopus (8) Google Scholar,12Mancuso A.C. Benavente C.A. Irmis R.B. Mundil R. Evidence for the Carnian pluvial episode in Gondwana: new multiproxy climate records and their bearing on early dinosaur diversification.Gondwana Res. 2020; 86: 104-125https://doi.org/10.1016/j.gr.2020.05.009Crossref Scopus (35) Google Scholar,13Mancuso A.C. Irmis R.B. Pedernera T.E. Gaetano L.C. Benavente C.A. Breeden III B.T. Paleoenvironmental and biotic changes in the late triassic of Argentina: testing hypotheses of abiotic forcing at the basin scale.Front. Earth Sci. 2022; 10https://doi.org/10.3389/feart.2022.883788Crossref PubMed Scopus (4) Google Scholar,14Kent D.V. Clemmensen L.B. Northward dispersal of dinosaurs from Gondwana to Greenland at the mid-Norian (215–212 Ma, Late Triassic) dip in atmospheric pCO2.Proc. Natl. Acad. Sci. USA. 2021; 118e2020778118https://doi.org/10.1073/pnas.2020778118Crossref Scopus (16) Google Scholar,15Griffin C.T. Wynd B.M. Munyikwa D. Broderick T.J. Zondo M. Tolan S. Langer M.C. Nesbitt S.J. Taruvinga H.R. Africa\'s oldest dinosaurs reveal early suppression of dinosaur distribution.Nature. 2022; 609: 313-319https://doi.org/10.1038/s41586-022-05133-xCrossref PubMed Scopus (4) Google Scholar,16Olsen P. Sha J. Fang Y. Chang C. Whiteside J.H. Kinney S. Sues H.-D. Kent D. Schaller M. Vajda V. Arctic ice and the ecological rise of the dinosaurs.Sci. Adv. 2022; 8eabo6342https://doi.org/10.1126/sciadv.abo6342Crossref Scopus (5) Google Scholar Here, we test this hypothesis and elucidate how climate influenced early dinosaur distribution by quantitatively examining changes in dinosaur and tetrapod "climatic niche space" across the Triassic-Jurassic boundary. Statistical analyses show that Late Triassic sauropodomorph dinosaurs occupied a more restricted climatic niche space than other tetrapods and dinosaurs, being excluded from the hottest, low-latitude climate zones. A subsequent, earliest Jurassic expansion of sauropodomorph geographic distribution is linked to the expansion of their preferred climatic conditions. Evolutionary model-fitting analyses provide evidence for an important evolutionary shift from cooler to warmer climatic niches during the origin of Sauropoda. These results are consistent with the hypothesis that global abundance of sauropodomorph dinosaurs was facilitated by climatic change and provide support for the key role of climate in the ascendancy of dinosaurs.',
        'The development of technologies to slow climate change has been identified as a global imperative. Nonetheless, such ‘green’ technologies can potentially have negative impacts on biodiversity. We explored how climate change and the mining of lithium for green technologies influence surface water availability, primary productivity and the abundance of three threatened and economically important flamingo species in the ‘Lithium Triangle’ of the Chilean Andes. We combined climate and primary productivity data with remotely sensed measures of surface water levels and a 30-year dataset on flamingo abundance using structural equation modelling. We found that, regionally, flamingo abundance fluctuated dramatically from year-to-year in response to variation in surface water levels and primary productivity but did not exhibit any temporal trends. Locally, in the Salar de Atacama—where lithium mining is focused—we found that mining was negatively correlated with the abundance of two of the three flamingo species. These results suggest continued increases in lithium mining and declines in surface water could soon have dramatic effects on flamingo abundance across their range. Efforts to slow the expansion of mining and the impacts of climate change are, therefore, urgently needed to benefit local biodiversity and the local human economy that depends on it.',
        'Rivers can abruptly shift pathways in rare events called avulsions, which cause devastating floods. The controls on avulsion locations are poorly understood as a result of sparse data on such features. We analyzed nearly 50 years of satellite imagery and documented 113 avulsions across the globe that indicate three distinct controls on avulsion location. Avulsions on fans coincide with valley-confinement change, whereas avulsions on deltas are primarily clustered within the backwater zone, indicating a control by spatial flow deceleration or acceleration during floods. However, 38% of avulsions on deltas occurred upstream of backwater effects. These events occurred in steep, sediment-rich rivers in tropical and desert environments. Our results indicate that avulsion location on deltas is set by the upstream extent of flood-driven erosion, which is typically limited to the backwater zone but can extend far upstream in steep, sediment-laden rivers. Our findings elucidate how avulsion hazards might respond to land use and climate change.',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Evaluation

Metrics

Cross Encoder Reranking

Dataset: climate-science-eval

Evaluated with CrossEncoderRerankingEvaluator with these parameters:

{
    "at_k": 10,
    "always_rerank_positives": true
}

Metric	Value
map	0.6629 (+0.4483)
mrr@10	0.6554 (+0.4475)
ndcg@10	0.7068 (+0.4669)

Training Details

Training Dataset

Unnamed Dataset

Size: 263,476 training samples
Columns: query, answer, and label

Approximate statistics based on the first 1000 samples:

	query	answer	label
type	string	string	int
details	min: 55 characters mean: 178.19 characters max: 593 characters	min: 13 characters mean: 1510.36 characters max: 29945 characters	0: ~74.40% 1: ~25.60%

Samples:

query	answer	label
`The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.`	Currently there is renewed interest in harnessing the vast tidal resource to combat the twin challenges of climate change and energy security. However, within the UK no tidal barrage proposals have passed the development stage, this is due to a combination of high cost and environmental concerns. This paper demonstrates how a framework, such as the North West Hydro Resource Model can be applied to tidal barrages, with the Mersey barrage as a case study. The model materialised in order to provide developers with a tool to successfully identify the capacity of hydropower schemes in a specific location. A key feature of the resource model is the understanding that there is no single barrier to the utilisation of small hydropower but several obstacles, which together impede development. Thus, this paper contributes in part to a fully holistic treatment of tidal barrages, recognising that apart from energy generation, other environmental, societal and economic opportunities arise and must b...	`1`
`The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.`	Rainbows contribute to human wellbeing by providing an inspiring connection to nature. Because the rainbow is an atmospheric optical phenomenon that results from the refraction of sunlight by rainwater droplets, changes in precipitation and cloud cover due to anthropogenic climate forcing will alter rainbow distribution. Yet, we lack a basic understanding of the current spatial distribution of rainbows and how climate change might alter this pattern. To assess how climate change might affect rainbow viewing opportunities, we developed a global database of crowd-sourced photographed rainbows, trained an empirical model of rainbow occurrence, and applied this model to present-day climate and three future climate scenarios. Results suggest that the average terrestrial location on Earth currently has 117 ± 71 days per year with conditions suitable for rainbows. By 2100, climate change is likely to generate a 4.0–4.9 % net increase in mean global annual rainbow-days (i.e., days with at leas...	`0`
`The researchers say that with the right design a Mersey barrage has the potential to become a globally identifiable piece of architectural infrastructure - a 'hydropower landmark' boosting tourism to the region.`	The ascendancy of dinosaurs to become dominant components of terrestrial ecosystems was a pivotal event in the history of life, yet the drivers of their early evolution and biodiversity are poorly understood.1Brusatte S.L. Benton M.J. Ruta M. Lloyd G.T. The first 50 Myr of dinosaur evolution: macroevolutionary pattern and morphological disparity.Biol. Lett. 2008; 4: 733-736https://doi.org/10.1098/rsbl.2008.0441Crossref PubMed Scopus (105) Google Scholar,2Irmis R.B. Evaluating hypotheses for the early diversification of dinosaurs.Earth Environ. Sci. Trans. R. Soc. Edinb. 2010; 101: 397-426https://doi.org/10.1017/S1755691011020068Crossref Scopus (94) Google Scholar,3Benton M.J. Forth J. Langer M.C. Models for the rise of the dinosaurs.Curr. Biol. 2014; 24: R87-R95https://doi.org/10.1016/j.cub.2013.11.063Abstract Full Text Full Text PDF PubMed Scopus (93) Google Scholar During their early diversification in the Late Triassic, dinosaurs were initially rare and geographically restricted, on...	`0`

Loss: BinaryCrossEntropyLoss with these parameters:

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": 6
}

Training Hyperparameters

Non-Default Hyperparameters

eval_strategy: steps
per_device_train_batch_size: 16
per_device_eval_batch_size: 16
learning_rate: 2e-05
warmup_ratio: 0.1
fp16: True
dataloader_num_workers: 4
load_best_model_at_end: True

All Hyperparameters

Click to expand

overwrite_output_dir: False
do_predict: False
eval_strategy: steps
prediction_loss_only: True
per_device_train_batch_size: 16
per_device_eval_batch_size: 16
per_gpu_train_batch_size: None
per_gpu_eval_batch_size: None
gradient_accumulation_steps: 1
eval_accumulation_steps: None
torch_empty_cache_steps: None
learning_rate: 2e-05
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1.0
num_train_epochs: 3
max_steps: -1
lr_scheduler_type: linear
lr_scheduler_kwargs: {}
warmup_ratio: 0.1
warmup_steps: 0
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
save_safetensors: True
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
no_cuda: False
use_cpu: False
use_mps_device: False
seed: 42
data_seed: None
jit_mode_eval: False
use_ipex: False
bf16: False
fp16: True
fp16_opt_level: O1
half_precision_backend: auto
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: 0
ddp_backend: None
tpu_num_cores: None
tpu_metrics_debug: False
debug: []
dataloader_drop_last: False
dataloader_num_workers: 4
dataloader_prefetch_factor: None
past_index: -1
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: True
ignore_data_skip: False
fsdp: []
fsdp_min_num_params: 0
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
tp_size: 0
fsdp_transformer_layer_cls_to_wrap: None
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch
optim_args: None
adafactor: False
group_by_length: False
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
use_legacy_prediction_loop: False
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: None
hub_always_push: False
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_inputs_for_metrics: False
include_for_metrics: []
eval_do_concat_batches: True
fp16_backend: auto
push_to_hub_model_id: None
push_to_hub_organization: None
mp_parameters:
auto_find_batch_size: False
full_determinism: False
torchdynamo: None
ray_scope: last
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
include_tokens_per_second: False
include_num_input_tokens_seen: False
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
use_liger_kernel: False
eval_use_gather_object: False
average_tokens_across_devices: False
prompts: None
batch_sampler: batch_sampler
multi_dataset_batch_sampler: proportional

Training Logs