Abstract

The unifying element of all biodiversity data is the issue of taxon hierarchy modeling. We compared 25 existing databases in terms of handling taxa hierarchy and presentation of this data. We used documentation or demo installations of databases as a source of information and next in line was the analysis of structures using R packages provided by inspected platforms. If neither of these was available, we used the public interface of individual databases. For almost half (12) of the databases analyzed, we did not find any formalized taxa hierarchy data structure, providing only biological information about taxon membership in higher ranks, which is not fully formalizable and thus not generally usable. The least effective Adjacency List model (storing parentId of a taxon) dominates among the remaining providers. This study demonstrates the lack of attention paid by current biodiversity databases to modeling taxon hierarchy, particularly to making it available to researchers in the form of a hierarchical data structure within the data provided. For biodiversity relational databases, the Closure Table type is the most suitable of the known data models, which also corresponds to the ontology concept. However, its use is rather sporadic within the biodiversity databases ecosystem.

Introduction

There is a rich discussion around the concept of a taxon in biodiversity databases, focused on the “suitability/correctness of the database model.” In our text, we want to take a step aside from the dominant conceptual debate, i.e. whether indeed from a biologist’s perspective taxon concepts “are often incorrectly modeled in biodiversity databases” [1], and instead look at how efficiently, technically useful, and “usable” hierarchical structures are modeled in them. We are motivated by the insight that the software making data available is similarly critical to the data themselves [2], and the retroactive impact of databases on the user community is rising in importance. The sum of their conceptual and technical properties has a major impact on how researchers conduct and communicate their research [3].

However, let us first recall a source of tension in the field of biodiversity data models, i.e., in our opinion, we make little distinction between the various aspects of such an assessment. At the conceptual level, it is crucial to distinguish whether biodiversity databases are expected to model natural reality or the taxonomy methodology. If a given database is supposed to model “natural reality,” then conceptually it is based on the idea that the naturalness of e.g. vascular plant taxa—their unique origin and coherence through time—is thought to exist independently of human classifications [4] and is thus permissible to exist only single one concept of a taxon.

A very different case arises if the database is to model the “processes of taxonomy,” i.e. the multidimensional universe of relationships between publications, names, herbarium specimens, and past and present meanings (more detailed in [4]). The appropriateness of the database model is incomparable in these cases—they are different models of different objects. Grenié et al. [5] aptly use a typology of biodiversity databases when they talk about taxonomic breadth and spatial scale. These features, as such cases that are not globally oriented databases, are perhaps not accidental imperfections, but the foundation of a different conceptual focus which very likely requires a different database model.

Therefore, the adequacy of a database model needs to be viewed from multiple perspectives—whether it is conceptual consistency with the modeled reality, consistency with the conventions of the professional community, or the adequacy of the abstraction used to the practical needs of users.

In the technical sense, a model is the medium to record the structure of an object in a more or less abstract way, following predefined and documented rules [6]. Hierarchical structures are a very typical and important structure in the field of bioinformatics [7]. Whether a biodiversity database operates with a hierarchy of names (i.e. biological database designs ignoring complexity by using only taxon names to identify taxa [8]), taxon concepts/potential taxa (6 and following), or any other concept of biodiversity, the unifying element is the presence of entities that are arranged in a hierarchical or tree structure [9]. This type of structure is found in many other areas of human concern and as such is well studied.

The decision of the appropriate model for hierarchical data significantly affects not only the internal database processes but also the ergonomics of data analysis and processing by users. We have therefore focused on the analysis of modeling tree structures in relational biodiversity databases, which are currently used by most institutions to facilitate the management and accessibility of biodiversity data [1].

Description

The hierarchical organization of data is used very often, e.g., in the computer file system, the territorial-administrative division, or the biological system, but the question of modeling hierarchy in biodiversity databases is still little discussed in the professional discourse, and therefore, in addition to presenting the theoretical aspects, we have set as an objective. In this section, we will use the established terms node, root, parent, child, direct child, sibling, branch, and leaf for a clear description of hierarchical structures (see Fig. 1 for more details).

Alt text: Three-row diagram. In the top row is node A, from it arrows lead to nodes B and C in the middle row. Node D is located on the bottom row and the arrow from node C points to it.
Figure 1.

Terminology of tree elements used in this paper. A is a root node, C is a direct parent of D, B is a sibling of C. Nodes C + D represent a branch while nodes B and D are leaves, as they have no children.

The graph theory deals with hierarchical data as a directed acyclic graph (DAG), which is a directed graph with no directed cycles. Trees are used for classification purposes, i.e. to provide a unique location of a node in the structure. Trees are a subset of DAGs specific in that a child can only have one parent, so called by another name the uniparental DAG (i.e. they conform to the convention that lichens, e.g., are not classified into both higher taxa, but always into just one fungal parent). At this point, we will narrow the description to tree structures only, but we will return to the issue of multiparental DAGs in the context of biodiversity modeling in the discussion.

Four approaches are generally used for storing tree structures in relational databases, see Celko [10] for more details, each of which brings certain advantages, and the specific choice is influenced by the context of use. A brief overview is given in Table 1, while the specific data form for each hierarchical structure model is presented in Fig. 2.

Alt text: For each of the four data models discussed, present a three-row diagram showing the ABCD node structure, supplemented by the values of the database columns used to store the hierarchy. Each diagram is accompanied by a listing of the database table rows for the ABCD nodes.
Figure 2.

Visualization of the tree and the minimum necessary content of data tables for each data model; blue symbols represent structures used for storing the tree hierarchy.

Table 1.

Overview of relational database tree data modeling approaches with basic characteristics

Adjacency ListMaterialized PathNested SetClosure Table
Basic mechanismEach node has its parent’s ID storedEach node has its full hierarchical position storedThe whole tree is double-sided numberedEach node has a defined link to itself and all its descendants
Minimal count of tables used for objects1112 (hierarchy is separated from objects)
Implementation relevance
Reading subtree performanceLowMediumHighHigh
Add/move node performanceHighMediumLowMedium to low
“ontogeny” capableNoNoNoYes
Users’ relevance
Implicit preservation of sibling nodes orderNoNoYesNo
Ease of filtering “in Excel”LowMediumHighLow
Ease of editing “in Excel”HighMediumLowMedium
Adjacency ListMaterialized PathNested SetClosure Table
Basic mechanismEach node has its parent’s ID storedEach node has its full hierarchical position storedThe whole tree is double-sided numberedEach node has a defined link to itself and all its descendants
Minimal count of tables used for objects1112 (hierarchy is separated from objects)
Implementation relevance
Reading subtree performanceLowMediumHighHigh
Add/move node performanceHighMediumLowMedium to low
“ontogeny” capableNoNoNoYes
Users’ relevance
Implicit preservation of sibling nodes orderNoNoYesNo
Ease of filtering “in Excel”LowMediumHighLow
Ease of editing “in Excel”HighMediumLowMedium

Classification of performance level is only indicative, as it depends on tree size or edited/added node position. The ontogeny capability refers to implicit opportunity in modeling more types of relationships besides the default parent–child relationship. “Users’ relevance” represents the usability of the hierarchy model when data are downloaded and processed in simple data settings, like in a spreadsheet.

Table 1.

Overview of relational database tree data modeling approaches with basic characteristics

Adjacency ListMaterialized PathNested SetClosure Table
Basic mechanismEach node has its parent’s ID storedEach node has its full hierarchical position storedThe whole tree is double-sided numberedEach node has a defined link to itself and all its descendants
Minimal count of tables used for objects1112 (hierarchy is separated from objects)
Implementation relevance
Reading subtree performanceLowMediumHighHigh
Add/move node performanceHighMediumLowMedium to low
“ontogeny” capableNoNoNoYes
Users’ relevance
Implicit preservation of sibling nodes orderNoNoYesNo
Ease of filtering “in Excel”LowMediumHighLow
Ease of editing “in Excel”HighMediumLowMedium
Adjacency ListMaterialized PathNested SetClosure Table
Basic mechanismEach node has its parent’s ID storedEach node has its full hierarchical position storedThe whole tree is double-sided numberedEach node has a defined link to itself and all its descendants
Minimal count of tables used for objects1112 (hierarchy is separated from objects)
Implementation relevance
Reading subtree performanceLowMediumHighHigh
Add/move node performanceHighMediumLowMedium to low
“ontogeny” capableNoNoNoYes
Users’ relevance
Implicit preservation of sibling nodes orderNoNoYesNo
Ease of filtering “in Excel”LowMediumHighLow
Ease of editing “in Excel”HighMediumLowMedium

Classification of performance level is only indicative, as it depends on tree size or edited/added node position. The ontogeny capability refers to implicit opportunity in modeling more types of relationships besides the default parent–child relationship. “Users’ relevance” represents the usability of the hierarchy model when data are downloaded and processed in simple data settings, like in a spreadsheet.

Adjacency List

It represents an intuitive tree structure model, where the classification is realized in the model employing a recursive relationship between entities of entities. It is generally understandable and easy to maintain even for a layman creating his tree in a spreadsheet. It has been used by historical information model designs for (mostly botanical) databases (like [6, 8, 11, 12]). Its main weaknesses lie in read operations where it requires recursive procedures.

Materialized Path

The Materialized Path model stores at each tree node the complete “path” of the node’s ancestors. Although the Materialized Path requires working with strings and regular expressions, it provides more flexibility in working with the tree than the previous model.

Nested set

The Nested Set model identifies each node’s position in the tree as stops in a round-trip traversal of the tree starting on the “left” side of the node. The traversal visits each node in the tree twice assigning numbers in the order of visiting, and at both visits. This results in two numbers for each node, which are stored as two attributes.

Although the entire hierarchy is determined by left + right values, for practical use it is useful to add a redundant depth value to the data structure. Attribute depth is dynamically computable, but storing it statically speeds up tree searches and facilitates direct queries, e.g. on direct descendants/parents.

Closure Table

The most general tree modeling approach is a Closure Table model. In this model, the relationships are kept in a separate table. It is very important that it can discern different types of relationships, i.e. it can model not only parent–child relationships but also multiparental structures or other relational structures essential for biology. This approach, being similar to ontogenies has the potential to be familiar to biodiversity database users.

In regards to the overall load on the database biodiversity backbone, the most common queries are read-only, and they are often requested at the level of aggregated branches (e.g. species occurrence including subspecies), rather than individual nodes. Parent lookup operations or clustering of branches across a tree are very common and in demand [7, 13].

Therefore, fast read rates at the node and branch level will be an important criterion for selecting a model in terms of internal implementation. The Nested Set and Closure Table models seem to be suitable, which can be indexed very efficiently and therefore searched quickly. Writing a new node or moving an existing one is usually a nonbottleneck operation in biodiversity databases and its computational complexity will play a less important role in model selection. Related to the editing of hierarchies is also the issue of preserving a record of these changes; we will return to this important aspect in the context of biodiversity databases in our discussion.

A common request for trees is also a fixed ordering of the descendants of a given node, e.g. corresponding to the phylogenetic background of taxa [7]. Although it is not difficult to store the order of siblings as metadata to the parent tree, the Nested Set model has the advantage of implicitly containing this information. Thus, if a database export intended for users contains tree structure information, the Nested Set ordering is an advantage.

In Table 1 we also included characteristics that are oriented to the database user, i.e. the usability of individual modeling approaches in a pure user environment, e.g. in an Excel spreadsheet (or simple dplyr-style operations in R) that the user downloads from the biodiversity database. Again, we consider the operation of reading and filtering the data as essential; the need to edit the hierarchy is rather theoretical but we present it to emphasize the fact that no modeling strategy is ideal in all its aspects. While in Adjacency List and Materialized Path, the read operation over the tree is at the level of more or less manual work, the two more derived models have much better properties. Some common tasks are demonstrated in Table 2. A complication for the Closure Table is the separation of the data and hierarchical structure into two independent tables which requires a join between the two tables.

Table 2.

Common filtering tasks on tree modeled with Nested Set and Closure Table

Filtering taskNested Set modelaClosure Table model
All parentslft < node.lft && rgt > node.rgtdescendant_id == node.id && depth > 0
Direct parentlft < node.lft && rgt > node.rgt && depth == node.depth—1descendant_id == node.id && depth =1
Subtreelft > node.lft && rgt < node.rgtparent_id == node.id && depth > 0
Subtree including subtree-rootlft ≥ node.lft && rgt ≤ node.rgtparent_id == node.id
Direct childernlft > node.lft && rgt < node.rgt && depth == node.depth + 1parent_id == node.id && depth = 1
Is leaf (have no children)lft == rgt-1NOT EXISTS (parent_id == node.id && depth > 0)
Is rootdepth == 0NOT EXISTS (descendant_id == node.id && depth > 0)
Filtering taskNested Set modelaClosure Table model
All parentslft < node.lft && rgt > node.rgtdescendant_id == node.id && depth > 0
Direct parentlft < node.lft && rgt > node.rgt && depth == node.depth—1descendant_id == node.id && depth =1
Subtreelft > node.lft && rgt < node.rgtparent_id == node.id && depth > 0
Subtree including subtree-rootlft ≥ node.lft && rgt ≤ node.rgtparent_id == node.id
Direct childernlft > node.lft && rgt < node.rgt && depth == node.depth + 1parent_id == node.id && depth = 1
Is leaf (have no children)lft == rgt-1NOT EXISTS (parent_id == node.id && depth > 0)
Is rootdepth == 0NOT EXISTS (descendant_id == node.id && depth > 0)
a

Ascending sort by node.lft provides hierarchically ordered results including the order of siblings.

“Node” represents the node of the structure we are referring to, “node.lft” is “lft” value of this node. Characters “&&” represent logical conjunction, and characters “==“represent equality. In the case of Closure Table, the “node” column is stored in one table and all remaining necessary fields are in another table.

Table 2.

Common filtering tasks on tree modeled with Nested Set and Closure Table

Filtering taskNested Set modelaClosure Table model
All parentslft < node.lft && rgt > node.rgtdescendant_id == node.id && depth > 0
Direct parentlft < node.lft && rgt > node.rgt && depth == node.depth—1descendant_id == node.id && depth =1
Subtreelft > node.lft && rgt < node.rgtparent_id == node.id && depth > 0
Subtree including subtree-rootlft ≥ node.lft && rgt ≤ node.rgtparent_id == node.id
Direct childernlft > node.lft && rgt < node.rgt && depth == node.depth + 1parent_id == node.id && depth = 1
Is leaf (have no children)lft == rgt-1NOT EXISTS (parent_id == node.id && depth > 0)
Is rootdepth == 0NOT EXISTS (descendant_id == node.id && depth > 0)
Filtering taskNested Set modelaClosure Table model
All parentslft < node.lft && rgt > node.rgtdescendant_id == node.id && depth > 0
Direct parentlft < node.lft && rgt > node.rgt && depth == node.depth—1descendant_id == node.id && depth =1
Subtreelft > node.lft && rgt < node.rgtparent_id == node.id && depth > 0
Subtree including subtree-rootlft ≥ node.lft && rgt ≤ node.rgtparent_id == node.id
Direct childernlft > node.lft && rgt < node.rgt && depth == node.depth + 1parent_id == node.id && depth = 1
Is leaf (have no children)lft == rgt-1NOT EXISTS (parent_id == node.id && depth > 0)
Is rootdepth == 0NOT EXISTS (descendant_id == node.id && depth > 0)
a

Ascending sort by node.lft provides hierarchically ordered results including the order of siblings.

“Node” represents the node of the structure we are referring to, “node.lft” is “lft” value of this node. Characters “&&” represent logical conjunction, and characters “==“represent equality. In the case of Closure Table, the “node” column is stored in one table and all remaining necessary fields are in another table.

The possibility of alternative classifications, which is required for databases that model taxonomic processes [7, 8], is not implicit in any of these models. Thus, restricting to a single classification or allowing alternative classification schemes is a related decision at the level of implementation detail of a particular application, and the principled approaches to hierarchy modeling described remain identical.

Biology has its own, traditional way of modeling real biodiversity, biological systems, and taxonomy. In terms of the above classification, it could be seen as an “inconsistent implementation” of the Materialized Path model (especially for ranks genus and lower). However, the taxonomic model of biodiversity is difficult to formalize [9] due to, among other things, the concept of ranks, so although it is a necessary and fundamental model for the intellectual work of biologists, it is inappropriate for use in relational databases. To store a tree structure, one should use one of the approaches presented above and treat “biological concretization” such as names or ranks of biological entities as metadata of the nodes of this structure.

Materials and methods

To show the variability of approaches used in current solutions and to demonstrate the importance of the choice of model type in the context of their users, we analyzed a set of established databases to show which hierarchical structure modeling approaches today’s relational biodiversity databases use.

To objectify the selection of the included platforms, we used 12 well-established biodiversity databases as a basis according to the paper of Feng et al. [14], to which we added the herbarium systems reported by Gadelha Jr et al. [1]. We added four major global checklists of vascular plant names according to Schellenberger Costa et al. [15]. The last group of nine software platforms consists of local databases that we use ourselves or came across during our survey.

To determine how the tree structure is modeled in the database, we used only publicly available sources in the following order: the preferred source was the documentation or demo installations within which the database schema can be addressed directly. This was rather sporadic, i.e. if we were unsuccessful, we followed the second approach by using the R package used by the platform. In the case where neither of the previous methods led to the identification of any of the formalized hierarchy entries, we then proceeded to inspect the web interface of the public application and search for possible sources of information such as taxon exports.

If we were unable to download any export or to find more details in the documentation and we were only able to find information about the hierarchy by “reading on the web pages,” it is rated as “not identified.” There was also a case where it was possible to examine the relational structure of the database and confirm the absence of a hierarchical model of taxa, in which case is rated as “none.”

If we encountered only a rank-based hierarchy within a given platform, i.e. a relationally informalized model, is marked as “rank/biological.”

Results

In total, we analyzed 25 biodiversity software whose summary is given in Table 3. For about half of them (12 platforms) we did not find a formalized data structure to represent the hierarchy. For six cases in this group, the structure was represented using a biological system (i.e. columns for individual ranks); for five cases, we were unable to determine from publicly available sources whether and what type of hierarchy modeling they used, mainly because they do not offer a public interface for downloading taxon lists or similar functionality. For one (BRAHMS) we classified as “none” based on the database schema, a situation where it does not store the taxon hierarchy at all.

Table 3.

Overview of examined biodiversity software and navigation path leading to the approximation of the model used

DatabaseReferenceMedium used for inspectionExamined link/operationTree representation
“Big12” sensu Feng et al. [14]
Atlas of Living Australia[17]Web UIhttps://bie.ala.org.au/species/https://id.biodiversity.org.au/taxon/apni/51412617Adjacency List
Botanical Information and Ecology Network[18]R codeBIEN::BIEN_phylogeny_conservative(“Caryophyllales”)Object of class ape::phylo, i.e. Adjacency List
Biodiversity Information Serving Our NationNot inspected, moved to GBIF
eBird[19]Documentationhttps://www.birds.cornell.edu/clementschecklist/wp-content/uploads/2022/10/ebird_taxonomy_v2022.xlsxRank/biological
Encyclopedia of Life[20]DocumentationNeo4j graph database
Global Biodiversity Information Facility[21]GBIF Backbone Taxonomy download archive—CSV filehttps://hosted-datasets.gbif.org/datasets/backbone/current/Adjacency List
Global Inventory of Floras and Traits[22]R codeGIFT::GIFT_taxonomy()Nested Set
Integrated Digitized Biocollections[23]Web UIhttps://www.idigbio.org/portal/searchdwc:higherClassification darwin Core, i.e. Materialized Path
iNaturalist[24]Web UI/documentationNot identified
Map of Life[25]Web UIhttps://mol.org/regions/?regiontype=point&location=49.75105923257857,15.3416869909362rank/biological
Plant Trait Database[26]Web UI/documentationNot identified
VertNet[27]Web UIhttp://portal.vertnet.org/search?q=salamanderdwc:higherClassification darwin Core, i.e. Materialized Path
Global checklists of vascular plants
Leipzig Catalogue of Vascular Plants[28]R codelcvplants::lcvp_group_search(“Caryophyllaceae”, search_by = “Family”)Rank/biological
World Checklist of Vascular Plants[29]Raw data downloadhttp://sftp.kew.org/pub/data-repositories/WCVPRank/biological
World Flora Online[30]Raw data downloadhttp://www.worldfloraonline.org/downloadDataRank/biological
WorldPlants[31]Web UINot identified
Herbarium systems according Gadelha Jr et al. [1]
BG-BASE[32]DocumentationNot identified
BRAHMS[33]Demo database structurehttps://herbaria.plants.ox.ac.uk/bol/brahms/support/conifersNone
EMu[34]DocumentationNot identified
Specify[35]Documentationhttps://www.specifysoftware.org/specify-6-schema/Adjacency List
Others
Avibase[36]DocumentationAdjacency List
Biologer[37]DocumentationAdjacency List
Dyntaxa[38]DocumentationClosure Table
Finnish Biodiversity Information Facility[39]Web UIhttps://laji.fi/en/taxon/list?target=MX.70046&onlyFinnish=trueRank/biological
Pladias[40]Web UIhttps://pladias.ibot.cas.cz/query/taxonDetailsNested Set
TaxonWorks[41]Documentationhttps://docs.taxonworks.org/develop/Data/models.html#taxon-name-relationshipClosure Table
DatabaseReferenceMedium used for inspectionExamined link/operationTree representation
“Big12” sensu Feng et al. [14]
Atlas of Living Australia[17]Web UIhttps://bie.ala.org.au/species/https://id.biodiversity.org.au/taxon/apni/51412617Adjacency List
Botanical Information and Ecology Network[18]R codeBIEN::BIEN_phylogeny_conservative(“Caryophyllales”)Object of class ape::phylo, i.e. Adjacency List
Biodiversity Information Serving Our NationNot inspected, moved to GBIF
eBird[19]Documentationhttps://www.birds.cornell.edu/clementschecklist/wp-content/uploads/2022/10/ebird_taxonomy_v2022.xlsxRank/biological
Encyclopedia of Life[20]DocumentationNeo4j graph database
Global Biodiversity Information Facility[21]GBIF Backbone Taxonomy download archive—CSV filehttps://hosted-datasets.gbif.org/datasets/backbone/current/Adjacency List
Global Inventory of Floras and Traits[22]R codeGIFT::GIFT_taxonomy()Nested Set
Integrated Digitized Biocollections[23]Web UIhttps://www.idigbio.org/portal/searchdwc:higherClassification darwin Core, i.e. Materialized Path
iNaturalist[24]Web UI/documentationNot identified
Map of Life[25]Web UIhttps://mol.org/regions/?regiontype=point&location=49.75105923257857,15.3416869909362rank/biological
Plant Trait Database[26]Web UI/documentationNot identified
VertNet[27]Web UIhttp://portal.vertnet.org/search?q=salamanderdwc:higherClassification darwin Core, i.e. Materialized Path
Global checklists of vascular plants
Leipzig Catalogue of Vascular Plants[28]R codelcvplants::lcvp_group_search(“Caryophyllaceae”, search_by = “Family”)Rank/biological
World Checklist of Vascular Plants[29]Raw data downloadhttp://sftp.kew.org/pub/data-repositories/WCVPRank/biological
World Flora Online[30]Raw data downloadhttp://www.worldfloraonline.org/downloadDataRank/biological
WorldPlants[31]Web UINot identified
Herbarium systems according Gadelha Jr et al. [1]
BG-BASE[32]DocumentationNot identified
BRAHMS[33]Demo database structurehttps://herbaria.plants.ox.ac.uk/bol/brahms/support/conifersNone
EMu[34]DocumentationNot identified
Specify[35]Documentationhttps://www.specifysoftware.org/specify-6-schema/Adjacency List
Others
Avibase[36]DocumentationAdjacency List
Biologer[37]DocumentationAdjacency List
Dyntaxa[38]DocumentationClosure Table
Finnish Biodiversity Information Facility[39]Web UIhttps://laji.fi/en/taxon/list?target=MX.70046&onlyFinnish=trueRank/biological
Pladias[40]Web UIhttps://pladias.ibot.cas.cz/query/taxonDetailsNested Set
TaxonWorks[41]Documentationhttps://docs.taxonworks.org/develop/Data/models.html#taxon-name-relationshipClosure Table
Table 3.

Overview of examined biodiversity software and navigation path leading to the approximation of the model used

DatabaseReferenceMedium used for inspectionExamined link/operationTree representation
“Big12” sensu Feng et al. [14]
Atlas of Living Australia[17]Web UIhttps://bie.ala.org.au/species/https://id.biodiversity.org.au/taxon/apni/51412617Adjacency List
Botanical Information and Ecology Network[18]R codeBIEN::BIEN_phylogeny_conservative(“Caryophyllales”)Object of class ape::phylo, i.e. Adjacency List
Biodiversity Information Serving Our NationNot inspected, moved to GBIF
eBird[19]Documentationhttps://www.birds.cornell.edu/clementschecklist/wp-content/uploads/2022/10/ebird_taxonomy_v2022.xlsxRank/biological
Encyclopedia of Life[20]DocumentationNeo4j graph database
Global Biodiversity Information Facility[21]GBIF Backbone Taxonomy download archive—CSV filehttps://hosted-datasets.gbif.org/datasets/backbone/current/Adjacency List
Global Inventory of Floras and Traits[22]R codeGIFT::GIFT_taxonomy()Nested Set
Integrated Digitized Biocollections[23]Web UIhttps://www.idigbio.org/portal/searchdwc:higherClassification darwin Core, i.e. Materialized Path
iNaturalist[24]Web UI/documentationNot identified
Map of Life[25]Web UIhttps://mol.org/regions/?regiontype=point&location=49.75105923257857,15.3416869909362rank/biological
Plant Trait Database[26]Web UI/documentationNot identified
VertNet[27]Web UIhttp://portal.vertnet.org/search?q=salamanderdwc:higherClassification darwin Core, i.e. Materialized Path
Global checklists of vascular plants
Leipzig Catalogue of Vascular Plants[28]R codelcvplants::lcvp_group_search(“Caryophyllaceae”, search_by = “Family”)Rank/biological
World Checklist of Vascular Plants[29]Raw data downloadhttp://sftp.kew.org/pub/data-repositories/WCVPRank/biological
World Flora Online[30]Raw data downloadhttp://www.worldfloraonline.org/downloadDataRank/biological
WorldPlants[31]Web UINot identified
Herbarium systems according Gadelha Jr et al. [1]
BG-BASE[32]DocumentationNot identified
BRAHMS[33]Demo database structurehttps://herbaria.plants.ox.ac.uk/bol/brahms/support/conifersNone
EMu[34]DocumentationNot identified
Specify[35]Documentationhttps://www.specifysoftware.org/specify-6-schema/Adjacency List
Others
Avibase[36]DocumentationAdjacency List
Biologer[37]DocumentationAdjacency List
Dyntaxa[38]DocumentationClosure Table
Finnish Biodiversity Information Facility[39]Web UIhttps://laji.fi/en/taxon/list?target=MX.70046&onlyFinnish=trueRank/biological
Pladias[40]Web UIhttps://pladias.ibot.cas.cz/query/taxonDetailsNested Set
TaxonWorks[41]Documentationhttps://docs.taxonworks.org/develop/Data/models.html#taxon-name-relationshipClosure Table
DatabaseReferenceMedium used for inspectionExamined link/operationTree representation
“Big12” sensu Feng et al. [14]
Atlas of Living Australia[17]Web UIhttps://bie.ala.org.au/species/https://id.biodiversity.org.au/taxon/apni/51412617Adjacency List
Botanical Information and Ecology Network[18]R codeBIEN::BIEN_phylogeny_conservative(“Caryophyllales”)Object of class ape::phylo, i.e. Adjacency List
Biodiversity Information Serving Our NationNot inspected, moved to GBIF
eBird[19]Documentationhttps://www.birds.cornell.edu/clementschecklist/wp-content/uploads/2022/10/ebird_taxonomy_v2022.xlsxRank/biological
Encyclopedia of Life[20]DocumentationNeo4j graph database
Global Biodiversity Information Facility[21]GBIF Backbone Taxonomy download archive—CSV filehttps://hosted-datasets.gbif.org/datasets/backbone/current/Adjacency List
Global Inventory of Floras and Traits[22]R codeGIFT::GIFT_taxonomy()Nested Set
Integrated Digitized Biocollections[23]Web UIhttps://www.idigbio.org/portal/searchdwc:higherClassification darwin Core, i.e. Materialized Path
iNaturalist[24]Web UI/documentationNot identified
Map of Life[25]Web UIhttps://mol.org/regions/?regiontype=point&location=49.75105923257857,15.3416869909362rank/biological
Plant Trait Database[26]Web UI/documentationNot identified
VertNet[27]Web UIhttp://portal.vertnet.org/search?q=salamanderdwc:higherClassification darwin Core, i.e. Materialized Path
Global checklists of vascular plants
Leipzig Catalogue of Vascular Plants[28]R codelcvplants::lcvp_group_search(“Caryophyllaceae”, search_by = “Family”)Rank/biological
World Checklist of Vascular Plants[29]Raw data downloadhttp://sftp.kew.org/pub/data-repositories/WCVPRank/biological
World Flora Online[30]Raw data downloadhttp://www.worldfloraonline.org/downloadDataRank/biological
WorldPlants[31]Web UINot identified
Herbarium systems according Gadelha Jr et al. [1]
BG-BASE[32]DocumentationNot identified
BRAHMS[33]Demo database structurehttps://herbaria.plants.ox.ac.uk/bol/brahms/support/conifersNone
EMu[34]DocumentationNot identified
Specify[35]Documentationhttps://www.specifysoftware.org/specify-6-schema/Adjacency List
Others
Avibase[36]DocumentationAdjacency List
Biologer[37]DocumentationAdjacency List
Dyntaxa[38]DocumentationClosure Table
Finnish Biodiversity Information Facility[39]Web UIhttps://laji.fi/en/taxon/list?target=MX.70046&onlyFinnish=trueRank/biological
Pladias[40]Web UIhttps://pladias.ibot.cas.cz/query/taxonDetailsNested Set
TaxonWorks[41]Documentationhttps://docs.taxonworks.org/develop/Data/models.html#taxon-name-relationshipClosure Table

The remaining sources contained a formalized tree model which was most often Adjacency List [6], the other models (Materialized Path, Nested Set, and Closure Table) had two instances each. Databases that represent the tree structure in the taxon export following the Darwin Core standard, specifically dwc:higherClassification in line with the recommendation to provide “values in a list with space vertical bar space (|), with terms in order from the highest taxonomic rank to the lowest” [16], were classified as Materialized Path.

In the Botanical Information and Ecology Network case where the taxon hierarchy was obtained through the R package BIEN, the hierarchy model was available as an object of the class ape::phylo. Although, as a phylogeny, it contains data describing partial relationships between nodes (and thus is similar to the Closure Table model), in terms of working with a hierarchical tree it corresponds to the Adjacency List model and we classified it as such.

Encyclopedia of Life has its backbone built not on relational databases but based on Neo4j graph database, i.e. in an environment that models trees quite differently.

Discussion

As mentioned in the introduction, we can expect the biodiversity database to model natural reality, the processes of systematics, or the resulting taxonomy—the traditional mental model of biologists. Each of these realities presents different conceptual challenges for database development, and the discussion to find the right model can hardly converge to a successful solution without a clearer distinction of the essence. We have chosen the issue of tree structures in relational biodiversity databases because we consider them to be the central structural element that is present in them, regardless of the conceptual differences indicated. Although relational databases have recently gained competing solutions in the form of graph databases that change the view of storing tree structures, the relational approach is currently the most widely used.

In relational software, the choice of the model for the tree structure is crucial for the relevance between the software model and the modeled reality, for the efficiency of the database operation, and is also relevant for the user. The role of the user of a biodiversity database can hardly be overestimated. In line with Gadelha Jr et al. [1], this role has the potential to provide users with valuable information, a fundamental component of data quality. Therefore, even when storing data in graph databases, the interest in making available a formalized tree structure remains relevant, as the typical format of data exchange between a database and its professional users is in the form of CSV-type spreadsheet formats, in which graph data must also be reformatted into some relational model for usability.

As an example to describe this problem, we will use the Dyntaxa database for which we have realized how isolated we often look at the individual application layers and the needs of their users; however, this is undoubtedly a common situation in other databases as well. The Dyntaxa documentation provides a detailed description of the relational structure [38, p. 10], so it is clear that it uses the Closure Table model and we have classified it as such in our overview. While exploring the UI of the application and looking for how to obtain a formalized model of the hierarchical structure, we found a dedicated tool for exporting taxa lists, including a so-called “hierarchical” mode (https://www.dyntaxa.se/Export/HierarchicalTaxonList/3000462). Despite the name, however, it only provides users with hierarchy information in the form of biological ranks in the downloaded Excel spreadsheet. Thus, although the database models the relationships between taxa with the modern and well-described Closure Table formalization, it does not provide it to users for some reason.

Undoubtedly, a field biologist needs insight into the data described by the rankings, as this corresponds to the “cognitive pragmatics” of biologists [42], but for “analytic pragmatics” we would expect biodiversity databases to also offer a formalized notation of tree structure, which is needed in almost every data analysis nowadays. A formalized notation of the taxon hierarchy should therefore become part of the requirements for “Next-Generation Collections” [43], as tools that support data usability and machine processing in analyses. Which of the possible models is appropriate is up to the operator’s discretion to choose the one that best suits the intended needs of the database and its users, but in short, it is necessary to have both a taxonomic and formalized notation of the data structure.

We do not want to label appropriate and inappropriate within the four modeling approaches—each of the formalized notations has its own strengths and weaknesses. Still, we nevertheless attempt to discuss relevant properties to biodiversity databases below.

Three models are only applicable to databases targeting classification models that work with uniparental DAGs.

Adjacency List is the most commonly used formalized structure notation we found. Its computational complexity for analyses is counterbalanced by its intuitive understandability for all users. From the point of view of internal database design, we consider it deprecated. In terms of presenting the data to users, we believe that the basic tree manipulations within the more derived models (as shown in Table 2) are, with the provision of some minor hints, easily understandable to nontechnical users. However, it is also relevant to consider the use and convenience of practical users. In the extreme position of our reasoning, one can consider that, independently of the internal implementation within the database model, it would be useful to provide users with complementary, computed hierarchical level models, precisely including the Adjacency List. To our knowledge, no biodiversity database provides data in this way, although it is not a technically challenging solution.

Materialized Path seems nowadays heavy-handed at the database model level. According to our findings, it is not often used in biodiversity databases and its observed occurrence is equivalent to the use of DarwinCore in exports. In such export mode, we find it useful when passing data for individual taxa or selecting unrelated taxa because, unlike other models, it does not require the listing of all parent nodes (higher taxa) and thus does not ballast the multiplication of rows in the output. In this sense, its use in the DarwinCore field dwc:higherClassification [16] is logical. At the same time, however, the exports already contain the taxon classification using ranks, from which the Materialized Path can be easily inferred.

The Nested Set model represents an interesting and the most abstract solution for classification tree data (i.e. uniparental DAGs). Its structure is highly searchable at the backend storage, but also when the tree is distributed as an Excel table as shown in Table 2. An ambivalent property of the Nested Set is the implicit ordering of descendants—on the one hand, it is positive that the structure itself preserves the order, on the other hand, there are situations where biologists do not have a phylogenetically based intention of sibling order. In such situations, a fixed order is de facto misleading.

At the beginning of our study, we pointed out the need to define precisely which reality should be modeled in the database. If the model is to describe natural reality, it must include direct evolutionary relationships between taxa, but uniparental DAGs are no longer sufficient. To store the linkages of both parents of a given hybrid taxon, the only usable relational formalization is the Closure Table, with capability to model a multiparental DAG. It also allows a formulation of a richer typology of relationships (part of, congruent, overlap) between nodes of the hierarchy than simple parent–child. Since many authors see the global future of biodiversity databases as being in the integration of ontologies [44–46] and Closure Table is capable of fulfilling needs for classification trees as well, we can expect its gradual dominance. Its fundamental property is the necessity to separate hierarchy data (ontology for taxa relationships) from the nodes (taxa) themselves. At the level of data presentation, the two-table structure may appear as a handicap for users working in spreadsheets, but it can also be seen as an easy vehicle to start providing the formalized data and “not scare away” natural scientists. In the same way as we discussed the usefulness of providing users with multiple variants of the formal expression of the tree structure, we offer a positive view of this feature of the Closure Table model. It could be a goal of databases to provide checklists of taxa with their biological classification and columns understandable to all biologists, such as “Class” or “Genus” etc., i.e. as the current most common practice looks like, complemented by a second set/table of formalized, ontology-ready structure notation for analysis purposes.

The computational complexity of editing (i.e. adding, moving, and deleting nodes) varies from model to model; see Table 1 for an indicative comparison. However, another requirement—tracking changes—is crucial compared to other tree structure models. Storing changes and presenting them in a comprehensible way is extremely desirable in the context of taxon hierarchy.

The general approach of write-ahead logging, i.e. a separate record of changes made over the initial tree, is possible for all the models discussed. By keeping each partial change, it is then possible to replicate the individual states and describe the differences between them. However, we see a difficulty in the biological interpretability of this approach. When one taxon is moved to another group, it is not only a change in its classification, but it is also a modification of the substantive nature of the initial and target groups. Creating a comprehensible presentation of tree changes that shows the context of changes in the biological concept of a taxon seems to us almost impossible.

Again, the Closure Table model could provide some solution. If we flagged node relationships as valid and invalidated, we could preserve the history of changes within the hierarchy model itself. When relationships are supplemented with a record of their creation and invalidation by reference to the versioning of the entire tree, a model capable of retrospective presentation of the evolution of the stored hierarchy would then be available.

Conclusion

We have tried to map the approaches that are used nowadays for modeling hierarchical structures in biodiversity databases and how they are provided to the users. In our opinion, the results show one main conclusion, namely that the formalized tree structure model is an overlooked aspect, at least from the users’ point of view. As a crucial point, we make a plea for database operators to realize that they have two tasks concerning tree structures—to model them effectively in the data backbone (which has undoubtedly been done for decades), but also, this is the critical point, provide formalized tree structure models included in the data exports for users’ utility and efficiency.

Of the identified data models in use, we consider Closure Table to be the most relevant for biological hierarchies in relational databases because of its ability to formalize the various types of relationships defining the hierarchy as well as relationships beyond it, including change tracking. For user interfaces and exports, the Nested Set model appears to be suitable, as it excels in the straightforwardness of searching and sorting within the tree.

Limits

A clear limitation of our review of the current state of hierarchical structure modeling is the methodology of discovering them. We only looked from the outside without insider knowledge of the internal structure of providers. This approach is usable for inspecting user ergonomics, but it limits the statement of what models are used in the db (see the example of Dyntaxa), as the applications may offer other options to internal users. At the same time, it is necessary to admit at least the hypothetical possibility of using one relational model internally and reconstructing it externally into a second model (e.g. Materialized Path of Darwin Core does not necessarily mean that the database stores it that way, it is just presented that way following the standard). Thus, the overview does not necessarily correctly describe the individual databases, but it allows us to illustrate the situation that led us to this work, i.e. the disparate and unappreciated emphasis on a formalized description of hierarchical data towards the public.

Our search focused only on taxon-related structure, but there are other hierarchies in the databases, such as spatial administrative units or phytogeographic subdivisions, and it would certainly be interesting to compare approaches to modeling them.

Although we have included databases with a global scope in the biological and spatial sense, when writing the text, we have in mind a vascular plant as a model taxon. Therefore, it is possible that, given the complexity of genetic flow mechanisms in prokaryotes or viruses or the differences between the nomenclatural-systematic traditions of particular organismal groups, we committed an oversimplification of the biological essence when considering taxon hierarchy. However, this should not undermine our conclusion regarding the necessity of hierarchical structure formalization of hierarchical structures in the context of biodiversity databases.

Acknowledgements

We thank the anonymous reviewers for their comments, which helped us to better formulate and compose our ideas.

Author contributions

P.N. conceptualized the work, P.N. and J.W. did the research and wrote the manuscript.

Conflict of interest

The authors declare that they have no competing interests in this manuscript other than the fact that they are co-authors of the nonprofit Pladias database included in the study.

Funding

J.W. was supported by long-term research development project No. RVO 67985939 of the Czech Academy of Sciences.

References

1.

Gadelha
LMR, Jr
,
de Siracusa
PC
,
Dalcin
EC
et al. 
A survey of biodiversity informatics: concepts, practices, and challenges
.
WIREs Data Mining Knowl Discov
2021
;
11
:e1394. doi:

2.

Merow
C
,
Boyle
B
,
Enquist
BJ
et al. 
Better incentives are needed to reward academic software development
.
Nat Ecol Evol
2023
;
7
:
626
27
. doi:

3.

Leonelli
S
,
Ankeny
RA
.
Re-thinking organisms: the impact of databases on model organism biology
.
Stud Hist Philos Sci C
2012
;
43
:
29
36
. doi:

4.

Franz
NM
.
Biological taxonomy and ontology development: scope and limitations
.
Biodivers Inform
2010
;
7
:
45
66
.

5.

Grenié
M
,
Berti
E
,
Carvajal-Quintero
J
et al. 
Harmonizing taxon names in biodiversity data: a review of tools, databases and best practices
.
Meth Ecol Evol
2023
;
14
:
12
25
. doi:

6.

Berendsohn
WG
.
A taxonomic information model for botanical databases: the IOPI Model
.
TAXON
1997
;
46
:
283
309
. doi:

7.

Patterson
DJ
,
Faulwetter
S
,
Shipunov
A
.
Principles for a names-based cyberinfrastructure to serve all of biology
.
Zootaxa
2008
;
1950
:
153
63
. doi:

8.

Yoon
N
Rose
J
. An information model for the representation of multiple biological classifications. In:
Alexandrov
VN
,
Dongarra
JJ
,
Juliano
BA
,
Renner
RS
,
Tan
CJK
(eds),
Computational Science — ICCS 2001
.
Berlin, Heidelberg
:
Springer
,
2001
,
937
46
. Lecture Notes in Computer Science.

9.

Priss
U
. Formalizing botanical taxonomies. In:
Ganter
B
,
de Moor
A
,
Lex
W
(eds),
Conceptual Structures for Knowledge Creation and Communication
.
Berlin, Heidelberg
:
Springer
,
2003
,
309
22
. Lecture Notes in Computer Science.

10.

Celko
J
.
Joe Celko’s Trees and Hierarchies in SQL for Smarties
.
Amsterdam Boston
:
Morgan Kaufmann
,
2012
, 173–86.

11.

Pullan
MR
,
Watson
MF
,
Kennedy
JB
et al. 
The prometheus taxonomic model: a practical approach to representing multiple classifications
.
TAXON
2000
;
49
:
55
75
. doi:

12.

Zhong
Y
,
Jung
S
,
Pramanik
S
et al. 
Data model and comparison and query methods for interacting classifications in a taxonomic database
.
TAXON
1996
;
45
:
223
41
. doi:

13.

Miller
JT
,
Pirzl
R
,
Rosauer
D
et al. 
Phylolink: phylogenetically-based profiling, visualisations and metrics for biodiversity
.
Bioinformatics
2019
;
35
:
1229
30
. doi:

14.

Feng
X
,
Enquist
BJ
,
Park
DS
et al. 
A review of the heterogeneous landscape of biodiversity databases: opportunities and challenges for a synthesized biodiversity knowledge base
.
Glob Ecol Biogeogr
2022
;
31
:
1242
60
. doi:

15.

Schellenberger Costa
D
,
Boehnisch
G
,
Freiberg
M
et al. 
The big four of plant taxonomy–a comparison of global checklists of vascular plant names
.
New Phytol
2023
;
240
:
1687
702
. doi:

16.

Darwin Core Maintenance Group
.
List of Darwin Core Terms
.
2023
. http://rs.tdwg.org/dwc/doc/list/2023-07-07 (
20 July 2023, date last accessed
).

17.

Belbin
L
,
Williams
KJ
.
Towards a national bio-environmental data facility: experiences from the Atlas of Living Australia
.
Int J Geog Inf Sci
2016
;
30
:
108
25
. doi:

18.

Enquist
BJ
,
Condit
R
,
Peet
RK
et al. 
Cyberinfrastructure for an integrated botanical information network to investigate the ecological impacts of global climate change on plant biodiversity
.
PeerJ Pre Prints
2016
. doi:

19.

Sullivan
BL
,
Aycrigg
JL
,
Barry
JH
et al. 
The eBird enterprise: an integrated approach to development and application of citizen science
.
Biol Conserv
2014
;
169
:
31
40
. doi:

20.

Parr
CS
,
Wilson
N
,
Leary
P
et al. 
The Encyclopedia of Life v2: providing global access to knowledge about life on earth
.
Biodivers Data J
2014
;
2
:e1079. doi:

21.

GBIF
. https://www.gbif.org/ (
19 July 2023, date last accessed
).

22.

Weigelt
P
,
König
C
,
Kreft
H
.
GIFT – A global inventory of floras and traits for macroecology and biogeography
.
J Biogeograph
2020
;
47
:
16
43
. doi:

23.

iDigBio
.
Integrated Digitized Biocollections
.
2023
. https://www.idigbio.org/ (
19 July 2023, date last accessed
).

24.

iNaturalist
. https://www.inaturalist.org/ (
19 July 2023, date last accessed
).

25.

Jetz
W
,
McPherson
JM
,
Guralnick
RP
.
Integrating biodiversity distribution knowledge: toward a global map of life
.
Trends Ecol Evol
2012
;
27
:
151
59
. doi:

26.

Kattge
J
,
Díaz
S
,
Lavorel
S
et al. 
TRY – a global database of plant traits
.
Glob Change Biol
2011
;
17
:
2905
35
. doi:

27.

Constable
H
,
Guralnick
R
,
Wieczorek
J
et al. ,
VertNet Steering Committee
.
VertNet: a new model for biodiversity data sharing
.
PLoS Biol
2010
;
8
:e1000309. doi:

28.

Freiberg
M
,
Winter
M
,
Gentile
A
et al. 
LCVP, The Leipzig catalogue of vascular plants, a new taxonomic reference list for all known vascular plants
.
Scientific Data
2020
;
7
:416. doi:

29.

Govaerts
R
,
Nic Lughadha
E
,
Black
N
et al. 
The world checklist of vascular plants, a continuously updated resource for exploring global plant diversity
.
Scientific Data
2021
;
8
:215. doi:

30.

Borsch
T
,
Berendsohn
W
,
Dalcin
E
et al. 
World Flora Online: placing taxonomists at the heart of a definitive and comprehensive global resource on the world’s plants
.
Taxon
2020
;
69
:
1311
41
. doi:

31.

Hassler
M
.
World Plants: Plant List. World Plants 16.2. Synonymic Checklist and Distribution of the World Flora
.
2023
. https://www.worldplants.de (
20 July 2023, date last accessed
).

32.

BG-BASE
.
Introduction
. http://www.bg-base.com/ (
19 July 2023, date last accessed
).

33.

BRAHMS
.
Software for Natural History Management
. https://herbaria.plants.ox.ac.uk/bol/ (
19 July 2023, date last accessed
).

34.

EMu
.
Collection Management System
. https://emu.axiell.com/ (
19 July 2023, date last accessed
).

35.

Specify Collections Consortium
.
Software for Biological Collections and Samples
. https://www.specifysoftware.org/ (
19 July 2023, date last accessed
).

36.

Lepage
D
,
Vaidya
G
,
Guralnick
R
.
Avibase – a database system for managing and organizing taxonomic concepts
.
ZooKeys
2014
;
420
:
117
35
. doi:

37.

Popović
M
,
Vasić
N
,
Koren
T
et al. 
Biologer: an open platform for collecting biodiversity data
.
Biodivers Data J
2020
;
8
:e53014. doi:

38.

Kindwall
O
,
Roscher
S
,
Maitre
JB
et al. 
Dyntaxa taxon concept administration and how to handle information related to taxa - ETC/BD Technical paper N°8/2015
.
Eionet Portal
,
2015
. https://www.eionet.europa.eu/etcs/etc-bd/products/etc-bd-reports/dyntaxa_admin_handle_info (
12 July 2021, date last accessed
).

39.

Schulman
L
,
Lahti
K
,
Piirainen
E
et al. 
The Finnish biodiversity information facility as a best-practice model for biodiversity data infrastructures
.
Scientific Data
2021
;
8
:137. doi:

40.

Novotný
P
,
Brůna
J
,
Chytrý
M
et al. 
Pladias platform: technical description of the database structure
.
Biodivers Data J
2022
;
10
:e80167. doi:

41.

Dmitriev
D
.
TaxonWorks
.
Biodiversity Information Science and Standards
,
2018
. http://taxonworks.org/

42.

Sterner
B
,
Franz
NM
.
Taxonomy for humans or computers? Cognitive pragmatics for big data
.
Biol Theory
2017
;
12
:
99
111
. doi:

43.

Schindel
DE
,
Cook
JA
.
The next generation of natural history collections
.
PLoS Biol
2018
;
16
:e2006125. doi:

44.

Laurenne
N
,
Tuominen
J
,
Saarenmaa
H
et al. 
Making species checklists understandable to machines – a shift from relational databases to ontologies
.
J Biomed Semant
2014
;
5
:40. doi:

45.

Lindström
J
.
Database model for taxonomic and observation data
. In: Proceedings of the 2nd IASTED International Conference on Advances in Computer Science and Technology.
Puerto Vallarta, Mexico
:
ACTA Press
,
2006
, 316–21.

46.

Trißl
S
,
Leser
U
Querying ontologies in relational database systems
. In: Data Integration in the Life Sciences: Second International Workshop, DILS 2005. pp.
63
79
.
San Diego, CA, USA
:
Springer
,
2005
.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.