MEDLINE: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Robert Badgett
imported>Robert Badgett
m (Fixed reference)
Line 14: Line 14:


# If a complete test collection of articles is available that is already divided into articles of meeting inclusion criteria and articles that not meeting criteria, then each strategy is compared for its ability to successfully identify the articles meeting criteria (sensitivity) and to successfully exclude (specificity) the articles not meeting criteria. Sensitivity is also called "''recall''" by some authors.<ref name="isbn0-387-95522-4">{{cite book |author=Hersh, William R. |title=Information retrieval: a health and biomedical perspective |publisher=Springer |location=Berlin |year=2003 |pages= |isbn=0-387-95522-4 |oclc= |doi=}}</ref>
# If a complete test collection of articles is available that is already divided into articles of meeting inclusion criteria and articles that not meeting criteria, then each strategy is compared for its ability to successfully identify the articles meeting criteria (sensitivity) and to successfully exclude (specificity) the articles not meeting criteria. Sensitivity is also called "''recall''" by some authors.<ref name="isbn0-387-95522-4">{{cite book |author=Hersh, William R. |title=Information retrieval: a health and biomedical perspective |publisher=Springer |location=Berlin |year=2003 |pages= |isbn=0-387-95522-4 |oclc= |doi=}}</ref>
# If a partial test collection is available that ''only'' consists of articles meeting inclusion criteria (for example, article meeting inclusion criteria for [http://www.acpjc.org/shared/purpose_and_procedure.htm ACP Journal Club]<ref name="pmid15561789">{{cite journal |author=Aphinyanaphongs Y, Tsamardinos I, Statnikov A, Hardin D, Aliferis CF |title=Text categorization models for high-quality article retrieval in internal medicine |journal=J Am Med Inform Assoc |volume=12 |issue=2 |pages=207–16 |year=2005 |pmid=15561789 |doi=10.1197/jamia.M1641}}</ref> or articles included in a [[systematic review]] of a clinical topic or articles in an annotated bibliography<ref name="pmid16221938"/>), then the sensitivity is again the proportion of relevent articles identified by the strategy. However, the specifity is not computable. Instead, one of several related measures are calculated. These measures are all based on the positive predictive value (PPV) of the strategy. Analogous to PPV used in diagnostic testing, the PPV directly correlates with the prevalence of relevent articles in the collection and thus is not stable accross prevalences.<ref name="pmid12386115">{{cite journal |author=Bachmann LM, Coray R, Estermann P, Ter Riet G |title=Identifying diagnostic studies in MEDLINE: reducing the number needed to read |journal=J Am Med Inform Assoc |volume=9 |issue=6 |pages=653–8 |year=2002 |pmid=12386115 |doi=}}</ref>
# If a partial test collection is available that ''only'' consists of articles meeting inclusion criteria (for example, article meeting inclusion criteria for [http://www.acpjc.org/shared/purpose_and_procedure.htm ACP Journal Club]<ref name="pmid15561789">{{cite journal |author=Aphinyanaphongs Y, Tsamardinos I, Statnikov A, Hardin D, Aliferis CF |title=Text categorization models for high-quality article retrieval in internal medicine |journal=J Am Med Inform Assoc |volume=12 |issue=2 |pages=207–16 |year=2005 |pmid=15561789 |doi=10.1197/jamia.M1641}}</ref> or articles included in a [[systematic review]] of a clinical topic or articles in an annotated bibliography<ref name="pmid16779053">{{cite journal |author=Herskovic JR, Bernstam EV |title=Using incomplete citation data for MEDLINE results ranking |journal=AMIA Annu Symp Proc |volume= |issue= |pages=316–20 |year=2005 |pmid=16779053 |doi=}}</ref>
), then the sensitivity is again the proportion of relevent articles identified by the strategy. However, the specifity is not computable. Instead, one of several related measures are calculated. These measures are all based on the positive predictive value (PPV) of the strategy. Analogous to PPV used in diagnostic testing, the PPV directly correlates with the prevalence of relevent articles in the collection and thus is not stable accross prevalences.<ref name="pmid12386115">{{cite journal |author=Bachmann LM, Coray R, Estermann P, Ter Riet G |title=Identifying diagnostic studies in MEDLINE: reducing the number needed to read |journal=J Am Med Inform Assoc |volume=9 |issue=6 |pages=653–8 |year=2002 |pmid=12386115 |doi=}}</ref>
## ''Precision'' is "the proportion of retrieved articles that meet criteria" and thus is the same as the PPV.<ref name="pmid15073027">{{cite journal |author=Haynes RB, Wilczynski NL |title=Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey |journal=BMJ |volume=328 |issue=7447 |pages=1040 |year=2004 |pmid=15073027 |doi=10.1136/bmj.38068.557998.EE}}</ref>
## ''Precision'' is "the proportion of retrieved articles that meet criteria" and thus is the same as the PPV.<ref name="pmid15073027">{{cite journal |author=Haynes RB, Wilczynski NL |title=Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey |journal=BMJ |volume=328 |issue=7447 |pages=1040 |year=2004 |pmid=15073027 |doi=10.1136/bmj.38068.557998.EE}}</ref>
##''Hit curve'' "is the number of important articles among the first n results."<ref name="pmid16469545">{{cite journal |author=Herskovic JR, Iyengar MS, Bernstam EV |title=Using hit curves to compare search algorithm performance |journal=J Biomed Inform |volume=40 |issue=2 |pages=93–9 |year=2007 |pmid=16469545 |doi=10.1016/j.jbi.2005.12.007}}</ref><ref name="pmid16221938">{{cite journal |author=Bernstam EV, Herskovic JR, Aphinyanaphongs Y, Aliferis CF, Sriram MG, Hersh WR |title=Using citation data to improve retrieval from MEDLINE |journal=J Am Med Inform Assoc |volume=13 |issue=1 |pages=96–105 |year=2006 |pmid=16221938 |doi=10.1197/jamia.M1909}}</ref>
##''Hit curve'' "is the number of important articles among the first n results."<ref name="pmid16469545">{{cite journal |author=Herskovic JR, Iyengar MS, Bernstam EV |title=Using hit curves to compare search algorithm performance |journal=J Biomed Inform |volume=40 |issue=2 |pages=93–9 |year=2007 |pmid=16469545 |doi=10.1016/j.jbi.2005.12.007}}</ref><ref name="pmid16221938">{{cite journal |author=Bernstam EV, Herskovic JR, Aphinyanaphongs Y, Aliferis CF, Sriram MG, Hersh WR |title=Using citation data to improve retrieval from MEDLINE |journal=J Am Med Inform Assoc |volume=13 |issue=1 |pages=96–105 |year=2006 |pmid=16221938 |doi=10.1197/jamia.M1909}}</ref>

Revision as of 23:12, 25 November 2007

This article is developing and not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.
(PD) Photo: National Center for Biotechnology Information
June 26, 1997: The first search of PubMed by Vice President Al Gore at the US Capitol.[1]

Structure

MEDLINE® (Medical Literature Analysis and Retrieval System Online) is a database of predominantly biomedical bibliographic citations maintained by the U.S. National Library of Medicine (NLM).[2] Each citation includes bibliographic data, abstract if available, links to full text of the article and keywords. The keywords are indexed with the NLM's Medical Subject Headings (MeSH®).[3]

The National Library of Medicine is investigated whether indexing MeSH terms can be either fully or semi-automated.[4]

Methods to improve searching MEDLINE

There is much ongoing research into improving MEDLINE search results.

Research methods for comparative studies

In comparing search strategies, there are two experimental methods.

  1. If a complete test collection of articles is available that is already divided into articles of meeting inclusion criteria and articles that not meeting criteria, then each strategy is compared for its ability to successfully identify the articles meeting criteria (sensitivity) and to successfully exclude (specificity) the articles not meeting criteria. Sensitivity is also called "recall" by some authors.[5]
  2. If a partial test collection is available that only consists of articles meeting inclusion criteria (for example, article meeting inclusion criteria for ACP Journal Club[6] or articles included in a systematic review of a clinical topic or articles in an annotated bibliography[7]

), then the sensitivity is again the proportion of relevent articles identified by the strategy. However, the specifity is not computable. Instead, one of several related measures are calculated. These measures are all based on the positive predictive value (PPV) of the strategy. Analogous to PPV used in diagnostic testing, the PPV directly correlates with the prevalence of relevent articles in the collection and thus is not stable accross prevalences.[8]

    1. Precision is "the proportion of retrieved articles that meet criteria" and thus is the same as the PPV.[9]
    2. Hit curve "is the number of important articles among the first n results."[10][11]
    3. Number Needed to Read (NNR) is "how many papers in a journal have to be read to find one of adequate clinical quality and relevance."[12][13][8][14] Of note, the NNR has been proposed as a metric to help libaries to decide which journals to subscribe to.[12]

Filters (hedges)

MEDLINE filters are an optimal Boolean combination of search terms, both textword and MeSH terms, to search articles of particular types. For example, one filter is for identifying randomized controlled trials. Many MEDLINE filters have been developed by the Hedges team[15] supported by a grant from the National Library of Medicine.[16]

Relevancy ranking

Although MEDLINE is usually searched for exact matches using Boolean terms, relevancy ranking has been studied. In an early comparion, relevency ranking performed well; however, the Boolean version of MEDLINE did not fully use MeSH terms.[17][18]

Citation analysis or PageRank

There is conflicting results over the role of.[14][11][7]

Methods to access MEDLINE

There are many third party interfaces to search MEDLINE such as OVID[19]. The National Library of Medicine's own search interface is PubMed (http://pubmed.gov).

PubMed

PubMed (http://pubmed.gov) is the National Library of Medicine's own free Internet access to MEDLINE. PubMed has been freely available since its first search was performed by Vice President Al Gore during a press conference in the US Capitol on June 26, 1997.[1] On a typical day, PubMed receives over 2 million queries.[20]

PubMed is hosted by the Entrez Search and Retrieval System of the National Center for Biotechnology Information[21] (NCBI) branch of the NLM[22] The hardware hosting Entrez has been described.[23]

References

  1. 1.0 1.1 National Center for Biotechnology Information. NCBI News - August 1997. Retrieved on 2007-11-09. Cite error: Invalid <ref> tag; name "aug97" defined multiple times with different content
  2. National Library of Medicine. MEDLINE Fact Sheet. Retrieved on 2007-11-09.
  3. National Library of Medicine. Medical Subject Headings (MESH®) Fact Sheet. Retrieved on 2007-11-09.
  4. National Library of Medicine. Indexing Initiative. Retrieved on 2007-11-25.
  5. Hersh, William R. (2003). Information retrieval: a health and biomedical perspective. Berlin: Springer. ISBN 0-387-95522-4. 
  6. Aphinyanaphongs Y, Tsamardinos I, Statnikov A, Hardin D, Aliferis CF (2005). "Text categorization models for high-quality article retrieval in internal medicine". J Am Med Inform Assoc 12 (2): 207–16. DOI:10.1197/jamia.M1641. PMID 15561789. Research Blogging.
  7. 7.0 7.1 Herskovic JR, Bernstam EV (2005). "Using incomplete citation data for MEDLINE results ranking". AMIA Annu Symp Proc: 316–20. PMID 16779053[e]
  8. 8.0 8.1 Bachmann LM, Coray R, Estermann P, Ter Riet G (2002). "Identifying diagnostic studies in MEDLINE: reducing the number needed to read". J Am Med Inform Assoc 9 (6): 653–8. PMID 12386115[e]
  9. Haynes RB, Wilczynski NL (2004). "Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey". BMJ 328 (7447): 1040. DOI:10.1136/bmj.38068.557998.EE. PMID 15073027. Research Blogging.
  10. Herskovic JR, Iyengar MS, Bernstam EV (2007). "Using hit curves to compare search algorithm performance". J Biomed Inform 40 (2): 93–9. DOI:10.1016/j.jbi.2005.12.007. PMID 16469545. Research Blogging.
  11. 11.0 11.1 Bernstam EV, Herskovic JR, Aphinyanaphongs Y, Aliferis CF, Sriram MG, Hersh WR (2006). "Using citation data to improve retrieval from MEDLINE". J Am Med Inform Assoc 13 (1): 96–105. DOI:10.1197/jamia.M1909. PMID 16221938. Research Blogging.
  12. 12.0 12.1 Toth B, Gray JA, Brice A (2005). "The number needed to read-a new measure of journal value". Health Info Libr J 22 (2): 81–2. DOI:10.1111/j.1471-1842.2005.00568.x. PMID 15910578. Research Blogging.
  13. McKibbon KA, Wilczynski NL, Haynes RB (2004). "What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals?". BMC Med 2: 33. DOI:10.1186/1741-7015-2-33. PMID 15350200. Research Blogging.
  14. 14.0 14.1 Haase A, Follmann M, Skipka G, Kirchner H (2007). "Developing search strategies for clinical practice guidelines in SUMSearch and Google Scholar and assessing their retrieval performance". BMC Med Res Methodol 7: 28. DOI:10.1186/1471-2288-7-28. PMID 17603909. Research Blogging.
  15. Hedges Team. Search Strategies. Retrieved on 2007-11-25.
  16. CRISP - Computer Retrieval of Information on Scientific Projects, Abstract Display. Retrieved on 2007-11-25.
  17. Hersh WR, Hickam DH (1992). "A comparison of retrieval effectiveness for three methods of indexing medical literature". Am. J. Med. Sci. 303 (5): 292–300. PMID 1580316[e]
  18. Hersh WR, Hickam DH, Haynes RB, McKibbon KA (1994). "A performance and failure analysis of SAPHIRE with a MEDLINE test collection". J Am Med Inform Assoc 1 (1): 51–60. PMID 7719787[e]
  19. Anonymous. MEDLINE® - Ovid's MEDLINE. Retrieved on 2007-11-09.
  20. Herskovic JR, Tanaka LY, Hersh W, Bernstam EV (2007). "A day in the life of PubMed: analysis of a typical day's query log". J Am Med Inform Assoc 14 (2): 212–20. DOI:10.1197/jamia.M2191. PMID 17213501. Research Blogging.
  21. National Library of Medicine. The National Center for Biotechnology Information Programs and Activities Fact Sheet. Retrieved on 2007-11-10.
  22. Ostell, J. The Entrez Search and Retrieval System. Retrieved on 2007-11-10.
  23. Canese, K; Jentsch, J; Myers, C. Database Management and Hardware. Retrieved on 2007-11-10.

External links