Publikation:

Research Paper Recommender System Evaluation : A Quantitative Literature Survey

Lade...
Vorschaubild

Dateien

Beel_0-285593.pdf
Beel_0-285593.pdfGröße: 367.4 KBDownloads: 4271

Datum

2013

Autor:innen

Beel, Joeran
Langer, Stefan
Genzmehr, Marcel
Nürnberger, Andreas

Herausgeber:innen

Kontakt

ISSN der Zeitschrift

Electronic ISSN

ISBN

Bibliografische Daten

Verlag

Schriftenreihe

Auflagebezeichnung

ArXiv-ID

Internationale Patentnummer

Angaben zur Forschungsförderung

Projekt

Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz

Gesperrt bis

Titel in einer weiteren Sprache

Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published

Erschienen in

ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512

Zusammenfassung

Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.

Zusammenfassung in einer weiteren Sprache

Fachgebiet (DDC)
004 Informatik

Schlagwörter

Research paper recommender systems, evaluation, comparative study, recommender systems, survey

Konferenz

RepSys '13, 12. Okt. 2013, Hong Kong
Rezension
undefined / . - undefined, undefined

Forschungsvorhaben

Organisationseinheiten

Zeitschriftenheft

Zugehörige Datensätze in KOPS

Zitieren

ISO 690BEEL, Joeran, Stefan LANGER, Marcel GENZMEHR, Bela GIPP, Corinna BREITINGER, Andreas NÜRNBERGER, 2013. Research Paper Recommender System Evaluation : A Quantitative Literature Survey. RepSys '13. Hong Kong, 12. Okt. 2013. In: ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512
BibTex
@inproceedings{Beel2013Resea-30897,
  year={2013},
  doi={10.1145/2532508.2532512},
  title={Research Paper Recommender System Evaluation : A Quantitative Literature Survey},
  isbn={978-1-4503-2465-6},
  publisher={ACM},
  address={New York},
  booktitle={Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation},
  pages={15--22},
  editor={Alejandro Bellogin},
  author={Beel, Joeran and Langer, Stefan and Genzmehr, Marcel and Gipp, Bela and Breitinger, Corinna and Nürnberger, Andreas}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/30897">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:contributor>Nürnberger, Andreas</dc:contributor>
    <dcterms:issued>2013</dcterms:issued>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dc:date>
    <dc:creator>Breitinger, Corinna</dc:creator>
    <dcterms:abstract xml:lang="eng">Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.</dcterms:abstract>
    <dc:rights>terms-of-use</dc:rights>
    <dc:creator>Gipp, Bela</dc:creator>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:creator>Genzmehr, Marcel</dc:creator>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dcterms:available>
    <dcterms:title>Research Paper Recommender System Evaluation : A Quantitative Literature Survey</dcterms:title>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/30897"/>
    <dc:contributor>Beel, Joeran</dc:contributor>
    <dc:contributor>Langer, Stefan</dc:contributor>
    <dc:creator>Langer, Stefan</dc:creator>
    <dc:creator>Nürnberger, Andreas</dc:creator>
    <dc:contributor>Gipp, Bela</dc:contributor>
    <dc:contributor>Genzmehr, Marcel</dc:contributor>
    <dc:creator>Beel, Joeran</dc:creator>
    <dc:contributor>Breitinger, Corinna</dc:contributor>
    <dc:language>eng</dc:language>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
  </rdf:Description>
</rdf:RDF>

Interner Vermerk

xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter

Kontakt
URL der Originalveröffentl.

Prüfdatum der URL

Prüfungsdatum der Dissertation

Finanzierungsart

Kommentar zur Publikation

Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Nein
Begutachtet
Diese Publikation teilen