Research Paper Recommender System Evaluation : A Quantitative Literature Survey

Kurzanzeige
dc.contributor.authorBeel, Joeran
dc.contributor.authorLanger, Stefan
dc.contributor.authorGenzmehr, Marcel
dc.contributor.authorGipp, Bela
dc.contributor.authorBreitinger, Corinna
dc.contributor.authorNürnberger, Andreas
dc.date.accessioned2015-05-06T09:52:12Z
dc.date.available2015-05-06T09:52:12Z
dc.date.issued2013eng
dc.description.abstractOver 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.eng
dc.description.versionpublished
dc.identifier.doi10.1145/2532508.2532512eng
dc.identifier.ppn443460825
dc.identifier.urihttp://kops.uni-konstanz.de/handle/123456789/30897
dc.language.isoengeng
dc.rightsterms-of-use
dc.rights.urihttps://rightsstatements.org/page/InC/1.0/
dc.subjectResearch paper recommender systems, evaluation, comparative study, recommender systems, surveyeng
dc.subject.ddc004eng
dc.titleResearch Paper Recommender System Evaluation : A Quantitative Literature Surveyeng
dc.typeINPROCEEDINGSeng
dspace.entity.typePublication
kops.citation.bibtex
@inproceedings{Beel2013Resea-30897,
  year={2013},
  doi={10.1145/2532508.2532512},
  title={Research Paper Recommender System Evaluation : A Quantitative Literature Survey},
  isbn={978-1-4503-2465-6},
  publisher={ACM},
  address={New York},
  booktitle={Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation},
  pages={15--22},
  editor={Alejandro Bellogin},
  author={Beel, Joeran and Langer, Stefan and Genzmehr, Marcel and Gipp, Bela and Breitinger, Corinna and Nürnberger, Andreas}
}
kops.citation.iso690BEEL, Joeran, Stefan LANGER, Marcel GENZMEHR, Bela GIPP, Corinna BREITINGER, Andreas NÜRNBERGER, 2013. Research Paper Recommender System Evaluation : A Quantitative Literature Survey. RepSys '13. Hong Kong, 12. Okt. 2013. In: ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512deu
kops.citation.iso690BEEL, Joeran, Stefan LANGER, Marcel GENZMEHR, Bela GIPP, Corinna BREITINGER, Andreas NÜRNBERGER, 2013. Research Paper Recommender System Evaluation : A Quantitative Literature Survey. RepSys '13. Hong Kong, Oct 12, 2013. In: ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512eng
kops.citation.rdf
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/30897">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:contributor>Nürnberger, Andreas</dc:contributor>
    <dcterms:issued>2013</dcterms:issued>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dc:date>
    <dc:creator>Breitinger, Corinna</dc:creator>
    <dcterms:abstract xml:lang="eng">Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.</dcterms:abstract>
    <dc:rights>terms-of-use</dc:rights>
    <dc:creator>Gipp, Bela</dc:creator>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:creator>Genzmehr, Marcel</dc:creator>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dcterms:available>
    <dcterms:title>Research Paper Recommender System Evaluation : A Quantitative Literature Survey</dcterms:title>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/30897"/>
    <dc:contributor>Beel, Joeran</dc:contributor>
    <dc:contributor>Langer, Stefan</dc:contributor>
    <dc:creator>Langer, Stefan</dc:creator>
    <dc:creator>Nürnberger, Andreas</dc:creator>
    <dc:contributor>Gipp, Bela</dc:contributor>
    <dc:contributor>Genzmehr, Marcel</dc:contributor>
    <dc:creator>Beel, Joeran</dc:creator>
    <dc:contributor>Breitinger, Corinna</dc:contributor>
    <dc:language>eng</dc:language>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
  </rdf:Description>
</rdf:RDF>
kops.conferencefieldRepSys '13, 12. Okt. 2013, Hong Kongdeu
kops.date.conferenceStart2013-10-12eng
kops.description.openAccessopenaccessgreen
kops.flag.knbibliographyfalse
kops.identifier.nbnurn:nbn:de:bsz:352-0-285593
kops.location.conferenceHong Kongeng
kops.sourcefieldALEJANDRO BELLOGIN, , ed.. <i>Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation</i>. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512deu
kops.sourcefield.plainALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512deu
kops.sourcefield.plainALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512eng
kops.title.conferenceRepSys '13eng
relation.isAuthorOfPublication358ad52f-dab7-4582-bf8e-8adcf477a2d4
relation.isAuthorOfPublicationebdceabd-fdd9-44b2-b7bb-57ebea6b5574
relation.isAuthorOfPublication.latestForDiscovery358ad52f-dab7-4582-bf8e-8adcf477a2d4
source.bibliographicInfo.fromPage15eng
source.bibliographicInfo.toPage22eng
source.contributor.editorAlejandro Bellogineng
source.identifier.isbn978-1-4503-2465-6eng
source.publisherACMeng
source.publisher.locationNew Yorkeng
source.titleProceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluationeng
temp.internal.duplicates<p>Keine Dubletten gefunden. Letzte Überprüfung: 08.04.2015 09:41:38</p>deu

Dateien

Originalbündel

Gerade angezeigt 1 - 1 von 1
Vorschaubild nicht verfügbar
Name:
Beel_0-285593.pdf
Größe:
367.4 KB
Format:
Adobe Portable Document Format
Beschreibung:
Beel_0-285593.pdf
Beel_0-285593.pdfGröße: 367.4 KBDownloads: 4581

Sammlungen

Informatik und Informationswissenschaft: Publikationen