news-please : a Generic News Crawler and Extractor

Cite This

Files in this item

Files Size Format View

There are no files associated with this item.

HAMBORG, Felix, Norman MEUSCHKE, Corinna BREITINGER, Bela GIPP, 2017. news-please : a Generic News Crawler and Extractor. 15th International Symposium of Information Science (ISI 2017). Berlin, Germany, Mar 13, 2017 - Mar 15, 2017. In: GÄDE, Maria, ed. and others. Everything changes, everything stays the same : Understanding Information Spaces; Proceedings of the 15th International Symposium of Information Science (ISI 2017), Berlin, Germany, 13th-15th March 2017. Glückstadt:Verlag Werner Hülsbusch, pp. 218-223. ISSN 0938-8710. ISBN 978-3-86488-117-6

@inproceedings{Hamborg2017newsp-41887, title={news-please : a Generic News Crawler and Extractor}, year={2017}, number={70}, isbn={978-3-86488-117-6}, issn={0938-8710}, address={Glückstadt}, publisher={Verlag Werner Hülsbusch}, series={Schriften zur Informationswissenschaft}, booktitle={Everything changes, everything stays the same : Understanding Information Spaces; Proceedings of the 15th International Symposium of Information Science (ISI 2017), Berlin, Germany, 13th-15th March 2017}, pages={218--223}, editor={Gäde, Maria}, author={Hamborg, Felix and Meuschke, Norman and Breitinger, Corinna and Gipp, Bela} }

<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/41887"> <dc:creator>Meuschke, Norman</dc:creator> <dc:creator>Breitinger, Corinna</dc:creator> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/41887"/> <dc:creator>Hamborg, Felix</dc:creator> <dcterms:issued>2017</dcterms:issued> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2018-03-22T07:38:28Z</dc:date> <dc:contributor>Breitinger, Corinna</dc:contributor> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dc:creator>Gipp, Bela</dc:creator> <dc:contributor>Gipp, Bela</dc:contributor> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <dcterms:title>news-please : a Generic News Crawler and Extractor</dcterms:title> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2018-03-22T07:38:28Z</dcterms:available> <foaf:homepage rdf:resource="http://localhost:8080/jspui"/> <dc:contributor>Meuschke, Norman</dc:contributor> <dc:language>eng</dc:language> <dc:contributor>Hamborg, Felix</dc:contributor> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dcterms:abstract xml:lang="eng">The amount of news published and read online has increased tremendously in recent years, making news data an interesting resource for many research dis-ciplines, such as the social sciences and linguistics. However, large scale col-lection of news data is cumbersome due to a lack of generic tools for crawling and extracting such data. We present news-please, a generic, multi-language, open-source crawler and extractor for news that works out-of-the-box for a large variety of news websites. Our system allows crawling arbitrary news websites and extracting the major elements of news articles on those websites, i.e., title, lead paragraph, main content, publication date, author, and main im-age. Compared to existing tools, news-please features full website extraction requiring only the root URL.</dcterms:abstract> </rdf:Description> </rdf:RDF>

This item appears in the following Collection(s)

Search KOPS


Browse

My Account