oru.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Can We Quantify Domainhood?: Exploring Measures to Assess Domain-Specificity in Web Corpora
RISE SICS, Linköping, Sweden.
RISE SICS, Linköping, Sweden; Linköping University, Linköping, Sweden.
RISE SICS, Linköping, Sweden; Linköping University, Linköping, Sweden.
Örebro universitet, Institutionen för naturvetenskap och teknik.ORCID-id: 0000-0002-4001-2087
Visa övriga samt affilieringar
2018 (Engelska)Ingår i: Database and Expert Systems Applications: EXA 2018 International Workshops / [ed] Elloumi, M.; Granitzer, M.; Hameurlain, A.; Seifert, C.; Stein, B.; Tjoa, AM.; Wagner, R., Springer Berlin/Heidelberg, 2018, s. 207-217Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Web corpora are a cornerstone of modern Language Technology. Corpora built from the web are convenient because their creation is fast and inexpensive. Several studies have been carried out to assess the representativeness of general-purpose web corpora by comparing them to traditional corpora. Less attention has been paid to assess the representativeness of specialized or domain-specific web corpora. In this paper, we focus on the assessment of domain representativeness of web corpora and we claim that it is possible to assess the degree of domainspecificity, or domainhood, of web corpora. We present a case study where we explore the effectiveness of different measures - namely the Mann-Withney-Wilcoxon Test, Kendall correlation coefficient, Kullback-Leibler divergence, log-likelihood and burstiness - to gauge domainhood. Our findings indicate that burstiness is the most suitable measure to single out domain-specific words from a specialized corpus and to allow for the quantification of domainhood.

Ort, förlag, år, upplaga, sidor
Springer Berlin/Heidelberg, 2018. s. 207-217
Serie
Communications in Computer and Information Science, ISSN 1865-0929, E-ISSN 1865-0937 ; 903
Nationell ämneskategori
Datavetenskap (datalogi)
Identifikatorer
URN: urn:nbn:se:oru:diva-73233DOI: 10.1007/978-3-319-99133-7_17ISI: 000460552400017Scopus ID: 2-s2.0-85052001976ISBN: 978-3-319-99133-7 (digital)ISBN: 978-3-319-99132-0 (tryckt)OAI: oai:DiVA.org:oru-73233DiVA, id: diva2:1297164
Konferens
29th International Conference on Database and Expert Systems Applications (DEXA), Regensburg, Germany, September 3-6, 2018
Tillgänglig från: 2019-03-19 Skapad: 2019-03-19 Senast uppdaterad: 2019-03-19Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Personposter BETA

Alirezaie, Marjan

Sök vidare i DiVA

Av författaren/redaktören
Alirezaie, Marjan
Av organisationen
Institutionen för naturvetenskap och teknik
Datavetenskap (datalogi)

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 52 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf