BITS Faculty Publications

Permanent URI for this communityhttp://localhost:4000/handle/123456789/1867

Browse

Filters

20191

Settings

Author: search.filters.author.Sharma, YashvardhanSubject: search.filters.subject.Data mining

Search Results

Now showing 1 - 1 of 1
  • No Thumbnail Available
    Item
    Language Identification and Context-based Analysis of Code-switching Behaviors in Social Media Discussions
    (IEEE, 2019) Sharma, Yashvardhan
    Social media discussions see the participation of multilingual individuals: who tend to utilize alternate languages in a single post (code-switching) for effective communication in a discussion. This paper attempts to characterize such discussions to analyze contextual factors related to multilingual communities. Features extracted from the posts are used to train a CRF-based sequence labeling algorithm for language identification in an intra-sentential code-switching scenario. The context of a sentence in a discussion is modeled in defining relevance through Term Frequency Inverse Document Frequency (TF-IDF). Further context of a multilingual sentence with respect to the discussion such as agreement and questioning between pairs of posts is also modeled.