com.articulate.sigma.nlp

Class TFIDFUtil

java.lang.Object

com.articulate.sigma.nlp.TFIDFUtil

public class TFIDFUtil
extends java.lang.Object

Created by areed on 3/4/15.

Constructor Summary

Constructors

Constructor and Description
TFIDFUtil()

Method Summary

Modifier and Type	Method and Description
static java.util.List<java.lang.String>	readFile(java.lang.String filename, boolean separateSentences) This method reads in a text file, breaking it into single line documents Currently, sentences are not separated if they occur on the same line.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TFIDFUtil

public TFIDFUtil()

Method Detail

readFile

public static java.util.List<java.lang.String> readFile(java.lang.String filename,
                                                        boolean separateSentences)
                                                 throws java.io.IOException

This method reads in a text file, breaking it into single line documents Currently, sentences are not separated if they occur on the same line.

Parameters:

filename - file to be read

separateSentences - should sentences be separated if they occur on one line

Returns:

list of strings from each line of the document

Throws:

java.io.IOException