Some suggested algorithms to add

[danyaljj]

From Mallet: https://github.com/mimno/Mallet/tree/master/src/cc/mallet/classify

• Maximum Entropy classifier: https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/MCMaxEnt.java
• Rank Maximum Entropy classifier : https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/RankMaxEnt.java
• Posterior Regularization:
  https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/MaxEntPRTrainer.java
• Decision Tree
• Balanced Winnow: https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/DecisionTree.java

[danr-ccg]

I think that most of these will be difficult to fit into our framework. We should talk about it.

        Dan

From: Daniel Khashabi [mailto:[email protected]]
Sent: Tuesday, April 12, 2016 12:14 AM
To: IllinoisCogComp/lbjava
Subject: [IllinoisCogComp/lbjava] Some suggested algorithms to add (#54)

From Mallet: https://github.com/mimno/Mallet/tree/master/src/cc/mallet/classifyhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_mimno_Mallet_tree_master_src_cc_mallet_classify&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=7RzFemxrTtZxV5rw6OivXTLdEdXzof_jUb9e7X7Fu7c&e=

• Maximum Entropy classifier: https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/MCMaxEnt.javahttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_mimno_Mallet_blob_master_src_cc_mallet_classify_MCMaxEnt.java&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=ile_0KIZ17G2Ekg3hXnGxFOENGZoZgpAjUjSOsZaxDs&e=
• Rank Maximum Entropy classifier : https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/RankMaxEnt.javahttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_mimno_Mallet_blob_master_src_cc_mallet_classify_RankMaxEnt.java&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=rQnGAI9JlrSDGzpjwCkKPWIa1WDxGSmyMhvN-QlK7sg&e=
• Posterior Regularization: https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/MaxEntPRTrainer.javahttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_mimno_Mallet_blob_master_src_cc_mallet_classify_MaxEntPRTrainer.java&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=IDNuVc33lbItv8XWkbPvSkh8L5fbDKxJldv-IkQTP10&e=
• Decision Tree
• Balanced Winnow: https://github.com/mimno/Mallet/blob/master/src/cc/mallet/classify/DecisionTree.javahttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_mimno_Mallet_blob_master_src_cc_mallet_classify_DecisionTree.java&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=HnxYc55BY32c0pXqsWCZU_4Awq5prxbDcO8w0-tJAz4&e=

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_IllinoisCogComp_lbjava_issues_54&d=BQMCaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=EoEIPOcXriNKNTRQxPa5uv7hPypxUE6tE_RlGOluh-c&m=c8SdVU954cAmQCQ_6LVWFl2yPkuIeFlVmZWY9b2cXUc&s=xPyUIKZ8zJPyq4LXCHGLNuqpp8_BgQ0FOc4AQ0b2gWM&e=

[danyaljj]

Suggested algorithms by others. I'm quoting:

Alla:

This is cool. I did not know that nowadays LBJ has so many algorithms. I wonder why there is no max entropy, as it seems like a very popular algorithm for many NLP tasks.

Shyam:

I was looking for a way to do logistic regression with LBJava. I am not sure logistic regression is supported by LBJava, although I did see the SGD regression example. Is it possible? can someone point me to a code?