If you write out a stack (or network) in XFST to a prolog file:

write prolog > mymorph.plg

and you want to convert it to DOT and visualize it in Graphviz, here is a Python 3.x script to do so:

Download zipped Python source
View Python code

Read More...

Tags: XFST, DOT, Python

I am offering an intensive class for the LING519 students, all the Linguist List people, and whoever might be interested, this Saturday 19th of Nov. 2011 at 10 AM Eastern Time in Cooper, the LinguistList Suite. We plan to meet for 4 hours or more, depending on speed and interest. Let me know, if you are interested. If you want to join us, let me know. I will share the screen and the audio already with Zadar, we can include you, if you cannot come. The topics covered might be:

Intro to Python 3
Using Komodo Edit 6.x
Processing corpora like the Brown corpus (raw text with slash-pos, or TEI XML), the Penn Treebank, the Croatian Language Corpus etc.
Generating statistical models and profiles: frequency profiles, N-gram models
Calculating significance, mutual information, relative entropy, …
Simple Finite State Machines
Simple Parsers
Generating outputs of analyses: CSV, HTML, XML, etc.
…

DC
Read More...

Tags: Corpuslinguistics, Python, XML, Brown corpus, Penn Treebank, Komodo Edit, Croatian Language Corpus, CLC, Parsing, FSA, FST

The Charty parser code is updated to Python 3.x (implementing an Earley parser for context-free grammars), and a compact module, TextStat.py, with some useful functions for N-gram models, frequency profiles, vector space models, statistical analyses, information theoretic measures (entropy, mutual information, etc.). If you have comments, or you find some bug or error, let me know.
Read More...

Tags: Parsing, Syntax, Statistics, Python, Entropy, Classification, N-Gram Model, Significance