Support for users of CCG software closed 7-27-20

[Nathan Schneider <nschneid AT cs.cmu.edu>]

OK, I am able to start the Charniak Parser Server successfully.

However, upon starting the verb SRL system I get the WordNet exception
described in the INSTALL file, and I cannot find the appropriate
WordNet directory to point to:

$ ls curator-0.6.9/curator-annotators/illinois-verb-srl/data/
$ ls curator-0.6.9/dist/data/
englishPCFG.ser.gz
ner-ext

Am I looking in the right place?

Nathan

On Mon, Jul 23, 2012 at 11:50 PM, Sammons, Mark 
<mssammon AT illinois.edu>
 wrote:
> great -- thanks for the info.
>
> Regards,
>
> Mark
> ________________________________________
> From: 
> neatnate AT gmail.com
>  
> [neatnate AT gmail.com]
>  on behalf of Nathan Schneider 
> [nschneid AT cs.cmu.edu]
> Sent: Tuesday, July 24, 2012 1:08 AM
> To: Sammons, Mark
> Cc: 
> illinois-ml-nlp-users AT cs.uiuc.edu
> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>
> Great, this allowed me to get the ant script to work.
>
> Some notes about compiling the Charniak Parser—
>
> My version of g++ is:
>    g++ (Ubuntu/Linaro 4.6.3-1ubuntu5) 4.6.3
> and it was unhappy with a few files. I got it to compile with the
> following fixes:
>
> BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
> BchartSm.C:654:43: error: 'strpbrk' was not declared in this scope
>
>     fixed by adding #include <cstring>
>
> BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
> BchartSm.C:655:43: error: invalid conversion from 'const char*' to
> 'char*' [-fpermissive]
>
>     fixed by adding 'const'
>
> ChartBase.C: In member function 'int ChartBase::effEnd(int)':
> ChartBase.C:80:26: error: 'strcmp' was not declared in this scope
>
>     #include <cstring>
>
> ECArgs.C: In member function 'bool ECArgs::isset(char)':
> ECArgs.C:78:53: error: no matching function for call to
> 'find(std::list<std::basic_string<char> >::iterator,
> std::list<std::basic_string<char> >::iterator, std::string&)'
>
>     #include <algorithm>
>
> FeatureTree.C: In member function 'int
> FeatureTree::readOneLevel0(std::istream&, int)':
> FeatureTree.C:97:36: error: 'atoi' was not declared in this scope
>
>     #include <stdlib.h>
>
> Params.C: In member function 'void Params::init(ECArgs&)':
> Params.C:67:43: error: 'strcpy' was not declared in this scope
> Params.C:68:40: error: 'strchr' was not declared in this scope
>
>     #include <cstring>
>
> utils.C: In function 'char* toLower(const char*, char*)':
> utils.C:81:21: error: 'strlen' was not declared in this scope
>
>     #include <cstring>
>
> Also, I had to change the permissions for the script
> dist/CharniakServer/runIt.pl to make it executable.
>
> Nathan
>
> On Mon, Jul 23, 2012 at 7:14 PM, Sammons, Mark 
> <mssammon AT illinois.edu>
>  wrote:
>> OK -- this is one of the bugs we need to work out.  There is currently a 
>> naming inconsistency between projects.
>>
>> Look in curator/lib/ and see which of the following you can see:
>>
>> LBJ2.jar
>> LBJ2-2.8.2.jar
>> LBJ-2.8.2.jar
>> LBJ2Library.jar
>> LBJ2Library-2.8.2.jar
>> LBJLibrary-2.8.2.jar
>>
>> The first 3 and last 3 overlap. Ideally, use LBJ2-2.8.2.jar or 
>> LBJ-2.8.2.jar as the master, and create symlinks for LBJ2.jar and 
>> whichever LBJ... was not present.
>> Then, use LBJLibrary-2.8.2.jar or LBJ2Library-2.8.2.jar as the master, and 
>> symlink LBJ2Library.jar and whichever LBJ...Library... was not present.
>>
>> Then try compiling again.
>>
>> This should be resolved in the next release.
>>
>> Regards,
>>
>> Mark
>> ________________________________________
>> From: 
>> neatnate AT gmail.com
>>  
>> [neatnate AT gmail.com]
>>  on behalf of Nathan Schneider 
>> [nschneid AT cs.cmu.edu]
>> Sent: Monday, July 23, 2012 7:18 PM
>> To: Sammons, Mark
>> Cc: 
>> illinois-ml-nlp-users AT cs.uiuc.edu
>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>
>> Building with `ant dist` is not quite working:
>>
>> compile:
>>     [mkdir] Created dir:
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
>> warning: 'includeantruntime' was not set, defaulting to
>> build.sysclasspath=last; set to false for repeatable builds
>>     [javac] Compiling 2 source files to
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:26:
>> package LBJ2.classify does not exist
>>     [javac] import LBJ2.classify.Classifier;
>>     [javac]                     ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:27:
>> package LBJ2.parse does not exist
>>     [javac] import LBJ2.parse.LinkedVector;
>>     [javac]                  ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:47:
>> cannot access LBJ2.learn.SparseNetworkLearner
>>     [javac] class file for LBJ2.learn.SparseNetworkLearner not found
>>     [javac]             NETaggerLevel1 tagger1=new
>> NETaggerLevel1(ParametersForLbjCode.currentParameters.pathToModelFile+".level1",ParametersForLbjCode.currentParameters.pathToModelFile+".level1.lex");
>>     [javac]                                    ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
>> cannot find symbol
>>     [javac] symbol  : class LinkedVector
>>     [javac] location: class
>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>     [javac]                     Vector<LinkedVector> v = new 
>> Vector<LinkedVector>();
>>     [javac]                            ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
>> cannot find symbol
>>     [javac] symbol  : class LinkedVector
>>     [javac] location: class
>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>     [javac]                     Vector<LinkedVector> v = new 
>> Vector<LinkedVector>();
>>     [javac]                                                         ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:78:
>> cannot find symbol
>>     [javac] symbol  : class LinkedVector
>>     [javac] location: class
>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>     [javac]                     v.addElement(new LinkedVector());
>>     [javac]                                      ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:81:
>> cannot find symbol
>>     [javac] symbol  : class LinkedVector
>>     [javac] location: class
>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>     [javac]             Vector<LinkedVector> sentences = 
>> PlainTextReader.parseText(input);
>>     [javac]                    ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
>> cannot find symbol
>>     [javac] symbol  : class LinkedVector
>>     [javac] location: class
>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>     [javac]                     LinkedVector vector =
>> data.documents.elementAt(0).sentences.get(i);
>>     [javac]                     ^
>>     [javac] 
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
>> cannot access LBJ2.parse.LinkedVector
>>     [javac] class file for LBJ2.parse.LinkedVector not found
>>     [javac]                     LinkedVector vector =
>> data.documents.elementAt(0).sentences.get(i);
>>     [javac]                                                                
>>                     ^
>>     [javac] 9 errors
>>
>> BUILD FAILED
>> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:106: The following error
>> occurred while executing this line:
>> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:32: The following error
>> occurred while executing this line:
>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
>> Compile failed; see the compiler error output for details.
>>
>>
>> curator-0.6.9/lib/ contains the following files:
>> LBJ-2.8.2.jar
>> LBJ2Library.jar
>> LBJChunk.jar
>> LBJCoref.jar
>> LBJLibrary-2.8.2.jar
>> LBJPOS.jar
>> LbjNerTagger-2.1.jar
>> commons-beanutils-1.7.0.jar
>> commons-beanutils-core-1.8.0.jar
>> commons-cli-1.2.jar
>> commons-collections-3.2.1.jar
>> commons-configuration-1.6.jar
>> commons-digester-1.8.jar
>> commons-lang-2.5.jar
>> commons-logging-1.1.1.jar
>> coreUtilities-0.1.2.jar
>> curator-client-0.6.jar
>> edison-0.2.9.jar
>> illinoisSRL-3.0.3.jar
>> illinoisSRL-nom-models-3.0.3.jar
>> illinoisSRL-verb-models-3.0.3.jar
>> junit-3.8.1.jar
>> junit-4.4.jar
>> jwnl-1.4_rc3.jar
>> libthrift-0.4.jar
>> libthrift.jar
>> logback-classic-0.9.17.jar
>> logback-classic-0.9.28.jar
>> logback-core-0.9.17.jar
>> logback-core-0.9.28.jar
>> slf4j-api-1.5.8.jar
>> slf4j-api-1.6.1.jar
>> snowball-1.0.jar
>> stanford-parser-2010-08-16.jar
>>
>> (I haven't downloaded the Wikifier because it's so large...that's not
>> the problem, is it?)
>>
>> Nathan
>>
>> On Mon, Jul 23, 2012 at 3:40 PM, Nathan Schneider 
>> <nschneid AT cs.cmu.edu>
>>  wrote:
>>> Oh cool, in that case I'll try to get Curator working (I prefer Java 
>>> anyway).
>>>
>>> Nathan
>>>
>>> On Mon, Jul 23, 2012 at 2:47 PM, Sammons, Mark 
>>> <mssammon AT illinois.edu>
>>>  wrote:
>>>> Hi, Nathan.
>>>>
>>>> I'll take a look; probably a first step is to add a bunch of logging 
>>>> statements to get a better sense of what is failing to happen.  It may 
>>>> take us a while to work through this, so I'm going to offer an 
>>>> alternative:
>>>> We do have a new Java version of SRL, which depends on our "Curator" 
>>>> software.  We're currently working on an improved version of the Curator 
>>>> software, and are planning to release it by the end of the summer.  But 
>>>> we also have a working version of the Curator + SRL that you could try 
>>>> if you are willing; installation is not yet as straightforward as we'd 
>>>> like.
>>>>
>>>> If you want to try this current version, you can get it here:
>>>>
>>>> http://cogcomp.cs.illinois.edu/trac/wiki/Curator
>>>>
>>>> -- this page also has some documentation for Curator.  The bootstrap.sh 
>>>> script that you run as part of the installation process will download 
>>>> SRL and other UI NLP tools that may interest you.  You don't have to run 
>>>> them all, and Curator allows you to run different NLP tools on different 
>>>> machines as some of the tools are quite memory hungry.  But you could 
>>>> just run the SRL and its dependencies (which should be clear from the 
>>>> Curator config files)
>>>> on a single machine if it has 8G of RAM or more. (This is playing it 
>>>> pretty safe).
>>>>
>>>> You may also want to use Edison, a java library that allows more 
>>>> straightforward interactions with the Curator server and provides a lot 
>>>> of NLP data structures and supporting functionality, which is here:
>>>>
>>>> http://cogcomp.cs.illinois.edu/page/software_view/Edison
>>>>
>>>> -- when you agree to the academic license, it will show a page with some 
>>>> introductory material for using Edison.
>>>>
>>>> Please let me know what you decide.
>>>>
>>>> Regards,
>>>>
>>>> Mark
>>>>
>>>>
>>>> ________________________________________
>>>> From: 
>>>> neatnate AT gmail.com
>>>>  
>>>> [neatnate AT gmail.com]
>>>>  on behalf of Nathan Schneider 
>>>> [nschneid AT cs.cmu.edu]
>>>> Sent: Monday, July 23, 2012 4:15 PM
>>>> To: Sammons, Mark
>>>> Cc: 
>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>
>>>> Mark,
>>>>
>>>> With that sentence it's the same except in the logs, fexidentification
>>>> has "Processing..." 3 times and fexclassification has "Processing..."
>>>> 2 times.
>>>>
>>>> Nathan
>>>>
>>>> On Mon, Jul 23, 2012 at 2:08 PM, Sammons, Mark 
>>>> <mssammon AT illinois.edu>
>>>>  wrote:
>>>>> Hi, Nathan.
>>>>>
>>>>> Do you get the same result with a longer sentence -- say, "John said he 
>>>>> read the book and laughed."?
>>>>>
>>>>> Regards,
>>>>>
>>>>> Mark
>>>>>
>>>>> ________________________________________
>>>>> From: 
>>>>> neatnate AT gmail.com
>>>>>  
>>>>> [neatnate AT gmail.com]
>>>>>  on behalf of Nathan Schneider 
>>>>> [nschneid AT cs.cmu.edu]
>>>>> Sent: Monday, July 23, 2012 3:53 PM
>>>>> To: Sammons, Mark
>>>>> Cc: 
>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>
>>>>> Mark,
>>>>>
>>>>> Thanks for the reply. That does indeed solve the hanging problem, so
>>>>> the tool now terminates—but unfortunately it does so without printing
>>>>> any result. Here is what I'm trying:
>>>>>
>>>>> $ echo "Misery loves company ." | ./srl-client-primitive.pl 0 0
>>>>>
>>>>> The output in the logs is as follows:
>>>>>
>>>>> ==> charniak-server.log <==
>>>>> [Connect from LOCALHOST]
>>>>> Parse: <s> Misery loves company . </s>
>>>>> Parse ok
>>>>> [Connection closed from LOCALHOST]
>>>>>
>>>>> ==> classification.log <==
>>>>> [Connect from LOCALHOST]
>>>>>
>>>>> ==> fexclassification.log <==
>>>>> fex: got connection from 127.0.0.1
>>>>> Waiting for clients...
>>>>> Processing...
>>>>>
>>>>> ==> fexidentification.log <==
>>>>> fex: got connection from 127.0.0.1
>>>>> Waiting for clients...
>>>>> Processing...
>>>>> Closing client socket...
>>>>>
>>>>> ==> identification.log <==
>>>>> [Connect from LOCALHOST]
>>>>> [Connection closed from LOCALHOST]
>>>>>
>>>>> ==> snowclassification.log <==
>>>>> SNoW: got connection from 127.0.0.1
>>>>> Waiting for clients...
>>>>> Options: -o allactivations
>>>>>
>>>>> ==> snowidentification.log <==
>>>>> SNoW: got connection from 127.0.0.1
>>>>> Waiting for clients...
>>>>> Options: -o allactivations
>>>>> Closing client socket...
>>>>>
>>>>> ==> srlservercentral.log <==
>>>>> [Connect from LOCALHOST]
>>>>>
>>>>> ==> classification.log <==
>>>>> [Connection closed from LOCALHOST]
>>>>>
>>>>> ==> fexclassification.log <==
>>>>> Closing client socket...
>>>>>
>>>>> ==> snowclassification.log <==
>>>>> Closing client socket...
>>>>>
>>>>> ==> srlservercentral.log <==
>>>>> [Connection closed from LOCALHOST]
>>>>>
>>>>>
>>>>> Any suggestions for how I should go about debugging this?
>>>>>
>>>>> Cheers,
>>>>> Nathan
>>>>>
>>>>> On Mon, Jul 23, 2012 at 11:51 AM, Sammons, Mark 
>>>>> <mssammon AT illinois.edu>
>>>>>  wrote:
>>>>>> Hi, Nathan.
>>>>>>
>>>>>> Please try the following: in bin/inference.pl on line 107, you should 
>>>>>> see the line:
>>>>>>
>>>>>> my $search_mode = 2;
>>>>>>
>>>>>> please change it to
>>>>>>
>>>>>> my $search_mode = 1;
>>>>>>
>>>>>> and retry.  Please let me know if this fixes the problem.
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Mark
>>>>>>
>>>>>> ________________________________________
>>>>>> From: 
>>>>>> illinois-ml-nlp-users-bounces AT cs.uiuc.edu
>>>>>>  
>>>>>> [illinois-ml-nlp-users-bounces AT cs.uiuc.edu]
>>>>>>  on behalf of Nathan Schneider 
>>>>>> [nschneid AT cs.cmu.edu]
>>>>>> Sent: Friday, July 20, 2012 2:47 PM
>>>>>> To: 
>>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I am trying to use the SRL system and am encountering the same issue
>>>>>> (it hangs during beam search). Has a solution been found?
>>>>>>
>>>>>> Thanks,
>>>>>> Nathan
>>>>>>
>>>>>> http://lists.cs.uiuc.edu/pipermail/illinois-ml-nlp-users/2011-May/000090.html
>>>>>>
>>>>>> On Wed May 11 19:51:58 CDT 2011, Steven Corman <steve.corman at 
>>>>>> asu.edu>  wrote:
>>>>>>> Greetings.  I am trying to get the semantic role labeler running.  I
>>>>>>> think I have got everything compiled and configured properly, but when
>>>>>>> I try to process a single, simple tokenized sentence, it hangs at some
>>>>>>> point along the way.  It appears from the log files (contents below)
>>>>>>> that all of the components with logs are working as they should.  The
>>>>>>> problem seems to be in the bin/beamsearch/search executable.
>>>>>>>
>>>>>>> As you can see from the top iteration captures (below the log
>>>>>>> contents, showing only processes using CPU to save space)  at the
>>>>>>> second iteration several srl components are running and a zombie
>>>>>>> appears.  By the next iteration, search, fex, and snow are running.
>>>>>>> By the last it's just search, consuming almost all of one cpu (out of
>>>>>>> two).  It sits there like that ad infinitum.  If I kill the process
>>>>>>> holding search, inference.pl comes to the top, runs for a while, then
>>>>>>> the job ends with no output.  The /tmp/2127.result file mentioned in
>>>>>>> the srlservercental log is filled with several thousand lines that
>>>>>>> say: double beam!!
>>>>>>>
>>>>>>> Anyone have a suggestion for what might be wrong, or how to debug?
>>>>>>>
>>>>>>> Cheers,
>>>>>>>
>>>>>>> Steve
>>>>>> _______________________________________________
>>>>>> illinois-ml-nlp-users mailing list
>>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>>> http://lists.cs.uiuc.edu/mailman/listinfo/illinois-ml-nlp-users