Skip to Content.
Sympa Menu

illinois-ml-nlp-users - Re: [Illinois-ml-nlp-users] srl-demo2 hanging

illinois-ml-nlp-users AT lists.cs.illinois.edu

Subject: Support for users of CCG software closed 7-27-20

List archive

Re: [Illinois-ml-nlp-users] srl-demo2 hanging


Chronological Thread 
  • From: "Sammons, Mark" <mssammon AT illinois.edu>
  • To: Nathan Schneider <nschneid AT cs.cmu.edu>
  • Cc: "illinois-ml-nlp-users AT cs.uiuc.edu" <illinois-ml-nlp-users AT cs.uiuc.edu>
  • Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
  • Date: Tue, 24 Jul 2012 06:50:46 +0000
  • Accept-language: en-US
  • List-archive: <http://lists.cs.uiuc.edu/pipermail/illinois-ml-nlp-users>
  • List-id: Support for users of CCG software <illinois-ml-nlp-users.cs.uiuc.edu>

great -- thanks for the info.

Regards,

Mark
________________________________________
From:
neatnate AT gmail.com

[neatnate AT gmail.com]
on behalf of Nathan Schneider
[nschneid AT cs.cmu.edu]
Sent: Tuesday, July 24, 2012 1:08 AM
To: Sammons, Mark
Cc:
illinois-ml-nlp-users AT cs.uiuc.edu
Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging

Great, this allowed me to get the ant script to work.

Some notes about compiling the Charniak Parser—

My version of g++ is:
g++ (Ubuntu/Linaro 4.6.3-1ubuntu5) 4.6.3
and it was unhappy with a few files. I got it to compile with the
following fixes:

BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
BchartSm.C:654:43: error: 'strpbrk' was not declared in this scope

fixed by adding #include <cstring>

BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
BchartSm.C:655:43: error: invalid conversion from 'const char*' to
'char*' [-fpermissive]

fixed by adding 'const'

ChartBase.C: In member function 'int ChartBase::effEnd(int)':
ChartBase.C:80:26: error: 'strcmp' was not declared in this scope

#include <cstring>

ECArgs.C: In member function 'bool ECArgs::isset(char)':
ECArgs.C:78:53: error: no matching function for call to
'find(std::list<std::basic_string<char> >::iterator,
std::list<std::basic_string<char> >::iterator, std::string&)'

#include <algorithm>

FeatureTree.C: In member function 'int
FeatureTree::readOneLevel0(std::istream&, int)':
FeatureTree.C:97:36: error: 'atoi' was not declared in this scope

#include <stdlib.h>

Params.C: In member function 'void Params::init(ECArgs&)':
Params.C:67:43: error: 'strcpy' was not declared in this scope
Params.C:68:40: error: 'strchr' was not declared in this scope

#include <cstring>

utils.C: In function 'char* toLower(const char*, char*)':
utils.C:81:21: error: 'strlen' was not declared in this scope

#include <cstring>

Also, I had to change the permissions for the script
dist/CharniakServer/runIt.pl to make it executable.

Nathan

On Mon, Jul 23, 2012 at 7:14 PM, Sammons, Mark
<mssammon AT illinois.edu>
wrote:
> OK -- this is one of the bugs we need to work out. There is currently a
> naming inconsistency between projects.
>
> Look in curator/lib/ and see which of the following you can see:
>
> LBJ2.jar
> LBJ2-2.8.2.jar
> LBJ-2.8.2.jar
> LBJ2Library.jar
> LBJ2Library-2.8.2.jar
> LBJLibrary-2.8.2.jar
>
> The first 3 and last 3 overlap. Ideally, use LBJ2-2.8.2.jar or
> LBJ-2.8.2.jar as the master, and create symlinks for LBJ2.jar and whichever
> LBJ... was not present.
> Then, use LBJLibrary-2.8.2.jar or LBJ2Library-2.8.2.jar as the master, and
> symlink LBJ2Library.jar and whichever LBJ...Library... was not present.
>
> Then try compiling again.
>
> This should be resolved in the next release.
>
> Regards,
>
> Mark
> ________________________________________
> From:
> neatnate AT gmail.com
>
> [neatnate AT gmail.com]
> on behalf of Nathan Schneider
> [nschneid AT cs.cmu.edu]
> Sent: Monday, July 23, 2012 7:18 PM
> To: Sammons, Mark
> Cc:
> illinois-ml-nlp-users AT cs.uiuc.edu
> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>
> Building with `ant dist` is not quite working:
>
> compile:
> [mkdir] Created dir:
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
> warning: 'includeantruntime' was not set, defaulting to
> build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 2 source files to
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:26:
> package LBJ2.classify does not exist
> [javac] import LBJ2.classify.Classifier;
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:27:
> package LBJ2.parse does not exist
> [javac] import LBJ2.parse.LinkedVector;
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:47:
> cannot access LBJ2.learn.SparseNetworkLearner
> [javac] class file for LBJ2.learn.SparseNetworkLearner not found
> [javac] NETaggerLevel1 tagger1=new
> NETaggerLevel1(ParametersForLbjCode.currentParameters.pathToModelFile+".level1",ParametersForLbjCode.currentParameters.pathToModelFile+".level1.lex");
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
> cannot find symbol
> [javac] symbol : class LinkedVector
> [javac] location: class
> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
> [javac] Vector<LinkedVector> v = new
> Vector<LinkedVector>();
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
> cannot find symbol
> [javac] symbol : class LinkedVector
> [javac] location: class
> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
> [javac] Vector<LinkedVector> v = new
> Vector<LinkedVector>();
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:78:
> cannot find symbol
> [javac] symbol : class LinkedVector
> [javac] location: class
> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
> [javac] v.addElement(new LinkedVector());
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:81:
> cannot find symbol
> [javac] symbol : class LinkedVector
> [javac] location: class
> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
> [javac] Vector<LinkedVector> sentences =
> PlainTextReader.parseText(input);
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
> cannot find symbol
> [javac] symbol : class LinkedVector
> [javac] location: class
> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
> [javac] LinkedVector vector =
> data.documents.elementAt(0).sentences.get(i);
> [javac] ^
> [javac]
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
> cannot access LBJ2.parse.LinkedVector
> [javac] class file for LBJ2.parse.LinkedVector not found
> [javac] LinkedVector vector =
> data.documents.elementAt(0).sentences.get(i);
> [javac]
> ^
> [javac] 9 errors
>
> BUILD FAILED
> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:106: The following error
> occurred while executing this line:
> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:32: The following error
> occurred while executing this line:
> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
> Compile failed; see the compiler error output for details.
>
>
> curator-0.6.9/lib/ contains the following files:
> LBJ-2.8.2.jar
> LBJ2Library.jar
> LBJChunk.jar
> LBJCoref.jar
> LBJLibrary-2.8.2.jar
> LBJPOS.jar
> LbjNerTagger-2.1.jar
> commons-beanutils-1.7.0.jar
> commons-beanutils-core-1.8.0.jar
> commons-cli-1.2.jar
> commons-collections-3.2.1.jar
> commons-configuration-1.6.jar
> commons-digester-1.8.jar
> commons-lang-2.5.jar
> commons-logging-1.1.1.jar
> coreUtilities-0.1.2.jar
> curator-client-0.6.jar
> edison-0.2.9.jar
> illinoisSRL-3.0.3.jar
> illinoisSRL-nom-models-3.0.3.jar
> illinoisSRL-verb-models-3.0.3.jar
> junit-3.8.1.jar
> junit-4.4.jar
> jwnl-1.4_rc3.jar
> libthrift-0.4.jar
> libthrift.jar
> logback-classic-0.9.17.jar
> logback-classic-0.9.28.jar
> logback-core-0.9.17.jar
> logback-core-0.9.28.jar
> slf4j-api-1.5.8.jar
> slf4j-api-1.6.1.jar
> snowball-1.0.jar
> stanford-parser-2010-08-16.jar
>
> (I haven't downloaded the Wikifier because it's so large...that's not
> the problem, is it?)
>
> Nathan
>
> On Mon, Jul 23, 2012 at 3:40 PM, Nathan Schneider
> <nschneid AT cs.cmu.edu>
> wrote:
>> Oh cool, in that case I'll try to get Curator working (I prefer Java
>> anyway).
>>
>> Nathan
>>
>> On Mon, Jul 23, 2012 at 2:47 PM, Sammons, Mark
>> <mssammon AT illinois.edu>
>> wrote:
>>> Hi, Nathan.
>>>
>>> I'll take a look; probably a first step is to add a bunch of logging
>>> statements to get a better sense of what is failing to happen. It may
>>> take us a while to work through this, so I'm going to offer an
>>> alternative:
>>> We do have a new Java version of SRL, which depends on our "Curator"
>>> software. We're currently working on an improved version of the Curator
>>> software, and are planning to release it by the end of the summer. But
>>> we also have a working version of the Curator + SRL that you could try if
>>> you are willing; installation is not yet as straightforward as we'd like.
>>>
>>> If you want to try this current version, you can get it here:
>>>
>>> http://cogcomp.cs.illinois.edu/trac/wiki/Curator
>>>
>>> -- this page also has some documentation for Curator. The bootstrap.sh
>>> script that you run as part of the installation process will download SRL
>>> and other UI NLP tools that may interest you. You don't have to run them
>>> all, and Curator allows you to run different NLP tools on different
>>> machines as some of the tools are quite memory hungry. But you could
>>> just run the SRL and its dependencies (which should be clear from the
>>> Curator config files)
>>> on a single machine if it has 8G of RAM or more. (This is playing it
>>> pretty safe).
>>>
>>> You may also want to use Edison, a java library that allows more
>>> straightforward interactions with the Curator server and provides a lot
>>> of NLP data structures and supporting functionality, which is here:
>>>
>>> http://cogcomp.cs.illinois.edu/page/software_view/Edison
>>>
>>> -- when you agree to the academic license, it will show a page with some
>>> introductory material for using Edison.
>>>
>>> Please let me know what you decide.
>>>
>>> Regards,
>>>
>>> Mark
>>>
>>>
>>> ________________________________________
>>> From:
>>> neatnate AT gmail.com
>>>
>>> [neatnate AT gmail.com]
>>> on behalf of Nathan Schneider
>>> [nschneid AT cs.cmu.edu]
>>> Sent: Monday, July 23, 2012 4:15 PM
>>> To: Sammons, Mark
>>> Cc:
>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>
>>> Mark,
>>>
>>> With that sentence it's the same except in the logs, fexidentification
>>> has "Processing..." 3 times and fexclassification has "Processing..."
>>> 2 times.
>>>
>>> Nathan
>>>
>>> On Mon, Jul 23, 2012 at 2:08 PM, Sammons, Mark
>>> <mssammon AT illinois.edu>
>>> wrote:
>>>> Hi, Nathan.
>>>>
>>>> Do you get the same result with a longer sentence -- say, "John said he
>>>> read the book and laughed."?
>>>>
>>>> Regards,
>>>>
>>>> Mark
>>>>
>>>> ________________________________________
>>>> From:
>>>> neatnate AT gmail.com
>>>>
>>>> [neatnate AT gmail.com]
>>>> on behalf of Nathan Schneider
>>>> [nschneid AT cs.cmu.edu]
>>>> Sent: Monday, July 23, 2012 3:53 PM
>>>> To: Sammons, Mark
>>>> Cc:
>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>
>>>> Mark,
>>>>
>>>> Thanks for the reply. That does indeed solve the hanging problem, so
>>>> the tool now terminates—but unfortunately it does so without printing
>>>> any result. Here is what I'm trying:
>>>>
>>>> $ echo "Misery loves company ." | ./srl-client-primitive.pl 0 0
>>>>
>>>> The output in the logs is as follows:
>>>>
>>>> ==> charniak-server.log <==
>>>> [Connect from LOCALHOST]
>>>> Parse: <s> Misery loves company . </s>
>>>> Parse ok
>>>> [Connection closed from LOCALHOST]
>>>>
>>>> ==> classification.log <==
>>>> [Connect from LOCALHOST]
>>>>
>>>> ==> fexclassification.log <==
>>>> fex: got connection from 127.0.0.1
>>>> Waiting for clients...
>>>> Processing...
>>>>
>>>> ==> fexidentification.log <==
>>>> fex: got connection from 127.0.0.1
>>>> Waiting for clients...
>>>> Processing...
>>>> Closing client socket...
>>>>
>>>> ==> identification.log <==
>>>> [Connect from LOCALHOST]
>>>> [Connection closed from LOCALHOST]
>>>>
>>>> ==> snowclassification.log <==
>>>> SNoW: got connection from 127.0.0.1
>>>> Waiting for clients...
>>>> Options: -o allactivations
>>>>
>>>> ==> snowidentification.log <==
>>>> SNoW: got connection from 127.0.0.1
>>>> Waiting for clients...
>>>> Options: -o allactivations
>>>> Closing client socket...
>>>>
>>>> ==> srlservercentral.log <==
>>>> [Connect from LOCALHOST]
>>>>
>>>> ==> classification.log <==
>>>> [Connection closed from LOCALHOST]
>>>>
>>>> ==> fexclassification.log <==
>>>> Closing client socket...
>>>>
>>>> ==> snowclassification.log <==
>>>> Closing client socket...
>>>>
>>>> ==> srlservercentral.log <==
>>>> [Connection closed from LOCALHOST]
>>>>
>>>>
>>>> Any suggestions for how I should go about debugging this?
>>>>
>>>> Cheers,
>>>> Nathan
>>>>
>>>> On Mon, Jul 23, 2012 at 11:51 AM, Sammons, Mark
>>>> <mssammon AT illinois.edu>
>>>> wrote:
>>>>> Hi, Nathan.
>>>>>
>>>>> Please try the following: in bin/inference.pl on line 107, you should
>>>>> see the line:
>>>>>
>>>>> my $search_mode = 2;
>>>>>
>>>>> please change it to
>>>>>
>>>>> my $search_mode = 1;
>>>>>
>>>>> and retry. Please let me know if this fixes the problem.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Mark
>>>>>
>>>>> ________________________________________
>>>>> From:
>>>>> illinois-ml-nlp-users-bounces AT cs.uiuc.edu
>>>>>
>>>>> [illinois-ml-nlp-users-bounces AT cs.uiuc.edu]
>>>>> on behalf of Nathan Schneider
>>>>> [nschneid AT cs.cmu.edu]
>>>>> Sent: Friday, July 20, 2012 2:47 PM
>>>>> To:
>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>
>>>>> Hi,
>>>>>
>>>>> I am trying to use the SRL system and am encountering the same issue
>>>>> (it hangs during beam search). Has a solution been found?
>>>>>
>>>>> Thanks,
>>>>> Nathan
>>>>>
>>>>> http://lists.cs.uiuc.edu/pipermail/illinois-ml-nlp-users/2011-May/000090.html
>>>>>
>>>>> On Wed May 11 19:51:58 CDT 2011, Steven Corman <steve.corman at
>>>>> asu.edu> wrote:
>>>>>> Greetings. I am trying to get the semantic role labeler running. I
>>>>>> think I have got everything compiled and configured properly, but when
>>>>>> I try to process a single, simple tokenized sentence, it hangs at some
>>>>>> point along the way. It appears from the log files (contents below)
>>>>>> that all of the components with logs are working as they should. The
>>>>>> problem seems to be in the bin/beamsearch/search executable.
>>>>>>
>>>>>> As you can see from the top iteration captures (below the log
>>>>>> contents, showing only processes using CPU to save space) at the
>>>>>> second iteration several srl components are running and a zombie
>>>>>> appears. By the next iteration, search, fex, and snow are running.
>>>>>> By the last it's just search, consuming almost all of one cpu (out of
>>>>>> two). It sits there like that ad infinitum. If I kill the process
>>>>>> holding search, inference.pl comes to the top, runs for a while, then
>>>>>> the job ends with no output. The /tmp/2127.result file mentioned in
>>>>>> the srlservercental log is filled with several thousand lines that
>>>>>> say: double beam!!
>>>>>>
>>>>>> Anyone have a suggestion for what might be wrong, or how to debug?
>>>>>>
>>>>>> Cheers,
>>>>>>
>>>>>> Steve
>>>>> _______________________________________________
>>>>> illinois-ml-nlp-users mailing list
>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>> http://lists.cs.uiuc.edu/mailman/listinfo/illinois-ml-nlp-users





Archive powered by MHonArc 2.6.16.

Top of Page