Support for users of CCG software closed 7-27-20

[Labhesh <labhesh AT gmail.com>]

Well, the more bizarre thing is - when I run the ./startServers from curator/dist, it all runs fine after changing in the txt file you sent earlier. So it was not working earlier. I came home from work, reconnected to the AWS instance, went into curator/dist and did the ./startServers.sh and everything seems to be running fine.

Thanks a bunch for all your help.

On another note, you might want to change the bootstrap.sh and make the following change:

Change to mv IllinoisLemmatizer/data/* $ANNOTATORDIR/illinois-lemmatizer/ (/* added after data) in bootstrap.sh  (the /* after data is needed otherwise it complains that mv cannot mv a directory)

On Fri, Mar 14, 2014 at 10:18 PM, Sammons, Mark <mssammon AT illinois.edu> wrote:

Bizarre.  The key just names a cache file for the lemmatizer to speed it up over time. You can manually change the file named in the startup command for the lemmatizer server -- I'm assuming that you're running it from curator/dist, in which case a good place for the cache file is data/lemmaCache.txt -- so you could add the line

lemmaCacheFile    data/lemmaCacheTxt

then start the server with

bin/illinois-lemmatizer-server.sh -c configs/lemmatizerConfig.txt -p 19125

(or whatever port you want it to run on -- one is specified in the startServers.sh script).

Mark

---

From: Labhesh [labhesh AT gmail.com]
Sent: Friday, March 14, 2014 5:27 PM
To: Sammons, Mark
Cc: Vivek Srikumar; illinois-ml-nlp-users AT cs.uiuc.edu

Subject: Re: [Illinois-ml-nlp-users] Error while running startServers.sh (Curator)

Hi Mark,

Replaced it- still the same problem. Where exactly is the key being looked for? Is this something that is being looked for in MongoDB downstream?

edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer constructor: initializing...

Exception in thread "main" java.lang.IllegalArgumentException: ERROR: ResourceLoader.getString(): no entry for key 'lemmaCacheFile'.

at edu.illinois.cs.cogcomp.core.utilities.ResourceManager.getString(ResourceManager.java:117)

at edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer.<init>(AugmentedLemmatizer.java:107)

at edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer.init(AugmentedLemmatizer.java:91)

at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:50)

at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:40)

at edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer.main(IllinoisLemmatizerServer.java:53)

On Fri, Mar 14, 2014 at 2:23 PM, Sammons, Mark <mssammon AT illinois.edu> wrote:

Hi, Labhesh.

There is an updated config file for lemmatizer attached.

Please copy it to curator/dist/configs.  It should replace the previous lemmatizer config file.

Mark

---

From: Labhesh [labhesh AT gmail.com]
Sent: Friday, March 14, 2014 4:16 PM
To: Vivek Srikumar
Cc: Sammons, Mark; illinois-ml-nlp-users AT cs.uiuc.edu
Subject: Re: [Illinois-ml-nlp-users] Error while running startServers.sh (Curator)

Hi Vivek,

I did what you suggested. I am still getting errors. To resolve the earlier error of not being able to find ResourceManager, I did a grep on all the jar files in dist/lib to find ResourceManager and found that coreUtilities-0.1.4.jar and coreUtilities-0.1.7.jar have that class file. As such, I modified the classpath  to point to coreUtilities-0.1.7.jar. Also, I changed the classpath to point to illinois-lemmatizer-0.0.4.jar as you suggested.

But now the error I am getting is the following (error is towards the end of the log) :

[root@ip-10-146-255-16 dist]# bin/illinois-lemmatizer-server.sh -p 16015 

bin/illinois-lemmatizer-server.sh: running command 'java -cp /root/curator-1.0.6/dist:/root/curator-1.0.6/dist/components/illinois-lemmatizer-server.jar:/root/curator-1.0.6/dist/components/curator-interfaces.jar:/root/curator-1.0.6/dist:/root/curator-1.0.6/dist/components/illinois-abstract-server.jar:/root/curator-1.0.6/dist/lib/illinois-lemmatizer-0.0.4.jar:/root/curator-1.0.6/dist/lib/commons-cli-1.2.jar:/root/curator-1.0.6/dist/lib/commons-lang-2.5.jar:/root/curator-1.0.6/dist/lib/commons-logging-1.1.1.jar:/root/curator-1.0.6/dist/lib/libthrift-0.8.0.jar:/root/curator-1.0.6/dist/lib/logback-classic-0.9.17.jar:/root/curator-1.0.6/dist/lib/logback-core-0.9.17.jar:/root/curator-1.0.6/dist/lib/slf4j-api-1.5.8.jar:/root/curator-1.0.6/dist/lib/coreUtilities-0.1.7.jar:/root/curator-1.0.6/dist/lib/edison-0.4.jar:/root/curator-1.0.6/dist/lib/lucene-snowball-3.0.3.jar:/root/curator-1.0.6/dist/lib/lucene-analyzers-common-4.1.0.jar:/root/curator-1.0.6/dist/lib/cogcomp-common-resources-1.2.jar:/root/curator-1.0.6/dist/lib/jwnl-1.4_rc3.jar:/root/curator-1.0.6/dist/lib/snowball-1.0.jar:/root/curator-1.0.6/dist/configs -Dhome=/root/curator-1.0.6/dist -Xmx512m edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer -p 16015'...

21:10:01,255 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]

21:10:01,256 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/root/curator-1.0.6/dist/logback.xml]

21:10:01,343 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set

21:10:01,343 |-INFO in ch.qos.logback.classic.turbo.ReconfigureOnChangeFilter@69818eaf - Will scan for changes in file [/root/curator-1.0.6/dist/logback.xml] every 60 seconds. 

21:10:01,343 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Adding ReconfigureOnChangeFilter as a turbo filter

21:10:01,343 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]

21:10:01,347 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]

21:10:01,398 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [layout] on top of the object stack.

21:10:01,457 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Popping appender named [STDOUT] from the object stack

21:10:01,457 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]

21:10:01,459 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]

21:10:01,474 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [rollingPolicy] on top of the object stack.

21:10:01,486 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy - No compression will be used

21:10:01,488 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy - Will use the pattern logs/dated/HOSTNAME_IS_UNDEFINED-servers.%d{yyyy-MM-dd}.log for the active file

21:10:01,494 |-INFO in ch.qos.logback.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy@38beb946 - The date pattern is 'yyyy-MM-dd' from file name pattern 'logs/dated/HOSTNAME_IS_UNDEFINED-servers.%d{yyyy-MM-dd}.log'.

21:10:01,494 |-INFO in ch.qos.logback.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy@38beb946 - Roll-over at midnight.

21:10:01,495 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [layout] on top of the object stack.

21:10:01,496 |-WARN in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Setting "File" property to null on account of prudent mode

21:10:01,496 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: logs/dated/HOSTNAME_IS_UNDEFINED-servers.2014-03-14.log

21:10:01,496 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [null]

21:10:01,501 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Popping appender named [FILE] from the object stack

21:10:01,501 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO

21:10:01,501 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]

21:10:01,503 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]

edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer constructor: initializing...

Exception in thread "main" java.lang.IllegalArgumentException: ERROR: ResourceLoader.getString(): no entry for key 'lemmaCacheFile'.

at edu.illinois.cs.cogcomp.core.utilities.ResourceManager.getString(ResourceManager.java:117)

at edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer.<init>(AugmentedLemmatizer.java:107)

at edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer.init(AugmentedLemmatizer.java:91)

at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:50)

at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:40)

at edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer.main(IllinoisLemmatizerServer.java:53)

On Fri, Mar 14, 2014 at 1:39 PM, Vivek Srikumar <svivek AT cs.stanford.edu> wrote:

Hi Labhesh,

In my instance of the curator, I have illinois-lemmatizer-0.0.4.jar in the class path in bin/illinois-lemmatizer-server.sh and it seems to be working. It appears that you have 0.0.3 in yours. If you have dist/lib/illinois-lemmatizer-0.0.4.jar, could you modify the classpath to check if it works?

-- vivek

On Mar 14, 2014, at 11:07 AM, Labhesh <labhesh AT gmail.com> wrote:

> Here's the output from the command:
>
> [root@ip-10-146-255-16 dist]# bin/illinois-lemmatizer-server.sh -p 16015
>
> bin/illinois-lemmatizer-server.sh: running command 'java -cp /root/curator-1.0.6/dist:/root/curator-1.0.6/dist/components/illinois-lemmatizer-server.jar:/root/curator-1.0.6/dist/components/curator-interfaces.jar:/root/curator-1.0.6/dist:/root/curator-1.0.6/dist/components/illinois-abstract-server.jar:/root/curator-1.0.6/dist/lib/illinois-lemmatizer-0.0.3.jar:/root/curator-1.0.6/dist/lib/commons-cli-1.2.jar:/root/curator-1.0.6/dist/lib/commons-lang-2.5.jar:/root/curator-1.0.6/dist/lib/commons-logging-1.1.1.jar:/root/curator-1.0.6/dist/lib/libthrift-0.8.0.jar:/root/curator-1.0.6/dist/lib/logback-classic-0.9.17.jar:/root/curator-1.0.6/dist/lib/logback-core-0.9.17.jar:/root/curator-1.0.6/dist/lib/slf4j-api-1.5.8.jar:/root/curator-1.0.6/dist/lib/coreUtilities-0.1.6.jar:/root/curator-1.0.6/dist/lib/edison-0.4.jar:/root/curator-1.0.6/dist/lib/lucene-snowball-3.0.3.jar:/root/curator-1.0.6/dist/lib/lucene-analyzers-common-4.1.0.jar:/root/curator-1.0.6/dist/lib/cogcomp-common-resources-1.2.jar:/root/curator-1.0.6/dist/lib/jwnl-1.4_rc3.jar:/root/curator-1.0.6/dist/lib/snowball-1.0.jar:/root/curator-1.0.6/dist/configs -Dhome=/root/curator-1.0.6/dist -Xmx512m edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer -p 16015'...
>
> 17:40:35,248 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
>
> 17:40:35,248 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/root/curator-1.0.6/dist/logback.xml]
>
> 17:40:35,605 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
>
> 17:40:35,606 |-INFO in ch.qos.logback.classic.turbo.ReconfigureOnChangeFilter@7c520467 - Will scan for changes in file [/root/curator-1.0.6/dist/logback.xml] every 60 seconds.
>
> 17:40:35,606 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Adding ReconfigureOnChangeFilter as a turbo filter
>
> 17:40:35,606 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
>
> 17:40:35,609 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
>
> 17:40:35,795 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [layout] on top of the object stack.
>
> 17:40:36,100 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Popping appender named [STDOUT] from the object stack
>
> 17:40:36,100 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
>
> 17:40:36,102 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
>
> 17:40:36,116 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [rollingPolicy] on top of the object stack.
>
> 17:40:36,129 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy - No compression will be used
>
> 17:40:36,132 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy - Will use the pattern logs/dated/HOSTNAME_IS_UNDEFINED-servers.%d{yyyy-MM-dd}.log for the active file
>
> 17:40:36,138 |-INFO in ch.qos.logback.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy@6c9f45f4 - The date pattern is 'yyyy-MM-dd' from file name pattern 'logs/dated/HOSTNAME_IS_UNDEFINED-servers.%d{yyyy-MM-dd}.log'.
>
> 17:40:36,138 |-INFO in ch.qos.logback.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy@6c9f45f4 - Roll-over at midnight.
>
> 17:40:36,139 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Pushing component [layout] on top of the object stack.
>
> 17:40:36,141 |-WARN in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Setting "File" property to null on account of prudent mode
>
> 17:40:36,141 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: logs/dated/HOSTNAME_IS_UNDEFINED-servers.2014-03-14.log
>
> 17:40:36,141 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [null]
>
> 17:40:36,167 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Popping appender named [FILE] from the object stack
>
> 17:40:36,167 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
>
> 17:40:36,167 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
>
> 17:40:36,205 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
>
>
>
> Exception in thread "main" java.lang.NoClassDefFoundError: edu/illinois/cs/cogcomp/core/utilities/ResourceManager
>
> at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:40)
>
> at edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer.main(IllinoisLemmatizerServer.java:53)
>
> Caused by: java.lang.ClassNotFoundException: edu.illinois.cs.cogcomp.core.utilities.ResourceManager
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> ... 2 more
>
>
>
>
>
> And here are the coreUtilities.jar versions:
>
> [root@ip-10-146-255-16 lib]# ls core*
>
> coreUtilities-0.1.1.jar  coreUtilities-0.1.4.jar
>
>
> coreUtilities-0.1.2.jar  coreUtilities-0.1.7.jar
>
>
>
> As such, the jar file pointed to by the java -cp command doesn't seem to exist.
>
> Here's what I tried. I went inside the illinois-lemmatizer-server.sh  and changed it to look for coreUtilities-0.1.7.jar instead.
>
>
>
>
>
> Upon running the server again, it bombed at a different place:
>
> Exception in thread "main" java.lang.NoClassDefFoundError: edu/illinois/cs/cogcomp/nlp/lemmatizer/AugmentedLemmatizer
>
> at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:50)
>
> at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:40)
>
> at edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer.main(IllinoisLemmatizerServer.java:53)
>
> Caused by: java.lang.ClassNotFoundException: edu.illinois.cs.cogcomp.nlp.lemmatizer.AugmentedLemmatizer
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
>
>
> Would appreciate help on how to proceed.
>
>
>
>
>
>
>
> On Fri, Mar 14, 2014 at 10:28 AM, Sammons, Mark <mssammon AT illinois.edu> wrote:
> Hi, Labesh.
>
> Please cd to the curator/dist/ directory and run the command
>
> $   bin/illinois-lemmatizer-server.sh -p 16015
>
> -- it should print the command being executed, including the classpath.
>
> Please also look in the curator/dist/lib/ directory and check which versions of coreUtilities it contains and let me know.
>
> Thanks,
>
> Mark
>

> From: illinois-ml-nlp-users-bounces AT cs.uiuc.edu [illinois-ml-nlp-users-bounces AT cs.uiuc.edu] on behalf of Labhesh [labhesh AT gmail.com]
> Sent: Friday, March 14, 2014 4:18 AM
> To: illinois-ml-nlp-users AT cs.uiuc.edu
> Subject: [Illinois-ml-nlp-users] Error while running startServers.sh (Curator)
>
> When I am running startServers.sh after building everything, I am getting the following error from one of the services:
> Exception in thread "main" java.lang.NoClassDefFoundError: edu/illinois/cs/cogcomp/core/utilities/ResourceManager
>
> at edu.illinois.cs.cogcomp.annotation.handler.IllinoisLemmatizerHandler.<init>(IllinoisLemmatizerHandler.java:40)
>
> at edu.illinois.cs.cogcomp.annotation.server.IllinoisLemmatizerServer.main(IllinoisLemmatizerServer.java:53)
>
> Caused by: java.lang.ClassNotFoundException: edu.illinois.cs.cogcomp.core.utilities.ResourceManager
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> ... 2 more
>
>
>
> I am running everything on one extra large instance on AWS (34GB RAM). All the services have been started with default parameters .
>
> Any help would be appreciated.
>
>
>

> _______________________________________________
> illinois-ml-nlp-users mailing list
> illinois-ml-nlp-users AT cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/illinois-ml-nlp-users