Support for users of CCG software closed 7-27-20

[Nathan Schneider <nschneid AT cs.cmu.edu>]

Yes, I ran bootstrap.sh with WIKIFIER=0. Which package contains the
WordNet data?

Nathan

On Tue, Jul 24, 2012 at 9:32 AM, Sammons, Mark 
<mssammon AT illinois.edu>
 wrote:
> Hi, Nathan.
>
> Did you run bootstrap.sh?  -- this script should download and install a lot 
> of files under the curator/dist/data/
> directory, including the WordNet data.
>
> Mark
> ________________________________________
> From: 
> neatnate AT gmail.com
>  
> [neatnate AT gmail.com]
>  on behalf of Nathan Schneider 
> [nschneid AT cs.cmu.edu]
> Sent: Tuesday, July 24, 2012 11:24 AM
> To: Sammons, Mark
> Cc: 
> illinois-ml-nlp-users AT cs.uiuc.edu
> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>
> OK, I am able to start the Charniak Parser Server successfully.
>
> However, upon starting the verb SRL system I get the WordNet exception
> described in the INSTALL file, and I cannot find the appropriate
> WordNet directory to point to:
>
> $ ls curator-0.6.9/curator-annotators/illinois-verb-srl/data/
> $ ls curator-0.6.9/dist/data/
> englishPCFG.ser.gz
> ner-ext
>
> Am I looking in the right place?
>
> Nathan
>
> On Mon, Jul 23, 2012 at 11:50 PM, Sammons, Mark 
> <mssammon AT illinois.edu>
>  wrote:
>> great -- thanks for the info.
>>
>> Regards,
>>
>> Mark
>> ________________________________________
>> From: 
>> neatnate AT gmail.com
>>  
>> [neatnate AT gmail.com]
>>  on behalf of Nathan Schneider 
>> [nschneid AT cs.cmu.edu]
>> Sent: Tuesday, July 24, 2012 1:08 AM
>> To: Sammons, Mark
>> Cc: 
>> illinois-ml-nlp-users AT cs.uiuc.edu
>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>
>> Great, this allowed me to get the ant script to work.
>>
>> Some notes about compiling the Charniak Parser—
>>
>> My version of g++ is:
>>    g++ (Ubuntu/Linaro 4.6.3-1ubuntu5) 4.6.3
>> and it was unhappy with a few files. I got it to compile with the
>> following fixes:
>>
>> BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
>> BchartSm.C:654:43: error: 'strpbrk' was not declared in this scope
>>
>>     fixed by adding #include <cstring>
>>
>> BchartSm.C: In member function 'double Bchart::pHypgt(const string&, int)':
>> BchartSm.C:655:43: error: invalid conversion from 'const char*' to
>> 'char*' [-fpermissive]
>>
>>     fixed by adding 'const'
>>
>> ChartBase.C: In member function 'int ChartBase::effEnd(int)':
>> ChartBase.C:80:26: error: 'strcmp' was not declared in this scope
>>
>>     #include <cstring>
>>
>> ECArgs.C: In member function 'bool ECArgs::isset(char)':
>> ECArgs.C:78:53: error: no matching function for call to
>> 'find(std::list<std::basic_string<char> >::iterator,
>> std::list<std::basic_string<char> >::iterator, std::string&)'
>>
>>     #include <algorithm>
>>
>> FeatureTree.C: In member function 'int
>> FeatureTree::readOneLevel0(std::istream&, int)':
>> FeatureTree.C:97:36: error: 'atoi' was not declared in this scope
>>
>>     #include <stdlib.h>
>>
>> Params.C: In member function 'void Params::init(ECArgs&)':
>> Params.C:67:43: error: 'strcpy' was not declared in this scope
>> Params.C:68:40: error: 'strchr' was not declared in this scope
>>
>>     #include <cstring>
>>
>> utils.C: In function 'char* toLower(const char*, char*)':
>> utils.C:81:21: error: 'strlen' was not declared in this scope
>>
>>     #include <cstring>
>>
>> Also, I had to change the permissions for the script
>> dist/CharniakServer/runIt.pl to make it executable.
>>
>> Nathan
>>
>> On Mon, Jul 23, 2012 at 7:14 PM, Sammons, Mark 
>> <mssammon AT illinois.edu>
>>  wrote:
>>> OK -- this is one of the bugs we need to work out.  There is currently a 
>>> naming inconsistency between projects.
>>>
>>> Look in curator/lib/ and see which of the following you can see:
>>>
>>> LBJ2.jar
>>> LBJ2-2.8.2.jar
>>> LBJ-2.8.2.jar
>>> LBJ2Library.jar
>>> LBJ2Library-2.8.2.jar
>>> LBJLibrary-2.8.2.jar
>>>
>>> The first 3 and last 3 overlap. Ideally, use LBJ2-2.8.2.jar or 
>>> LBJ-2.8.2.jar as the master, and create symlinks for LBJ2.jar and 
>>> whichever LBJ... was not present.
>>> Then, use LBJLibrary-2.8.2.jar or LBJ2Library-2.8.2.jar as the master, 
>>> and symlink LBJ2Library.jar and whichever LBJ...Library... was not 
>>> present.
>>>
>>> Then try compiling again.
>>>
>>> This should be resolved in the next release.
>>>
>>> Regards,
>>>
>>> Mark
>>> ________________________________________
>>> From: 
>>> neatnate AT gmail.com
>>>  
>>> [neatnate AT gmail.com]
>>>  on behalf of Nathan Schneider 
>>> [nschneid AT cs.cmu.edu]
>>> Sent: Monday, July 23, 2012 7:18 PM
>>> To: Sammons, Mark
>>> Cc: 
>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>
>>> Building with `ant dist` is not quite working:
>>>
>>> compile:
>>>     [mkdir] Created dir:
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
>>> warning: 'includeantruntime' was not set, defaulting to
>>> build.sysclasspath=last; set to false for repeatable builds
>>>     [javac] Compiling 2 source files to
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/bin
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:26:
>>> package LBJ2.classify does not exist
>>>     [javac] import LBJ2.classify.Classifier;
>>>     [javac]                     ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:27:
>>> package LBJ2.parse does not exist
>>>     [javac] import LBJ2.parse.LinkedVector;
>>>     [javac]                  ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:47:
>>> cannot access LBJ2.learn.SparseNetworkLearner
>>>     [javac] class file for LBJ2.learn.SparseNetworkLearner not found
>>>     [javac]             NETaggerLevel1 tagger1=new
>>> NETaggerLevel1(ParametersForLbjCode.currentParameters.pathToModelFile+".level1",ParametersForLbjCode.currentParameters.pathToModelFile+".level1.lex");
>>>     [javac]                                    ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
>>> cannot find symbol
>>>     [javac] symbol  : class LinkedVector
>>>     [javac] location: class
>>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>>     [javac]                     Vector<LinkedVector> v = new 
>>> Vector<LinkedVector>();
>>>     [javac]                            ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:77:
>>> cannot find symbol
>>>     [javac] symbol  : class LinkedVector
>>>     [javac] location: class
>>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>>     [javac]                     Vector<LinkedVector> v = new 
>>> Vector<LinkedVector>();
>>>     [javac]                                                         ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:78:
>>> cannot find symbol
>>>     [javac] symbol  : class LinkedVector
>>>     [javac] location: class
>>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>>     [javac]                     v.addElement(new LinkedVector());
>>>     [javac]                                      ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:81:
>>> cannot find symbol
>>>     [javac] symbol  : class LinkedVector
>>>     [javac] location: class
>>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>>     [javac]             Vector<LinkedVector> sentences = 
>>> PlainTextReader.parseText(input);
>>>     [javac]                    ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
>>> cannot find symbol
>>>     [javac] symbol  : class LinkedVector
>>>     [javac] location: class
>>> edu.illinois.cs.cogcomp.annotation.handler.IllinoisNERHandler
>>>     [javac]                     LinkedVector vector =
>>> data.documents.elementAt(0).sentences.get(i);
>>>     [javac]                     ^
>>>     [javac] 
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/src/edu/illinois/cs/cogcomp/annotation/handler/IllinoisNERHandler.java:110:
>>> cannot access LBJ2.parse.LinkedVector
>>>     [javac] class file for LBJ2.parse.LinkedVector not found
>>>     [javac]                     LinkedVector vector =
>>> data.documents.elementAt(0).sentences.get(i);
>>>     [javac]                                                               
>>>                      ^
>>>     [javac] 9 errors
>>>
>>> BUILD FAILED
>>> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:106: The following error
>>> occurred while executing this line:
>>> /nfs/nlg/semmt/tools/curator-0.6.9/build.xml:32: The following error
>>> occurred while executing this line:
>>> /nfs/nlg/semmt/tools/curator-0.6.9/curator-annotators/illinois-ner-extended/build.xml:49:
>>> Compile failed; see the compiler error output for details.
>>>
>>>
>>> curator-0.6.9/lib/ contains the following files:
>>> LBJ-2.8.2.jar
>>> LBJ2Library.jar
>>> LBJChunk.jar
>>> LBJCoref.jar
>>> LBJLibrary-2.8.2.jar
>>> LBJPOS.jar
>>> LbjNerTagger-2.1.jar
>>> commons-beanutils-1.7.0.jar
>>> commons-beanutils-core-1.8.0.jar
>>> commons-cli-1.2.jar
>>> commons-collections-3.2.1.jar
>>> commons-configuration-1.6.jar
>>> commons-digester-1.8.jar
>>> commons-lang-2.5.jar
>>> commons-logging-1.1.1.jar
>>> coreUtilities-0.1.2.jar
>>> curator-client-0.6.jar
>>> edison-0.2.9.jar
>>> illinoisSRL-3.0.3.jar
>>> illinoisSRL-nom-models-3.0.3.jar
>>> illinoisSRL-verb-models-3.0.3.jar
>>> junit-3.8.1.jar
>>> junit-4.4.jar
>>> jwnl-1.4_rc3.jar
>>> libthrift-0.4.jar
>>> libthrift.jar
>>> logback-classic-0.9.17.jar
>>> logback-classic-0.9.28.jar
>>> logback-core-0.9.17.jar
>>> logback-core-0.9.28.jar
>>> slf4j-api-1.5.8.jar
>>> slf4j-api-1.6.1.jar
>>> snowball-1.0.jar
>>> stanford-parser-2010-08-16.jar
>>>
>>> (I haven't downloaded the Wikifier because it's so large...that's not
>>> the problem, is it?)
>>>
>>> Nathan
>>>
>>> On Mon, Jul 23, 2012 at 3:40 PM, Nathan Schneider 
>>> <nschneid AT cs.cmu.edu>
>>>  wrote:
>>>> Oh cool, in that case I'll try to get Curator working (I prefer Java 
>>>> anyway).
>>>>
>>>> Nathan
>>>>
>>>> On Mon, Jul 23, 2012 at 2:47 PM, Sammons, Mark 
>>>> <mssammon AT illinois.edu>
>>>>  wrote:
>>>>> Hi, Nathan.
>>>>>
>>>>> I'll take a look; probably a first step is to add a bunch of logging 
>>>>> statements to get a better sense of what is failing to happen.  It may 
>>>>> take us a while to work through this, so I'm going to offer an 
>>>>> alternative:
>>>>> We do have a new Java version of SRL, which depends on our "Curator" 
>>>>> software.  We're currently working on an improved version of the 
>>>>> Curator software, and are planning to release it by the end of the 
>>>>> summer.  But we also have a working version of the Curator + SRL that 
>>>>> you could try if you are willing; installation is not yet as 
>>>>> straightforward as we'd like.
>>>>>
>>>>> If you want to try this current version, you can get it here:
>>>>>
>>>>> http://cogcomp.cs.illinois.edu/trac/wiki/Curator
>>>>>
>>>>> -- this page also has some documentation for Curator.  The bootstrap.sh 
>>>>> script that you run as part of the installation process will download 
>>>>> SRL and other UI NLP tools that may interest you.  You don't have to 
>>>>> run them all, and Curator allows you to run different NLP tools on 
>>>>> different machines as some of the tools are quite memory hungry.  But 
>>>>> you could just run the SRL and its dependencies (which should be clear 
>>>>> from the Curator config files)
>>>>> on a single machine if it has 8G of RAM or more. (This is playing it 
>>>>> pretty safe).
>>>>>
>>>>> You may also want to use Edison, a java library that allows more 
>>>>> straightforward interactions with the Curator server and provides a lot 
>>>>> of NLP data structures and supporting functionality, which is here:
>>>>>
>>>>> http://cogcomp.cs.illinois.edu/page/software_view/Edison
>>>>>
>>>>> -- when you agree to the academic license, it will show a page with 
>>>>> some introductory material for using Edison.
>>>>>
>>>>> Please let me know what you decide.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Mark
>>>>>
>>>>>
>>>>> ________________________________________
>>>>> From: 
>>>>> neatnate AT gmail.com
>>>>>  
>>>>> [neatnate AT gmail.com]
>>>>>  on behalf of Nathan Schneider 
>>>>> [nschneid AT cs.cmu.edu]
>>>>> Sent: Monday, July 23, 2012 4:15 PM
>>>>> To: Sammons, Mark
>>>>> Cc: 
>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>
>>>>> Mark,
>>>>>
>>>>> With that sentence it's the same except in the logs, fexidentification
>>>>> has "Processing..." 3 times and fexclassification has "Processing..."
>>>>> 2 times.
>>>>>
>>>>> Nathan
>>>>>
>>>>> On Mon, Jul 23, 2012 at 2:08 PM, Sammons, Mark 
>>>>> <mssammon AT illinois.edu>
>>>>>  wrote:
>>>>>> Hi, Nathan.
>>>>>>
>>>>>> Do you get the same result with a longer sentence -- say, "John said 
>>>>>> he read the book and laughed."?
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Mark
>>>>>>
>>>>>> ________________________________________
>>>>>> From: 
>>>>>> neatnate AT gmail.com
>>>>>>  
>>>>>> [neatnate AT gmail.com]
>>>>>>  on behalf of Nathan Schneider 
>>>>>> [nschneid AT cs.cmu.edu]
>>>>>> Sent: Monday, July 23, 2012 3:53 PM
>>>>>> To: Sammons, Mark
>>>>>> Cc: 
>>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>>
>>>>>> Mark,
>>>>>>
>>>>>> Thanks for the reply. That does indeed solve the hanging problem, so
>>>>>> the tool now terminates—but unfortunately it does so without printing
>>>>>> any result. Here is what I'm trying:
>>>>>>
>>>>>> $ echo "Misery loves company ." | ./srl-client-primitive.pl 0 0
>>>>>>
>>>>>> The output in the logs is as follows:
>>>>>>
>>>>>> ==> charniak-server.log <==
>>>>>> [Connect from LOCALHOST]
>>>>>> Parse: <s> Misery loves company . </s>
>>>>>> Parse ok
>>>>>> [Connection closed from LOCALHOST]
>>>>>>
>>>>>> ==> classification.log <==
>>>>>> [Connect from LOCALHOST]
>>>>>>
>>>>>> ==> fexclassification.log <==
>>>>>> fex: got connection from 127.0.0.1
>>>>>> Waiting for clients...
>>>>>> Processing...
>>>>>>
>>>>>> ==> fexidentification.log <==
>>>>>> fex: got connection from 127.0.0.1
>>>>>> Waiting for clients...
>>>>>> Processing...
>>>>>> Closing client socket...
>>>>>>
>>>>>> ==> identification.log <==
>>>>>> [Connect from LOCALHOST]
>>>>>> [Connection closed from LOCALHOST]
>>>>>>
>>>>>> ==> snowclassification.log <==
>>>>>> SNoW: got connection from 127.0.0.1
>>>>>> Waiting for clients...
>>>>>> Options: -o allactivations
>>>>>>
>>>>>> ==> snowidentification.log <==
>>>>>> SNoW: got connection from 127.0.0.1
>>>>>> Waiting for clients...
>>>>>> Options: -o allactivations
>>>>>> Closing client socket...
>>>>>>
>>>>>> ==> srlservercentral.log <==
>>>>>> [Connect from LOCALHOST]
>>>>>>
>>>>>> ==> classification.log <==
>>>>>> [Connection closed from LOCALHOST]
>>>>>>
>>>>>> ==> fexclassification.log <==
>>>>>> Closing client socket...
>>>>>>
>>>>>> ==> snowclassification.log <==
>>>>>> Closing client socket...
>>>>>>
>>>>>> ==> srlservercentral.log <==
>>>>>> [Connection closed from LOCALHOST]
>>>>>>
>>>>>>
>>>>>> Any suggestions for how I should go about debugging this?
>>>>>>
>>>>>> Cheers,
>>>>>> Nathan
>>>>>>
>>>>>> On Mon, Jul 23, 2012 at 11:51 AM, Sammons, Mark 
>>>>>> <mssammon AT illinois.edu>
>>>>>>  wrote:
>>>>>>> Hi, Nathan.
>>>>>>>
>>>>>>> Please try the following: in bin/inference.pl on line 107, you should 
>>>>>>> see the line:
>>>>>>>
>>>>>>> my $search_mode = 2;
>>>>>>>
>>>>>>> please change it to
>>>>>>>
>>>>>>> my $search_mode = 1;
>>>>>>>
>>>>>>> and retry.  Please let me know if this fixes the problem.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> Mark
>>>>>>>
>>>>>>> ________________________________________
>>>>>>> From: 
>>>>>>> illinois-ml-nlp-users-bounces AT cs.uiuc.edu
>>>>>>>  
>>>>>>> [illinois-ml-nlp-users-bounces AT cs.uiuc.edu]
>>>>>>>  on behalf of Nathan Schneider 
>>>>>>> [nschneid AT cs.cmu.edu]
>>>>>>> Sent: Friday, July 20, 2012 2:47 PM
>>>>>>> To: 
>>>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>>>> Subject: Re: [Illinois-ml-nlp-users] srl-demo2 hanging
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I am trying to use the SRL system and am encountering the same issue
>>>>>>> (it hangs during beam search). Has a solution been found?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Nathan
>>>>>>>
>>>>>>> http://lists.cs.uiuc.edu/pipermail/illinois-ml-nlp-users/2011-May/000090.html
>>>>>>>
>>>>>>> On Wed May 11 19:51:58 CDT 2011, Steven Corman <steve.corman at 
>>>>>>> asu.edu>  wrote:
>>>>>>>> Greetings.  I am trying to get the semantic role labeler running.  I
>>>>>>>> think I have got everything compiled and configured properly, but 
>>>>>>>> when
>>>>>>>> I try to process a single, simple tokenized sentence, it hangs at 
>>>>>>>> some
>>>>>>>> point along the way.  It appears from the log files (contents below)
>>>>>>>> that all of the components with logs are working as they should.  The
>>>>>>>> problem seems to be in the bin/beamsearch/search executable.
>>>>>>>>
>>>>>>>> As you can see from the top iteration captures (below the log
>>>>>>>> contents, showing only processes using CPU to save space)  at the
>>>>>>>> second iteration several srl components are running and a zombie
>>>>>>>> appears.  By the next iteration, search, fex, and snow are running.
>>>>>>>> By the last it's just search, consuming almost all of one cpu (out of
>>>>>>>> two).  It sits there like that ad infinitum.  If I kill the process
>>>>>>>> holding search, inference.pl comes to the top, runs for a while, then
>>>>>>>> the job ends with no output.  The /tmp/2127.result file mentioned in
>>>>>>>> the srlservercental log is filled with several thousand lines that
>>>>>>>> say: double beam!!
>>>>>>>>
>>>>>>>> Anyone have a suggestion for what might be wrong, or how to debug?
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>>
>>>>>>>> Steve
>>>>>>> _______________________________________________
>>>>>>> illinois-ml-nlp-users mailing list
>>>>>>> illinois-ml-nlp-users AT cs.uiuc.edu
>>>>>>> http://lists.cs.uiuc.edu/mailman/listinfo/illinois-ml-nlp-users