ILSP Focused Crawler

h1. Getting Started

Once you [[DeveloperSetup|build]] or [[HowToGet|download]] an ilsp-fc runnable jar, you can run it like this

<pre><code>java -jar ilsp-fc-1.1-jar-with-dependencies.jar</code></pre>

h2. Run a monolingual crawl

<pre><code>java -jar ilsp-fc-1.1-jar-with-dependencies.jar crawlandexport -a test1 -c 10 -f -k -lang de -t 10 -of output_test1_list.txt <br>-ofh  output_test1_list.txt.html -tc C:/PANACEA/AUTOMOTIVE/AUTO_DE/Automotive-seed-terms-de.txt  -u  C:/PANACEA/AUTOMOTIVE/Automotive-seed-urls.txt -type m -xslt -cfg C:/Users/vpapa/workspace/ilsp-fc/src/main/resources/FMC_config.xml</code></pre>

h2. Run a bilingual crawl

<pre><code>java -jar ilsp-fc-1.1-jar-with-dependencies.jar crawlandexport -a test1 -c 10 -f -k -l1 de -l2 it -t 10 -of C:/PANACEA/test_HS_DE-IT_output.txt -ofh  C:/PANACEA/test_HS_DE-IT_output.txt.html  -tc C:/PANACEA/HS_DE_IT/HS_DE-IT_topic.txt -type p -xslt -u  C:/PANACEA/HS_DE_IT/suva_f/seed_suva.txt -cfg C:/Users/vpapa/workspace/ilsp-fc/src/main/resources/FBC_config.xml</code></pre>

h2. Example of java code

<pre>

<code class="java">

package gr.ilsp.fmc.classifier;

public enum ClassifierCounters {

    CLASSIFIER_DOCUMENTS_PASSED,   // successfully classified a document.

    CLASSIFIER_DOCUMENTS_FAILED,   // failed to classify a document

    CLASSIFIER_DOCUMENTS_ABORTED, 

    CLASSIFIER_TIME

}</code></pre>

<pre>

<code class="xml">

<?xml version="1.0" encoding="UTF-8"?>

<configuration>

        <agent>

                <email>yourmail@mail.com</email>

                <web_address>www.youraddress.com</web_address>

        </agent>

</configuration></code></pre>