Sentence Alignment Setup » History » Version 8
Prokopis Prokopidis, 2016-02-05 01:37 PM
1 | 8 | Prokopis Prokopidis | # Sentence Alignment Setup |
---|---|---|---|
2 | 1 | Prokopis Prokopidis | |
3 | 7 | Vassilis Papavassiliou | For the generation of sentence alignments from bilingual crawls, ILSP-FC integrates the java sentence aligner provided at http://align.sourceforge.net/. Alternatively you can use an external aligner like hunalign. |
4 | 6 | Prokopis Prokopidis | |
5 | 6 | Prokopis Prokopidis | For example, for the current version of ILSP-FC, you can |
6 | 6 | Prokopis Prokopidis | |
7 | 6 | Prokopis Prokopidis | * download the hunalign-1.2 source code from http://mokk.bme.hu/en/resources/hunalign/ |
8 | 1 | Prokopis Prokopidis | * follow the instructions on the hunalign page for building hunalign |
9 | 1 | Prokopis Prokopidis | * put the hunalign directory containing the hunalign executable next to the runnable ilsp-fc jar. |
10 | 1 | Prokopis Prokopidis | |
11 | 1 | Prokopis Prokopidis | For example, if you run ilsp-fc from: |
12 | 8 | Prokopis Prokopidis | ``` |
13 | 8 | Prokopis Prokopidis | ~/ilsp-fc/ilsp-fc-2.2-jar-with-dependencies.jar |
14 | 8 | Prokopis Prokopidis | ``` |
15 | 1 | Prokopis Prokopidis | |
16 | 6 | Prokopis Prokopidis | you should do the following |
17 | 1 | Prokopis Prokopidis | |
18 | 8 | Prokopis Prokopidis | ``` |
19 | 6 | Prokopis Prokopidis | cd ~/ilsp-fc/ |
20 | 6 | Prokopis Prokopidis | wget ftp://ftp.mokk.bme.hu/Hunglish/src/hunalign/latest/hunalign-1.2.tgz |
21 | 1 | Prokopis Prokopidis | tar xvfz hunalign-1.2.tgz |
22 | 6 | Prokopis Prokopidis | cd hunalign-1.2/src/hunalign/ |
23 | 1 | Prokopis Prokopidis | make |
24 | 1 | Prokopis Prokopidis | ln -sf hunalign-1.2 hunalign |
25 | 8 | Prokopis Prokopidis | ``` |
26 | 1 | Prokopis Prokopidis | |
27 | 6 | Prokopis Prokopidis | This should create hunalign/src/hunalign/hunalign with the suggested hunalign directory structure, including |
28 | 1 | Prokopis Prokopidis | |
29 | 8 | Prokopis Prokopidis | ``` |
30 | 8 | Prokopis Prokopidis | ~/ilsp-fc/hunalign/data/ |
31 | 8 | Prokopis Prokopidis | ~/ilsp-fc/hunalign/src/hunalign/hunalign |
32 | 8 | Prokopis Prokopidis | ``` |
33 | 4 | Prokopis Prokopidis | |
34 | 1 | Prokopis Prokopidis | Now, you are ready to produce TMX files from bilingual crawled data using the <code>-align</code>, <code>-dict</code>, <code>-oft</code> and <code>-ofth</code> options described in the [[GettingStarted|Getting Started]] part of the documentation. |