TMX merging » History » Version 4
Vassilis Papavassiliou, 2016-05-31 05:34 PM
| 1 | 1 | Prokopis Prokopidis | # TMX merging |
|---|---|---|---|
| 2 | 1 | Prokopis Prokopidis | |
| 3 | 1 | Prokopis Prokopidis | It merges generated TMX and creates the final TMX which is considered as the final output (i.e. the bilingual corpus). Filtering of segment pairs is supported since targeted types of document pairs and segment can be selected. It also extracts metadata of the final corpus. |
| 4 | 1 | Prokopis Prokopidis | |
| 5 | 1 | Prokopis Prokopidis | ``` |
| 6 | 1 | Prokopis Prokopidis | java -Dlog4j.configuration=file:/opt/ilsp-fc/log4j.xml -jar /opt/ilsp-fc/ilsp-fc-2.2.2-jar-with-dependencies.jar \ |
| 7 | 1 | Prokopis Prokopidis | -tmxmerge -lang "L1;L2" -oxslt -doctypes "aupdih" -segtypes "1:1" \ |
| 8 | 1 | Prokopis Prokopidis | -tmx (fullpath of the merged TMX to be constructed) \ |
| 9 | 1 | Prokopis Prokopidis | &>"log-tmxmerge" |
| 10 | 4 | Vassilis Papavassiliou | |
| 11 | 4 | Vassilis Papavassiliou | |
| 12 | 4 | Vassilis Papavassiliou | java -Dlog4j.configuration=file:/opt/ilsp-fc/log4j.xml -jar /opt/ilsp-fc/ilsp-fc-2.2.3-SNAPSHOT-jar-with-dependencies.jar -tmxmerge -lang "L1;L2" \ |
| 13 | 4 | Vassilis Papavassiliou | -i (input) -oxslt -pdm "aupdih" -segtypes "1:1" -bs (baseName for output files) -mtuvl 3 -mpa "0.16" -minlr "0.6" -maxlr "1.6" -ksn &>"log-tmxmerge" |
| 14 | 1 | Prokopis Prokopidis | ``` |
| 15 | 1 | Prokopis Prokopidis | |
| 16 | 4 | Vassilis Papavassiliou | ## Options |
| 17 | 4 | Vassilis Papavassiliou | |
| 18 | 4 | Vassilis Papavassiliou | |
| 19 | 4 | Vassilis Papavassiliou | ``` |
| 20 | 1 | Prokopis Prokopidis | -tmxmerge : for merging generated TMX files (i.e. construct a bilingual corpus). |
| 21 | 1 | Prokopis Prokopidis | |
| 22 | 1 | Prokopis Prokopidis | -doctypes : Defines the types of the document pairs from which the segment pairs will be selected. The proposed value is "aupidh" since pairs of type "m" and "l" (e.g. eng-1_lav-3_m.xml or eng-2_lav-8_l.xml) are only used for testing or examining the tool. |
| 23 | 1 | Prokopis Prokopidis | |
| 24 | 1 | Prokopis Prokopidis | -thres : thresholds for 0:1 alignments per type. It should be of the same length with the types parameter. If a TMX of type X contains more 0:1 segment pairs than the corresponding threshold, it will not be selected |
| 25 | 1 | Prokopis Prokopidis | |
| 26 | 3 | Prokopis Prokopidis | -segtypes : Types of segment alignments that will be selected for the final output. A suggested value is "1:1". Multiple segment types can be separated by ";" (e.g. 1:1;1:2;2:1). |
| 27 | 1 | Prokopis Prokopidis | |
| 28 | 1 | Prokopis Prokopidis | -tmx : A TMX files that includes filtered segment pairs of the generated TMX. This is the final output of the process (i.e. the parallel corpus) |
| 29 | 1 | Prokopis Prokopidis | |
| 30 | 2 | Vassilis Papavassiliou | -cc : If exists, only document pairs for which a license has been detected will be selected in merged TMX. |
| 31 | 1 | Prokopis Prokopidis | |
| 32 | 1 | Prokopis Prokopidis | -metadata : Generates an XML file which contains metadata of the generated corpus. |
| 33 | 1 | Prokopis Prokopidis | |
| 34 | 1 | Prokopis Prokopidis | -cfg : The full path to a configuration file that can be used to override default parameters. |
| 35 | 4 | Vassilis Papavassiliou | ``` |