Using Pootle for translation

{panel}
(on) *Pootle can process GNU-po files, not Solaris-version*
{panel}
Pootle cannot process correctly po files that do not have one or more empty lines at the beggining of new entry (except of the first one). To fix this issue you need to add one ore more empty lines between end of msgstr string and msgid of new message (or comment section that belongs to next msgid)

h3. Example 1:

{code}
msgid "AMD-8000-MU.action"
msgstr "Schedule a repair procedure to replace the affected CPU."

#
# code: AMD-8000-N7
# keys: fault.memory.page_ck
msgid "AMD-8000-N7.action"
msgstr "No repair action is recommended at this time."
{code}

h3. Example 2:

{code}
msgid "AMD-8000-MU.action"
msgstr "Schedule a repair procedure to replace the affected CPU."
#
# code: AMD-8000-N7
# keys: fault.memory.page_ck
msgid "AMD-8000-N7.action"
msgstr "No repair action is recommended at this time."
{code}
Example 1 will be processed by Pootle correctly, however Example 2 will produce garbled po file because of missing new line between msgstr and msgid (or comment section). To fix this issue automatically you can use _poval_pootle.sh_ script.
{panel}
(on) *Some po files contain randomly generated msgid*
{panel}
Some _msgid_ strings are generated automatically by _mgsid_ tool. As a result, translator looses information about original string once the first version of translation is done.
{code}
# code: AMD-8000-N7
# keys: fault.memory.page_ck
msgid "AMD-8000-N7.action"
msgstr "No repair action is recommended at this time."
{code}
Information about original msgstr (_"No repair action is recommended at this time."_) will be lost after translation. Workaround is to add English string to comment section. Original message will be shown in Pootle as comments for translator.
{code}
# code: AMD-8000-N7
# keys: fault.memory.page_ck
#
#| msgstr "No repair action is recommended at this time."
#
msgid "AMD-8000-N7.action"
msgstr "No repair action is recommended at this time."
{code}
You can add such comments automatically by using _poval_pootle.sh_ script.

The other solution is to use poswap script from translation toolbox to create template file, which will be used for translation. The drawback of this approach is that you need also the original file to transform the msgids back to their proper values.

{panel}
If some strings remain untranslated, they should contain original (English) text. Otherwise Solaris gettext utility displays it as an empty string instead of English message.

h3. Example:

{code}
msgid "No repair action is recommended at this time."
msgstr ""
{code}
This causes empty string listing instead of having original English message. Instead of this, you have to remove such <tt>msgid</tt> (not recommended) or add original string to msgstr like below:
{code}
msgid "No repair action is recommended at this time."
msgstr "No repair action is recommended at this time."
{code}
This is not related to Pootle, but to integration into OpenSolaris.

* GNU gettext requires untranslated messages to be formed as 'msgstr ""', but in some solaris files is just 'msgstr', the double quotes are missing.
* GNU gettext threats some escape sequences used in open Solaris as errors: \' ,\`, \|
* In the Solaris .po files, is not present encoding, this is reported as possible error.
* In many Solaris .po files the 'msgid ""' repeats several times. This is an error for GNU gettext tools.
* Duplicate msgids are defined in the scope of each domain. That is, a msgid is considered a duplicate only if the identical msgid exists in the same domain.

h2. The Pootle specific problems and complications

* Pootle cannot handle Solaris .po unmodified files. Pootle requires the optional empty line at beginning of each translation entry (except of the first one: before msgid, after msgstr).
* Pootle is not capable to work with .po files in strict Uniforum format.
* Majority of Solaris .po files has msgid in format of coded string. This implies that after translation the original English text will be reachable only through original .po files. This brings up problem with solving fuzzy translations and controlling the correctness of translation.

h3. Problem solutions

There are two base aproaches:
* Make the OpenSolaris .po files fully compatible with GNU .po file format

or
* Correct the structure of OpenSolaris files to make it usable with Pootle.

h3. Validating structure of .po files to use with Pootle

The only problem, which cannot be easily removed is problem with escape sequences. All the other problems can be removed without changing the compatibility and meaning.

h3. Checking the validity of .po files, for use with Pootle

This script will verify these pitfalls:
* Missing empty line at the beggining.
* Missing numbersign(#) separator at the first line (for Uniforum files)
* Invalid strings in the file (is not msgid, msgstr, comentary or empty line)
* Comentaries or empty lines between msgid and msgstr (see example 1. and 2. below)
* Missing or corrupted msgids, or additional spurious msgstr lines.

h5. Example 1:

this one causes Pootle to ignore the entry
{code}
#
# code: AMD-8000-N7
# keys: fault.memory.page_ck
msgid "AMD-8000-N7.action"

msgstr "No repair action is recommended at this time."
{code}

h5. Example 2:

{code}
#
# code: AMD-8000-N7
# keys: fault.memory.page_ck
msgid "AMD-8000-N7.action"
#
msgstr "No repair action is recommended at this time."
{code}

h3. Make the OpenSolaris .po files fully compatible with GNU .po file format

Scripts _poval_gnu.sh_ was implemented in order to validate the .po files for GNU gettext tools. The script is using GNU gettext tools to make it compatible with GNU gettext .po files (the majority of work is done by GNU gettext tools automatic checkups). This solution is not final due to unsolved problem with escaped characters.

_poval_gnu.sh_
{code}
#!/bin/bash
# Simple work arround, presumes correct inputs and experienced user.

if [[ -d "$1" ]]; then
po_dir="$1"
files=(`find "$po_dir" -name "*po"`)
else
files="$1"
fi

for filename in "${files[@]}"; do
new_filename=${filename/.po/_val.po}
tmp_filename=${filename/.po/_tmp.po}

# This section corrects the missing "" after msgstr
cat "$filename" | sed -e 's/msgstr/msgstr \"\"/' > $tmp_filename
gmsguniq --strict -E -u "$tmp_filename" > "$new_filename"
# gmsguniq -u "$filename" > "$new_filename"
# gmsguniq -d "$filename"

# Clearing temporary files
rm "$tmp_filename"
done
{code}